From owner-freebsd-performance@FreeBSD.ORG Tue Oct 18 09:23:39 2011 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 954F3106566B for ; Tue, 18 Oct 2011 09:23:39 +0000 (UTC) (envelope-from urmas.lett@eenet.ee) Received: from muheleja.eenet.ee (muheleja.eenet.ee [193.40.0.132]) by mx1.freebsd.org (Postfix) with ESMTP id 536EF8FC08 for ; Tue, 18 Oct 2011 09:23:39 +0000 (UTC) Received: from muheleja.eenet.ee (localhost [127.0.0.1]) by localhost.eenet.ee (Postfix) with ESMTP id 75FFF1CC1F for ; Tue, 18 Oct 2011 12:02:22 +0300 (EEST) X-Virus-Scanned: amavisd-new at eenet.ee Received: from muheleja.eenet.ee ([127.0.0.1]) by muheleja.eenet.ee (muheleja.eenet.ee [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id pH6m8fJO4PIk for ; Tue, 18 Oct 2011 12:02:17 +0300 (EEST) Received: from [193.40.0.223] (poriseja.eenet.ee [193.40.0.223]) by muheleja.eenet.ee (Postfix) with ESMTP id 9CB961CC09 for ; Tue, 18 Oct 2011 12:02:17 +0300 (EEST) Message-ID: <4E9D4124.9000307@eenet.ee> Date: Tue, 18 Oct 2011 12:04:36 +0300 From: Urmas Lett Organization: EENet User-Agent: Mozilla/5.0 (Windows NT 5.1; rv:7.0.1) Gecko/20110929 Thunderbird/7.0.1 MIME-Version: 1.0 To: freebsd-performance@freebsd.org Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Mailman-Approved-At: Tue, 18 Oct 2011 11:19:54 +0000 Subject: ffmpeg & ULE X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Oct 2011 09:23:39 -0000 Hello. Why is ffmpeg -threads massively slower with ULE than 4BSD? ffmpeg preset veryfast with sched_bsd: real 1m49.407s user 6m53.932s sys 0m1.700s ffmpeg preset veryfast with sched_ule: real 2m52.711s user 6m50.310s sys 0m1.582s #uname -a FreeBSD 9.0-RC1 FreeBSD 9.0-RC1 #0: Mon Oct 17 20:32:29 EEST -- Urmas Lett Tel: +(372) 7 302 110 Fax: +(372) 7 302 111 E-Mail: urmas.lett@eenet.ee From owner-freebsd-performance@FreeBSD.ORG Tue Oct 18 11:52:01 2011 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 567771065672 for ; Tue, 18 Oct 2011 11:52:01 +0000 (UTC) (envelope-from fidaj@ukr.net) Received: from fsm1.ukr.net (fsm1.ukr.net [195.214.192.120]) by mx1.freebsd.org (Postfix) with ESMTP id 0CA8B8FC16 for ; Tue, 18 Oct 2011 11:52:00 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=ukr.net; s=fsm; h=Content-Transfer-Encoding:Content-Type:Mime-Version:References:In-Reply-To:Message-ID:Subject:Cc:To:From:Date; bh=mpLroLL/WhcdM5y73QPVQQ+WVL6ducen8LraFX/wtFg=; b=BMBKohsX1rqvhfOfYX1SDekUyzUUsFKHCmBsJ4deMtKcxtyc8OmAe1NuIBNdKaCD9pAyBUKrOnRzML+Ycn76kIJoaBQ+CsABqm/2haY9dOdatm7O2ml/SvRtsOq3FKFyXt8cNttDzR8b+2Ma8ieW2Em2GxGcnc9LWRdQglC39Yw=; Received: from [81.23.24.100] (helo=nonamehost.) by fsm1.ukr.net with esmtpsa ID 1RG7sV-000KWv-OL ; Tue, 18 Oct 2011 14:30:40 +0300 Date: Tue, 18 Oct 2011 14:30:12 +0300 From: Ivan Klymenko To: Urmas Lett Message-ID: <20111018143012.66cdbbf8@nonamehost.> In-Reply-To: <4E9D4124.9000307@eenet.ee> References: <4E9D4124.9000307@eenet.ee> X-Mailer: Claws Mail 3.7.9 (GTK+ 2.22.1; amd64-portbld-freebsd9.0) Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: freebsd-performance@freebsd.org Subject: Re: ffmpeg & ULE X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Oct 2011 11:52:01 -0000 =D0=92 Tue, 18 Oct 2011 12:04:36 +0300 Urmas Lett =D0=BF=D0=B8=D1=88=D0=B5=D1=82: > Hello. >=20 > Why is ffmpeg -threads massively slower with ULE than 4BSD? >=20 > ffmpeg preset veryfast with sched_bsd: > real 1m49.407s > user 6m53.932s > sys 0m1.700s >=20 > ffmpeg preset veryfast with sched_ule: > real 2m52.711s > user 6m50.310s > sys 0m1.582s >=20 > #uname -a > FreeBSD 9.0-RC1 FreeBSD 9.0-RC1 #0: Mon Oct 17 20:32:29 EEST >=20 >=20 probably because you have a system processor with 2 cores...? if yes - then use the 4BSD...it is better for the two cores... IMHO From owner-freebsd-performance@FreeBSD.ORG Tue Oct 18 12:12:34 2011 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3872C106566B for ; Tue, 18 Oct 2011 12:12:34 +0000 (UTC) (envelope-from urmas.lett@eenet.ee) Received: from muheleja.eenet.ee (muheleja.eenet.ee [193.40.0.132]) by mx1.freebsd.org (Postfix) with ESMTP id E9DFF8FC1B for ; Tue, 18 Oct 2011 12:12:33 +0000 (UTC) Received: from muheleja.eenet.ee (localhost [127.0.0.1]) by localhost.eenet.ee (Postfix) with ESMTP id 3F9021CC1F; Tue, 18 Oct 2011 15:10:17 +0300 (EEST) X-Virus-Scanned: amavisd-new at eenet.ee Received: from muheleja.eenet.ee ([127.0.0.1]) by muheleja.eenet.ee (muheleja.eenet.ee [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id r+sV0-AAsGWE; Tue, 18 Oct 2011 15:10:12 +0300 (EEST) Received: from [193.40.0.223] (poriseja.eenet.ee [193.40.0.223]) by muheleja.eenet.ee (Postfix) with ESMTP id 2FABF1CC09; Tue, 18 Oct 2011 15:10:12 +0300 (EEST) Message-ID: <4E9D6D2C.9060306@eenet.ee> Date: Tue, 18 Oct 2011 15:12:28 +0300 From: Urmas Lett Organization: EENet User-Agent: Mozilla/5.0 (Windows NT 5.1; rv:7.0.1) Gecko/20110929 Thunderbird/7.0.1 MIME-Version: 1.0 To: Ivan Klymenko References: <4E9D4124.9000307@eenet.ee> <20111018143012.66cdbbf8@nonamehost.> In-Reply-To: <20111018143012.66cdbbf8@nonamehost.> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Mailman-Approved-At: Tue, 18 Oct 2011 12:27:34 +0000 Cc: freebsd-performance@freebsd.org Subject: Re: ffmpeg & ULE X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Oct 2011 12:12:34 -0000 On 10/18/2011 2:30 PM, Ivan Klymenko wrote: > > probably because you have a system processor with 2 cores...? > if yes - then use the 4BSD...it is better for the two cores... IMHO Hi, In reality, I have 4 cores: CPU: Intel(R) Core(TM) i5-2400 CPU @ 3.10GHz (3093.05-MHz K8-class CPU) FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs FreeBSD/SMP: 1 package(s) x 4 core(s) cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 2 cpu2 (AP): APIC ID: 4 cpu3 (AP): APIC ID: 6 with sched_ule, top -H shows computer being 40.2% idle: CPU: 0.0% user, 59.8% nice, 0.0% system, 0.0% interrupt, 40.2% idle Mem: 153M Active, 181M Inact, 499M Wired, 120K Cache, 409M Buf, 3024M Free Swap: 4096M Total, 4096M Free PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND 1187 root 52 20 279M 153M uwait 3 0:30 41.16% ffmpeg{ffmpeg} 1187 root 101 20 279M 153M RUN 0 0:21 31.59% ffmpeg{ffmpeg} 1187 root 52 20 279M 153M uwait 1 0:17 29.20% ffmpeg{ffmpeg} 1187 root 100 20 279M 153M CPU0 0 0:17 28.76% ffmpeg{ffmpeg} 1187 root 52 20 279M 153M uwait 2 0:17 28.76% ffmpeg{ffmpeg} 1187 root 52 20 279M 153M uwait 2 0:17 28.37% ffmpeg{ffmpeg} 1187 root 52 20 279M 153M uwait 2 0:17 27.98% ffmpeg{ffmpeg} 1187 root 52 20 279M 153M uwait 2 0:17 26.37% ffmpeg{ffmpeg} 1176 root 20 0 67992K 5396K select 2 0:00 0.00% sshd with sched_bsd: CPU: 0.0% user, 97.6% nice, 0.0% system, 0.3% interrupt, 2.1% idle Mem: 153M Active, 16M Inact, 445M Wired, 120K Cache, 364M Buf, 3242M Free Swap: 4096M Total, 4096M Free PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND 1201 root 69 20 279M 152M CPU2 0 0:20 75.23% ffmpeg{ffmpeg} 1201 root 66 20 279M 152M CPU1 1 0:14 51.30% ffmpeg{ffmpeg} 1201 root 67 20 279M 152M RUN 3 0:11 42.47% ffmpeg{ffmpeg} 1201 root 66 20 279M 152M CPU3 2 0:10 41.17% ffmpeg{ffmpeg} 1201 root 66 20 279M 152M RUN 2 0:10 40.83% ffmpeg{ffmpeg} 1201 root 66 20 279M 152M RUN 1 0:10 40.83% ffmpeg{ffmpeg} 1201 root 66 20 279M 152M RUN 2 0:10 40.63% ffmpeg{ffmpeg} 1201 root 66 20 279M 152M RUN 0 0:10 40.49% ffmpeg{ffmpeg} 1191 root 40 0 67992K 5352K select 2 0:00 0.00% sshd -- Urmas Lett Tel: +(372) 7 302 110 Fax: +(372) 7 302 111 E-Mail: urmas.lett@eenet.ee From owner-freebsd-performance@FreeBSD.ORG Tue Oct 18 12:48:32 2011 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id EA2A91065672 for ; Tue, 18 Oct 2011 12:48:31 +0000 (UTC) (envelope-from prvs=12729c8c6e=killing@multiplay.co.uk) Received: from mail1.multiplay.co.uk (mail1.multiplay.co.uk [85.236.96.23]) by mx1.freebsd.org (Postfix) with ESMTP id 5FA708FC12 for ; Tue, 18 Oct 2011 12:48:31 +0000 (UTC) X-MDAV-Processed: mail1.multiplay.co.uk, Tue, 18 Oct 2011 13:36:36 +0100 X-Spam-Processed: mail1.multiplay.co.uk, Tue, 18 Oct 2011 13:36:36 +0100 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on mail1.multiplay.co.uk X-Spam-Level: X-Spam-Status: No, score=-5.0 required=6.0 tests=USER_IN_WHITELIST shortcircuit=ham autolearn=disabled version=3.2.5 Received: from r2d2 ([188.220.16.49]) by mail1.multiplay.co.uk (mail1.multiplay.co.uk [85.236.96.23]) (MDaemon PRO v10.0.4) with ESMTP id md50015664068.msg for ; Tue, 18 Oct 2011 13:36:36 +0100 X-MDRemoteIP: 188.220.16.49 X-Return-Path: prvs=12729c8c6e=killing@multiplay.co.uk X-Envelope-From: killing@multiplay.co.uk X-MDaemon-Deliver-To: freebsd-performance@freebsd.org Message-ID: <4161C63AB02B4332864C985BBAEAD8F2@multiplay.co.uk> From: "Steven Hartland" To: "Urmas Lett" , "Ivan Klymenko" References: <4E9D4124.9000307@eenet.ee> <20111018143012.66cdbbf8@nonamehost.> <4E9D6D2C.9060306@eenet.ee> Date: Tue, 18 Oct 2011 13:36:32 +0100 MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="UTF-8"; reply-type=response Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.5931 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.6109 Cc: freebsd-performance@freebsd.org Subject: Re: ffmpeg & ULE X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Oct 2011 12:48:32 -0000 What happens if you either: 1. disable HT in the bios 2. limit the threads to 4? Regards Steve ----- Original Message ----- From: "Urmas Lett" To: "Ivan Klymenko" Cc: Sent: Tuesday, October 18, 2011 1:12 PM Subject: Re: ffmpeg & ULE > On 10/18/2011 2:30 PM, Ivan Klymenko wrote: >> >> probably because you have a system processor with 2 cores...? >> if yes - then use the 4BSD...it is better for the two cores... IMHO > > Hi, > > In reality, I have 4 cores: > CPU: Intel(R) Core(TM) i5-2400 CPU @ 3.10GHz (3093.05-MHz K8-class CPU) > FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs > FreeBSD/SMP: 1 package(s) x 4 core(s) > cpu0 (BSP): APIC ID: 0 > cpu1 (AP): APIC ID: 2 > cpu2 (AP): APIC ID: 4 > cpu3 (AP): APIC ID: 6 > > with sched_ule, top -H shows computer being 40.2% idle: > > CPU: 0.0% user, 59.8% nice, 0.0% system, 0.0% interrupt, 40.2% idle > Mem: 153M Active, 181M Inact, 499M Wired, 120K Cache, 409M Buf, 3024M Free > Swap: 4096M Total, 4096M Free > > PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND > 1187 root 52 20 279M 153M uwait 3 0:30 41.16% > ffmpeg{ffmpeg} > 1187 root 101 20 279M 153M RUN 0 0:21 31.59% > ffmpeg{ffmpeg} > 1187 root 52 20 279M 153M uwait 1 0:17 29.20% > ffmpeg{ffmpeg} > 1187 root 100 20 279M 153M CPU0 0 0:17 28.76% > ffmpeg{ffmpeg} > 1187 root 52 20 279M 153M uwait 2 0:17 28.76% > ffmpeg{ffmpeg} > 1187 root 52 20 279M 153M uwait 2 0:17 28.37% > ffmpeg{ffmpeg} > 1187 root 52 20 279M 153M uwait 2 0:17 27.98% > ffmpeg{ffmpeg} > 1187 root 52 20 279M 153M uwait 2 0:17 26.37% > ffmpeg{ffmpeg} > 1176 root 20 0 67992K 5396K select 2 0:00 0.00% sshd > > with sched_bsd: > CPU: 0.0% user, 97.6% nice, 0.0% system, 0.3% interrupt, 2.1% idle > Mem: 153M Active, 16M Inact, 445M Wired, 120K Cache, 364M Buf, 3242M Free > Swap: 4096M Total, 4096M Free > > PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND > 1201 root 69 20 279M 152M CPU2 0 0:20 75.23% > ffmpeg{ffmpeg} > 1201 root 66 20 279M 152M CPU1 1 0:14 51.30% > ffmpeg{ffmpeg} > 1201 root 67 20 279M 152M RUN 3 0:11 42.47% > ffmpeg{ffmpeg} > 1201 root 66 20 279M 152M CPU3 2 0:10 41.17% > ffmpeg{ffmpeg} > 1201 root 66 20 279M 152M RUN 2 0:10 40.83% > ffmpeg{ffmpeg} > 1201 root 66 20 279M 152M RUN 1 0:10 40.83% > ffmpeg{ffmpeg} > 1201 root 66 20 279M 152M RUN 2 0:10 40.63% > ffmpeg{ffmpeg} > 1201 root 66 20 279M 152M RUN 0 0:10 40.49% > ffmpeg{ffmpeg} > 1191 root 40 0 67992K 5352K select 2 0:00 0.00% sshd > > > > -- > Urmas Lett > > Tel: +(372) 7 302 110 > Fax: +(372) 7 302 111 > E-Mail: urmas.lett@eenet.ee > _______________________________________________ > freebsd-performance@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-performance > To unsubscribe, send any mail to "freebsd-performance-unsubscribe@freebsd.org" > ================================================ This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337 or return the E.mail to postmaster@multiplay.co.uk. From owner-freebsd-performance@FreeBSD.ORG Tue Oct 18 13:26:33 2011 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6F7061065674 for ; Tue, 18 Oct 2011 13:26:33 +0000 (UTC) (envelope-from prvs=12729c8c6e=killing@multiplay.co.uk) Received: from mail1.multiplay.co.uk (mail1.multiplay.co.uk [85.236.96.23]) by mx1.freebsd.org (Postfix) with ESMTP id EF4958FC1C for ; Tue, 18 Oct 2011 13:26:32 +0000 (UTC) X-MDAV-Processed: mail1.multiplay.co.uk, Tue, 18 Oct 2011 14:26:21 +0100 X-Spam-Processed: mail1.multiplay.co.uk, Tue, 18 Oct 2011 14:26:21 +0100 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on mail1.multiplay.co.uk X-Spam-Level: X-Spam-Status: No, score=-5.0 required=6.0 tests=USER_IN_WHITELIST shortcircuit=ham autolearn=disabled version=3.2.5 Received: from r2d2 ([188.220.16.49]) by mail1.multiplay.co.uk (mail1.multiplay.co.uk [85.236.96.23]) (MDaemon PRO v10.0.4) with ESMTP id md50015664466.msg for ; Tue, 18 Oct 2011 14:26:19 +0100 X-MDRemoteIP: 188.220.16.49 X-Return-Path: prvs=12729c8c6e=killing@multiplay.co.uk X-Envelope-From: killing@multiplay.co.uk X-MDaemon-Deliver-To: freebsd-performance@freebsd.org Message-ID: <06DF6B887E064C82A452884F5735F929@multiplay.co.uk> From: "Steven Hartland" To: "Urmas Lett" References: <4E9D4124.9000307@eenet.ee> <20111018143012.66cdbbf8@nonamehost.> <4E9D6D2C.9060306@eenet.ee> <4161C63AB02B4332864C985BBAEAD8F2@multiplay.co.uk> <4E9D7C63.1090507@eenet.ee> Date: Tue, 18 Oct 2011 14:26:17 +0100 MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="UTF-8"; reply-type=response Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.5931 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.6109 Cc: freebsd-performance@freebsd.org Subject: Re: ffmpeg & ULE X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Oct 2011 13:26:33 -0000 ----- Original Message ----- From: "Urmas Lett" > On 10/18/2011 3:36 PM, Steven Hartland wrote: >> What happens if you either: >> 1. disable HT in the bios > > Intel says i5-2400 has no HT: > Processor Number i5-2400 > # of Cores 4 > # of Threads 4 > > and BIOS has no HT disable knob Ahh yes of course. > >> 2. limit the threads to 4? > > ffmpeg -threads 4 (sched_ule): > > real 3m19.379s (with -threads 0 was 2m52.711s) > user 6m50.107s (with -threads 0 was 6m50.310s) > sys 0m1.507s > > top -H: > CPU: 0.0% user, 55.8% nice, 0.4% system, 0.0% interrupt, 43.8% idle > Mem: 136M Active, 884M Inact, 498M Wired, 84K Cache, 409M Buf, 2339M Free > Swap: 4096M Total, 4096M Free > > PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND > 1178 root 52 20 255M 140M uwait 1 1:05 51.17% > ffmpeg{ffmpeg} > 1178 root 103 20 255M 140M CPU0 1 0:59 37.60% > ffmpeg{ffmpeg} > 1178 root 52 20 255M 140M uwait 3 0:59 37.16% > ffmpeg{ffmpeg} > 1178 root 52 20 255M 140M uwait 3 0:59 34.38% > ffmpeg{ffmpeg} > 1178 root 52 20 255M 140M uwait 2 0:54 33.59% > ffmpeg{ffmpeg} > 1178 root 102 20 255M 140M CPU2 0 0:46 32.37% > ffmpeg{ffmpeg} > 1171 root 20 0 67992K 5516K select 2 0:00 0.00% sshd That seems to be using 6 threads not 4, what about -threads 2? Regards Steve ================================================ This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337 or return the E.mail to postmaster@multiplay.co.uk. From owner-freebsd-performance@FreeBSD.ORG Tue Oct 18 13:26:48 2011 Return-Path: Delivered-To: freebsd-performance@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 45563106567B for ; Tue, 18 Oct 2011 13:26:48 +0000 (UTC) (envelope-from fidaj@ukr.net) Received: from fsm1.ukr.net (fsm1.ukr.net [195.214.192.120]) by mx1.freebsd.org (Postfix) with ESMTP id EDAB78FC2C for ; Tue, 18 Oct 2011 13:26:47 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=ukr.net; s=fsm; h=Content-Transfer-Encoding:Content-Type:Mime-Version:References:In-Reply-To:Message-ID:Subject:Cc:To:From:Date; bh=lUhD+pUnxANX+Hia4OMHdKW5ReKg2e0vVT87pV1+4Iw=; b=bW/WS49MWKytfqb0ONfC944VA7ZG3wh66FRpGQgZsUrBvNeMfg6+B7dlNAM/1yc8c0RrRHKCE9owCUTHCw8z0q3sqThVmy3UBtsSwUApiAZjEmXvoHCxdlgEv3patjIp22XiJcsWeCbUct5K3HZQYrzi25FQiG+/Ob93bY2C+zg=; Received: from [81.23.24.122] (helo=nonamehost.) by fsm1.ukr.net with esmtpsa ID 1RG9gr-0006si-Lm ; Tue, 18 Oct 2011 16:26:46 +0300 Date: Tue, 18 Oct 2011 16:26:09 +0300 From: Ivan Klymenko To: Andriy Gapon Message-ID: <20111018162609.1319eb44@nonamehost.> In-Reply-To: <4E9D7880.1030308@FreeBSD.org> References: <4E9D4124.9000307@eenet.ee> <12913.3257120431$1318938804@news.gmane.org> <4E9D7880.1030308@FreeBSD.org> X-Mailer: Claws Mail 3.7.9 (GTK+ 2.22.1; amd64-portbld-freebsd9.0) Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: freebsd-performance@FreeBSD.org Subject: Re: ffmpeg & ULE X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Oct 2011 13:26:48 -0000 =D0=92 Tue, 18 Oct 2011 16:00:48 +0300 Andriy Gapon =D0=BF=D0=B8=D1=88=D0=B5=D1=82: > on 18/10/2011 14:30 Ivan Klymenko said the following: > > =D0=92 Tue, 18 Oct 2011 12:04:36 +0300 > > Urmas Lett =D0=BF=D0=B8=D1=88=D0=B5=D1=82: > >=20 > >> Hello. > >> > >> Why is ffmpeg -threads massively slower with ULE than 4BSD? > >> > >> ffmpeg preset veryfast with sched_bsd: > >> real 1m49.407s > >> user 6m53.932s > >> sys 0m1.700s > >> > >> ffmpeg preset veryfast with sched_ule: > >> real 2m52.711s > >> user 6m50.310s > >> sys 0m1.582s > >> > >> #uname -a > >> FreeBSD 9.0-RC1 FreeBSD 9.0-RC1 #0: Mon Oct 17 20:32:29 EEST > >> > >> > >=20 > > probably because you have a system processor with 2 cores...? > > if yes - then use the 4BSD...it is better for the two cores... IMHO >=20 > Do you have any facts to substantiate your claim? >=20 well, for example: http://img37.imageshack.us/img37/9311/plotj.gif http://img850.imageshack.us/img850/584/plot.gif From owner-freebsd-performance@FreeBSD.ORG Tue Oct 18 13:11:29 2011 Return-Path: Delivered-To: freebsd-performance@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8C1F7106567B for ; Tue, 18 Oct 2011 13:11:29 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from citadel.icyb.net.ua (citadel.icyb.net.ua [212.40.38.140]) by mx1.freebsd.org (Postfix) with ESMTP id D6B148FC26 for ; Tue, 18 Oct 2011 13:11:28 +0000 (UTC) Received: from odyssey.starpoint.kiev.ua (alpha-e.starpoint.kiev.ua [212.40.38.101]) by citadel.icyb.net.ua (8.8.8p3/ICyb-2.3exp) with ESMTP id QAA02965; Tue, 18 Oct 2011 16:00:49 +0300 (EEST) (envelope-from avg@FreeBSD.org) Message-ID: <4E9D7880.1030308@FreeBSD.org> Date: Tue, 18 Oct 2011 16:00:48 +0300 From: Andriy Gapon User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:7.0.1) Gecko/20111003 Thunderbird/7.0.1 MIME-Version: 1.0 To: Ivan Klymenko References: <4E9D4124.9000307@eenet.ee> <12913.3257120431$1318938804@news.gmane.org> In-Reply-To: <12913.3257120431$1318938804@news.gmane.org> X-Enigmail-Version: undefined Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Mailman-Approved-At: Tue, 18 Oct 2011 13:28:33 +0000 Cc: freebsd-performance@FreeBSD.org Subject: Re: ffmpeg & ULE X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Oct 2011 13:11:29 -0000 on 18/10/2011 14:30 Ivan Klymenko said the following: > Ð’ Tue, 18 Oct 2011 12:04:36 +0300 > Urmas Lett пишет: > >> Hello. >> >> Why is ffmpeg -threads massively slower with ULE than 4BSD? >> >> ffmpeg preset veryfast with sched_bsd: >> real 1m49.407s >> user 6m53.932s >> sys 0m1.700s >> >> ffmpeg preset veryfast with sched_ule: >> real 2m52.711s >> user 6m50.310s >> sys 0m1.582s >> >> #uname -a >> FreeBSD 9.0-RC1 FreeBSD 9.0-RC1 #0: Mon Oct 17 20:32:29 EEST >> >> > > probably because you have a system processor with 2 cores...? > if yes - then use the 4BSD...it is better for the two cores... IMHO Do you have any facts to substantiate your claim? -- Andriy Gapon From owner-freebsd-performance@FreeBSD.ORG Tue Oct 18 14:18:02 2011 Return-Path: Delivered-To: freebsd-performance@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 43ABE1065670; Tue, 18 Oct 2011 14:18:02 +0000 (UTC) (envelope-from fidaj@ukr.net) Received: from fsm2.ukr.net (fsm2.ukr.net [195.214.192.121]) by mx1.freebsd.org (Postfix) with ESMTP id EA8658FC15; Tue, 18 Oct 2011 14:18:01 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=ukr.net; s=fsm; h=Content-Transfer-Encoding:Content-Type:Mime-Version:References:In-Reply-To:Message-ID:Subject:Cc:To:From:Date; bh=l4G3HUorfJmZgO8Rqkhz0Jz8GQQ1kSC3wbkV/oFRF0c=; b=s3Zk6F+Vxeq6OKhqMSUJap3YO7K0I9Mas0IzaHZBdLy4Xe93lca9VxztDUy28oysAQaB4ZuT1TJi69cLS8c7+H1sG1DlUK/az3ExhniN461wRi4J7jcBJa3s4O99gyxgK2gdntMIoaVZZ2Ji+uxDWJhacOKS/i8zdaIQm5sRXVw=; Received: from [81.23.24.110] (helo=nonamehost.) by fsm2.ukr.net with esmtpsa ID 1RGAUQ-000Fns-DH ; Tue, 18 Oct 2011 17:17:59 +0300 Date: Tue, 18 Oct 2011 17:17:27 +0300 From: Ivan Klymenko To: Andriy Gapon Message-ID: <20111018171727.1fad2c7d@nonamehost.> In-Reply-To: <4E9D8747.4020104@FreeBSD.org> References: <4E9D4124.9000307@eenet.ee> <12913.3257120431$1318938804@news.gmane.org> <4E9D7880.1030308@FreeBSD.org> <20111018162609.1319eb44@nonamehost.> <4E9D8747.4020104@FreeBSD.org> X-Mailer: Claws Mail 3.7.9 (GTK+ 2.22.1; amd64-portbld-freebsd9.0) Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: freebsd-performance@FreeBSD.org Subject: Re: ffmpeg & ULE X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Oct 2011 14:18:02 -0000 =D0=92 Tue, 18 Oct 2011 17:03:51 +0300 Andriy Gapon =D0=BF=D0=B8=D1=88=D0=B5=D1=82: > on 18/10/2011 16:26 Ivan Klymenko said the following: > > =D0=92 Tue, 18 Oct 2011 16:00:48 +0300 > > Andriy Gapon =D0=BF=D0=B8=D1=88=D0=B5=D1=82: > >=20 > >> on 18/10/2011 14:30 Ivan Klymenko said the following: > >>> =D0=92 Tue, 18 Oct 2011 12:04:36 +0300 > >>> Urmas Lett =D0=BF=D0=B8=D1=88=D0=B5=D1=82: > >>> > >>>> Hello. > >>>> > >>>> Why is ffmpeg -threads massively slower with ULE than 4BSD? > >>>> > >>>> ffmpeg preset veryfast with sched_bsd: > >>>> real 1m49.407s > >>>> user 6m53.932s > >>>> sys 0m1.700s > >>>> > >>>> ffmpeg preset veryfast with sched_ule: > >>>> real 2m52.711s > >>>> user 6m50.310s > >>>> sys 0m1.582s > >>>> > >>>> #uname -a > >>>> FreeBSD 9.0-RC1 FreeBSD 9.0-RC1 #0: Mon Oct 17 20:32:29 EEST > >>>> > >>>> > >>> > >>> probably because you have a system processor with 2 cores...? > >>> if yes - then use the 4BSD...it is better for the two cores... > >>> IMHO > >> > >> Do you have any facts to substantiate your claim? > >> > >=20 > > well, for example: > > http://img37.imageshack.us/img37/9311/plotj.gif > > http://img850.imageshack.us/img850/584/plot.gif >=20 > Not sure if two pictures is all that it takes. > There is no description of hardware, OS versions, reproducibility of > the results. Also you made a broader claim like "4BSD ... is better > for the two cores", but the pictures demonstrate only that it is > better (by ~10% ? I hate it when the axises do not start at zero) http://forum.lissyara.su/viewtopic.php?p=3D305269#p305269 > only for transactions/s in postgresql sysbench. There are other > workloads and other important things to measure (like interactivity, > etc). >=20 > Good benchmarking is a real science. >=20 Of course - I understand it. Please tell me what tests should I do? I will give you the test results for review. I also give all the information about the hardware on which the tests were conducted. From owner-freebsd-performance@FreeBSD.ORG Tue Oct 18 14:38:48 2011 Return-Path: Delivered-To: freebsd-performance@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 15ADB1065670; Tue, 18 Oct 2011 14:38:48 +0000 (UTC) (envelope-from fidaj@ukr.net) Received: from fsm1.ukr.net (fsm1.ukr.net [195.214.192.120]) by mx1.freebsd.org (Postfix) with ESMTP id BD1E08FC13; Tue, 18 Oct 2011 14:38:47 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=ukr.net; s=fsm; h=Content-Transfer-Encoding:Content-Type:Mime-Version:References:In-Reply-To:Message-ID:Subject:Cc:To:From:Date; bh=pE+lCUSa6OISpLCi/4oz4Ui5q5m8ROtc2FLe6Fk6cBg=; b=g4WXHIwmPQcuGxt9QKD3PqhFTgiMkUZsozFc4qzmP3SgxVNhJmDHZ622rFfYFpkk0tOHpjDLm619s3MRGclvTsZQYFQooUTlahU6gMGDXytxFmIKITp4Xdcmxvll4PdKut2GLnQSxp7SRtNQ7CbsBvnEppaTjdjczEmE7zLQT3U=; Received: from [81.23.24.97] (helo=nonamehost.) by fsm1.ukr.net with esmtpsa ID 1RGAoX-0004Rk-Lh ; Tue, 18 Oct 2011 17:38:46 +0300 Date: Tue, 18 Oct 2011 17:38:17 +0300 From: Ivan Klymenko To: Andriy Gapon Message-ID: <20111018173817.12c3dd59@nonamehost.> In-Reply-To: <4E9D8BA5.3010501@FreeBSD.org> References: <4E9D4124.9000307@eenet.ee> <12913.3257120431$1318938804@news.gmane.org> <4E9D7880.1030308@FreeBSD.org> <20111018162609.1319eb44@nonamehost.> <4E9D8747.4020104@FreeBSD.org> <20111018171727.1fad2c7d@nonamehost.> <4E9D8BA5.3010501@FreeBSD.org> X-Mailer: Claws Mail 3.7.9 (GTK+ 2.22.1; amd64-portbld-freebsd9.0) Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: freebsd-performance@FreeBSD.org Subject: Re: ffmpeg & ULE X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Oct 2011 14:38:48 -0000 =D0=92 Tue, 18 Oct 2011 17:22:29 +0300 Andriy Gapon =D0=BF=D0=B8=D1=88=D0=B5=D1=82: > on 18/10/2011 17:17 Ivan Klymenko said the following: > > =D0=92 Tue, 18 Oct 2011 17:03:51 +0300 > > Andriy Gapon =D0=BF=D0=B8=D1=88=D0=B5=D1=82: > >=20 > >> on 18/10/2011 16:26 Ivan Klymenko said the following: > >>> =D0=92 Tue, 18 Oct 2011 16:00:48 +0300 > >>> Andriy Gapon =D0=BF=D0=B8=D1=88=D0=B5=D1=82: > >>> > >>>> on 18/10/2011 14:30 Ivan Klymenko said the following: > >>>>> =D0=92 Tue, 18 Oct 2011 12:04:36 +0300 > >>>>> Urmas Lett =D0=BF=D0=B8=D1=88=D0=B5=D1=82: > >>>>> > >>>>>> Hello. > >>>>>> > >>>>>> Why is ffmpeg -threads massively slower with ULE than 4BSD? > >>>>>> > >>>>>> ffmpeg preset veryfast with sched_bsd: > >>>>>> real 1m49.407s > >>>>>> user 6m53.932s > >>>>>> sys 0m1.700s > >>>>>> > >>>>>> ffmpeg preset veryfast with sched_ule: > >>>>>> real 2m52.711s > >>>>>> user 6m50.310s > >>>>>> sys 0m1.582s > >>>>>> > >>>>>> #uname -a > >>>>>> FreeBSD 9.0-RC1 FreeBSD 9.0-RC1 #0: Mon Oct 17 20:32:29 EEST > >>>>>> > >>>>>> > >>>>> > >>>>> probably because you have a system processor with 2 cores...? > >>>>> if yes - then use the 4BSD...it is better for the two cores... > >>>>> IMHO > >>>> > >>>> Do you have any facts to substantiate your claim? > >>>> > >>> > >>> well, for example: > >>> http://img37.imageshack.us/img37/9311/plotj.gif > >>> http://img850.imageshack.us/img850/584/plot.gif > >> > >> Not sure if two pictures is all that it takes. > >> There is no description of hardware, OS versions, reproducibility > >> of the results. Also you made a broader claim like "4BSD ... is > >> better for the two cores", but the pictures demonstrate only that > >> it is better (by ~10% ? I hate it when the axises do not start at > >> zero) > >=20 > > http://forum.lissyara.su/viewtopic.php?p=3D305269#p305269 > >=20 > >> only for transactions/s in postgresql sysbench. There are other > >> workloads and other important things to measure (like > >> interactivity, etc). > >> > >> Good benchmarking is a real science. > >> > > Of course - I understand it. > > Please tell me what tests should I do? > > I will give you the test results for review. > > I also give all the information about the hardware on which the > > tests were conducted. >=20 > That's a problem for me - I am not an expert in this area and have > very little experience doing formal performance testing. >=20 So how can I convince you to confirm that I am right? From owner-freebsd-performance@FreeBSD.ORG Tue Oct 18 15:02:48 2011 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5DEAF1065672; Tue, 18 Oct 2011 15:02:48 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-yx0-f182.google.com (mail-yx0-f182.google.com [209.85.213.182]) by mx1.freebsd.org (Postfix) with ESMTP id 01B198FC15; Tue, 18 Oct 2011 15:02:47 +0000 (UTC) Received: by yxn16 with SMTP id 16so830094yxn.13 for ; Tue, 18 Oct 2011 08:02:47 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type; bh=jo6X4zu62tTRzJkJXXUtrRcLUFTv+Xz+e4gDpmMgn68=; b=kYQaPNZuObwSUdLAAF5lIDqzoU8QMuutf+JYJ86cg2V7l53uJ/9F16ro9xGd7G4pdu T36n9qa3MW38zzYIxU8QgwAVAHH4nhcJbl6W2AO4jUipWNq918SwGLrf+s4zSkaN859b HufpHhCOMpJDEAJpBxVJFJ6gH09NUivEtDs3o= MIME-Version: 1.0 Received: by 10.236.175.195 with SMTP id z43mr3781559yhl.66.1318950167403; Tue, 18 Oct 2011 08:02:47 -0700 (PDT) Sender: adrian.chadd@gmail.com Received: by 10.236.95.147 with HTTP; Tue, 18 Oct 2011 08:02:47 -0700 (PDT) In-Reply-To: <4e9d8ab4.c89aec0a.4216.ffffd1efSMTPIN_ADDED@mx.google.com> References: <4E9D4124.9000307@eenet.ee> <12913.3257120431$1318938804@news.gmane.org> <4E9D7880.1030308@FreeBSD.org> <20111018162609.1319eb44@nonamehost.> <4E9D8747.4020104@FreeBSD.org> <4e9d8ab4.c89aec0a.4216.ffffd1efSMTPIN_ADDED@mx.google.com> Date: Tue, 18 Oct 2011 23:02:47 +0800 X-Google-Sender-Auth: YS8oGADKgkBU3BdJJcPTKmntnPQ Message-ID: From: Adrian Chadd To: Ivan Klymenko Content-Type: text/plain; charset=ISO-8859-1 Cc: freebsd-performance@freebsd.org, Andriy Gapon Subject: Re: ffmpeg & ULE X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Oct 2011 15:02:48 -0000 What is FBFS? Adrian From owner-freebsd-performance@FreeBSD.ORG Tue Oct 18 15:24:34 2011 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B42C4106566B; Tue, 18 Oct 2011 15:24:34 +0000 (UTC) (envelope-from fidaj@ukr.net) Received: from fsm1.ukr.net (fsm1.ukr.net [195.214.192.120]) by mx1.freebsd.org (Postfix) with ESMTP id 297A38FC08; Tue, 18 Oct 2011 15:24:34 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=ukr.net; s=fsm; h=Content-Transfer-Encoding:Content-Type:Mime-Version:References:In-Reply-To:Message-ID:Subject:Cc:To:From:Date; bh=L6LMDYHBQ9WrYO6CM0/CDycAVYcvG/LDU38gLlqhztI=; b=fa087j89M4t5yFh2WnPSWT2VE5nz+JQzMSoabM7eiZQf2WGA60k4a7U/SVuAyL27bEQYDudPoiA+z85gdb+ieZmaX/XGlQv82r0btePQ5+lqetVZ9REUxgN3L+hYildvTN5kVzJdJPFxRqktbnMgagN9qJwZyZ3EuOXDSuhSwH8=; Received: from [81.23.24.124] (helo=nonamehost.) by fsm1.ukr.net with esmtpsa ID 1RGBWq-000Gej-FC ; Tue, 18 Oct 2011 18:24:33 +0300 Date: Tue, 18 Oct 2011 18:24:00 +0300 From: Ivan Klymenko To: Adrian Chadd Message-ID: <20111018182400.25676e8e@nonamehost.> In-Reply-To: References: <4E9D4124.9000307@eenet.ee> <12913.3257120431$1318938804@news.gmane.org> <4E9D7880.1030308@FreeBSD.org> <20111018162609.1319eb44@nonamehost.> <4E9D8747.4020104@FreeBSD.org> <4e9d8ab4.c89aec0a.4216.ffffd1efSMTPIN_ADDED@mx.google.com> X-Mailer: Claws Mail 3.7.9 (GTK+ 2.22.1; amd64-portbld-freebsd9.0) Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: freebsd-performance@freebsd.org, Andriy Gapon Subject: Re: ffmpeg & ULE X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Oct 2011 15:24:34 -0000 =D0=92 Tue, 18 Oct 2011 23:02:47 +0800 Adrian Chadd =D0=BF=D0=B8=D1=88=D0=B5=D1=82: > What is FBFS? >=20 >=20 >=20 > Adrian :) http://rudot.blog.com/ From owner-freebsd-performance@FreeBSD.ORG Tue Oct 18 15:28:07 2011 Return-Path: Delivered-To: freebsd-performance@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0CF521065674; Tue, 18 Oct 2011 15:28:07 +0000 (UTC) (envelope-from fidaj@ukr.net) Received: from fsm1.ukr.net (fsm1.ukr.net [195.214.192.120]) by mx1.freebsd.org (Postfix) with ESMTP id 7DDA18FC1F; Tue, 18 Oct 2011 15:28:06 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=ukr.net; s=fsm; h=Content-Transfer-Encoding:Content-Type:Mime-Version:References:In-Reply-To:Message-ID:Subject:Cc:To:From:Date; bh=8Miw1VpwxXH/ooAx59h5S1sgDklMqkLReSNlTPxNGc4=; b=dlMUZxHzfy1uFuXa+7HqYB0ez9UyK5tmu0Utk5zzEvCkcu6IUEV6QRt9JyOoJK6GFGo9FC1i8lrI7JpLV3tu6ocvicEvY3TtlZ2JGUlk0Dc5PSIuw4+MNyuGLKNz+PVA5tuEIc6YwvkqvsW+4l3BWJh+AFvNDPtal+d0pz8A70Y=; Received: from [81.23.24.103] (helo=nonamehost.) by fsm1.ukr.net with esmtpsa ID 1RGBaG-000HLb-Ky ; Tue, 18 Oct 2011 18:28:05 +0300 Date: Tue, 18 Oct 2011 18:27:37 +0300 From: Ivan Klymenko To: Andriy Gapon Message-ID: <20111018182737.750ac7a5@nonamehost.> In-Reply-To: <4E9D9510.9050609@FreeBSD.org> References: <4E9D4124.9000307@eenet.ee> <12913.3257120431$1318938804@news.gmane.org> <4E9D7880.1030308@FreeBSD.org> <20111018162609.1319eb44@nonamehost.> <4E9D8747.4020104@FreeBSD.org> <20111018171727.1fad2c7d@nonamehost.> <4E9D8BA5.3010501@FreeBSD.org> <20111018173817.12c3dd59@nonamehost.> <4E9D9510.9050609@FreeBSD.org> X-Mailer: Claws Mail 3.7.9 (GTK+ 2.22.1; amd64-portbld-freebsd9.0) Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: freebsd-performance@FreeBSD.org Subject: Re: ffmpeg & ULE X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Oct 2011 15:28:07 -0000 =D0=92 Tue, 18 Oct 2011 18:02:40 +0300 Andriy Gapon =D0=BF=D0=B8=D1=88=D0=B5=D1=82: > on 18/10/2011 17:38 Ivan Klymenko said the following: > > =D0=92 Tue, 18 Oct 2011 17:22:29 +0300 > > Andriy Gapon =D0=BF=D0=B8=D1=88=D0=B5=D1=82: > >=20 > >> on 18/10/2011 17:17 Ivan Klymenko said the following: > >>> =D0=92 Tue, 18 Oct 2011 17:03:51 +0300 > >>> Andriy Gapon =D0=BF=D0=B8=D1=88=D0=B5=D1=82: > >>> > >>>> on 18/10/2011 16:26 Ivan Klymenko said the following: > >>>>> =D0=92 Tue, 18 Oct 2011 16:00:48 +0300 > >>>>> Andriy Gapon =D0=BF=D0=B8=D1=88=D0=B5=D1=82: > >>>>> > >>>>>> on 18/10/2011 14:30 Ivan Klymenko said the following: > >>>>>>> =D0=92 Tue, 18 Oct 2011 12:04:36 +0300 > >>>>>>> Urmas Lett =D0=BF=D0=B8=D1=88=D0=B5=D1=82: > >>>>>>> > >>>>>>>> Hello. > >>>>>>>> > >>>>>>>> Why is ffmpeg -threads massively slower with ULE than 4BSD? > >>>>>>>> > >>>>>>>> ffmpeg preset veryfast with sched_bsd: > >>>>>>>> real 1m49.407s > >>>>>>>> user 6m53.932s > >>>>>>>> sys 0m1.700s > >>>>>>>> > >>>>>>>> ffmpeg preset veryfast with sched_ule: > >>>>>>>> real 2m52.711s > >>>>>>>> user 6m50.310s > >>>>>>>> sys 0m1.582s > >>>>>>>> > >>>>>>>> #uname -a > >>>>>>>> FreeBSD 9.0-RC1 FreeBSD 9.0-RC1 #0: Mon Oct 17 20:32:29 EEST > >>>>>>>> > >>>>>>>> > >>>>>>> > >>>>>>> probably because you have a system processor with 2 cores...? > >>>>>>> if yes - then use the 4BSD...it is better for the two cores... > >>>>>>> IMHO > >>>>>> > >>>>>> Do you have any facts to substantiate your claim? > >>>>>> > >>>>> > >>>>> well, for example: > >>>>> http://img37.imageshack.us/img37/9311/plotj.gif > >>>>> http://img850.imageshack.us/img850/584/plot.gif > >>>> > >>>> Not sure if two pictures is all that it takes. > >>>> There is no description of hardware, OS versions, reproducibility > >>>> of the results. Also you made a broader claim like "4BSD ... is > >>>> better for the two cores", but the pictures demonstrate only that > >>>> it is better (by ~10% ? I hate it when the axises do not start at > >>>> zero) > >>> > >>> http://forum.lissyara.su/viewtopic.php?p=3D305269#p305269 > >>> > >>>> only for transactions/s in postgresql sysbench. There are other > >>>> workloads and other important things to measure (like > >>>> interactivity, etc). > >>>> > >>>> Good benchmarking is a real science. > >>>> > >>> Of course - I understand it. > >>> Please tell me what tests should I do? > >>> I will give you the test results for review. > >>> I also give all the information about the hardware on which the > >>> tests were conducted. > >> > >> That's a problem for me - I am not an expert in this area and have > >> very little experience doing formal performance testing. > >> > >=20 > > So how can I convince you to confirm that I am right? >=20 > Right about what? > I do not think that your postgresql tests (with about ~10% of maximal > difference for a particular configuration) provide any insight into > the reported ffmpeg results that started this topic. >=20 What tests should I do with ffmpeg? From owner-freebsd-performance@FreeBSD.ORG Tue Oct 18 13:17:28 2011 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F1048106573F for ; Tue, 18 Oct 2011 13:17:28 +0000 (UTC) (envelope-from urmas.lett@eenet.ee) Received: from muheleja.eenet.ee (muheleja.eenet.ee [193.40.0.132]) by mx1.freebsd.org (Postfix) with ESMTP id AD8728FC12 for ; Tue, 18 Oct 2011 13:17:28 +0000 (UTC) Received: from muheleja.eenet.ee (localhost [127.0.0.1]) by localhost.eenet.ee (Postfix) with ESMTP id 527E91CC1F; Tue, 18 Oct 2011 16:15:12 +0300 (EEST) X-Virus-Scanned: amavisd-new at eenet.ee Received: from muheleja.eenet.ee ([127.0.0.1]) by muheleja.eenet.ee (muheleja.eenet.ee [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 645O5AfUPBqX; Tue, 18 Oct 2011 16:15:07 +0300 (EEST) Received: from [193.40.0.223] (poriseja.eenet.ee [193.40.0.223]) by muheleja.eenet.ee (Postfix) with ESMTP id 0637E1CC09; Tue, 18 Oct 2011 16:15:07 +0300 (EEST) Message-ID: <4E9D7C63.1090507@eenet.ee> Date: Tue, 18 Oct 2011 16:17:23 +0300 From: Urmas Lett Organization: EENet User-Agent: Mozilla/5.0 (Windows NT 5.1; rv:7.0.1) Gecko/20110929 Thunderbird/7.0.1 MIME-Version: 1.0 To: Steven Hartland References: <4E9D4124.9000307@eenet.ee> <20111018143012.66cdbbf8@nonamehost.> <4E9D6D2C.9060306@eenet.ee> <4161C63AB02B4332864C985BBAEAD8F2@multiplay.co.uk> In-Reply-To: <4161C63AB02B4332864C985BBAEAD8F2@multiplay.co.uk> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Mailman-Approved-At: Tue, 18 Oct 2011 15:28:43 +0000 Cc: freebsd-performance@freebsd.org Subject: Re: ffmpeg & ULE X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Oct 2011 13:17:29 -0000 On 10/18/2011 3:36 PM, Steven Hartland wrote: > What happens if you either: > 1. disable HT in the bios Intel says i5-2400 has no HT: Processor Number i5-2400 # of Cores 4 # of Threads 4 and BIOS has no HT disable knob > 2. limit the threads to 4? ffmpeg -threads 4 (sched_ule): real 3m19.379s (with -threads 0 was 2m52.711s) user 6m50.107s (with -threads 0 was 6m50.310s) sys 0m1.507s top -H: CPU: 0.0% user, 55.8% nice, 0.4% system, 0.0% interrupt, 43.8% idle Mem: 136M Active, 884M Inact, 498M Wired, 84K Cache, 409M Buf, 2339M Free Swap: 4096M Total, 4096M Free PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND 1178 root 52 20 255M 140M uwait 1 1:05 51.17% ffmpeg{ffmpeg} 1178 root 103 20 255M 140M CPU0 1 0:59 37.60% ffmpeg{ffmpeg} 1178 root 52 20 255M 140M uwait 3 0:59 37.16% ffmpeg{ffmpeg} 1178 root 52 20 255M 140M uwait 3 0:59 34.38% ffmpeg{ffmpeg} 1178 root 52 20 255M 140M uwait 2 0:54 33.59% ffmpeg{ffmpeg} 1178 root 102 20 255M 140M CPU2 0 0:46 32.37% ffmpeg{ffmpeg} 1171 root 20 0 67992K 5516K select 2 0:00 0.00% sshd regards, Urmas Lett Tel: +(372) 7 302 110 Fax: +(372) 7 302 111 E-Mail: urmas.lett@eenet.ee From owner-freebsd-performance@FreeBSD.ORG Tue Oct 18 15:30:25 2011 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DEE5A1065672; Tue, 18 Oct 2011 15:30:25 +0000 (UTC) (envelope-from vince@unsane.co.uk) Received: from unsane.co.uk (unsane-pt.tunnel.tserv5.lon1.ipv6.he.net [IPv6:2001:470:1f08:110::2]) by mx1.freebsd.org (Postfix) with ESMTP id 690FA8FC19; Tue, 18 Oct 2011 15:30:25 +0000 (UTC) Received: from vhoffman.lon.namesco.net (lon.namesco.net [195.7.254.102]) (authenticated bits=0) by unsane.co.uk (8.14.4/8.14.4) with ESMTP id p9IFUNRA094994 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Tue, 18 Oct 2011 16:30:23 +0100 (BST) (envelope-from vince@unsane.co.uk) Message-ID: <4E9D9B8E.7030407@unsane.co.uk> Date: Tue, 18 Oct 2011 16:30:22 +0100 From: Vincent Hoffman User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:7.0.1) Gecko/20110929 Thunderbird/7.0.1 MIME-Version: 1.0 To: Ivan Klymenko References: <4E9D4124.9000307@eenet.ee> <12913.3257120431$1318938804@news.gmane.org> <4E9D7880.1030308@FreeBSD.org> <20111018162609.1319eb44@nonamehost.> <4E9D8747.4020104@FreeBSD.org> <4e9d8ab4.c89aec0a.4216.ffffd1efSMTPIN_ADDED@mx.google.com> <20111018182400.25676e8e@nonamehost.> In-Reply-To: <20111018182400.25676e8e@nonamehost.> X-Enigmail-Version: 1.3.2 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Cc: Adrian Chadd , freebsd-performance@freebsd.org, Andriy Gapon Subject: Re: ffmpeg & ULE X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Oct 2011 15:30:26 -0000 On 18/10/2011 16:24, Ivan Klymenko wrote: > Ð’ Tue, 18 Oct 2011 23:02:47 +0800 > Adrian Chadd пишет: > >> What is FBFS? >> >> >> >> Adrian > :) > http://rudot.blog.com/ or http://wiki.freebsd.org/RudolfTomori/rudotSoC2011 The blog entry was interesting in that it gives some context to the 2 images you previously posted as does the wiki entry. Vince > _______________________________________________ > freebsd-performance@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-performance > To unsubscribe, send any mail to "freebsd-performance-unsubscribe@freebsd.org" From owner-freebsd-performance@FreeBSD.ORG Tue Oct 18 15:31:59 2011 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D00FB1065677 for ; Tue, 18 Oct 2011 15:31:59 +0000 (UTC) (envelope-from yanegomi@gmail.com) Received: from mail-gy0-f182.google.com (mail-gy0-f182.google.com [209.85.160.182]) by mx1.freebsd.org (Postfix) with ESMTP id 8F8ED8FC0A for ; Tue, 18 Oct 2011 15:31:59 +0000 (UTC) Received: by gyd8 with SMTP id 8so897622gyd.13 for ; Tue, 18 Oct 2011 08:31:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=oHjVwVMLRZWcNlgFTtzaBsVbJluXVSNw0DV+9bfVJB8=; b=aAue2MUWQXxT9HgjLUXOuWm005HLdH5DNTbP83dxDUpBA2qAD35HxOcHvKB1bKA/1d xTtlqgHw1OzU5pKrM8k2i/WAqA3V7DK61zxjUBOvnmypICL0Pffg2CkO03RrFvD9w5oS y+G7seBGmYSNaH8IRAinXdmAFZp7U6xtNdhnM= MIME-Version: 1.0 Received: by 10.42.146.195 with SMTP id k3mr5512955icv.13.1318950267058; Tue, 18 Oct 2011 08:04:27 -0700 (PDT) Received: by 10.182.122.33 with HTTP; Tue, 18 Oct 2011 08:04:27 -0700 (PDT) In-Reply-To: References: <4E9D4124.9000307@eenet.ee> <12913.3257120431$1318938804@news.gmane.org> <4E9D7880.1030308@FreeBSD.org> <20111018162609.1319eb44@nonamehost.> <4E9D8747.4020104@FreeBSD.org> <4e9d8ab4.c89aec0a.4216.ffffd1efSMTPIN_ADDED@mx.google.com> Date: Tue, 18 Oct 2011 08:04:27 -0700 Message-ID: From: Garrett Cooper To: Adrian Chadd Content-Type: text/plain; charset=ISO-8859-1 Cc: Ivan Klymenko , freebsd-performance@freebsd.org, Andriy Gapon Subject: Re: ffmpeg & ULE X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Oct 2011 15:31:59 -0000 On Tue, Oct 18, 2011 at 8:02 AM, Adrian Chadd wrote: > What is FBFS? http://ivoras.net/blog/tree/2011-07-13.testing-the-new-fbfs-scheduler.html From owner-freebsd-performance@FreeBSD.ORG Tue Oct 18 15:32:27 2011 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5B8871065676 for ; Tue, 18 Oct 2011 15:32:27 +0000 (UTC) (envelope-from nec556@retena.com) Received: from resmaa13.ono.com (smtp13.ono.com [62.42.230.16]) by mx1.freebsd.org (Postfix) with ESMTP id D7A2E8FC0A for ; Tue, 18 Oct 2011 15:32:26 +0000 (UTC) Received: from GogPortatil.retena.com (85.219.71.186) by resmaa13.ono.com (8.5.113) (authenticated as nec556@retena.com) id 4E5EF2B000CD3A44 for freebsd-performance@freebsd.org; Tue, 18 Oct 2011 17:20:31 +0200 Message-ID: <4E5EF2B000CD3A44@> (added by postmaster@resmaa13.ono.com) X-Mailer: QUALCOMM Windows Eudora Version 7.1.0.9 Date: Tue, 18 Oct 2011 17:20:31 +0200 To: freebsd-performance@freebsd.org From: Eduardo Morras In-Reply-To: References: <4E9D4124.9000307@eenet.ee> <12913.3257120431$1318938804@news.gmane.org> <4E9D7880.1030308@FreeBSD.org> <20111018162609.1319eb44@nonamehost.> <4E9D8747.4020104@FreeBSD.org> <4e9d8ab4.c89aec0a.4216.ffffd1efSMTPIN_ADDED@mx.google.com> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed X-Antivirus: AVG for E-mail 10.0.1411 [1522/3958] Subject: Re: ffmpeg & ULE X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Oct 2011 15:32:27 -0000 At 17:02 18/10/2011, Adrian Chadd wrote: >What is FBFS? It's the freebsd port of the Brain Fuck Scheduler. It's not strictly a port because Ivan Voras and the GSoC student made some changes on the algorithm. >Adrian >_______________________________________________ >freebsd-performance@freebsd.org mailing list >http://lists.freebsd.org/mailman/listinfo/freebsd-performance >To unsubscribe, send any mail to "freebsd-performance-unsubscribe@freebsd.org" From owner-freebsd-performance@FreeBSD.ORG Tue Oct 18 15:39:37 2011 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C91741065670; Tue, 18 Oct 2011 15:39:37 +0000 (UTC) (envelope-from tevans.uk@googlemail.com) Received: from mail-vx0-f182.google.com (mail-vx0-f182.google.com [209.85.220.182]) by mx1.freebsd.org (Postfix) with ESMTP id 718E88FC0A; Tue, 18 Oct 2011 15:39:37 +0000 (UTC) Received: by vcbfo13 with SMTP id fo13so928291vcb.13 for ; Tue, 18 Oct 2011 08:39:36 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=pmlmzE+itZaIpom2xcexRv36hN0Ke9gigoMFYK+mSbg=; b=sXidgZxi0PejyevFyQX4fIM3mw05uJGfpF8sEI3aHYNean4lYT8pLayuCF7gbYg7e7 QnhhsIAKeCEmNgmDY5yd4EDfT27vfox31VHY4rPizfTC6F1Cqzj94PRbwVu9+G2DseVm 41nQJmiA9vqzB/VJjWFUEtEDDB6ZaZ4BmnrAM= MIME-Version: 1.0 Received: by 10.52.28.140 with SMTP id b12mr2899923vdh.2.1318950702160; Tue, 18 Oct 2011 08:11:42 -0700 (PDT) Received: by 10.52.111.201 with HTTP; Tue, 18 Oct 2011 08:11:42 -0700 (PDT) In-Reply-To: References: <4E9D4124.9000307@eenet.ee> <12913.3257120431$1318938804@news.gmane.org> <4E9D7880.1030308@FreeBSD.org> <20111018162609.1319eb44@nonamehost.> <4E9D8747.4020104@FreeBSD.org> <4e9d8ab4.c89aec0a.4216.ffffd1efSMTPIN_ADDED@mx.google.com> Date: Tue, 18 Oct 2011 16:11:42 +0100 Message-ID: From: Tom Evans To: Adrian Chadd Content-Type: text/plain; charset=UTF-8 Cc: freebsd-performance@freebsd.org Subject: Re: ffmpeg & ULE X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Oct 2011 15:39:37 -0000 On Tue, Oct 18, 2011 at 4:02 PM, Adrian Chadd wrote: > What is FBFS? > http://rudot.blog.com/2011/07/13/freebsd-fbfs-live-dvd-image-is-available-now/ Cheers Tom From owner-freebsd-performance@FreeBSD.ORG Tue Oct 18 13:59:01 2011 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D93621065675 for ; Tue, 18 Oct 2011 13:59:01 +0000 (UTC) (envelope-from urmas.lett@eenet.ee) Received: from muheleja.eenet.ee (muheleja.eenet.ee [193.40.0.132]) by mx1.freebsd.org (Postfix) with ESMTP id 958838FC08 for ; Tue, 18 Oct 2011 13:59:01 +0000 (UTC) Received: from muheleja.eenet.ee (localhost [127.0.0.1]) by localhost.eenet.ee (Postfix) with ESMTP id 2A8AB1CC1F; Tue, 18 Oct 2011 16:56:45 +0300 (EEST) X-Virus-Scanned: amavisd-new at eenet.ee Received: from muheleja.eenet.ee ([127.0.0.1]) by muheleja.eenet.ee (muheleja.eenet.ee [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id dj1WFiPePpDl; Tue, 18 Oct 2011 16:56:39 +0300 (EEST) Received: from [193.40.0.223] (poriseja.eenet.ee [193.40.0.223]) by muheleja.eenet.ee (Postfix) with ESMTP id B79061CC09; Tue, 18 Oct 2011 16:56:39 +0300 (EEST) Message-ID: <4E9D8620.3080203@eenet.ee> Date: Tue, 18 Oct 2011 16:58:56 +0300 From: Urmas Lett Organization: EENet User-Agent: Mozilla/5.0 (Windows NT 5.1; rv:7.0.1) Gecko/20110929 Thunderbird/7.0.1 MIME-Version: 1.0 To: Steven Hartland References: <4E9D4124.9000307@eenet.ee> <20111018143012.66cdbbf8@nonamehost.> <4E9D6D2C.9060306@eenet.ee> <4161C63AB02B4332864C985BBAEAD8F2@multiplay.co.uk> <4E9D7C63.1090507@eenet.ee> <06DF6B887E064C82A452884F5735F929@multiplay.co.uk> In-Reply-To: <06DF6B887E064C82A452884F5735F929@multiplay.co.uk> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Mailman-Approved-At: Tue, 18 Oct 2011 15:41:32 +0000 Cc: freebsd-performance@freebsd.org Subject: Re: ffmpeg & ULE X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Oct 2011 13:59:01 -0000 On 10/18/2011 4:26 PM, Steven Hartland wrote: > > ----- Original Message ----- From: "Urmas Lett" > > >> On 10/18/2011 3:36 PM, Steven Hartland wrote: >>> What happens if you either: >>> 1. disable HT in the bios >> >> Intel says i5-2400 has no HT: >> Processor Number i5-2400 >> # of Cores 4 >> # of Threads 4 >> >> and BIOS has no HT disable knob > > Ahh yes of course. > >> >>> 2. limit the threads to 4? >> >> ffmpeg -threads 4 (sched_ule): >> >> real 3m19.379s (with -threads 0 was 2m52.711s) >> user 6m50.107s (with -threads 0 was 6m50.310s) >> sys 0m1.507s >> >> top -H: >> CPU: 0.0% user, 55.8% nice, 0.4% system, 0.0% interrupt, 43.8% idle >> Mem: 136M Active, 884M Inact, 498M Wired, 84K Cache, 409M Buf, 2339M Free >> Swap: 4096M Total, 4096M Free >> >> PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND >> 1178 root 52 20 255M 140M uwait 1 1:05 51.17% ffmpeg{ffmpeg} >> 1178 root 103 20 255M 140M CPU0 1 0:59 37.60% ffmpeg{ffmpeg} >> 1178 root 52 20 255M 140M uwait 3 0:59 37.16% ffmpeg{ffmpeg} >> 1178 root 52 20 255M 140M uwait 3 0:59 34.38% ffmpeg{ffmpeg} >> 1178 root 52 20 255M 140M uwait 2 0:54 33.59% ffmpeg{ffmpeg} >> 1178 root 102 20 255M 140M CPU2 0 0:46 32.37% ffmpeg{ffmpeg} >> 1171 root 20 0 67992K 5516K select 2 0:00 0.00% sshd > > That seems to be using 6 threads not 4, what about -threads 2? real 3m7.826s user 6m49.813s sys 0m1.581s CPU: 0.0% user, 57.9% nice, 0.0% system, 0.0% interrupt, 42.1% idle Mem: 116M Active, 18M Inact, 457M Wired, 112K Cache, 376M Buf, 3265M Free Swap: 4096M Total, 4096M Free PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND 1224 root 106 10 223M 117M CPU2 2 0:33 79.98% ffmpeg{ffmpeg} 1224 root 52 10 223M 117M uwait 1 0:31 76.76% ffmpeg{ffmpeg} 1224 root 94 10 223M 117M CPU3 3 0:20 40.77% ffmpeg{ffmpeg} 1224 root 90 10 223M 117M CPU1 0 0:14 28.76% ffmpeg{ffmpeg} 1215 root 20 0 67992K 5516K select 2 0:00 0.00% sshd Regards, Urmas Lett Tel: +(372) 7 302 110 Fax: +(372) 7 302 111 E-Mail: urmas.lett@eenet.ee From owner-freebsd-performance@FreeBSD.ORG Tue Oct 18 15:46:09 2011 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 65B64106564A; Tue, 18 Oct 2011 15:46:09 +0000 (UTC) (envelope-from fidaj@ukr.net) Received: from fsm2.ukr.net (fsm2.ukr.net [195.214.192.121]) by mx1.freebsd.org (Postfix) with ESMTP id 13F938FC12; Tue, 18 Oct 2011 15:46:08 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=ukr.net; s=fsm; h=Content-Transfer-Encoding:Content-Type:Mime-Version:References:In-Reply-To:Message-ID:Subject:Cc:To:From:Date; bh=zOiwyjpbJ5NVJEp+I+OYi2iQq5jFfDWqYX3i8V+8W3w=; b=TjPo7wGVqg6V6GSzbD4COgIGJ2FYTtMlBec2Wiv9JkJl+j2zFTvKLq3seZbSOJf1DhY1NBhnkwoVnMblGQG6S8iUGsHGSiXbeBV4DoFcGsK2qbRwXN6c1jZuKpZ1YrzMms724h2DLUiT/JZcvLS8MHCLn6XZGNQ3V8eaROtYIkU=; Received: from [81.23.24.124] (helo=nonamehost.) by fsm2.ukr.net with esmtpsa ID 1RGBri-000BTU-U9 ; Tue, 18 Oct 2011 18:46:07 +0300 Date: Tue, 18 Oct 2011 18:45:39 +0300 From: Ivan Klymenko To: Vincent Hoffman Message-ID: <20111018184539.63b49134@nonamehost.> In-Reply-To: <4E9D9B8E.7030407@unsane.co.uk> References: <4E9D4124.9000307@eenet.ee> <12913.3257120431$1318938804@news.gmane.org> <4E9D7880.1030308@FreeBSD.org> <20111018162609.1319eb44@nonamehost.> <4E9D8747.4020104@FreeBSD.org> <4e9d8ab4.c89aec0a.4216.ffffd1efSMTPIN_ADDED@mx.google.com> <20111018182400.25676e8e@nonamehost.> <4E9D9B8E.7030407@unsane.co.uk> X-Mailer: Claws Mail 3.7.9 (GTK+ 2.22.1; amd64-portbld-freebsd9.0) Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: Adrian Chadd , freebsd-performance@freebsd.org, Andriy Gapon Subject: Re: ffmpeg & ULE X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Oct 2011 15:46:09 -0000 =D0=92 Tue, 18 Oct 2011 16:30:22 +0100 Vincent Hoffman =D0=BF=D0=B8=D1=88=D0=B5=D1=82: > On 18/10/2011 16:24, Ivan Klymenko wrote: > > =D0=92 Tue, 18 Oct 2011 23:02:47 +0800 > > Adrian Chadd =D0=BF=D0=B8=D1=88=D0=B5=D1=82: > > > >> What is FBFS? > >> > >> > >> > >> Adrian > > :) > > http://rudot.blog.com/ > or=20 > http://wiki.freebsd.org/RudolfTomori/rudotSoC2011 >=20 > The blog entry was interesting in that it gives some context to the 2 > images you previously posted as does the wiki entry. >=20 > Vince they are very different four images - made on different systems Forgive me for offtopic :( From owner-freebsd-performance@FreeBSD.ORG Tue Oct 18 15:37:18 2011 Return-Path: Delivered-To: freebsd-performance@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E676C1065674 for ; Tue, 18 Oct 2011 15:37:18 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from citadel.icyb.net.ua (citadel.icyb.net.ua [212.40.38.140]) by mx1.freebsd.org (Postfix) with ESMTP id 265BE8FC0C for ; Tue, 18 Oct 2011 15:37:17 +0000 (UTC) Received: from odyssey.starpoint.kiev.ua (alpha-e.starpoint.kiev.ua [212.40.38.101]) by citadel.icyb.net.ua (8.8.8p3/ICyb-2.3exp) with ESMTP id SAA05419; Tue, 18 Oct 2011 18:37:16 +0300 (EEST) (envelope-from avg@FreeBSD.org) Message-ID: <4E9D9D2B.5010905@FreeBSD.org> Date: Tue, 18 Oct 2011 18:37:15 +0300 From: Andriy Gapon User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:7.0.1) Gecko/20111003 Thunderbird/7.0.1 MIME-Version: 1.0 To: Ivan Klymenko References: <4E9D4124.9000307@eenet.ee> <12913.3257120431$1318938804@news.gmane.org> <4E9D7880.1030308@FreeBSD.org> <20111018162609.1319eb44@nonamehost.> <4E9D8747.4020104@FreeBSD.org> <20111018171727.1fad2c7d@nonamehost.> <4E9D8BA5.3010501@FreeBSD.org> <20111018173817.12c3dd59@nonamehost.> <4E9D9510.9050609@FreeBSD.org> <20111018182737.750ac7a5@nonamehost.> In-Reply-To: <20111018182737.750ac7a5@nonamehost.> X-Enigmail-Version: undefined Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Mailman-Approved-At: Tue, 18 Oct 2011 15:57:42 +0000 Cc: freebsd-performance@FreeBSD.org Subject: Re: ffmpeg & ULE X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Oct 2011 15:37:19 -0000 on 18/10/2011 18:27 Ivan Klymenko said the following: > What tests should I do with ffmpeg? I don't know - what the original poster did? I.e. compare ffmpeg multithreaded performance with different schedulers. -- Andriy Gapon From owner-freebsd-performance@FreeBSD.ORG Tue Oct 18 16:41:35 2011 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CE812106566C for ; Tue, 18 Oct 2011 16:41:35 +0000 (UTC) (envelope-from nec556@retena.com) Received: from resmaa13.ono.com (smtp13.ono.com [62.42.230.16]) by mx1.freebsd.org (Postfix) with ESMTP id 5EC958FC12 for ; Tue, 18 Oct 2011 16:41:34 +0000 (UTC) Received: from GogPortatil.retena.com (85.219.71.186) by resmaa13.ono.com (8.5.113) (authenticated as nec556@retena.com) id 4E5EF2B000CD95C0 for freebsd-performance@freebsd.org; Tue, 18 Oct 2011 18:41:33 +0200 Message-ID: <4E5EF2B000CD95C0@> (added by postmaster@resmaa13.ono.com) X-Mailer: QUALCOMM Windows Eudora Version 7.1.0.9 Date: Tue, 18 Oct 2011 18:41:33 +0200 To: freebsd-performance@freebsd.org From: Eduardo Morras In-Reply-To: <20111018184539.63b49134@nonamehost.> References: <4E9D4124.9000307@eenet.ee> <12913.3257120431$1318938804@news.gmane.org> <4E9D7880.1030308@FreeBSD.org> <20111018162609.1319eb44@nonamehost.> <4E9D8747.4020104@FreeBSD.org> <4e9d8ab4.c89aec0a.4216.ffffd1efSMTPIN_ADDED@mx.google.com> <20111018182400.25676e8e@nonamehost.> <4E9D9B8E.7030407@unsane.co.uk> <20111018184539.63b49134@nonamehost.> Mime-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1"; format=flowed Content-Transfer-Encoding: quoted-printable X-Antivirus: AVG for E-mail 10.0.1411 [1522/3959] Subject: Re: ffmpeg & ULE X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Oct 2011 16:41:35 -0000 At 17:45 18/10/2011, Ivan Klymenko wrote: >=D0=92 Tue, 18 Oct 2011 16:30:22 +0100 >Vincent Hoffman =D0=BF=D0=B8=D1=88=D0=B5=D1=82: > > > On 18/10/2011 16:24, Ivan Klymenko wrote: > > > =D0=92 Tue, 18 Oct 2011 23:02:47 +0800 > > > Adrian Chadd =D0=BF=D0=B8=D1=88=D0=B5=D1=82: > > > > > >> What is FBFS? > > >> > > >> > > >> > > >> Adrian > > > :) > > > http://rudot.blog.com/ > > or > > http://wiki.freebsd.org/RudolfTomori/rudotSoC2011 > > > > The blog entry was interesting in that it gives some context to the 2 > > images you previously posted as does the wiki entry. > > > > Vince > >they are very different four images - made on different systems >Forgive me for offtopic :( I think it's on topic. Andriy Gapon requested any=20 facts that demostrates or shows examples when ULE=20 scheduler is not so good than others. The images=20 shows how the 3 schedulers performs with the same=20 workload when number of cores is changed. Perhaps=20 it's not a scientific and statistically valid=20 but, for me, it shows when is ULE under other schedulers. Also, some people has asked and pointed about=20 using 4BSD and not ULE in 8.x because it works=20 better for some type of workload. From owner-freebsd-performance@FreeBSD.ORG Tue Oct 18 16:50:57 2011 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 60083106566B for ; Tue, 18 Oct 2011 16:50:57 +0000 (UTC) (envelope-from ohartman@zedat.fu-berlin.de) Received: from outpost1.zedat.fu-berlin.de (outpost1.zedat.fu-berlin.de [130.133.4.66]) by mx1.freebsd.org (Postfix) with ESMTP id 1D0A38FC19 for ; Tue, 18 Oct 2011 16:50:57 +0000 (UTC) Received: from inpost2.zedat.fu-berlin.de ([130.133.4.69]) by outpost1.zedat.fu-berlin.de (Exim 4.69) with esmtp (envelope-from ) id <1RGCsR-00054M-7c>; Tue, 18 Oct 2011 18:50:55 +0200 Received: from e178042116.adsl.alicedsl.de ([85.178.42.116] helo=thor.walstatt.dyndns.org) by inpost2.zedat.fu-berlin.de (Exim 4.69) with esmtpsa (envelope-from ) id <1RGCsR-0000qg-4L>; Tue, 18 Oct 2011 18:50:55 +0200 Message-ID: <4E9DAE6E.5080809@zedat.fu-berlin.de> Date: Tue, 18 Oct 2011 18:50:54 +0200 From: "Hartmann, O." User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:7.0.1) Gecko/20111013 Thunderbird/7.0.1 MIME-Version: 1.0 To: Urmas Lett References: <4E9D4124.9000307@eenet.ee> <20111018143012.66cdbbf8@nonamehost.> <4E9D6D2C.9060306@eenet.ee> <4161C63AB02B4332864C985BBAEAD8F2@multiplay.co.uk> <4E9D7C63.1090507@eenet.ee> In-Reply-To: <4E9D7C63.1090507@eenet.ee> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Originating-IP: 85.178.42.116 Cc: freebsd-performance@freebsd.org, Steven Hartland Subject: Re: ffmpeg & ULE X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Oct 2011 16:50:57 -0000 On 10/18/11 15:17, Urmas Lett wrote: > On 10/18/2011 3:36 PM, Steven Hartland wrote: >> What happens if you either: >> 1. disable HT in the bios > > Intel says i5-2400 has no HT: > Processor Number i5-2400 > # of Cores 4 > # of Threads 4 That is right. This CPU is purely 4-core with no Intel HTT/SMT. Do not blame the CPU for poor performance. There was another thread regarding poor performance with ULE, I need to look for it. It seems, ULE does have some serious problems and there is no developer available. oh > > and BIOS has no HT disable knob > >> 2. limit the threads to 4? > > ffmpeg -threads 4 (sched_ule): > > real 3m19.379s (with -threads 0 was 2m52.711s) > user 6m50.107s (with -threads 0 was 6m50.310s) > sys 0m1.507s > > top -H: > CPU: 0.0% user, 55.8% nice, 0.4% system, 0.0% interrupt, 43.8% idle > Mem: 136M Active, 884M Inact, 498M Wired, 84K Cache, 409M Buf, 2339M Free > Swap: 4096M Total, 4096M Free > > PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND > 1178 root 52 20 255M 140M uwait 1 1:05 51.17% > ffmpeg{ffmpeg} > 1178 root 103 20 255M 140M CPU0 1 0:59 37.60% > ffmpeg{ffmpeg} > 1178 root 52 20 255M 140M uwait 3 0:59 37.16% > ffmpeg{ffmpeg} > 1178 root 52 20 255M 140M uwait 3 0:59 34.38% > ffmpeg{ffmpeg} > 1178 root 52 20 255M 140M uwait 2 0:54 33.59% > ffmpeg{ffmpeg} > 1178 root 102 20 255M 140M CPU2 0 0:46 32.37% > ffmpeg{ffmpeg} > 1171 root 20 0 67992K 5516K select 2 0:00 0.00% sshd > > > regards, > Urmas Lett > From owner-freebsd-performance@FreeBSD.ORG Tue Oct 18 16:52:57 2011 Return-Path: Delivered-To: freebsd-performance@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 69B311065673 for ; Tue, 18 Oct 2011 16:52:57 +0000 (UTC) (envelope-from ohartman@zedat.fu-berlin.de) Received: from outpost1.zedat.fu-berlin.de (outpost1.zedat.fu-berlin.de [130.133.4.66]) by mx1.freebsd.org (Postfix) with ESMTP id 25B6C8FC0A for ; Tue, 18 Oct 2011 16:52:57 +0000 (UTC) Received: from inpost2.zedat.fu-berlin.de ([130.133.4.69]) by outpost1.zedat.fu-berlin.de (Exim 4.69) with esmtp (envelope-from ) id <1RGCuM-0005Oh-LZ>; Tue, 18 Oct 2011 18:52:54 +0200 Received: from e178042116.adsl.alicedsl.de ([85.178.42.116] helo=thor.walstatt.dyndns.org) by inpost2.zedat.fu-berlin.de (Exim 4.69) with esmtpsa (envelope-from ) id <1RGCuM-0000yL-IT>; Tue, 18 Oct 2011 18:52:54 +0200 Message-ID: <4E9DAEE6.9080608@zedat.fu-berlin.de> Date: Tue, 18 Oct 2011 18:52:54 +0200 From: "Hartmann, O." User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:7.0.1) Gecko/20111013 Thunderbird/7.0.1 MIME-Version: 1.0 To: Ivan Klymenko References: <4E9D4124.9000307@eenet.ee> <12913.3257120431$1318938804@news.gmane.org> <4E9D7880.1030308@FreeBSD.org> <20111018162609.1319eb44@nonamehost.> In-Reply-To: <20111018162609.1319eb44@nonamehost.> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Originating-IP: 85.178.42.116 Cc: freebsd-performance@FreeBSD.org, Andriy Gapon Subject: Re: ffmpeg & ULE X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Oct 2011 16:52:57 -0000 On 10/18/11 15:26, Ivan Klymenko wrote: > Ð’ Tue, 18 Oct 2011 16:00:48 +0300 > Andriy Gapon пишет: > >> on 18/10/2011 14:30 Ivan Klymenko said the following: >>> Ð’ Tue, 18 Oct 2011 12:04:36 +0300 >>> Urmas Lett пишет: >>> >>>> Hello. >>>> >>>> Why is ffmpeg -threads massively slower with ULE than 4BSD? >>>> >>>> ffmpeg preset veryfast with sched_bsd: >>>> real 1m49.407s >>>> user 6m53.932s >>>> sys 0m1.700s >>>> >>>> ffmpeg preset veryfast with sched_ule: >>>> real 2m52.711s >>>> user 6m50.310s >>>> sys 0m1.582s >>>> >>>> #uname -a >>>> FreeBSD 9.0-RC1 FreeBSD 9.0-RC1 #0: Mon Oct 17 20:32:29 EEST >>>> >>>> >>> probably because you have a system processor with 2 cores...? >>> if yes - then use the 4BSD...it is better for the two cores... IMHO >> Do you have any facts to substantiate your claim? >> > well, for example: > http://img37.imageshack.us/img37/9311/plotj.gif > http://img850.imageshack.us/img850/584/plot.gif Thanks a lot for those diagrams. From owner-freebsd-performance@FreeBSD.ORG Tue Oct 18 17:11:43 2011 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id EACB8106566B for ; Tue, 18 Oct 2011 17:11:43 +0000 (UTC) (envelope-from ohartman@zedat.fu-berlin.de) Received: from outpost1.zedat.fu-berlin.de (outpost1.zedat.fu-berlin.de [130.133.4.66]) by mx1.freebsd.org (Postfix) with ESMTP id A47298FC18 for ; Tue, 18 Oct 2011 17:11:43 +0000 (UTC) Received: from inpost2.zedat.fu-berlin.de ([130.133.4.69]) by outpost1.zedat.fu-berlin.de (Exim 4.69) for freebsd-performance@freebsd.org with esmtp (envelope-from ) id <1RGDCY-0008RP-UE>; Tue, 18 Oct 2011 19:11:42 +0200 Received: from e178042116.adsl.alicedsl.de ([85.178.42.116] helo=thor.walstatt.dyndns.org) by inpost2.zedat.fu-berlin.de (Exim 4.69) for freebsd-performance@freebsd.org with esmtpsa (envelope-from ) id <1RGDCY-0002Ek-R8>; Tue, 18 Oct 2011 19:11:42 +0200 Message-ID: <4E9DB34E.1010402@zedat.fu-berlin.de> Date: Tue, 18 Oct 2011 19:11:42 +0200 From: "Hartmann, O." User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:7.0.1) Gecko/20111013 Thunderbird/7.0.1 MIME-Version: 1.0 To: freebsd-performance@freebsd.org References: <4E9D4124.9000307@eenet.ee> <12913.3257120431$1318938804@news.gmane.org> <4E9D7880.1030308@FreeBSD.org> <20111018162609.1319eb44@nonamehost.> <4E9D8747.4020104@FreeBSD.org> <4e9d8ab4.c89aec0a.4216.ffffd1efSMTPIN_ADDED@mx.google.com> In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Originating-IP: 85.178.42.116 Subject: Re: ffmpeg & ULE X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Oct 2011 17:11:44 -0000 On 10/18/11 17:11, Tom Evans wrote: > On Tue, Oct 18, 2011 at 4:02 PM, Adrian Chadd wrote: >> What is FBFS? >> > http://rudot.blog.com/2011/07/13/freebsd-fbfs-live-dvd-image-is-available-now/ > > Cheers > > Tom > _______________________________________________ > freebsd-performance@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-performance > To unsubscribe, send any mail to "freebsd-performance-unsubscribe@freebsd.org" It would be great to see this in 10.0-CURRENT, even if it is marked "highly experimental". Oliver From owner-freebsd-performance@FreeBSD.ORG Tue Oct 18 17:25:43 2011 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CBC16106566B for ; Tue, 18 Oct 2011 17:25:43 +0000 (UTC) (envelope-from fidaj@ukr.net) Received: from fsm2.ukr.net (fsm2.ukr.net [195.214.192.121]) by mx1.freebsd.org (Postfix) with ESMTP id 3C9078FC08 for ; Tue, 18 Oct 2011 17:25:43 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=ukr.net; s=fsm; h=Content-Transfer-Encoding:Content-Type:Mime-Version:References:In-Reply-To:Message-ID:Subject:Cc:To:From:Date; bh=3iEYvWk6exlj/yu3hIqqN70Wx2ByPuEZ+YRV2qeaYzM=; b=bUWveBURfPb+7BSaSeGvB9FEzjxuMSpOOlTQ0O6M1QVZJcjKXrNra4RRx1RFxxECwBnxNlEyO0IrMZGrJoGi42bz3woUaq7k3Mr0CudtqI6dWbdw/i6y1bBmNfCXnyD7reF2+A++8UY5KH7051aJpEe99t/jfxKdpuFTn76My40=; Received: from [81.23.24.110] (helo=nonamehost.) by fsm2.ukr.net with esmtpsa ID 1RGDQ5-0003kr-9N ; Tue, 18 Oct 2011 20:25:41 +0300 Date: Tue, 18 Oct 2011 20:25:14 +0300 From: Ivan Klymenko To: "Hartmann, O." Message-ID: <20111018202514.71ed1b22@nonamehost.> In-Reply-To: <4E9DB34E.1010402@zedat.fu-berlin.de> References: <4E9D4124.9000307@eenet.ee> <12913.3257120431$1318938804@news.gmane.org> <4E9D7880.1030308@FreeBSD.org> <20111018162609.1319eb44@nonamehost.> <4E9D8747.4020104@FreeBSD.org> <4e9d8ab4.c89aec0a.4216.ffffd1efSMTPIN_ADDED@mx.google.com> <4E9DB34E.1010402@zedat.fu-berlin.de> X-Mailer: Claws Mail 3.7.9 (GTK+ 2.22.1; amd64-portbld-freebsd9.0) Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: freebsd-performance@freebsd.org Subject: Re: ffmpeg & ULE X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Oct 2011 17:25:43 -0000 =D0=92 Tue, 18 Oct 2011 19:11:42 +0200 "Hartmann, O." =D0=BF=D0=B8=D1=88=D0=B5=D1=82: > It would be great to see this in 10.0-CURRENT, even if it is marked > "highly experimental". My patch for CURRENT http://pazzle.otdux.com.ua/fbfs_12_8_2011.my.patch From owner-freebsd-performance@FreeBSD.ORG Wed Oct 19 01:20:16 2011 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F3613106564A for ; Wed, 19 Oct 2011 01:20:16 +0000 (UTC) (envelope-from pieter@degoeje.nl) Received: from mx.utwente.nl (mx2.utsp.utwente.nl [130.89.2.13]) by mx1.freebsd.org (Postfix) with ESMTP id 6E9B88FC0C for ; Wed, 19 Oct 2011 01:20:15 +0000 (UTC) Received: from nox-laptop.student.utwente.nl (nox-laptop.student.utwente.nl [130.89.160.140]) by mx.utwente.nl (8.12.10/SuSE Linux 0.7) with ESMTP id p9J0if67021459; Wed, 19 Oct 2011 02:44:41 +0200 From: Pieter de Goeje To: freebsd-performance@freebsd.org Date: Wed, 19 Oct 2011 02:44:41 +0200 User-Agent: KMail/1.9.10 References: <4E9D4124.9000307@eenet.ee> In-Reply-To: <4E9D4124.9000307@eenet.ee> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <201110190244.41301.pieter@degoeje.nl> X-UTwente-MailScanner-Information: Scanned by MailScanner. Contact icts.servicedesk@utwente.nl for more information. X-UTwente-MailScanner: Found to be clean X-UTwente-MailScanner-From: pieter@degoeje.nl X-Spam-Status: No Cc: Urmas Lett Subject: Re: ffmpeg & ULE X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Oct 2011 01:20:17 -0000 On Tuesday 18 October 2011 11:04:36 Urmas Lett wrote: > Hello. > > Why is ffmpeg -threads massively slower with ULE than 4BSD? > > ffmpeg preset veryfast with sched_bsd: > real 1m49.407s > user 6m53.932s > sys 0m1.700s > > ffmpeg preset veryfast with sched_ule: > real 2m52.711s > user 6m50.310s > sys 0m1.582s > > #uname -a > FreeBSD 9.0-RC1 FreeBSD 9.0-RC1 #0: Mon Oct 17 20:32:29 EEST Since no-one has offered any insight about the cause (yet) I'll explain what I think is happening here. SCHED_ULE tries to make threads "sticky" to a certain CPU. This has benefits in the realm of cache utilization and memory locality for NUMA systems. This works great when all running threads do useful work all the time. Not all threads will receive equal amounts of CPU time. SCHED_BSD on the other hand much more aggressively reschedules running threads on other CPUs with no regard for cache locality. This gives all threads an equal share of CPU time. I was unable to (quickly) find out the exact implementation details of multithreaded ffmpeg, but I guess it simply splits up each frame in N equal parts and uses N threads to encode these parts. The master process then probably recombines them into the final frame. Because almost all encodings compress video using the 3rd dimension (time) it must wait for the current frame to finish before it can start encoding the next frame. Thus we end up with a workload like this: split1 -> N x encode1 -> recombine1 -> split2 -> N x encode2 -> recombine2 etc.. This bursty behavior really is no good match for ULE, because it (ffmpeg's master process) assumes equal runtime of all threads. ULE has no time to properly load balance all threads before they die (or stop doing work). You can see clearly in your timings that SCHED_ULE is actually just as fast when we look at the amount of CPU time spent. However, because it is not nearly as aggressive as SCHED_BSD in stealing threads from busy CPUs there is some idle time in there as well. This causes the difference. There are some tunable sysctls (kern.sched.*) that might help in this scenario. I bet if you would run two ffmpeg processes in parallel you'd get about the same runtimes for both schedulers. (Disclaimer: I have collected most of this information from the mailing lists, not the actual code, so I could be completely wrong) -- Pieter de Goeje From owner-freebsd-performance@FreeBSD.ORG Fri Oct 21 06:30:23 2011 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9DB611065765 for ; Fri, 21 Oct 2011 06:30:22 +0000 (UTC) (envelope-from ohartman@zedat.fu-berlin.de) Received: from outpost1.zedat.fu-berlin.de (outpost1.zedat.fu-berlin.de [130.133.4.66]) by mx1.freebsd.org (Postfix) with ESMTP id 769A28FC14 for ; Fri, 21 Oct 2011 06:30:22 +0000 (UTC) Received: from inpost2.zedat.fu-berlin.de ([130.133.4.69]) by outpost1.zedat.fu-berlin.de (Exim 4.69) for freebsd-performance@freebsd.org with esmtp (envelope-from ) id <1RH8cX-0003cr-BI>; Fri, 21 Oct 2011 08:30:21 +0200 Received: from e178022135.adsl.alicedsl.de ([85.178.22.135] helo=thor.walstatt.dyndns.org) by inpost2.zedat.fu-berlin.de (Exim 4.69) for freebsd-performance@freebsd.org with esmtpsa (envelope-from ) id <1RH8cX-0007db-7b>; Fri, 21 Oct 2011 08:30:21 +0200 Message-ID: <4EA1117C.1000509@zedat.fu-berlin.de> Date: Fri, 21 Oct 2011 08:30:20 +0200 From: "Hartmann, O." User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:7.0.1) Gecko/20111019 Thunderbird/7.0.1 MIME-Version: 1.0 To: "freebsd-performance@freebsd.org" Content-Type: text/plain; charset=ISO-8859-15 Content-Transfer-Encoding: 8bit X-Originating-IP: 85.178.22.135 Subject: LLVM/CLANG and several OpenCL projects: FreeBSD or any *BSD developer involved? X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Oct 2011 06:30:23 -0000 As I'm not a developer, but for scientific purposes highly interested in using GPUs, the only way of doing HPC computing at the moment is with nVidias TESLA/nVidia consumer graphics cards and LINUX, since on Linux one willing to use the GPU has the necessary libraries, driver and compilers. I'm hoping that *BSD, at least FreeBSD, is involved in the ongoing development of LLVM and especially CLANG, since I see a great chance to get GPGPU stuff via OpenCL into one of the systems. Today I stumbled, while searching for news regarding to open and free OpenCL/LLVM based implementations into several announcements on Phoronix (see phoronix.com). There are is a very interesting project in Saarbrücken, another has just announced an open and BSD-style licensed library and I hope there are more projects popping up next time. It is awesome how fast now the community is focussing on CLANG and OpenCL. The pitty is all of these projects are highly Linux related and I see not one BSD-like development movement in that part. It seems, as *BSD developers are hiding or being passive waiting for until Linux stuff gets ready and then adapting it. this makes me feel strange, since this is the typical behaviour of always being in "the second row". My question is simple and easy: Is there any *BSD ambition to participate on the development of any free implementation of OpenCL free libraries and, obviously, the more important thing, to implement some kind of kernel facility, the OpenCL stack, into FreeBSD or any *BSD to make the BSD claims loud and clear in the community? For me personally, the situation becomes a little bit unsatisfying, since for my scientific work I drift more and more into Linux, which provides with the very good stuff provided from nVidia OpenCL, compiler and even high performance graphics chips. As I now has to provide also administrative tasks for some Linux systems, I won't go deeper into my resistance having also Linux on my desktop or even as a backbone for my infrastructure. To make is short. Can someone provide informations or some details in how any *BSD developer is, if, involved in the development of an OpenCL stack, free libraries or even OpenCL CLANG frontend/LLVM backend? Are their chances to get also FreeBSD atop the list of GPGPU capable operating systems in a near future? Thanks a lot for your patience and I'd like to apology for bringing up this stuff repeatedly. Oliver From owner-freebsd-performance@FreeBSD.ORG Fri Oct 21 07:17:53 2011 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B32631065673 for ; Fri, 21 Oct 2011 07:17:53 +0000 (UTC) (envelope-from julian@freebsd.org) Received: from vps1.elischer.org (vps1.elischer.org [204.109.63.16]) by mx1.freebsd.org (Postfix) with ESMTP id 9145A8FC15 for ; Fri, 21 Oct 2011 07:17:53 +0000 (UTC) Received: from julian-mac.elischer.org (home-nat.elischer.org [67.100.89.137]) (authenticated bits=0) by vps1.elischer.org (8.14.4/8.14.4) with ESMTP id p9L7HoJJ081069 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Fri, 21 Oct 2011 00:17:52 -0700 (PDT) (envelope-from julian@freebsd.org) Message-ID: <4EA11C99.9060702@freebsd.org> Date: Fri, 21 Oct 2011 00:17:45 -0700 From: Julian Elischer User-Agent: Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10.4; en-US; rv:1.9.2.23) Gecko/20110920 Thunderbird/3.1.15 MIME-Version: 1.0 To: "Hartmann, O." References: <4EA1117C.1000509@zedat.fu-berlin.de> In-Reply-To: <4EA1117C.1000509@zedat.fu-berlin.de> Content-Type: text/plain; charset=ISO-8859-15; format=flowed Content-Transfer-Encoding: 8bit Cc: "freebsd-performance@freebsd.org" Subject: Re: LLVM/CLANG and several OpenCL projects: FreeBSD or any *BSD developer involved? X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Oct 2011 07:17:53 -0000 On 10/20/11 11:30 PM, Hartmann, O. wrote: > As I'm not a developer, but for scientific purposes highly interested in > using GPUs, the only way of doing HPC computing at the moment is with > nVidias TESLA/nVidia consumer graphics cards and LINUX, since on Linux > one willing to use the GPU has the necessary libraries, driver and > compilers. > > I'm hoping that *BSD, at least FreeBSD, is involved in the ongoing > development of LLVM and especially CLANG, since I see a great chance to > get GPGPU stuff via OpenCL into one of the systems. > > Today I stumbled, while searching for news regarding to open and free > OpenCL/LLVM based implementations into several announcements on Phoronix > (see phoronix.com). There are is a very interesting project in > Saarbrücken, another has just announced an open and BSD-style licensed > library and I hope there are more projects popping up next time. It is > awesome how fast now the community is focussing on CLANG and OpenCL. > > The pitty is all of these projects are highly Linux related and I see > not one BSD-like development movement in that part. It seems, as *BSD > developers are hiding or being passive waiting for until Linux stuff > gets ready and then adapting it. this makes me feel strange, since this > is the typical behaviour of always being in "the second row". > > My question is simple and easy: Is there any *BSD ambition to > participate on the development of any free implementation of OpenCL free > libraries and, obviously, the more important thing, to implement some > kind of kernel facility, the OpenCL stack, into FreeBSD or any *BSD to > make the BSD claims loud and clear in the community? > > For me personally, the situation becomes a little bit unsatisfying, > since for my scientific work I drift more and more into Linux, which > provides with the very good stuff provided from nVidia OpenCL, compiler > and even high performance graphics chips. As I now has to provide also > administrative tasks for some Linux systems, I won't go deeper into my > resistance having also Linux on my desktop or even as a backbone for my > infrastructure. > > To make is short. Can someone provide informations or some details in > how any *BSD developer is, if, involved in the development of an OpenCL > stack, free libraries or even OpenCL CLANG frontend/LLVM backend? Are > their chances to get also FreeBSD atop the list of GPGPU capable > operating systems in a near future? The problem is manpower. In any Open Source project, the developers do wha thtey need to be done, and with Linux there is someone interested in working on almost anything you care to imagine. For FreeBSD, there are a lot of people, but there are always going to be things that are covered by Linux that we just don't have people to work on. It IS possible that there are enough people out there in the BSD world intersted enough in this to work on this but they may be doing it on their own for their own reasons. > Thanks a lot for your patience and I'd like to apology for bringing up > this stuff repeatedly. > > Oliver > _______________________________________________ > freebsd-performance@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-performance > To unsubscribe, send any mail to "freebsd-performance-unsubscribe@freebsd.org" > >