From owner-svn-src-head@freebsd.org Thu Dec 31 18:46:38 2015 Return-Path: Delivered-To: svn-src-head@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DDEACA56F39; Thu, 31 Dec 2015 18:46:38 +0000 (UTC) (envelope-from jtl@freebsd.org) Received: from na01-by2-obe.outbound.protection.outlook.com (mail-by2on0142.outbound.protection.outlook.com [207.46.100.142]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "MSIT Machine Auth CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4385119E6; Thu, 31 Dec 2015 18:46:37 +0000 (UTC) (envelope-from jtl@freebsd.org) Received: from SN1PR05CA0034.namprd05.prod.outlook.com (10.163.68.172) by BY1PR0501MB1381.namprd05.prod.outlook.com (10.160.107.139) with Microsoft SMTP Server (TLS) id 15.1.361.13; Thu, 31 Dec 2015 18:32:08 +0000 Received: from BL2FFO11FD048.protection.gbl (2a01:111:f400:7c09::112) by SN1PR05CA0034.outlook.office365.com (2a01:111:e400:5197::44) with Microsoft SMTP Server (TLS) id 15.1.361.13 via Frontend Transport; Thu, 31 Dec 2015 18:32:07 +0000 Authentication-Results: spf=softfail (sender IP is 66.129.239.19) smtp.mailfrom=freebsd.org; optusnet.com.au; dkim=none (message not signed) header.d=none;optusnet.com.au; dmarc=none action=none header.from=freebsd.org; Received-SPF: SoftFail (protection.outlook.com: domain of transitioning freebsd.org discourages use of 66.129.239.19 as permitted sender) Received: from p-emfe01b-sac.jnpr.net (66.129.239.19) by BL2FFO11FD048.mail.protection.outlook.com (10.173.161.210) with Microsoft SMTP Server (TLS) id 15.1.355.15 via Frontend Transport; Thu, 31 Dec 2015 18:32:07 +0000 Received: from magenta.juniper.net (172.17.27.123) by p-emfe01b-sac.jnpr.net (172.24.192.21) with Microsoft SMTP Server (TLS) id 14.3.123.3; Thu, 31 Dec 2015 10:32:06 -0800 Received: from [172.29.33.31] ([172.29.33.31]) by magenta.juniper.net (8.11.3/8.11.3) with ESMTP id tBVIW2D96601; Thu, 31 Dec 2015 10:32:02 -0800 (PST) (envelope-from jtl@freebsd.org) User-Agent: Microsoft-MacOutlook/14.5.9.151119 Date: Thu, 31 Dec 2015 13:32:02 -0500 Subject: Re: svn commit: r292955 - head/lib/libmd From: "Jonathan T. Looney" Sender: Jonathan Looney To: Allan Jude , Bruce Evans CC: , , Message-ID: Thread-Topic: svn commit: r292955 - head/lib/libmd References: <201512301804.tBUI4oGp065466@repo.freebsd.org> <20151231115651.R995@besplex.bde.org> <20151231143314.Y1520@besplex.bde.org> <5684D606.3080609@freebsd.org> In-Reply-To: <5684D606.3080609@freebsd.org> MIME-Version: 1.0 Content-Type: text/plain; charset="US-ASCII" Content-Transfer-Encoding: 7bit X-EOPAttributedMessage: 0 X-Microsoft-Exchange-Diagnostics: 1; BL2FFO11FD048; 1:pKyZDNcYafqHQLYzpB97ZLjnI7FflffRyLWizDVm8cLdDSmiVdrxxmG1Ma5atZQtpQ2/z2Drjd3rFDemVpTF14lWb87tl2rInp5aFVqKbhItLDZbfipE+jJfBaHdDypSAM1soCptsnxRguhtiEid7GwgI8uEF3iv9c3N9RgZRBWA8KGe9iv1MHs8Le+LPxPJ7c6TSqdTsw3LA9kdccjkFL81GRaRCTdsjPAztCAciZMAIJkASLm4eefRbUpH4D+4mQK7Ik9rvnv1hF2SHwWNl6H9xzPdLvfczACpNk6V0TLV78RBtUo+TwJyb+EN+4SPNaRqAFr6qCjy8rDw6pdH2ndTeQibW+Maq0vbTYjYZK7wc3nvjlMPmmiV1zgkQe7/mJhQdvYVB7TKqGEbp31JJg== X-Forefront-Antispam-Report: CIP:66.129.239.19; CTRY:US; IPV:NLI; EFV:NLI; SFV:NSPM; SFS:(10019020)(6009001)(2980300002)(377454003)(189002)(24454002)(199003)(479174004)(4001350100001)(47776003)(2950100001)(230700001)(92566002)(97736004)(46406003)(6806005)(50986999)(50466002)(16796002)(4326007)(5001770100001)(586003)(54356999)(69596002)(23726003)(81156007)(93886004)(76176999)(5001960100002)(1220700001)(83506001)(1096002)(11100500001)(36756003)(189998001)(87936001)(105596002)(575784001)(86362001)(106466001)(77096005)(19580405001)(19580395003)(42262002); DIR:OUT; SFP:1102; SCL:1; SRVR:BY1PR0501MB1381; H:p-emfe01b-sac.jnpr.net; FPR:; SPF:SoftFail; PTR:InfoDomainNonexistent; MX:1; A:1; LANG:en; X-Microsoft-Exchange-Diagnostics: 1; BY1PR0501MB1381; 2:ZvY/hlnq5AkDnmgfDWOSAtwcr7MTFdHfWlJWiqlFuAaVdUuUqoNhuomk58O0cfh876iSE9FFiZ93ernI7XPkHGgsj04U31x2zKArfupjwQKB8dP8N76oe9Ad/9/pdG+d8h1nB4tNwQZMdl6mSlTOKg==; 3:guDUEuc5SzJrecu91DNdThFoKgvHK+ETjYA04ZI9XBw7vR0BYStcb/7OXYVu8eXnWIsm0KDBTqC20CLLw4gaYpNl9FblWws0i/2kxiK/IW9TsSY0L5wywGKGOid+YD0hshI57vRsFJK2wdlbIUn/y6oZsM44qlLIRDtt6p7iYM4DylRZQCk+Y7fnvYd8gJgv+2IuW/7+UV6YgQklHY3a1dLU2GGN3xDQvGxUr4VdyDY=; 25:QN5dlLu5LuJ9VfpvSEY2uXkXHenl3fjBIfMLJNJsfmMGdPt+xRqmzkP5S3nZkgEo5QyE6BFT6k4ETbTI2AfQShfsjRVZVOk8YXlqjpPjNjzAwaZROxwmcNoadyFqzFcdSm46PPcUAfh5Sn0ukW+boePKbdE4PDImUTS0L3kxQ0yyYt9UTAsWW8LyOraerqd3dk1NDpIrSTyAqfGCFHSUD0B6SSl07gLFHtYwGogrZexGc/maWv02EpBGWLp9cS1k6mL1QHnWLM8pYOgHTTW6AA== X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:BY1PR0501MB1381; X-Microsoft-Exchange-Diagnostics: 1; BY1PR0501MB1381; 20:PsTzCi9d/SF6ZiBg6ZVxKQ8VcqMycpbb/Oxidav4VGoqRIImAHIVzaRiTWhr3z2PZDuXfoyyRgHxQFa4zcXLPokSDjefvUg4m27dHPVugSxv4rNUpoxCAH/IbjCRBszzpxn3tEMZjUyapVge7GIQWvVydrFr/kLjYJwJYOvHibI5N05eUnBwOFk7PyTeenCu+Pd0GgTOo4OJ218hpbxsNgz9Q4/RLcSZhWkEdy+irjeu2yLWzoJjxQhv86KCssS82f11yMaMr36KzQXlSwLgmjkIH8UBOQYUeUZNwJV8qPnMrcfV2K/RQcmuPaBaZDLHIZj0Di9mLKNw8dnDZrurFIMNOTOLTCERYm9IbkHpq4E5wV8XlDMifcyAcmL5JZEGmq1492Ge33zjh1WaQYVhBVafE9cJsxWgHr5dgrZRAZkzqxDaPwREJiFe4sMbqTQylCb5if5fOM9bHqOVdjOWacmINCaLOkTMBQPBkn++dKlJv5D4fkZd4trr7ssS+o8s; 4:J+RrDpNJBJZcuX3AqHIodnQJecahVRDXUnK7OOoELa5eXxBAzdZdANxQN3x/ImBNTqIVsVKw2xjRKQlzNdZ6XWbhgviPIsQsHeNOne9qfwYNefK7F1bnbQrIQc61r6Ux0ehsfx8FItLSuOSDAV9Nc+f8Tw0wwdBEw3OJSAP+071izTf3N3gFllmcTldvdnYuGiwMLvmjroum8GnUHPSoa26PlNeFiMYIwzrdq+BpGfMK5Hr0pxTIY/c/1kSqdn2VnBJ86tCkTwz060AcgNNBWh4yHhG8a+gtzK5PKPDIXgsne6CmXJI/l/3/Z0GtXZu7J+xl+v3FSWQMMDEC4RMZA7derA2MHDppaTePq6nQCrCigPInZnobNhV8DKVhik2G X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(601004)(2401047)(8121501046)(520078)(5005006)(10201501046)(3002001); SRVR:BY1PR0501MB1381; BCL:0; PCL:0; RULEID:; SRVR:BY1PR0501MB1381; X-Forefront-PRVS: 08076ABC99 X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1; BY1PR0501MB1381; 23:rltxLYZgfjFcd0YI1O8/arNmk8z9QSezacizPhG?= =?us-ascii?Q?uZyDZAxI/T73ufGdkMtlpZMB4vG2YwsraCwSMo949q2FeKq6CyvT3OBMWAQ1?= =?us-ascii?Q?samSAhqTM+ujX+p6iFscSHTjjr6MJKHE9YCFiIjuLM9l5jl0cDIV7j7Hceql?= =?us-ascii?Q?ZPvfN+4rp6lGsDhBZTwOnTPN02v3SP9bW1bmNkQIpS+Xclrraaac4r7Tu5OH?= =?us-ascii?Q?opua+P5MMk/DIDMsvKIDO0PYsyhEa425y07JAo1W3sxLGyyajHvUChv7ouYc?= =?us-ascii?Q?sCxLLXqzIxZMjTfC47lVlbzh31fW8AQitilBD+PJo4kubriQCsthWRS9mC7h?= =?us-ascii?Q?QgQjfvRXxjLF4j4LQjrVMX5srEwSmNydtMblsgxKixXUOtmQi8uwzeh1kYdS?= =?us-ascii?Q?V84WqocsqtyJQYgJz1aN+8X5h9Jt6AeubTtQLHtMt3G8k2xM54GyAd9IFtLH?= =?us-ascii?Q?B/1nDGHFGiOqkVtCJAOUk1OP7YgZkJqyzLd5orPfI1NvH5MI9vKFT3vIDWqg?= =?us-ascii?Q?0l2nabonQ4jDEccEOcqXT/KgiS4VANOhH5n+dYGoud7kn6wgIQIWhnRm/EX9?= =?us-ascii?Q?sD5vyPpjMua9AJn+yqNcStP2e+8+rejiJ1d7t2gPbmKEiQyqgMbaK0QbYXRm?= =?us-ascii?Q?71/+vJYQxSlBKn0wuQs+U5J+dAZv1iT1KhhZ67d/KobKAn/3tiSIOFDaZKm5?= =?us-ascii?Q?pNAO1UDW9/CDZKgpzwiH2xawB+oZxptoQ5b0s35UizdmVKUhnOKaoBDh06Iw?= =?us-ascii?Q?R9E6Upwo61nsvcxWywsgL1i5GDMVtsxkcW3Rl7JW7/t+leBye7ayrUaWGnGO?= =?us-ascii?Q?PKjz1IJAcfae5EO+UcYfJxrhYn8SmbUInzZ+k2DLlaFuScKTdNth/MBGNckD?= =?us-ascii?Q?ZMWOcsWJIOL7Xjtq1XYTRdMLp0SX/DByoF9RUMcSFdYyDuANWbSS47kXGt9h?= =?us-ascii?Q?S7bxu+Db2S3gpsJ9202OydTvxgKpdS9CUulO9AuQByJ9k+Al7DA8SOJEBwlo?= =?us-ascii?Q?QHqnAmcd5vxQsjSzlIYPHP/NkRwpZg8UguQZpZxvrBWwa/5Gyz+J4q9Xff+B?= =?us-ascii?Q?bFA0IDWShg7soJPifk5bKNcLCMlOXe7/Wc+dDMyjmWPh4J7flFACrBQuhoTt?= =?us-ascii?Q?tmn9eP5mN9nXmXkzIn/Hce+LWnURSjNHX?= X-Microsoft-Exchange-Diagnostics: 1; BY1PR0501MB1381; 5:x+n8do2IKQd/woo0hhgVBy91Wc0oCqgGosFs/o3a1O/Dg/XIyMbvZVjj9aJNAbutDN1XVYxwTanUzDUGA1JI92stXk8nxU5cUhCqKlMRKGG/8MQW6Fae4qZNa2l5mCEcB4nQsNWK2OzjkLBxnAA1lA==; 24:/I/vKTdnRJaIgXrqKsU1aq8HDJxd/VBWC2g8C0GatX44385/hVIFhf/QFU6VuldAGLSljxTIntBdoaEddTj/oA4ZgcR63JniHO5QFdrgG1c= SpamDiagnosticOutput: 1:23 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: juniper.net X-MS-Exchange-CrossTenant-OriginalArrivalTime: 31 Dec 2015 18:32:07.6114 (UTC) X-MS-Exchange-CrossTenant-Id: bea78b3c-4cdb-4130-854a-1d193232e5f4 X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=bea78b3c-4cdb-4130-854a-1d193232e5f4; Ip=[66.129.239.19]; Helo=[p-emfe01b-sac.jnpr.net] X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: BY1PR0501MB1381 X-BeenThere: svn-src-head@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: SVN commit messages for the src tree for head/-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 31 Dec 2015 18:46:39 -0000 On 12/31/15, 2:15 AM, "Allan Jude" wrote: >It seems these problems also slow things down, a lot: > ># time md5 /media/md5test/bigdata >MD5 (/media/md5test/bigdata) = 6afad0bf5d8318093e943229be05be67 >4.310u 3.476s 0:07.79 99.8% 20+167k 0+0io 0pf+0w ># time env LD_PRELOAD=/usr/obj/media/svn/md5/head/tmp/lib/libmd.so >/usr/obj/media/svn/md5/head/sbin/md5/md5 /media/md5test/bigdata >MD5 (/media/md5test/bigdata) = 6afad0bf5d8318093e943229be05be67 >4.133u 0.354s 0:04.49 99.7% 20+167k 1+0io 0pf+0w > >(file is fully cached in ZFS ARC, dd reads it at 11GB/s) > >Will investigate more tomorrow. md5 will be slower than dd due to the extra processing it needs to do to generate the hash. I suspect that explains the difference you're seeing between those utilities. Jonathan