From owner-freebsd-stable@freebsd.org Sun Aug 13 10:09:31 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 85A04DD5134; Sun, 13 Aug 2017 10:09:31 +0000 (UTC) (envelope-from emz@norma.perm.ru) Received: from elf.hq.norma.perm.ru (mail.norma.perm.ru [IPv6:2a00:7540:1::5]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.norma.perm.ru", Issuer "Vivat-Trade UNIX Root CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id EFD45675B5; Sun, 13 Aug 2017 10:09:30 +0000 (UTC) (envelope-from emz@norma.perm.ru) Received: from [IPv6:2a02:2698:26:ba6d:b8c2:5ea7:b69b:1849] (dynamic-2a02-2698-26-0-0.perm.ertelecom.ru [IPv6:2a02:2698:26:ba6d:b8c2:5ea7:b69b:1849] (may be forged)) (authenticated bits=0) by elf.hq.norma.perm.ru (8.15.2/8.15.2) with ESMTPSA id v7DA9Psd036500 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO); Sun, 13 Aug 2017 15:09:25 +0500 (YEKT) (envelope-from emz@norma.perm.ru) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=norma.perm.ru; s=key; t=1502618965; bh=VySA4zhZ8cIn8iDCAv7T+QPVKuUplKPP7uddFkMqSME=; h=Subject:To:Cc:References:From:Date:In-Reply-To; b=GVQIjTlavkVVDMRs5ECS4zaIyDyYO1H23k0y9ZxhMRh8olUlZ14HQ8cIGsTJLDeAi fx5Cycf9RrGGL2hMH5qps1GJwM2nMlvcbEmnF7ZZLEMFWsAoNnTHBpoMm280d9BPj9 N/y1NFgmNDgMKt/Ky/WsEQsOzrk9TiMGW+oipalo= Subject: Re: zfs listing and CPU To: freebsd-fs@freebsd.org Cc: freebsd-stable References: From: "Eugene M. Zheganin" Message-ID: <399c4309-c7a6-a7e9-299f-9675224c090d@norma.perm.ru> Date: Sun, 13 Aug 2017 15:09:23 +0500 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.2.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-GB X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 13 Aug 2017 10:09:31 -0000 Hi, On 12.08.2017 20:50, Paul Kraus wrote: >> On Aug 11, 2017, at 2:28 AM, Eugene M. Zheganin wrote: >> >> Why does the zfs listing eat so much of the CPU ? >> 47114 root 1 20 0 40432K 3840K db->db 4 0:05 26.84% zfs >> 47099 root 1 20 0 40432K 3840K zio->i 17 0:05 26.83% zfs >> 47106 root 1 20 0 40432K 3840K db->db 21 0:05 26.81% zfs >> 47150 root 1 20 0 40432K 3428K db->db 13 0:03 26.31% zfs >> 47141 root 1 20 0 40432K 3428K zio->i 28 0:03 26.31% zfs >> 47135 root 1 20 0 40432K 3312K g_wait 9 0:03 25.51% zfs >> This is from winter 2017 11-STABLE (r310734), one of the 'zfs'es is cloning, and all the others are 'zfs list -t all'. I have like 25 gigs of free RAM, do I have any chance of speeding this up using may be some caching or some sysctl tuning ? We are using a simple ZFS web API that may issue concurrent or sequential listing requests, so as you can see they sometimes do stack. > How many snapshots do you have ? I have only seen this behavior with LOTS (not hundreds, but thousands) of snapshots. [root@san1:~]# zfs list -t snapshot | wc -l 88 > What does your `iostat -x 1` look like ? I expect that you are probably saturating your drives with random I/O. Well, it's really long, and the disks are busy with random i/o indeed, but byst only for 20-30%. As about iostat - it's really long, because I have hundreds (not thousands) of zvols, and they do show up in iostat -x. But nothing unusual besides that. Thanks. Eugene. From owner-freebsd-stable@freebsd.org Sun Aug 13 11:13:24 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 35D0ADD9174; Sun, 13 Aug 2017 11:13:24 +0000 (UTC) (envelope-from tenzin.lhakhang@gmail.com) Received: from mail-wm0-x22d.google.com (mail-wm0-x22d.google.com [IPv6:2a00:1450:400c:c09::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id DB08669DCD; Sun, 13 Aug 2017 11:13:23 +0000 (UTC) (envelope-from tenzin.lhakhang@gmail.com) Received: by mail-wm0-x22d.google.com with SMTP id k20so11309051wmg.0; Sun, 13 Aug 2017 04:13:23 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=sb/SJRa2EAKbfvjv+9OyiiuIyzHrgAXqAYd9b/GNhQ4=; b=X+u+ry9ujs4blAdvjWWf63TW9+wYwKYqo2afC1m5OuuFAZQkqwgnTmAcyJjlT5Kj9a gxXzBi1agZjPwUgi0C98cLl6SkmYHN95+VNFTBzwwkMlZ0hX0LzpmzDgJoEtExMeSN6n 0cSI9X8Y/gryhpPi75HVXdTLCe+QwrgW9YqIJbgtT1JIf+STAJNLj6dxiMFHmZURQ9cq NYYksF4BBzXSNh3zyMKLU6plJ2xmutkG2lgrDzA2fMxeOh+jAlWnsZY/Bc25P9QBPBnt Xo0LgWDYlEq5aGYj1pQFFvFE2OK0IV9evLyts2mxgyEYSGEk0flPMnD6JFwAiivFTuE8 shjg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=sb/SJRa2EAKbfvjv+9OyiiuIyzHrgAXqAYd9b/GNhQ4=; b=gv+PCBSZWHk0+eAkdvA6WxBphBi93D0j05smp48er/Q1uCh5FV8eJ2v2arFtsDMnIr Z81Fcnsb0v+eSwzNBwDjMSUFKgrp5mHLAHTbryGjej+OmlwXelfAjyYE30DF33yUkFdK VGgzwS3nRVwJ+mCaUO9HKBMdaJgiXLoHBUDPwmiHgSNI1kv7TLemODHHKCNBx/otAYHr jaOggGdmtkOfTpMLiuohHXdH1byLHQbV87oZEMCeONirSFl5cwkTE+vGWjFGW4yYAJgs DOvxuOE/PFRaTwGTEx8Gxtt+BICC31RASrdEdqX9Y5ZigHNAZz91hw6yJZu30sA7xBpL wxqg== X-Gm-Message-State: AHYfb5jwcKtFy8+fPRyCdFeSyudJ+R8FT88fuA0jE72rV4sCYZIDUoO3 nz5CjpX8cUmHNTm/eiSLERAoM26myS+8 X-Received: by 10.28.12.201 with SMTP id 192mr2274527wmm.45.1502622801545; Sun, 13 Aug 2017 04:13:21 -0700 (PDT) MIME-Version: 1.0 Received: by 10.223.167.2 with HTTP; Sun, 13 Aug 2017 04:13:20 -0700 (PDT) In-Reply-To: <399c4309-c7a6-a7e9-299f-9675224c090d@norma.perm.ru> References: <399c4309-c7a6-a7e9-299f-9675224c090d@norma.perm.ru> From: Tenzin Lhakhang Date: Sun, 13 Aug 2017 07:13:20 -0400 Message-ID: Subject: Re: zfs listing and CPU To: "Eugene M. Zheganin" Cc: "freebsd-fs@FreeBSD.org" , freebsd-stable Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 13 Aug 2017 11:13:24 -0000 You may want to have an async zfs-get program/script that regularly does a zfs get -Ho and stores then in a local cache (redis or your own program) at a set interval and then the api can hit the cache instead of directly running get or list. - Some silly person will try to benchmark your zfs web-API and overload your server with zfs processes. - Example: let me run [ ab -c 10 -n 10000 http://yourserver/zfs-api/list ] -- Let me run 10 concurrent connection with a total of 10k requests to your api (it's a simple one liner -- people will be tempted to benchmark like this). Example: https://github.com/tlhakhan/ideal-potato/blob/master/zdux/routers/zfs/service.js#L9 - This is a JS example, but you can easily script it or another language (golang) for cache separation and another program for the API. Also, zfs does have a -c property to get cached values -- these values are stored in an internal zfs process cache. The -c doesn't help if you have 1000(0)s of filesystems, a single list can still take minutes. Sending the list is also several megabytes. zfs list -Hrpc -o space zfs get -Hrpc space all - H= no headers - r = recursive - p = machine parseable - c = hit cached entries Fixes: if ok, it may be good to stop the API, kill slowly the zfs list -t all. @ Eugene: - I have seen single zfs list -Ho space -rt all take about 4-5 minutes, on an 8000+ zfs_dataset zpool. --- Notes: my knowledge is from the illumos-zfs man pages but should apply here. On Sun, Aug 13, 2017 at 6:09 AM, Eugene M. Zheganin wrote: > Hi, > > On 12.08.2017 20:50, Paul Kraus wrote: > >> On Aug 11, 2017, at 2:28 AM, Eugene M. Zheganin >>> wrote: >>> >>> Why does the zfs listing eat so much of the CPU ? >>> 47114 root 1 20 0 40432K 3840K db->db 4 0:05 26.84% zfs >>> 47099 root 1 20 0 40432K 3840K zio->i 17 0:05 26.83% zfs >>> 47106 root 1 20 0 40432K 3840K db->db 21 0:05 26.81% zfs >>> 47150 root 1 20 0 40432K 3428K db->db 13 0:03 26.31% zfs >>> 47141 root 1 20 0 40432K 3428K zio->i 28 0:03 26.31% zfs >>> 47135 root 1 20 0 40432K 3312K g_wait 9 0:03 25.51% zfs >>> This is from winter 2017 11-STABLE (r310734), one of the 'zfs'es is >>> cloning, and all the others are 'zfs list -t all'. I have like 25 gigs of >>> free RAM, do I have any chance of speeding this up using may be some >>> caching or some sysctl tuning ? We are using a simple ZFS web API that may >>> issue concurrent or sequential listing requests, so as you can see they >>> sometimes do stack. >>> >> How many snapshots do you have ? I have only seen this behavior with LOTS >> (not hundreds, but thousands) of snapshots. >> > [root@san1:~]# zfs list -t snapshot | wc -l > 88 > >> What does your `iostat -x 1` look like ? I expect that you are probably >> saturating your drives with random I/O. >> > > Well, it's really long, and the disks are busy with random i/o indeed, but > byst only for 20-30%. As about iostat - it's really long, because I have > hundreds (not thousands) of zvols, and they do show up in iostat -x. But > nothing unusual besides that. > > > Thanks. > > Eugene. > > > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > From owner-freebsd-stable@freebsd.org Sun Aug 13 17:24:13 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A9C39DCC42C for ; Sun, 13 Aug 2017 17:24:13 +0000 (UTC) (envelope-from aijazbaig1@gmail.com) Received: from mail-ua0-x22a.google.com (mail-ua0-x22a.google.com [IPv6:2607:f8b0:400c:c08::22a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 64B9877382 for ; Sun, 13 Aug 2017 17:24:13 +0000 (UTC) (envelope-from aijazbaig1@gmail.com) Received: by mail-ua0-x22a.google.com with SMTP id 80so29989026uas.0 for ; Sun, 13 Aug 2017 10:24:13 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=ECUZR4rYySC1i0GWlvCoinnctoS+8mSSvj5n5mTLaCQ=; b=n/qzeWIsflg+4RdIMyugHRZW9m1BGKsit/43+OJFohWpQGuS3kDdT3DaB90U67tH0J DNdJwgU0EcUKNc3QyYHbOTY7JIk/zGwZRgWm0+wNWXBQ8qOubfhG+TRA9uCG/dBXgTkP ge2iGKg5zudqrqExocAKoq8MVHBch+7LT4CtD+tqCJmNmYQolB0sHa/L8G3kFuxGTQnr TEsbeP3X7+BJ4jkbvhR4MCK/rQI1Ufw3HVbJIG82iQA/DBUT4QFEuYi70QYgCM9okbJw evguBPmDlaL8CC5pPgmLOA8aE9GF0S0hap4W6YLHM+1dZulAAFIvDLN9nmwr9Ufw7ZtF PAQw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=ECUZR4rYySC1i0GWlvCoinnctoS+8mSSvj5n5mTLaCQ=; b=JnB7qoDcKrFsam2ZS0ly58i+/ZTEppMP0G7eFFLPU9bMeBM8MeobR05sUDBh1jc4Xk M3XHQhZ+CA/onJwiZTG94Y7nPXLA2gLS7tAUo52M6zkVaDCA1ZU6N+jHWswCegAUW6VE kkecVisiOEr0W2HZ3WpOfm3c7OJcmJFqC8vyllhZn/gnRpmRlQjS27RS3DI19rYKTkVF USFhfsa47zVvmhPoNwl7IwXeqeVg7mvn75A0U8Xuu9MxyeSoMOwb5UmE9bt39uxQsi/O 97ma4UdNLXOCD5Incnhn/+JYtePaBZQbsJxTmoJEdUODFAddPjxReij4FsVec2Zo5VXA ZRGw== X-Gm-Message-State: AHYfb5hgN+aNpNjoPz/z/EXr2bxp5h3xxKswULFIHGhhyy71WmtO2XuR ArI7eyT0AexwT0Onjt0nNndGL8+WuUJv X-Received: by 10.159.62.147 with SMTP id x19mr13156012uai.179.1502645052054; Sun, 13 Aug 2017 10:24:12 -0700 (PDT) MIME-Version: 1.0 Received: by 10.31.55.198 with HTTP; Sun, 13 Aug 2017 10:24:11 -0700 (PDT) From: Aijaz Baig Date: Sun, 13 Aug 2017 22:54:11 +0530 Message-ID: Subject: Error in 'make buildworld' on 10.3 To: freebsd-stable@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 13 Aug 2017 17:24:13 -0000 I am trying to buildworld on 10.3 and I encounter an error: --- _worldtmp --- -------------------------------------------------------------- >>> Rebuilding the temporary build tree -------------------------------------------------------------- rm -rf /mnt/ObjDir/usr/src/tmp rm -rf /mnt/ObjDir/usr/src/lib32 mkdir -p /mnt/ObjDir/usr/src/tmp/lib mkdir -p /mnt/ObjDir/usr/src/tmp/usr mkdir -p /mnt/ObjDir/usr/src/tmp/legacy/bin mkdir -p /mnt/ObjDir/usr/src/tmp/legacy/usr mtree -deU -f /usr/src/etc/mtree/BSD.usr.dist -p /mnt/ObjDir/usr/src/tmp/legacy/usr >/dev/null mtree -deU -f /usr/src/etc/mtree/BSD.groff.dist -p /mnt/ObjDir/usr/src/tmp/legacy/usr >/dev/null mtree -deU -f /usr/src/etc/mtree/BSD.usr.dist -p /mnt/ObjDir/usr/src/tmp/usr >/dev/null mtree -deU -f /usr/src/etc/mtree/BSD.include.dist -p /mnt/ObjDir/usr/src/tmp/usr/include >/dev/null ln -sf /usr/src/sys /mnt/ObjDir/usr/src/tmp --- _legacy --- -------------------------------------------------------------- >>> stage 1.1: legacy release compatibility shims -------------------------------------------------------------- cd /usr/src; MAKEOBJDIRPREFIX=/mnt/ObjDir/usr/src/tmp INSTALL="sh /usr/src/tools/install.sh" PATH=/mnt/ObjDir/usr/src/tmp/legacy/usr/sbin:/mnt/ObjDir/usr/src/tmp/legacy/usr/bin:/mnt/ObjDir/usr/src/tmp/legacy/usr/games:/mnt/ObjDir/usr/src/tmp/legacy/bin:/sbin:/bin:/usr/sbin:/usr/bin WORLDTMP=/mnt/ObjDir/usr/src/tmp VERSION="FreeBSD 10.3-RELEASE amd64 1003000" MAKEFLAGS="-m /usr/src/tools/build/mk -j 4 -J 15,16 -m /usr/src/share/mk" COMPILER_TYPE=clang make -f Makefile.inc1 DESTDIR= BOOTSTRAPPING=1003000 SSP_CFLAGS= -DWITHOUT_HTML -DWITHOUT_INFO -DNO_LINT -DWITHOUT_MAN -DNO_PIC -DNO_PROFILE -DNO_SHARED _BOOTSTRAP_MAKEINFO=yes -DNO_CPU_CFLAGS -DNO_WARNS -DNO_CTF -DEARLY_BUILD -DNO_TESTS legacy --- legacy --- ===> tools/build (obj,includes,depend,all,install) --- obj --- /mnt/ObjDir/usr/src/tmp/usr/src/tools/build created for /usr/src/tools/build --- includes --- ; cd /usr/src/tools/build; make buildincludes; make installincludes --- .depend --- rm -f .depend mkdep -f .depend -a -I/mnt/ObjDir/usr/src/tmp/legacy/usr/include -std=gnu99 /usr/src/tools/build/../../contrib/libc-pwcache/pwcache.c /usr/src/tools/build/../../contrib/libc-pwcache/pwcache.c:82:10: fatal error: 'namespace.h' file not found #include "namespace.h" ^ 1 error generated. mkdep: compile failed *** [.depend] Error code 1 make[3]: stopped in /usr/src/tools/build 1 error make[3]: stopped in /usr/src/tools/build *** [legacy] Error code 2 make[2]: stopped in /usr/src 1 error make[2]: stopped in /usr/src *** [_legacy] Error code 2 make[1]: stopped in /usr/src 1 error make[1]: stopped in /usr/src *** [buildworld] Error code 2 make: stopped in /usr/src 1 error make: stopped in /usr/src What is this error? Am I missing certain header files? Keen to hear -- Best Regards, Aijaz Baig From owner-freebsd-stable@freebsd.org Sun Aug 13 18:25:45 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1DF56DD0A34; Sun, 13 Aug 2017 18:25:45 +0000 (UTC) (envelope-from emz@norma.perm.ru) Received: from elf.hq.norma.perm.ru (mail.norma.perm.ru [IPv6:2a00:7540:1::5]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.norma.perm.ru", Issuer "Vivat-Trade UNIX Root CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 89BA27D9E3; Sun, 13 Aug 2017 18:25:43 +0000 (UTC) (envelope-from emz@norma.perm.ru) Received: from [IPv6:2a02:2698:26:ba6d:b8c2:5ea7:b69b:1849] (dynamic-2a02-2698-26-0-0.perm.ertelecom.ru [IPv6:2a02:2698:26:ba6d:b8c2:5ea7:b69b:1849] (may be forged)) (authenticated bits=0) by elf.hq.norma.perm.ru (8.15.2/8.15.2) with ESMTPSA id v7DIPcfZ058994 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO); Sun, 13 Aug 2017 23:25:38 +0500 (YEKT) (envelope-from emz@norma.perm.ru) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=norma.perm.ru; s=key; t=1502648738; bh=EzrOpIoJuONDvA70FFhY/Lidt4qvvxquAR8qPyJRz8I=; h=Subject:To:Cc:References:From:Date:In-Reply-To; b=tZr4MHnr7MVvBeCars1wCjh9enj1pEaXhEpN0t3yNkrs+tugfPYAVw1HWnU8fEjks jywUijPPD23lpjEYrN4KHR7RNKySriprN3J/RZ1BMXpURJ5IOvahVBHzOiyW+93ggs VqkQzEnxHGztvCSYPcWsNtAM9f7lO6q3js9/HkCg= Subject: Re: zfs listing and CPU To: "freebsd-fs@FreeBSD.org" Cc: freebsd-stable References: <399c4309-c7a6-a7e9-299f-9675224c090d@norma.perm.ru> From: "Eugene M. Zheganin" Message-ID: Date: Sun, 13 Aug 2017 23:25:36 +0500 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.2.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-GB X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 13 Aug 2017 18:25:45 -0000 On 13.08.2017 16:13, Tenzin Lhakhang wrote: > You may want to have an async zfs-get program/script that regularly > does a zfs get -Ho and stores then in a local cache (redis or your own > program) at a set interval and then the api can hit the cache instead > of directly running get or list. I cannot because the cache will become stale on first new entity creation, which happens all the time. > - Some silly person will try to benchmark your zfs web-API and > overload your server with zfs processes. > - Example: let me run [ ab -c 10 -n 10000 http://yourserver/zfs-api/list ] > -- Let me run 10 concurrent connection with a total of 10k requests to > your api (it's a simple one liner -- people will be tempted to > benchmark like this). > > Example: > https://github.com/tlhakhan/ideal-potato/blob/master/zdux/routers/zfs/service.js#L9 > - This is a JS example, but you can easily script it or another > language (golang) for cache separation and another program for the API. > > Also, zfs does have a -c property to get cached values -- these values > are stored in an internal zfs process cache. The -c doesn't help if > you have 1000(0)s of filesystems, a single list can still take > minutes. Sending the list is also several megabytes. Doesn't have on FreeBSD. Thanks. Eugene. From owner-freebsd-stable@freebsd.org Mon Aug 14 02:11:34 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 011BBDC924D for ; Mon, 14 Aug 2017 02:11:34 +0000 (UTC) (envelope-from markmi@dsl-only.net) Received: from asp.reflexion.net (outbound-mail-210-92.reflexion.net [208.70.210.92]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B44DA672D9 for ; Mon, 14 Aug 2017 02:11:33 +0000 (UTC) (envelope-from markmi@dsl-only.net) Received: (qmail 22835 invoked from network); 14 Aug 2017 02:11:31 -0000 Received: from unknown (HELO rtc-sm-01.app.dca.reflexion.local) (10.81.150.1) by 0 (rfx-qmail) with SMTP; 14 Aug 2017 02:11:31 -0000 Received: by rtc-sm-01.app.dca.reflexion.local (Reflexion email security v8.40.2) with SMTP; Sun, 13 Aug 2017 22:11:31 -0400 (EDT) Received: (qmail 25206 invoked from network); 14 Aug 2017 02:11:31 -0000 Received: from unknown (HELO iron2.pdx.net) (69.64.224.71) by 0 (rfx-qmail) with (AES256-SHA encrypted) SMTP; 14 Aug 2017 02:11:31 -0000 Received: from [192.168.1.26] (c-76-115-7-162.hsd1.or.comcast.net [76.115.7.162]) by iron2.pdx.net (Postfix) with ESMTPSA id B274AEC85D5; Sun, 13 Aug 2017 19:11:30 -0700 (PDT) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: UNAME_r () and OSVERSION (1101501) do not agree on major version number , which poudriere bulk rejects as a combination. Message-Id: Date: Sun, 13 Aug 2017 19:11:29 -0700 To: Bryan Drewery , FreeBSD Toolchain , FreeBSD-STABLE Mailing List X-Mailer: Apple Mail (2.3273) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Aug 2017 02:11:34 -0000 The summary: My attempts to use poudriere-devel via a -m null -M /usr/obj/DESTDIRs/FBSDx6411SL-installworld-dist-from-src based jail and a -m null -M /usr/ports based ports=20 got: make: "/usr/ports/Mk/bsd.port.mk" line 1177: UNAME_r () and OSVERSION = (1101501) do not agree on major version number. This suggests that in /usr/ports/Mk/bsd.ports.mk the logic: # Get the architecture .if !defined(ARCH) ARCH!=3D ${UNAME} -p .endif _EXPORTED_VARS+=3D ARCH # Get the operating system type .if !defined(OPSYS) OPSYS!=3D ${UNAME} -s .endif _EXPORTED_VARS+=3D OPSYS .if !defined(_OSRELEASE) _OSRELEASE!=3D ${UNAME} -r .endif _EXPORTED_VARS+=3D _OSRELEASE # Get the operating system revision OSREL?=3D ${_OSRELEASE:C/-.*//} _EXPORTED_VARS+=3D OSREL is not getting the expected values for use in the later logic, in this case _OSRELEASE: .if ${_OSVERSION_MAJOR} !=3D ${_OSRELEASE:R} .error UNAME_r (${_OSRELEASE}) and OSVERSION (${OSVERSION}) do not agree = on major version number. .elif ${_OSVERSION_MAJOR} !=3D ${OSREL:R} .error OSREL (${OSREL}) and OSVERSION (${OSVERSION}) do not agree on = major version number. .endif (The message's reference to UNAME_r also looks odd since it is not used in the .if expression or anywhere nearby but there is such a name in the login.conf default .) A testing hack of: # svnlite diff /usr/ports/Mk/bsd.port.mk = = =20 Index: /usr/ports/Mk/bsd.port.mk =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D --- /usr/ports/Mk/bsd.port.mk (revision 447897) +++ /usr/ports/Mk/bsd.port.mk (working copy) @@ -1119,18 +1119,18 @@ =20 # Get the architecture .if !defined(ARCH) -ARCH!=3D ${UNAME} -p +ARCH!=3D echo amd64 .endif _EXPORTED_VARS+=3D ARCH =20 # Get the operating system type .if !defined(OPSYS) -OPSYS!=3D ${UNAME} -s +OPSYS!=3D echo FreeBSD .endif _EXPORTED_VARS+=3D OPSYS =20 .if !defined(_OSRELEASE) -_OSRELEASE!=3D ${UNAME} -r +_OSRELEASE!=3D echo 11.1-STABLE .endif _EXPORTED_VARS+=3D _OSRELEASE got past the specific issue. But it later got: /usr/local/share/poudriere/bulk.sh: cannot open = /usr/local/etc/poudriere.d/jails/zrFBSDx64SLjail/version: No such file = or directory via: [00:00:00] Creating the reference jail... done [00:00:04] Mounting system devices for zrFBSDx64SLjail-default [00:00:04] Mounting ports/packages/distfiles [00:00:04] Using packages from previously failed build [00:00:04] Mounting packages from: = /usr/local/poudriere/data/packages/zrFBSDx64SLjail-default /etc/resolv.conf -> = /usr/local/poudriere/data/.m/zrFBSDx64SLjail-default/ref/etc/resolv.conf [00:00:04] Starting jail zrFBSDx64SLjail-default [00:00:05] Logs: = /usr/local/poudriere/data/logs/bulk/zrFBSDx64SLjail-default/2017-08-13_18h= 39m47s [00:00:06] Loading MOVED [00:00:06] Ports supports: DEPENDS_ARGS SELECTED_OPTIONS [00:00:06] Gathering ports metadata [00:06:18] Calculating ports order and dependencies [00:09:13] pkg package missing, skipping sanity [00:09:13] Skipping incremental rebuild and repository sanity checks [00:09:13] Cleaning the build queue [00:09:13] Sanity checking build queue [00:09:16] Processing PRIORITY_BOOST [00:09:24] Balancing pool /usr/local/share/poudriere/bulk.sh: cannot open = /usr/local/etc/poudriere.d/jails/zrFBSDx64SLjail/version: No such file = or directory # ls -lT /usr/local/etc/poudriere.d/jails/zrFBSDx64SLjail/ total 3 -rw-r--r-- 1 root wheel 6 Aug 13 17:30:39 2017 arch -rw-r--r-- 1 root wheel 5 Aug 13 17:30:39 2017 method -rw-r--r-- 1 root wheel 57 Aug 13 17:30:39 2017 mnt -rw-r--r-- 1 root wheel 9 Aug 13 17:30:39 2017 srcpath -rw-r--r-- 1 root wheel 11 Aug 13 17:30:39 2017 timestamp (I've not tracked this part down at all yet.) More details on the sequence I went through: I installed FreeBSD-11.1-STABLE-amd64-20170807-r322164-disc1.iso into a new VirtualBox virtual machine and then checked out: # svnlite info /usr/src/ | grep "Re[plv]" Relative URL: ^/stable/11 Repository Root: svn://svn.freebsd.org/base Repository UUID: ccf9f872-aa2e-dd11-9fc8-001c23d0bc1f Revision: 322433 Last Changed Rev: 322433 and did buildworld buildkernel installkernel installworld . I also then installed this ( installworld distrib-dirs distribution ) to: # ls -dlT /usr/obj/DESTDIRs/* drwxr-xr-x 18 root wheel 22 Aug 13 17:28:54 2017 = /usr/obj/DESTDIRs/FBSDx6411SL-installworld-dist-from-src The result for uname is: # uname -apKU FreeBSD FBSDx6411SL 11.1-STABLE FreeBSD 11.1-STABLE r322433 amd64 = amd64 1101501 1101501 # uname -r 11.1-STABLE I used pkg to install poudriere-devel : # pkg info poudriere-devel poudriere-devel-3.1.99.20170803 Name : poudriere-devel Version : 3.1.99.20170803 Installed on : Sun Aug 13 16:08:56 2017 PDT Origin : ports-mgmt/poudriere-devel Architecture : FreeBSD:11:amd64 Prefix : /usr/local Categories : ports-mgmt Licenses : BSD2CLAUSE Maintainer : bdrewery@FreeBSD.org WWW : https://github.com/freebsd/poudriere/wiki Comment : Port build and test system Options : EXAMPLES : on QEMU : off ZSH : on Annotations : repo_type : binary repository : FreeBSD Flat size : 2.09MiB Description : poudriere is a tool primarily designed to test package production on FreeBSD. However, most people will find it useful to bulk build ports for FreeBSD. WWW: https://github.com/freebsd/poudriere/wiki I tried to configure and use a -m null -M /usr/obj/DESTDIRs/FBSDx6411SL-installworld-dist-from-src based jail and a -m null -M /usr/ports based ports . . . This leads to my attempted poudriere bulk after configuring doing the following: [00:00:00] Creating the reference jail... done [00:00:04] Mounting system devices for zrFBSDx64SLjail-default [00:00:04] Mounting ports/packages/distfiles [00:00:04] Converting package repository to new format [00:00:04] Stashing existing package repository [00:00:04] Mounting packages from: = /usr/local/poudriere/data/packages/zrFBSDx64SLjail-default /etc/resolv.conf -> = /usr/local/poudriere/data/.m/zrFBSDx64SLjail-default/ref/etc/resolv.conf [00:00:04] Starting jail zrFBSDx64SLjail-default make: "/usr/ports/Mk/bsd.port.mk" line 1177: UNAME_r () and OSVERSION = (1101501) do not agree on major version number. [00:00:05] Logs: = /usr/local/poudriere/data/logs/bulk/zrFBSDx64SLjail-default/2017-08-13_17h= 45m28s [00:00:05] Loading MOVED make: "/usr/ports/Mk/bsd.port.mk" line 1177: UNAME_r () and OSVERSION = (1101501) do not agree on major version number. [00:00:06] Error: Error looking up pre-build ports vars [00:00:06] Cleaning up [00:00:09] Unmounting file systems And at this point we are to what I put in the summary. =3D=3D=3D Mark Millard markmi at dsl-only.net From owner-freebsd-stable@freebsd.org Mon Aug 14 03:28:04 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5499FDCE3E2 for ; Mon, 14 Aug 2017 03:28:04 +0000 (UTC) (envelope-from prvs=03993fbaa3=ari@ish.com.au) Received: from fish.ish.com.au (ip-2.ish.com.au [203.29.62.2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 1FE896A272 for ; Mon, 14 Aug 2017 03:28:03 +0000 (UTC) (envelope-from prvs=03993fbaa3=ari@ish.com.au) Received: from ip-136.ish.com.au ([203.29.62.136]:63740) by fish.ish.com.au with esmtpsa (TLSv1.2:AES128-SHA:128) (Exim 4.82_1-5b7a7c0-XX) (envelope-from ) id 1dh60Z-0004tb-0K for freebsd-stable@freebsd.org; Mon, 14 Aug 2017 13:25:39 +1000 X-CTCH-RefID: str=0001.0A150203.59911833.0048:SCFSTAT42589845, ss=1, re=-4.000, recu=0.000, reip=0.000, cl=1, cld=1, fgs=0 To: freebsd-stable From: Aristedes Maniatis Subject: TSC timekeeping and cpu states Message-ID: Date: Mon, 14 Aug 2017 13:25:38 +1000 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:56.0) Gecko/20100101 Thunderbird/56.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Language: en-AU Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Aug 2017 03:28:04 -0000 I note that in FreeBSD 11, we now have this: # grep performance_cx_lowest /etc/defaults/rc.conf performance_cx_lowest="C2" # Online CPU idle state However this wiki page suggests that C1 is the default https://wiki.freebsd.org/TuningPowerConsumption Are these inconsistent? I went looking for this because I've been having trouble with the TSC-low timecounter hardware choice and my system clock running at about 80% of normal speed. Moving to ACPI-fast solved this problem. Could the power saving CPU states be related to this problem, or should I look elsewhere for the TSC issue? This is a server, not a laptop. Thanks Ari -- --------------------------> Aristedes Maniatis CEO, ish https://www.ish.com.au GPG fingerprint CBFB 84B4 738D 4E87 5E5C 5EFA EF6A 7D2E 3E49 102A From owner-freebsd-stable@freebsd.org Mon Aug 14 05:08:33 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A6FC0DD47E3 for ; Mon, 14 Aug 2017 05:08:33 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: from mail-ua0-x233.google.com (mail-ua0-x233.google.com [IPv6:2607:f8b0:400c:c08::233]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 642DF6D039 for ; Mon, 14 Aug 2017 05:08:33 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: by mail-ua0-x233.google.com with SMTP id w45so32803695uac.5 for ; Sun, 13 Aug 2017 22:08:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc; bh=n6szXHBmvRfI9Qq82Nt8sBJ88QAbAcxvymlPy9Fs4nA=; b=oDKC3keFv/4SbadgusoI9X1w3SbTBfqkMeY2OFbXftiP5JOKQgE05Syzn5PlYgUQwj +P3zOPiPKB5M8zCzHCTdJupXznGycLnV68cc5UdhXKfMN4+riNu8xCxAMRbm2XA2jx8Y coKAk1hzBY2ZFFckT6bZpbToL5GDPRgfgw+GOJQcT1Xl4kJbYgbHcaZ89LjTqMOJC5Ta ALh0cxiTtUXq1k4HnlwJzlSIGuwePxncMT9pfjBJNtMIjk8RG24tyV26A0j8gu/Fkmk8 surx4PpY20btIPHWx2L2K2gUwqGCjJgi+n+6G3a1X9EIqn+IRwpvSBEtLxZAlwIXkBq/ 6R1A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to:cc; bh=n6szXHBmvRfI9Qq82Nt8sBJ88QAbAcxvymlPy9Fs4nA=; b=kP1KwirRsUXjU2SDrlUgATYatLS+GjaFed2Efucsgg7OskEsIPE+JHkoY4cOrLD4BP vjWTxa6H35IxhJNjU3XnuRScMf0qRUFbv9624ZHR1Q7Hvvt2Fe/fY5SgMieGydVMNL4M ZgMUQpUGeJr5k0AXIXxjdciBEy4laVtHhxl3zY9XBkvA05a+Y/KYD6dqY5oNS1kaU0jL yJGXmEqC9mITrC4otazPFMv8keWerZvwqEvtU4uh7H0mk9e7LtqER77NBOYRD9qufl7g h6gTCba7jWsfra8nbe0NtveroNAPJFPSAlSR19D9UQmQnOhZoCivM8ZBTgq/8pnbG8f5 x7ZA== X-Gm-Message-State: AHYfb5hgPiTu5J/me1zO8QqVaprvlACBipX/FRRFC3Q0g4Nl+F1H4y8k VOFnLBxgeEJLJPWOLprgq2yGiSftcWj7VLM= X-Received: by 10.176.80.193 with SMTP id d1mr16264230uaa.124.1502687312419; Sun, 13 Aug 2017 22:08:32 -0700 (PDT) MIME-Version: 1.0 Sender: kob6558@gmail.com Received: by 10.103.76.143 with HTTP; Sun, 13 Aug 2017 22:08:31 -0700 (PDT) In-Reply-To: References: From: Kevin Oberman Date: Sun, 13 Aug 2017 22:08:31 -0700 X-Google-Sender-Auth: 1hrdrvuMvU9433HsnEKm0UCy7-U Message-ID: Subject: Re: TSC timekeeping and cpu states To: Aristedes Maniatis Cc: freebsd-stable Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Aug 2017 05:08:33 -0000 On Sun, Aug 13, 2017 at 8:25 PM, Aristedes Maniatis wrote: > I note that in FreeBSD 11, we now have this: > > # grep performance_cx_lowest /etc/defaults/rc.conf > performance_cx_lowest="C2" # Online CPU idle state > > However this wiki page suggests that C1 is the default > > https://wiki.freebsd.org/TuningPowerConsumption > > > Are these inconsistent? > > > I went looking for this because I've been having trouble with the TSC-low > timecounter hardware choice and my system clock running at about 80% of > normal speed. Moving to ACPI-fast solved this problem. > > Could the power saving CPU states be related to this problem, or should I > look elsewhere for the TSC issue? > > This is a server, not a laptop. > > > Thanks > Ari > > > > -- > --------------------------> > Aristedes Maniatis > CEO, ish > https://www.ish.com.au > GPG fingerprint CBFB 84B4 738D 4E87 5E5C 5EFA EF6A 7D2E 3E49 102A > Again, the documentation lags reality. The default was changed for 11.0. It is still conservative. In ALMOST all cases, Cmax will yield the bast results. However, on large systems with many cores, Cmax will trigger very poor results, so the default is C2, just to be safe. As far as possible TSC impact, I think older processors had TSC issues when not all cores ran with the same clock speed. That said, I am not remotely expert on such issues, so don't take this too seriously. -- Kevin Oberman, Part time kid herder and retired Network Engineer E-mail: rkoberman@gmail.com PGP Fingerprint: D03FB98AFA78E3B78C1694B318AB39EF1B055683 From owner-freebsd-stable@freebsd.org Mon Aug 14 07:16:34 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C5C79DD9BC6 for ; Mon, 14 Aug 2017 07:16:34 +0000 (UTC) (envelope-from prvs=03993fbaa3=ari@ish.com.au) Received: from fish.ish.com.au (ip-2.ish.com.au [203.29.62.2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8EC9071344 for ; Mon, 14 Aug 2017 07:16:33 +0000 (UTC) (envelope-from prvs=03993fbaa3=ari@ish.com.au) Received: from ip-136.ish.com.au ([203.29.62.136]:64855) by fish.ish.com.au with esmtpsa (TLSv1.2:AES128-SHA:128) (Exim 4.82_1-5b7a7c0-XX) (envelope-from ) id 1dh9bq-0001MZ-0f; Mon, 14 Aug 2017 17:16:22 +1000 X-CTCH-RefID: str=0001.0A150205.59914E46.0061:SCFSTAT42589845, ss=1, re=-4.000, recu=0.000, reip=0.000, cl=1, cld=1, fgs=0 Subject: Re: TSC timekeeping and cpu states To: Kevin Oberman Cc: freebsd-stable References: From: Aristedes Maniatis Message-ID: <2ef99f5e-46f5-a185-2ac3-67d6afe68c89@ish.com.au> Date: Mon, 14 Aug 2017 17:16:22 +1000 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:56.0) Gecko/20100101 Thunderbird/56.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-AU Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Aug 2017 07:16:34 -0000 On 14/8/17 3:08PM, Kevin Oberman wrote: > Again, the documentation lags reality. The default was changed for 11.0. It is still conservative. In ALMOST all cases, Cmax will yield the bast results. However, on large systems with many cores, Cmax will trigger very poor results, so the default is C2, just to be safe. > > As far as possible TSC impact, I think older processors had TSC issues when not all cores ran with the same clock speed. That said, I am not remotely expert on such issues, so don't take this too seriously. Thanks Kevin What does 'large' and 'many cores' mean here? Is 24 cores large or small? For a server do we ever want the CPU to enter states other than C1? Ari -- --------------------------> Aristedes Maniatis CEO, ish https://www.ish.com.au GPG fingerprint CBFB 84B4 738D 4E87 5E5C 5EFA EF6A 7D2E 3E49 102A From owner-freebsd-stable@freebsd.org Mon Aug 14 08:34:06 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7DADCDDCD2B for ; Mon, 14 Aug 2017 08:34:06 +0000 (UTC) (envelope-from tsuroerusu@gmail.com) Received: from mail-ua0-x232.google.com (mail-ua0-x232.google.com [IPv6:2607:f8b0:400c:c08::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 492B2733DB for ; Mon, 14 Aug 2017 08:34:06 +0000 (UTC) (envelope-from tsuroerusu@gmail.com) Received: by mail-ua0-x232.google.com with SMTP id f9so34111503uaf.4 for ; Mon, 14 Aug 2017 01:34:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=4EgrZjB9LIfJGaro/5UBIdvf80YKaOdCBJV3icnOr+c=; b=C6UhRfFVXIutChgGCMURc66VoTZsO48bgx5K7+SsTf7VQHWmBIOMnktVhDEDAIG411 Dv997DxKB3FiB80j8s2XKRwc2FdGVCRXNWvhkC90hIbOokGfrUozszMMLSApEP9kDK+k EcxVgpTH+5E8TgrG0Rx14AdpEUbD2Onk7OmxCXLs/4JwqT0uCE8QIYhj9EAuuJIDZ4V9 YqoXmc8JmAA6ochfZLbtJgr1lal4wSjOnJ5UQRaVkft4Y1cjF5BOwlBRi67lVekn+Wqc s1fi6zW9UGgWxfy0iDw/KSGQv1v1PXY14AoGpKuEyGj2/DIHqTa8NsadegdsaCu3VqjI V4tw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=4EgrZjB9LIfJGaro/5UBIdvf80YKaOdCBJV3icnOr+c=; b=U8e2oUlSdE77vhNK8JdxcSWFXV9xxxv1BCkM+D5GLQAq9yB0914qlKUO3BK7B7mpqq wIb3f4F4fbj3BT+3d4Ns/2QPX6rzkAsqoS8M7AmvqssGTmaOYb3tLpNVoMb/ZCuUK/nH Y65Qcf79eGDKXEyfdJQBCBCb105bzq/vh27NpDHMdAQYq797npHUf8BJbst7kj3IGOkc 12WyC823iujLJm7t2EXMwNfVNKcLltqA1qsWDJWIYtjrRIjYMFKE/GLQQHIWRGyGFced fHVQqltMBNjrZFi/J+romGGs5+iZLdtVdnbTMnha516OKxQLdfjco4lW2fxDJQpwJcVZ phRg== X-Gm-Message-State: AHYfb5hCIbdLD5OWAHMWXDbPZRwzgxFmXKqT8s2C3m9cXLPD3As38YR6 arrW51ZbzO/Z+7WIPNEfkpI1lXH55cbA X-Received: by 10.176.73.194 with SMTP id f2mr17537849uad.140.1502699644993; Mon, 14 Aug 2017 01:34:04 -0700 (PDT) MIME-Version: 1.0 Received: by 10.31.157.79 with HTTP; Mon, 14 Aug 2017 01:34:04 -0700 (PDT) From: tsuroerusu@gmail.com Date: Mon, 14 Aug 2017 10:34:04 +0200 Message-ID: Subject: nullfs making contents of ZFS datasets invisible even after unmounting To: freebsd-stable@freebsd.org Content-Type: text/plain; charset="UTF-8" X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Aug 2017 08:34:06 -0000 I am running a FreeBSD 11.1 system with ZFS and jails and I mount a file system on my storage pool (/storage/cloud) into the jail (/jails/cloud/storage) via nullfs, and that works fine for what the jail does. However I just noticed that outside the jail, I can only see the mount points of the file system children, but not the contents. For example if I do: ls -la /storage/cloud/* (As root) then nothing shows up, but they are present inside the jail. Even if I stop the jail, they still are not present outside the jail. I just tried disabling jails in /etc/rc.conf and rebooting the system and EVEN THEN the files do not reappear outside the jail in their original location, yet zfs list reports the space being used. But if I then (without rebooting) enable the jail, the files show up in the nullfs-mounted location inside the jail! As an experiment, I tried creating /mnt/test and /mnt/test2 and creates a folder and a few files in test, and then nullfs-mounted it onto test2, and I could then see the files in both locations. Does anybody know what might be causing this? The fact that my data stays hidden after a reboot is rather worrisome. From owner-freebsd-stable@freebsd.org Mon Aug 14 11:15:11 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C0321DE3B24; Mon, 14 Aug 2017 11:15:11 +0000 (UTC) (envelope-from tenzin.lhakhang@gmail.com) Received: from mail-wr0-x22e.google.com (mail-wr0-x22e.google.com [IPv6:2a00:1450:400c:c0c::22e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5C51177DAD; Mon, 14 Aug 2017 11:15:11 +0000 (UTC) (envelope-from tenzin.lhakhang@gmail.com) Received: by mail-wr0-x22e.google.com with SMTP id y41so8774914wrd.3; Mon, 14 Aug 2017 04:15:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=oX3ioggygsDcsNUW6QE0FYMIBCQkF6IxPhYSCCQoaGA=; b=sRmBm5fQn7YGyz+581g3//62tgjCsjH9Fgo4GLgD1QnwxoNQnSssT7bbPGmKsf5StB 1HQd1c6hS9XSWBtr5yIZ1A6f3M5uIeMBtK5ohHRYm+Y/KvCWjX0WchGyv3tGhbYyP8De XsPVP0iLW5sfapxB7HEZsMY3Ev4642qw54twCmxME+BMP+m8fLtTZWSvyJpqx3Xuk8d4 N1pLFMTHWpczxnixoMGhtSQYeiADRsiqz3Q2IclMpK2sV8i8HJAUq7xNIQcDYg8RyK9h bk30igYQHUgfAvF00GxQHeE5LK61sspC8kRVz8T0ZjAjX5NCdsgjioWyf1T8TjjyMcU/ yYbg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=oX3ioggygsDcsNUW6QE0FYMIBCQkF6IxPhYSCCQoaGA=; b=g6boV2I/u7pUeUrmUBnVbD2vc8Qz0rfWqf+80lNqP8uddHxxPFWntrsemz5C1Ma/wM Nt4Vyc9nC+/GwNHmGZRXE3moPF4DuZO4ED4ReCdd2CaFns4KC9GRqpflUIiAaFTSGn9l 58to7Butk04T4KgAf2fLU8/+eMcJHpnn5+ZZqfhcadZz3q+Vw1z1ka40s1Lrov+/gjoV Rr2+AZjolEK9t0smtti2wFNNTdizTGwG+uFfaGnhZVGZo99byQJKwcVJH9gtV51zVV2z FMVNEOPwgByTEdl50UUU0rRNF2ejlrpP2iqG3eTAIFxi+Y2qfS9LaQ+dIxdk573QtBLg GheQ== X-Gm-Message-State: AHYfb5jX4i8yN5/EISE063AgxQrl/cMDQoVhVHmq51+qjg3EYhjNQrcl u4R5DemaVBbBseBq1gYsquxZGEpxRND0 X-Received: by 10.223.186.130 with SMTP id p2mr1598413wrg.151.1502709308743; Mon, 14 Aug 2017 04:15:08 -0700 (PDT) MIME-Version: 1.0 Received: by 10.223.167.2 with HTTP; Mon, 14 Aug 2017 04:15:07 -0700 (PDT) In-Reply-To: References: <399c4309-c7a6-a7e9-299f-9675224c090d@norma.perm.ru> From: Tenzin Lhakhang Date: Mon, 14 Aug 2017 07:15:07 -0400 Message-ID: Subject: Re: zfs listing and CPU To: "Eugene M. Zheganin" Cc: "freebsd-fs@FreeBSD.org" , freebsd-stable Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Aug 2017 11:15:11 -0000 Interesting, even the illumos man page doesn't have the -c defined. I remember reading about it at one point. I can only get `zfs get -Hrpc all` working, even though -c is not documented. So, I retract my statement on the zfs list with cached. # zfs get -*Hpc* -o property,value name,used,avail zones name zones used 1219313598464 available 761203195904 # I use the above way to create easily parseable zfs_dataset objects. As for needing immediate/latest version of zfs list on entity creation -- you ideally want a way to do cache invalidation or use some sort of message/event driven system between the client that creates the entity and the server. You can perform the cache invalidation by monitoring the 'creation' events that come to your API, or by tailing zpool history [pool] for changes. - I recently read this article and they show a nice way to decouple the storage events and the api, architecture is not entirely new but can be adapted to your case. - https://medium.freecodecamp.org/million-websockets-and-go-cc58418460bb Thanks, Tenzin On Sun, Aug 13, 2017 at 2:25 PM, Eugene M. Zheganin wrote: > On 13.08.2017 16:13, Tenzin Lhakhang wrote: > >> You may want to have an async zfs-get program/script that regularly does >> a zfs get -Ho and stores then in a local cache (redis or your own program) >> at a set interval and then the api can hit the cache instead of directly >> running get or list. >> > I cannot because the cache will become stale on first new entity creation, > which happens all the time. > > - Some silly person will try to benchmark your zfs web-API and overload >> your server with zfs processes. >> - Example: let me run [ ab -c 10 -n 10000 http://yourserver/zfs-api/list >> ] >> -- Let me run 10 concurrent connection with a total of 10k requests to >> your api (it's a simple one liner -- people will be tempted to benchmark >> like this). >> >> Example: >> https://github.com/tlhakhan/ideal-potato/blob/master/zdux/ro >> uters/zfs/service.js#L9 >> - This is a JS example, but you can easily script it or another language >> (golang) for cache separation and another program for the API. >> >> Also, zfs does have a -c property to get cached values -- these values >> are stored in an internal zfs process cache. The -c doesn't help if you >> have 1000(0)s of filesystems, a single list can still take minutes. >> Sending the list is also several megabytes. >> > Doesn't have on FreeBSD. > > > > Thanks. > Eugene. > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > From owner-freebsd-stable@freebsd.org Mon Aug 14 12:07:46 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DE1A8DC2836 for ; Mon, 14 Aug 2017 12:07:46 +0000 (UTC) (envelope-from tsuroerusu@gmail.com) Received: from mail-vk0-x232.google.com (mail-vk0-x232.google.com [IPv6:2607:f8b0:400c:c05::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 987E97E2FF for ; Mon, 14 Aug 2017 12:07:46 +0000 (UTC) (envelope-from tsuroerusu@gmail.com) Received: by mail-vk0-x232.google.com with SMTP id j189so30702077vka.0 for ; Mon, 14 Aug 2017 05:07:46 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=DWKYB4RTBKuL+8bRkalrsduMiCE7ysLiY46MzgJVgvU=; b=FAQdy6ZbcRu9FEQNCrknBPvXbDby4GGsSaMItZenrH8JrH3A9Zx/T25SM6rCn0gPYs xtPnoeIyPLcmq4BijWmC+CpO9MNcFSV3l46v8eqSdWKK4g6w2biZnn6kKn/N2RMohEoJ f3Yz6Ga5ghx2Vmegk7gk9dpVekpCLJZ7vUBgl316VZntiTqhda1iosV2in3B53tx8Y3p ntcv2kGzvVRKGKNmwI0Ayky+mY7CkiwS3fe/+rOkFDOtMoU0SOgwmMy1OebFdgAWRB0T I9OqU2SuM+LJbnLUxx4mavit4410cwpmprKvEkrPUGvlW5GEoU8yae9R97aLHWC7uqeK 4MWg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=DWKYB4RTBKuL+8bRkalrsduMiCE7ysLiY46MzgJVgvU=; b=nNf85yCWsoI5psY0rQIv5rI2geGqldyO82fdIF1PDtzQn3r+JvU6bK1D6XSDxLmP3z 7Msre2YU3GFwAwu28KHr1ciVtj6TnPPFBSipBT87Qs4D72M1JfzVqresF0rbi7MZcwy+ ndjVD5cc/vljNDd21MYPF+5nrJCA87biCcDe2DQ1Nf8Ass1RQog3X9OqRbqQsnVAYGRS s6GLQ/3UNGGrIJgb6MJcK1QLeqCDZSiOiAX/UMKoETFxXqrm00U86olO9wePhYS/CCYU vsn1OybeANOGRYJ39QIQk3AVGsnUojhzTE00z9moHtgS6r1jppvFQuaFzoF1Yg3k+FRp V+xg== X-Gm-Message-State: AHYfb5iUSYWGu3XLJpM7svmsolxo4T2E//Ffhc80/+wJnxAATSTDp8py N4TIE39Pq8+IJLmOMnmdOzpYO3cZtigs X-Received: by 10.31.213.70 with SMTP id m67mr6714470vkg.144.1502712465428; Mon, 14 Aug 2017 05:07:45 -0700 (PDT) MIME-Version: 1.0 Received: by 10.31.157.79 with HTTP; Mon, 14 Aug 2017 05:07:44 -0700 (PDT) In-Reply-To: References: From: tsuroerusu@gmail.com Date: Mon, 14 Aug 2017 14:07:44 +0200 Message-ID: Subject: Re: nullfs making contents of ZFS datasets invisible even after unmounting To: freebsd-stable@freebsd.org Content-Type: text/plain; charset="UTF-8" X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Aug 2017 12:07:47 -0000 With a little bit of help, I managed to figure out what the problem was. It turned out that I had run, head first, into the wall of nullfs not operating across file systems. Thus inside the jail, the data was being saved to a regular directory on my "storage/cloud"-dataset (Mountpoint: /storage/cloud), whereas outside the jail the child file system "storage/cloud/bc", having been left empty, was mounted over the folder "bc" on "storage/cloud", where the files actually resided, thus "hiding" them from view outside the jail. A simple "zfs unmount storage/cloud/bc" revealed them. Anybody reading this in the future: If you are using ZFS and want to put a file system and all of its children into a jail then you cannot use nullfs. Instead you need to either change the actual mount point using "zfs set mountpoint=/jails/jail1/storage storage/path/to/filesystem" or to attach the entire dataset to the jail, and allow it to be managed from within the jail using "zfs jail". 2017-08-14 10:34 GMT+02:00 : > I am running a FreeBSD 11.1 system with ZFS and jails and I mount a > file system on my storage pool (/storage/cloud) into the jail > (/jails/cloud/storage) via nullfs, and that works fine for what the > jail does. However I just noticed that outside the jail, I can only > see the mount points of the file system children, but not the > contents. > > For example if I do: ls -la /storage/cloud/* (As root) then nothing > shows up, but they are present inside the jail. Even if I stop the > jail, they still are not present outside the jail. > > I just tried disabling jails in /etc/rc.conf and rebooting the system > and EVEN THEN the files do not reappear outside the jail in their > original location, yet zfs list reports the space being used. But if I > then (without rebooting) enable the jail, the files show up in the > nullfs-mounted location inside the jail! > > As an experiment, I tried creating /mnt/test and /mnt/test2 and > creates a folder and a few files in test, and then nullfs-mounted it > onto test2, and I could then see the files in both locations. > > Does anybody know what might be causing this? The fact that my data > stays hidden after a reboot is rather worrisome. From owner-freebsd-stable@freebsd.org Mon Aug 14 13:18:17 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 72B30DC67EC for ; Mon, 14 Aug 2017 13:18:17 +0000 (UTC) (envelope-from gjb@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [96.47.72.132]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4C7B080CB2; Mon, 14 Aug 2017 13:18:17 +0000 (UTC) (envelope-from gjb@FreeBSD.org) Received: from FreeBSD.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by freefall.freebsd.org (Postfix) with ESMTPS id 3FE1E1C4ED; Mon, 14 Aug 2017 13:18:16 +0000 (UTC) (envelope-from gjb@FreeBSD.org) Date: Mon, 14 Aug 2017 13:18:14 +0000 From: Glen Barber To: Bryce Edwards Cc: "freebsd-stable@freebsd.org" Subject: Re: Error in /usr/src/release/release.sh Message-ID: <20170814131814.GB14627@FreeBSD.org> References: MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="WhfpMioaduB5tiZL" Content-Disposition: inline In-Reply-To: X-Operating-System: FreeBSD 11.0-STABLE amd64 X-SCUD-Definition: Sudden Completely Unexpected Dataloss X-SULE-Definition: Sudden Unexpected Learning Event X-PEKBAC-Definition: Problem Exists, Keyboard Between Admin/Computer X-Spidey-Sense: Uh oh, Peter logged in User-Agent: Mutt/1.8.2 (2017-04-18) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Aug 2017 13:18:17 -0000 --WhfpMioaduB5tiZL Content-Type: text/plain; charset=us-ascii Content-Disposition: inline On Sat, Aug 12, 2017 at 05:12:02PM +0000, Bryce Edwards wrote: > When trying to build a set of RELENG/11.1 release files, I'm getting the > following error (tail end of output) in the release.sh run: > -------------------------------------------------------------- > >>> Kernel build for ALLWINNER completed on Fri Aug 11 22:24:02 UTC 2017 > -------------------------------------------------------------- > make -C /usr/src/release obj > make -C /usr/src/release ftp > `ftp' is up to date. This makes me think a populated release directory within ${.OBJDIR} (i.e., /usr/obj/usr/src/release) already existed (perhaps from a previous 11.1-RELEASE build?). Could you retry after moving the release directory in the obj tree out of the way? Everything from your release.conf looks sane otherwise. Glen --WhfpMioaduB5tiZL Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEjRJAPC5sqwhs9k2jAxRYpUeP4pMFAlmRoxEACgkQAxRYpUeP 4pMYew//dkm6fhwJ0gMtjopaQVR3Bwg+H5feplmLS2kpWSX/bjzgLiES98zo+SNg r5l9Uplw1tTvZZNuB7aLE/F62HwFLVWEFwhQkUZQA+m978IAB8x3rxgv+EWGDL1+ P7I0/CGoONG6vHEGU5uNFytT4On2T8SShtvN9/YAlVzv6IzA7gQYxIegfyBDxlyH 6dsicR29qxMKZJO6ZKQilt11GQ4IIx33pndY+2ZIT5I5IgN7gruhT7No8ML3a1V8 g+4hc860DO1kFIIR/iZPpbALv/UNJDzdiWMpdw9Mt3n7lvA+wXYUbMv+/GazTACT w/Bn/3sjnuhuxvp0HgOMtt6aWV5a9uoWmO13zfL3lPMj8tonrxNa7Tdb2mfqdj2c bDWzgTeFj2p0OfQ6FaIqIY88MwHfRz58+mzqXGf4X2eKPsorR0a1IA2zMDKxVp/8 Um6n/h4gzOz8MyJlghUrZoueMvZBNSi54o9KlKv7ya1TZ5143YBlEPXvODlAfgJL xfzdIcJq72O+hBaNmsD5Xyh5Bg8kd97t72z/IYmigR2AqLRRKtolm+ZyA4TDBLbD 4XQCvQtk4kM+Q9I0sOs2wT+HLM/9R4gIuzpDdv9+xp5J+dsi1OQE7xCKKF8glJKV cXYdsyId2m6HVw+STcRhb1G8iQGfNGlHTdtXUr4cUwxobDFiJls= =uO8R -----END PGP SIGNATURE----- --WhfpMioaduB5tiZL-- From owner-freebsd-stable@freebsd.org Mon Aug 14 13:23:07 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EA95DDC6D59 for ; Mon, 14 Aug 2017 13:23:07 +0000 (UTC) (envelope-from gjb@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [96.47.72.132]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C5191810DD; Mon, 14 Aug 2017 13:23:07 +0000 (UTC) (envelope-from gjb@FreeBSD.org) Received: from FreeBSD.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by freefall.freebsd.org (Postfix) with ESMTPS id CB6431C5AF; Mon, 14 Aug 2017 13:23:06 +0000 (UTC) (envelope-from gjb@FreeBSD.org) Date: Mon, 14 Aug 2017 13:23:05 +0000 From: Glen Barber To: Bryce Edwards Cc: "freebsd-stable@freebsd.org" Subject: Re: Error in /usr/src/release/release.sh Message-ID: <20170814132305.GC14627@FreeBSD.org> References: <20170814131814.GB14627@FreeBSD.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="uh9ZiVrAOUUm9fzH" Content-Disposition: inline In-Reply-To: <20170814131814.GB14627@FreeBSD.org> X-Operating-System: FreeBSD 11.0-STABLE amd64 X-SCUD-Definition: Sudden Completely Unexpected Dataloss X-SULE-Definition: Sudden Unexpected Learning Event X-PEKBAC-Definition: Problem Exists, Keyboard Between Admin/Computer X-Spidey-Sense: Uh oh, Peter logged in User-Agent: Mutt/1.8.2 (2017-04-18) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Aug 2017 13:23:08 -0000 --uh9ZiVrAOUUm9fzH Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Aug 14, 2017 at 01:18:14PM +0000, Glen Barber wrote: > On Sat, Aug 12, 2017 at 05:12:02PM +0000, Bryce Edwards wrote: > > When trying to build a set of RELENG/11.1 release files, I'm getting the > > following error (tail end of output) in the release.sh run: > > -------------------------------------------------------------- > > >>> Kernel build for ALLWINNER completed on Fri Aug 11 22:24:02 UTC 2017 > > -------------------------------------------------------------- > > make -C /usr/src/release obj > > make -C /usr/src/release ftp > > `ftp' is up to date. >=20 > This makes me think a populated release directory within ${.OBJDIR} > (i.e., /usr/obj/usr/src/release) already existed (perhaps from > a previous 11.1-RELEASE build?). >=20 > Could you retry after moving the release directory in the obj tree out > of the way? Everything from your release.conf looks sane otherwise. >=20 Actually, at second look, it seems you are missing EMBEDDEDBUILD=3D1 in your release.conf. arm/armv6 targets should not create the 'ftp' directory - the SoC u-boot loader address is baked in during the world build, making it infeasible to create the ftp bits. Glen --uh9ZiVrAOUUm9fzH Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEjRJAPC5sqwhs9k2jAxRYpUeP4pMFAlmRpDkACgkQAxRYpUeP 4pNUyw/9EDd0gx4IRJtPVxNIC3QJCdJa+u9G71Kfmk3TLn/L30vBk3bqctjHl13/ rIbmH0eB4Yyp9W5eUInvA7m2WMru8NlX6wzv6bspUEzKTomtoReh4Y8Iquofkik7 rAmAr67ZEmu91b+Qg3gYEDleGByG0zKX11sAb7Vj8DmboIXbIXjKYHOAixqRLtH/ LPvfRCStnFQ+L/Ux+g98ohLY/vk06GZzrLhweddOo3wyo8b6//lZd/RNfP6hAKWc RM6Fu5NKOZjXnPrRgsssRPPkVUxhJyxnTUORUGkoLwHvS82F0iEi1KJzruVCJVCw 1901kaskpuY8F+vKHCYBgufJJIQS0nOWFHVHBdLg9M+p4a7IhMsNG6RAexoczImE EtU1aQFnyIdwLrRIPcBeNWMTpMN+AOpDkiHA29hpYFWrTloVO3zaiHYSUcBgtdXA iJKlJjB7efleaqILJeX91RhhF4w2yQF6LLY8wphN+ZYwLtpiJkD6HDT48gSkaiTB umuskpmTpSUQ2mZvaGUxQ6OuvYze2486JYwGkkxp6ww2FUmI1zF/HhwFJAJAghLU KIk2hnDu5Mg9aoL/lA9wRhPwg1iocfucFcK9NjS3pj98jNVeJfAhHkLyZm5hzUGE 4ctXdGOVAwrx+4RyrpX04tPHvtxBOoRsBM8yjyk/JwEqehl8JQ0= =icvX -----END PGP SIGNATURE----- --uh9ZiVrAOUUm9fzH-- From owner-freebsd-stable@freebsd.org Mon Aug 14 14:27:09 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 42FC6DCBBD7 for ; Mon, 14 Aug 2017 14:27:09 +0000 (UTC) (envelope-from ian@freebsd.org) Received: from bat.oak.relay.mailchannels.net (bat.oak.relay.mailchannels.net [23.83.215.13]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id DFA638442E for ; Mon, 14 Aug 2017 14:27:08 +0000 (UTC) (envelope-from ian@freebsd.org) X-Sender-Id: _forwarded-from|73.78.92.27 Received: from relay.mailchannels.net (localhost [127.0.0.1]) by relay.mailchannels.net (Postfix) with ESMTP id A80FA1097FA for ; Mon, 14 Aug 2017 14:27:06 +0000 (UTC) Received: from outbound1a.eu.mailhop.org (unknown [100.96.140.177]) (Authenticated sender: duocircle) by relay.mailchannels.net (Postfix) with ESMTPA id 15548109551 for ; Mon, 14 Aug 2017 14:27:05 +0000 (UTC) X-Sender-Id: _forwarded-from|73.78.92.27 Received: from outbound1a.eu.mailhop.org (outbound1a.eu.mailhop.org [172.20.110.49]) (using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384) by 0.0.0.0:2500 (trex/5.9.10); Mon, 14 Aug 2017 14:27:06 +0000 X-MC-Relay: Junk X-MailChannels-SenderId: _forwarded-from|73.78.92.27 X-MailChannels-Auth-Id: duocircle X-Language-Arithmetic: 022590607ebe49cc_1502720826534_1536341506 X-MC-Loop-Signature: 1502720826534:1402064837 X-MC-Ingress-Time: 1502720826533 X-MHO-User: a2322bf9-80fc-11e7-83af-a91f44540cb3 X-Report-Abuse-To: https://support.duocircle.com/support/solutions/articles/5000540958-duocircle-standard-smtp-abuse-information X-Originating-IP: 73.78.92.27 X-Mail-Handler: DuoCircle Outbound SMTP Received: from ilsoft.org (unknown [73.78.92.27]) by outbound1.eu.mailhop.org (Halon) with ESMTPSA id a2322bf9-80fc-11e7-83af-a91f44540cb3; Mon, 14 Aug 2017 14:27:01 +0000 (UTC) Received: from rev (rev [172.22.42.240]) by ilsoft.org (8.15.2/8.15.2) with ESMTP id v7EEQxEY008226; Mon, 14 Aug 2017 08:26:59 -0600 (MDT) (envelope-from ian@freebsd.org) Message-ID: <1502720819.26153.2.camel@freebsd.org> Subject: Re: Error in /usr/src/release/release.sh From: Ian Lepore To: Glen Barber , Bryce Edwards Cc: "freebsd-stable@freebsd.org" Date: Mon, 14 Aug 2017 08:26:59 -0600 In-Reply-To: <20170814132305.GC14627@FreeBSD.org> References: <20170814131814.GB14627@FreeBSD.org> <20170814132305.GC14627@FreeBSD.org> Content-Type: text/plain; charset="ISO-8859-1" X-Mailer: Evolution 3.18.5.1 FreeBSD GNOME Team Port Mime-Version: 1.0 Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Aug 2017 14:27:09 -0000 On Mon, 2017-08-14 at 13:23 +0000, Glen Barber wrote: > On Mon, Aug 14, 2017 at 01:18:14PM +0000, Glen Barber wrote: > >=20 > > On Sat, Aug 12, 2017 at 05:12:02PM +0000, Bryce Edwards wrote: > > >=20 > > > When trying to build a set of RELENG/11.1 release files, I'm > > > getting the > > > following error (tail end of output) in the release.sh run: > > > -------------------------------------------------------------- > > > >=20 > > > > >=20 > > > > > >=20 > > > > > > Kernel build for ALLWINNER completed on Fri Aug 11 22:24:02 > > > > > > UTC 2017 > > > -------------------------------------------------------------- > > > make -C /usr/src/release=A0=A0obj > > > make -C /usr/src/release=A0=A0ftp > > > `ftp' is up to date. > > This makes me think a populated release directory within ${.OBJDIR} > > (i.e., /usr/obj/usr/src/release) already existed (perhaps from > > a previous 11.1-RELEASE build?). > >=20 > > Could you retry after moving the release directory in the obj tree > > out > > of the way?=A0=A0Everything from your release.conf looks sane > > otherwise. > >=20 > Actually, at second look, it seems you are missing EMBEDDEDBUILD=3D1 in > your release.conf.=A0=A0arm/armv6 targets should not create the 'ftp' > directory - the SoC u-boot loader address is baked in during the > world > build, making it infeasible to create the ftp bits. >=20 > Glen >=20 Except the u-boot loader address hasn't actually been used for about 2 years in arm builds. =A0I don't know anything about this ftp stuff or what this thread is about, but I do know that UBLDR_LOADADDR is no longer used in arm builds, and thus should not be preventing anything else from working. -- Ian From owner-freebsd-stable@freebsd.org Mon Aug 14 14:34:47 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 766CADCC32C for ; Mon, 14 Aug 2017 14:34:47 +0000 (UTC) (envelope-from gjb@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [96.47.72.132]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 50FAC84915; Mon, 14 Aug 2017 14:34:47 +0000 (UTC) (envelope-from gjb@FreeBSD.org) Received: from FreeBSD.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by freefall.freebsd.org (Postfix) with ESMTPS id 6C0A01DDDF; Mon, 14 Aug 2017 14:34:46 +0000 (UTC) (envelope-from gjb@FreeBSD.org) Date: Mon, 14 Aug 2017 14:34:44 +0000 From: Glen Barber To: Ian Lepore Cc: Bryce Edwards , "freebsd-stable@freebsd.org" Subject: Re: Error in /usr/src/release/release.sh Message-ID: <20170814143444.GE14627@FreeBSD.org> References: <20170814131814.GB14627@FreeBSD.org> <20170814132305.GC14627@FreeBSD.org> <1502720819.26153.2.camel@freebsd.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="8vCeF2GUdMpe9ZbK" Content-Disposition: inline In-Reply-To: <1502720819.26153.2.camel@freebsd.org> X-Operating-System: FreeBSD 11.0-STABLE amd64 X-SCUD-Definition: Sudden Completely Unexpected Dataloss X-SULE-Definition: Sudden Unexpected Learning Event X-PEKBAC-Definition: Problem Exists, Keyboard Between Admin/Computer X-Spidey-Sense: Uh oh, Peter logged in User-Agent: Mutt/1.8.2 (2017-04-18) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Aug 2017 14:34:47 -0000 --8vCeF2GUdMpe9ZbK Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Aug 14, 2017 at 08:26:59AM -0600, Ian Lepore wrote: > On Mon, 2017-08-14 at 13:23 +0000, Glen Barber wrote: > > On Mon, Aug 14, 2017 at 01:18:14PM +0000, Glen Barber wrote: > > >=20 > > > On Sat, Aug 12, 2017 at 05:12:02PM +0000, Bryce Edwards wrote: > > > >=20 > > > > When trying to build a set of RELENG/11.1 release files, I'm > > > > getting the > > > > following error (tail end of output) in the release.sh run: > > > > -------------------------------------------------------------- > > > > >=20 > > > > > >=20 > > > > > > >=20 > > > > > > > Kernel build for ALLWINNER completed on Fri Aug 11 22:24:02 > > > > > > > UTC 2017 > > > > -------------------------------------------------------------- > > > > make -C /usr/src/release=A0=A0obj > > > > make -C /usr/src/release=A0=A0ftp > > > > `ftp' is up to date. > > > This makes me think a populated release directory within ${.OBJDIR} > > > (i.e., /usr/obj/usr/src/release) already existed (perhaps from > > > a previous 11.1-RELEASE build?). > > >=20 > > > Could you retry after moving the release directory in the obj tree > > > out > > > of the way?=A0=A0Everything from your release.conf looks sane > > > otherwise. > > >=20 > > Actually, at second look, it seems you are missing EMBEDDEDBUILD=3D1 in > > your release.conf.=A0=A0arm/armv6 targets should not create the 'ftp' > > directory - the SoC u-boot loader address is baked in during the > > world > > build, making it infeasible to create the ftp bits. > >=20 > > Glen > >=20 >=20 > Except the u-boot loader address hasn't actually been used for about 2 > years in arm builds. =A0I don't know anything about this ftp stuff or > what this thread is about, but I do know that UBLDR_LOADADDR is no > longer used in arm builds, and thus should not be preventing anything > else from working. >=20 Hmm, I thought UBLDR_LOADADDR was still used. Good to know. Regarding ftp, the "big-iron" builds create a ftp directory as part of the release target, which contains the distribution sets used by various things such as bootonly.iso and poudriere. That said, should we now expect that a userland build between all arm/armv6 SoCs to be identical (modulo any baked-in timestamps)? Glen --8vCeF2GUdMpe9ZbK Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEjRJAPC5sqwhs9k2jAxRYpUeP4pMFAlmRtQQACgkQAxRYpUeP 4pM2uQ/+LCk3cTGLLRA+tSlFlMU8XFwD8/yNj+nzsHwJOhsvRNpJNXSkRcGNsdsb 0UNJmbyeABTUNHgY3hdMHeXuQeh1x8T/K0WD+QlNnBacAP1/RoG9Lcp4GkHAiBib TeRTMdiGyTSB7HudXigHv1tl0GOinZ3FYSGvDC6lK9+nZC2yv9USe/63bN6ANktM p5mWayd6A/v6S4b86s4PrpRXuk+BhJXARBj1CteaogZtUs2Eabs+GncdY19thNFc Oi7vn52XpD/PJ6RGSDkWsdwT5Zffdk5+rvH8AP1sRFlNbzHRr7QYW94b3zsTpUCs Gyb2lzZ59b9P+6J/oS1VjpJ3UvxPZVz4UkrBL87YXvAI3AxUWO/+QrLVvk/Xtu2N msCGtm3xzYkNWudQFo//LcnHbY4foB/AOsyyYimE/3kGOIRynA7XewRDV84WnCZz aSd/cMIkVe/TaQvsGUSfoQH01y/Pbioxzqhe2M9fuWIZnBEEkAsSptWM2nhGggbp ni6FYZgRmTUWGP23VMUbHIoafD+IG/8wbPKttZLnNOIrotkpAjDnhUbt+6VbpU7p qUMb5Hw0eWvlRkIoHz3huolT+m/fWq8Mesbt50UNauxuw9rH9GV79wnEXV9uB941 XLVIC2CyIpKd1yhk9D25S8ZQ61VN3/NtJmR5d+if/824vm2bxcI= =sJdb -----END PGP SIGNATURE----- --8vCeF2GUdMpe9ZbK-- From owner-freebsd-stable@freebsd.org Mon Aug 14 15:12:07 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EE84FDCFACE for ; Mon, 14 Aug 2017 15:12:07 +0000 (UTC) (envelope-from ian@freebsd.org) Received: from outbound1b.ore.mailhop.org (outbound1b.ore.mailhop.org [54.200.247.200]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D0F661901 for ; Mon, 14 Aug 2017 15:12:07 +0000 (UTC) (envelope-from ian@freebsd.org) X-MHO-User: ef6057a9-8102-11e7-950d-03a3531dacf2 X-Report-Abuse-To: https://support.duocircle.com/support/solutions/articles/5000540958-duocircle-standard-smtp-abuse-information X-Originating-IP: 73.78.92.27 X-Mail-Handler: DuoCircle Outbound SMTP Received: from ilsoft.org (unknown [73.78.92.27]) by outbound1.ore.mailhop.org (Halon) with ESMTPSA id ef6057a9-8102-11e7-950d-03a3531dacf2; Mon, 14 Aug 2017 15:12:06 +0000 (UTC) Received: from rev (rev [172.22.42.240]) by ilsoft.org (8.15.2/8.15.2) with ESMTP id v7EFC4kL008292; Mon, 14 Aug 2017 09:12:04 -0600 (MDT) (envelope-from ian@freebsd.org) Message-ID: <1502723524.26153.4.camel@freebsd.org> Subject: Re: Error in /usr/src/release/release.sh From: Ian Lepore To: Glen Barber Cc: "freebsd-stable@freebsd.org" , Bryce Edwards Date: Mon, 14 Aug 2017 09:12:04 -0600 In-Reply-To: <20170814143444.GE14627@FreeBSD.org> References: <20170814131814.GB14627@FreeBSD.org> <20170814132305.GC14627@FreeBSD.org> <1502720819.26153.2.camel@freebsd.org> <20170814143444.GE14627@FreeBSD.org> Content-Type: text/plain; charset="ISO-8859-1" X-Mailer: Evolution 3.18.5.1 FreeBSD GNOME Team Port Mime-Version: 1.0 Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Aug 2017 15:12:08 -0000 On Mon, 2017-08-14 at 14:34 +0000, Glen Barber wrote: > On Mon, Aug 14, 2017 at 08:26:59AM -0600, Ian Lepore wrote: > > > > On Mon, 2017-08-14 at 13:23 +0000, Glen Barber wrote: > > > > > > On Mon, Aug 14, 2017 at 01:18:14PM +0000, Glen Barber wrote: > > > > > > > > > > > > On Sat, Aug 12, 2017 at 05:12:02PM +0000, Bryce Edwards wrote: > > > > > > > > > > > > > > > When trying to build a set of RELENG/11.1 release files, I'm > > > > > getting the > > > > > following error (tail end of output) in the release.sh run: > > > > > ----------------------------------------------------------- > > > > > --- > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Kernel build for ALLWINNER completed on Fri Aug 11 > > > > > > > > 22:24:02 > > > > > > > > UTC 2017 > > > > > ----------------------------------------------------------- > > > > > --- > > > > > make -C /usr/src/release  obj > > > > > make -C /usr/src/release  ftp > > > > > `ftp' is up to date. > > > > This makes me think a populated release directory within > > > > ${.OBJDIR} > > > > (i.e., /usr/obj/usr/src/release) already existed (perhaps from > > > > a previous 11.1-RELEASE build?). > > > > > > > > Could you retry after moving the release directory in the obj > > > > tree > > > > out > > > > of the way?  Everything from your release.conf looks sane > > > > otherwise. > > > > > > > Actually, at second look, it seems you are missing > > > EMBEDDEDBUILD=1 in > > > your release.conf.  arm/armv6 targets should not create the 'ftp' > > > directory - the SoC u-boot loader address is baked in during the > > > world > > > build, making it infeasible to create the ftp bits. > > > > > > Glen > > > > > Except the u-boot loader address hasn't actually been used for > > about 2 > > years in arm builds.  I don't know anything about this ftp stuff or > > what this thread is about, but I do know that UBLDR_LOADADDR is no > > longer used in arm builds, and thus should not be preventing > > anything > > else from working. > > > Hmm, I thought UBLDR_LOADADDR was still used.  Good to know. > > Regarding ftp, the "big-iron" builds create a ftp directory as part > of > the release target, which contains the distribution sets used by > various > things such as bootonly.iso and poudriere. > > That said, should we now expect that a userland build between all > arm/armv6 SoCs to be identical (modulo any baked-in timestamps)? > > Glen > Hrm.  Well apparently, UBLDR_LOADADDR is no longer needed, but it is still used when building ubldr (not ubldr.bin), and some old uboot scripts still refer to ubldr.  So we've got to clean those up before we can finish eliminating UBLDR_LOADADDR. -- Ian From owner-freebsd-stable@freebsd.org Mon Aug 14 15:15:14 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3AF97DCFF16 for ; Mon, 14 Aug 2017 15:15:14 +0000 (UTC) (envelope-from gjb@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [96.47.72.132]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 146131C97; Mon, 14 Aug 2017 15:15:14 +0000 (UTC) (envelope-from gjb@FreeBSD.org) Received: from FreeBSD.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by freefall.freebsd.org (Postfix) with ESMTPS id 373631E4C1; Mon, 14 Aug 2017 15:15:13 +0000 (UTC) (envelope-from gjb@FreeBSD.org) Date: Mon, 14 Aug 2017 15:15:11 +0000 From: Glen Barber To: Ian Lepore Cc: "freebsd-stable@freebsd.org" , Bryce Edwards Subject: Re: Error in /usr/src/release/release.sh Message-ID: <20170814151511.GF14627@FreeBSD.org> References: <20170814131814.GB14627@FreeBSD.org> <20170814132305.GC14627@FreeBSD.org> <1502720819.26153.2.camel@freebsd.org> <20170814143444.GE14627@FreeBSD.org> <1502723524.26153.4.camel@freebsd.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="gneEPciiIl/aKvOT" Content-Disposition: inline In-Reply-To: <1502723524.26153.4.camel@freebsd.org> X-Operating-System: FreeBSD 11.0-STABLE amd64 X-SCUD-Definition: Sudden Completely Unexpected Dataloss X-SULE-Definition: Sudden Unexpected Learning Event X-PEKBAC-Definition: Problem Exists, Keyboard Between Admin/Computer X-Spidey-Sense: Uh oh, Peter logged in User-Agent: Mutt/1.8.2 (2017-04-18) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Aug 2017 15:15:14 -0000 --gneEPciiIl/aKvOT Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Aug 14, 2017 at 09:12:04AM -0600, Ian Lepore wrote: > On Mon, 2017-08-14 at 14:34 +0000, Glen Barber wrote: > > On Mon, Aug 14, 2017 at 08:26:59AM -0600, Ian Lepore wrote: > > >=20 > > > On Mon, 2017-08-14 at 13:23 +0000, Glen Barber wrote: > > > >=20 > > > > On Mon, Aug 14, 2017 at 01:18:14PM +0000, Glen Barber wrote: > > > > >=20 > > > > >=20 > > > > > On Sat, Aug 12, 2017 at 05:12:02PM +0000, Bryce Edwards wrote: > > > > > >=20 > > > > > >=20 > > > > > > When trying to build a set of RELENG/11.1 release files, I'm > > > > > > getting the > > > > > > following error (tail end of output) in the release.sh run: > > > > > > ----------------------------------------------------------- > > > > > > --- > > > > > > >=20 > > > > > > >=20 > > > > > > > >=20 > > > > > > > >=20 > > > > > > > > >=20 > > > > > > > > >=20 > > > > > > > > > Kernel build for ALLWINNER completed on Fri Aug 11 > > > > > > > > > 22:24:02 > > > > > > > > > UTC 2017 > > > > > > ----------------------------------------------------------- > > > > > > --- > > > > > > make -C /usr/src/release=A0=A0obj > > > > > > make -C /usr/src/release=A0=A0ftp > > > > > > `ftp' is up to date. > > > > > This makes me think a populated release directory within > > > > > ${.OBJDIR} > > > > > (i.e., /usr/obj/usr/src/release) already existed (perhaps from > > > > > a previous 11.1-RELEASE build?). > > > > >=20 > > > > > Could you retry after moving the release directory in the obj > > > > > tree > > > > > out > > > > > of the way?=A0=A0Everything from your release.conf looks sane > > > > > otherwise. > > > > >=20 > > > > Actually, at second look, it seems you are missing > > > > EMBEDDEDBUILD=3D1 in > > > > your release.conf.=A0=A0arm/armv6 targets should not create the 'ft= p' > > > > directory - the SoC u-boot loader address is baked in during the > > > > world > > > > build, making it infeasible to create the ftp bits. > > > >=20 > > > > Glen > > > >=20 > > > Except the u-boot loader address hasn't actually been used for > > > about 2 > > > years in arm builds. =A0I don't know anything about this ftp stuff or > > > what this thread is about, but I do know that UBLDR_LOADADDR is no > > > longer used in arm builds, and thus should not be preventing > > > anything > > > else from working. > > >=20 > > Hmm, I thought UBLDR_LOADADDR was still used.=A0=A0Good to know. > >=20 > > Regarding ftp, the "big-iron" builds create a ftp directory as part > > of > > the release target, which contains the distribution sets used by > > various > > things such as bootonly.iso and poudriere. > >=20 > > That said, should we now expect that a userland build between all > > arm/armv6 SoCs to be identical (modulo any baked-in timestamps)? > >=20 > > Glen > >=20 >=20 > Hrm. =A0Well apparently, UBLDR_LOADADDR is no longer needed, but it is > still used when building ubldr (not ubldr.bin), and some old uboot > scripts still refer to ubldr. =A0So we've got to clean those up before we > can finish eliminating UBLDR_LOADADDR. >=20 Ok, thanks for the information. I'll leave UBLDR_LOADADDR in the build tools for now. Glen --gneEPciiIl/aKvOT Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEjRJAPC5sqwhs9k2jAxRYpUeP4pMFAlmRvn8ACgkQAxRYpUeP 4pPigxAAkoXDxUIKbZk0vfbirhug6Q/cCcKdYCW6M7XBXA8zS+iaP58TXLNEh3nB Jn8eewka2Ho7bv85KxAY+8wEOev4hUZIKlmYIPRTZaUgiF/mmxZkZ4JuBMObIssl oyDcCr0N7VuuAKHGfa1eag0ZLHzULEGV8+8spf9bzDd6uEdgdw5+Sl/tWdtWRM6l h+AkvwT5BkOWtvXBkU1ZsMwJ1h0RD8C3b0w1TpURUsTbSwHGOVlv0e5tIVQbnHoM 4aMyi0vPNQ15ZmDctKOyWq43qSW/SwLng1e7ulTx+aL6ohwonsoXSxKD8tUjW7sX zEcxEO6peB9UaLTewoMXSi5clGbxadkjxAbPP1Qe0VUSd0Guob1YGGzEnh368TQc 3EsSCnEBzF9vGCLl/e45NEIAumzDEgVUjtJGHiZ5mbuhaL3b7aVD1ad5XGPTejiz Xu9cE0hLM3V754kSkRpYsA3UtRQo3RaZXdEbXPoTguMLOZOJyOJjRW+BFcezEHKq N0D2Za8NqlE5fVpU2na9ClvKKGBooeQN5mPJdGeFbOoj/U+f9iVR7ri2Fa8hi4db JNFJ6cpnWCx7WlPpXt4zcZnLvDX4hJfBxmJbjIik845NfzTnP62VWWzRVMfLCggE /1+BQd2amop0XpSrxsHNbGatTHcjl6+xaZdUi/DKozgosGIbaZY= =WxfV -----END PGP SIGNATURE----- --gneEPciiIl/aKvOT-- From owner-freebsd-stable@freebsd.org Mon Aug 14 15:38:45 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5E5FEDD15AB for ; Mon, 14 Aug 2017 15:38:45 +0000 (UTC) (envelope-from smithi@nimnet.asn.au) Received: from sola.nimnet.asn.au (paqi.nimnet.asn.au [115.70.110.159]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 585862B55; Mon, 14 Aug 2017 15:38:44 +0000 (UTC) (envelope-from smithi@nimnet.asn.au) Received: from localhost (localhost [127.0.0.1]) by sola.nimnet.asn.au (8.14.2/8.14.2) with ESMTP id v7EFcUcK022551; Tue, 15 Aug 2017 01:38:30 +1000 (EST) (envelope-from smithi@nimnet.asn.au) Date: Tue, 15 Aug 2017 01:38:30 +1000 (EST) From: Ian Smith To: Aristedes Maniatis cc: Kevin Oberman , freebsd-stable , Alexander Motin Subject: Re: TSC timekeeping and cpu states In-Reply-To: <2ef99f5e-46f5-a185-2ac3-67d6afe68c89@ish.com.au> Message-ID: <20170815010943.B12950@sola.nimnet.asn.au> References: <2ef99f5e-46f5-a185-2ac3-67d6afe68c89@ish.com.au> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Aug 2017 15:38:45 -0000 On Mon, 14 Aug 2017 17:16:22 +1000, Aristedes Maniatis wrote: > On 14/8/17 3:08PM, Kevin Oberman wrote: > > Again, the documentation lags reality. The default was changed for > > 11.0. It is still conservative. In ALMOST all cases, Cmax will yield > > the bast results. However, on large systems with many cores, Cmax > > will trigger very poor results, so the default is C2, just to be > > safe. Given it's a server, anything beyond C2 is likely not worth trying. OTOH, C2 is perhaps not worth avoiding; it's probably low latency and should result in lower power consumption, so heat, and unlikely to hurt. Or at least, I suspect that's the case .. cc'ing Alexander, as the wiki article you referenced was his doing, so he's among those best placed. > > As far as possible TSC impact, I think older processors had TSC > > issues when not all cores ran with the same clock speed. That said, > > I am not remotely expert on such issues, so don't take this too > > seriously. I wasn't aware that FreeBSD could yet do different freqs on different cores? But I'm less expert than Kevin, and certainly behind the times. > Thanks Kevin > > What does 'large' and 'many cores' mean here? Is 24 cores large or > small? For a server do we ever want the CPU to enter states other > than C1? If C2 works well on your box, I don't see why you wouldn't want to use it .. but others might. I have no personal experience beyond 2 cores, but I'm perennially curious about such issues, as Kevin knows :) Are you using powerd? And what says, for example: sysctl -a | egrep 'cx|available|_freq|freq_|choice' | grep -v net\. which should include your timecounter and eventtimer setup too. cheers, Ian From owner-freebsd-stable@freebsd.org Mon Aug 14 16:47:32 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D3D69DD664B for ; Mon, 14 Aug 2017 16:47:32 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-lf0-x230.google.com (mail-lf0-x230.google.com [IPv6:2a00:1450:4010:c07::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5460364F40 for ; Mon, 14 Aug 2017 16:47:32 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: by mail-lf0-x230.google.com with SMTP id o85so42057254lff.3 for ; Mon, 14 Aug 2017 09:47:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:subject:to:cc:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-language:content-transfer-encoding; bh=Fff90SlDBODRlkyixInCCvfpqr3VjeBxiP7Gc4MUh30=; b=d/F8i4Q3rJOkPp7UokNzoVWuSfF3vSvEiExDgtnailve9JFlRM52nKe6kRYHiXDjBZ spbltCgC/365iOfiRF07KIoIvfJYYUtLPnu8dRHXnTazqnXGXa7KGjbhTKTdprqnn1CQ xTiNyGsFUlbetouSXjQpxPCacMdR77UgmcjILl1QTY3iJGGaPyaJWJAuO/9g2hdB1AbP FpMUbTN6SaU0Yk8u9gpcPWVTJu7LDThBXvjyU3Im73d+hJzdIeZZPWTqR7vbdCh6Iwsy M5OPSu+ScufxkjV9S48wI0NbvOSZOCstvLxQTa99SKTykW2S/JE8clSr5AZ1AlPMe/zW 0jNA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:subject:to:cc:references:from:message-id :date:user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=Fff90SlDBODRlkyixInCCvfpqr3VjeBxiP7Gc4MUh30=; b=UXs2aRDrG55cufSxlEKWoU7ie16camaGuv4AKL+9A0zIeaX8qYFMo4JHkSkVlQdfI9 /HBMGeq9olTVhfmHSlyGbEWcsxI3U3G9BSaYt4UMxt2Reo0aYwkCrFJnQNSRiXaIdNp/ G+Mz91zTD7FQp50XnxKcP9hRSMa+UdAPVEC262Df2zO++DNNhEOGTMznUQOrbhg4GEBF NQAE7lu8h/r2tdhUR33GgzXCt3x56t1J+nmU4MWsT8Fub+mhSLCMkyCCvv9cgoQJfgJG v8UxkfKe+C8wj+UJEtjIi7LE3QdMt4bcniqEmKBmeXbRtiKg5soIALr3b0UhMjmhbX3U /AAg== X-Gm-Message-State: AHYfb5gUDZR9T4Im05+BQ+l0nmh6U5l0DeklmUe0Y8iM8BFNEFOSf+W5 z1RLLOLlu8VeI+wi2kc= X-Received: by 10.25.92.132 with SMTP id u4mr8813073lfi.7.1502729249956; Mon, 14 Aug 2017 09:47:29 -0700 (PDT) Received: from spectre.mavhome.dp.ua ([134.249.139.101]) by smtp.gmail.com with ESMTPSA id q77sm1555743lfb.60.2017.08.14.09.47.26 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 14 Aug 2017 09:47:27 -0700 (PDT) Sender: Alexander Motin Subject: Re: TSC timekeeping and cpu states To: Ian Smith , Aristedes Maniatis Cc: Kevin Oberman , freebsd-stable References: <2ef99f5e-46f5-a185-2ac3-67d6afe68c89@ish.com.au> <20170815010943.B12950@sola.nimnet.asn.au> From: Alexander Motin Message-ID: <96ecb63f-0c69-5ed7-d521-0fa826d78d39@FreeBSD.org> Date: Mon, 14 Aug 2017 19:47:25 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.2.1 MIME-Version: 1.0 In-Reply-To: <20170815010943.B12950@sola.nimnet.asn.au> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Aug 2017 16:47:32 -0000 On 14.08.2017 18:38, Ian Smith wrote: > On Mon, 14 Aug 2017 17:16:22 +1000, Aristedes Maniatis wrote: > > On 14/8/17 3:08PM, Kevin Oberman wrote: > > > Again, the documentation lags reality. The default was changed for > > > 11.0. It is still conservative. In ALMOST all cases, Cmax will yield > > > the bast results. However, on large systems with many cores, Cmax > > > will trigger very poor results, so the default is C2, just to be > > > safe. > > Given it's a server, anything beyond C2 is likely not worth trying. > OTOH, C2 is perhaps not worth avoiding; it's probably low latency and > should result in lower power consumption, so heat, and unlikely to hurt. > > Or at least, I suspect that's the case .. cc'ing Alexander, as the wiki > article you referenced was his doing, so he's among those best placed. C-states controlled here are ACPI C-states, which have limited relation to real CPU C-states. There are systems where they map exactly, but there are also systems where ACPI C1/C2/C3 states map to CPU C1/C3/C6, so it is difficult to make general recommendations. Approximately the map can be guessed looking on latency value (last of three) reported in sysctl dev.cpu.0.cx_supported: 1 is usually CPU C1, 2+ is likely CPU C2, 100+ can be C3, 500+ can be C6, but all that is very approximately and I guess depends on BIOS writer mood. What's about recommendations from me, I'd say that CPU C2 state should not hurt in most cases, unless something is broken, but benefit is rather small (often just covered by C1E enabled in BIOS); CPU C3 state gives significant power saving, but can either hurt performance due to higher enter/exit latency or slightly improve it due to TurboBoost activation (require CPU frequency to be set to max value); CPU C6 is probably useful only for laptops, since it saves not so much power power, while exit latency can be in milliseconds range. > > > As far as possible TSC impact, I think older processors had TSC > > > issues when not all cores ran with the same clock speed. That said, > > > I am not remotely expert on such issues, so don't take this too > > > seriously. > > I wasn't aware that FreeBSD could yet do different freqs on different > cores? But I'm less expert than Kevin, and certainly behind the times. On old CPUs TSC frequency was related to CPU frequency and so could fluctuate with frequency change. On modern CPUs it is always constant, equal to base CPU frequency. What's about different frequency for different cores, IIRC ACPI allows that, but up to recent time neither FreeBSD nor hardware could do that. I have feeling I heard that some very new CPUs may allow that, but to be efficient it would require very tight interoperation between power manager and CPU scheduler, otherwise performance may suffer. -- Alexander Motin From owner-freebsd-stable@freebsd.org Mon Aug 14 16:48:09 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7DC12DD6717 for ; Mon, 14 Aug 2017 16:48:09 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: from mail-vk0-x235.google.com (mail-vk0-x235.google.com [IPv6:2607:f8b0:400c:c05::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 33F0E65059; Mon, 14 Aug 2017 16:48:09 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: by mail-vk0-x235.google.com with SMTP id d124so33319859vkf.2; Mon, 14 Aug 2017 09:48:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc; bh=rxZWWNDCnCnoEl3ZLCbvenvQI+AJxE660EEynETUFlI=; b=QsniFvR9ZU5UBXjE/OsdvYUgdp+HA5jxMRqBsxmXAOQj+DEMsvlgr1lkLIel7X2WkH OO2VwkTp+zWg46buuzxRY93Cu2AYyuykoefqFPU35drTyAcQ3DSk10Z9WN9cVwlFJlAe D1+rHsYdxpmBUU78l+Fgra6CcDn9Wn7gL0HboyBc1t7SfOgrh3aYX17zvRGpHc+uWvsF A4jKpYeHwLDG2ulAI3ZuGiN2rOJ8mZgrOWauw5/Y7kCx6FmFRxIw4srNQvqxMkPU7gqd yy5xs3Tml/ooLNutbYvJR7khReLUz3F1FUfe7AbUNXLdixDhZRCP9P/11NcYEKxuRUMh IxLw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to:cc; bh=rxZWWNDCnCnoEl3ZLCbvenvQI+AJxE660EEynETUFlI=; b=hxbL2nGlyjzcFpSb79JvE5zTDkzmLjddMsd2n8MSwU1yE1PHCIGYqlVfGannPdHmdD OzTaekchvyLxdvJdrKGFk+R5zeQNfJzL/HVz0KbWia0OvxMYOd6GIE77lDu+mbSjvoDR +0QDW272eRqn133pThrGjfKVXdfiCJ1ufVkAJ1rSRZFjlLm4hFIDwVY2yylOSz9q6gHz ets/xzpxIPgXvsuoGyTkuqCf6NSIL5RwJv5kCeL+zKbTHQjmFQPFWGO4voIxouzLiZrZ uFOw7JZtxhr/m2ZNH2IMa3Bu9Jcq6hSqx2ZGzGkGddWvW87z/qzN2gJgscoPeylUk7hr SvvA== X-Gm-Message-State: AHYfb5jjVyKopwiat97u3G4fhXmER5vreEse5e9IFlPba/HRd80dQ0zN WRB0PpXC90bh/Iv8aqRD42lbJt6MHCXm X-Received: by 10.31.69.8 with SMTP id s8mr15792590vka.102.1502729288195; Mon, 14 Aug 2017 09:48:08 -0700 (PDT) MIME-Version: 1.0 Sender: kob6558@gmail.com Received: by 10.103.76.143 with HTTP; Mon, 14 Aug 2017 09:48:07 -0700 (PDT) In-Reply-To: <20170815010943.B12950@sola.nimnet.asn.au> References: <2ef99f5e-46f5-a185-2ac3-67d6afe68c89@ish.com.au> <20170815010943.B12950@sola.nimnet.asn.au> From: Kevin Oberman Date: Mon, 14 Aug 2017 09:48:07 -0700 X-Google-Sender-Auth: 4vjWzoF1YrnmUqvjOaKZ7S4KjRY Message-ID: Subject: Re: TSC timekeeping and cpu states To: Ian Smith Cc: Aristedes Maniatis , freebsd-stable , Alexander Motin Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Aug 2017 16:48:09 -0000 On Mon, Aug 14, 2017 at 8:38 AM, Ian Smith wrote: > On Mon, 14 Aug 2017 17:16:22 +1000, Aristedes Maniatis wrote: > > > On 14/8/17 3:08PM, Kevin Oberman wrote: > > > Again, the documentation lags reality. The default was changed for > > > 11.0. It is still conservative. In ALMOST all cases, Cmax will yield > > > the bast results. However, on large systems with many cores, Cmax > > > will trigger very poor results, so the default is C2, just to be > > > safe. > > Given it's a server, anything beyond C2 is likely not worth trying. > OTOH, C2 is perhaps not worth avoiding; it's probably low latency and > should result in lower power consumption, so heat, and unlikely to hurt. > > Or at least, I suspect that's the case .. cc'ing Alexander, as the wiki > article you referenced was his doing, so he's among those best placed. > > > > As far as possible TSC impact, I think older processors had TSC > > > issues when not all cores ran with the same clock speed. That said, > > > I am not remotely expert on such issues, so don't take this too > > > seriously. > > I wasn't aware that FreeBSD could yet do different freqs on different > cores? But I'm less expert than Kevin, and certainly behind the times. > > > Thanks Kevin > > > > What does 'large' and 'many cores' mean here? Is 24 cores large or > > small? For a server do we ever want the CPU to enter states other > > than C1? > > If C2 works well on your box, I don't see why you wouldn't want to use > it .. but others might. I have no personal experience beyond 2 cores, > but I'm perennially curious about such issues, as Kevin knows :) > > Are you using powerd? And what says, for example: > > sysctl -a | egrep 'cx|available|_freq|freq_|choice' | grep -v net\. > > which should include your timecounter and eventtimer setup too. > > cheers, Ian > I guess I need to clarify. No, FreeBSD does not have the ability to tun different cores at different frequencies. I seem to recall that TCC on some processors could adjust the frequency of a core exceeding a defined temperature, skipping N of every 8 clock cycles to slow the processor and reduce the temperature. This is what TCC was designed for. It is entirely possible that I am not correctly remembering the details of the issue, but it could only be resolved by switching from TCC to another clocking system. If memory serves, and it may not, there was an issue a few years ago (jhb@ worked the issue) where TSC was varying with frequency and that caused clock drift. I believe all "modern" processors do not have this issue and it seems unlikely that any system running 24 cores is old enough that this might be an issue. Sorry for any confusion I may have caused. From owner-freebsd-stable@freebsd.org Tue Aug 15 13:30:55 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 742BADD450D for ; Tue, 15 Aug 2017 13:30:55 +0000 (UTC) (envelope-from smithi@nimnet.asn.au) Received: from sola.nimnet.asn.au (paqi.nimnet.asn.au [115.70.110.159]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 6CAEC6FD01; Tue, 15 Aug 2017 13:30:52 +0000 (UTC) (envelope-from smithi@nimnet.asn.au) Received: from localhost (localhost [127.0.0.1]) by sola.nimnet.asn.au (8.14.2/8.14.2) with ESMTP id v7FDUi1x067492; Tue, 15 Aug 2017 23:30:44 +1000 (EST) (envelope-from smithi@nimnet.asn.au) Date: Tue, 15 Aug 2017 23:30:44 +1000 (EST) From: Ian Smith To: Kevin Oberman cc: Aristedes Maniatis , freebsd-stable , Alexander Motin Subject: Re: TSC timekeeping and cpu states In-Reply-To: Message-ID: <20170815232509.Y12950@sola.nimnet.asn.au> References: <2ef99f5e-46f5-a185-2ac3-67d6afe68c89@ish.com.au> <20170815010943.B12950@sola.nimnet.asn.au> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Aug 2017 13:30:55 -0000 On Mon, 14 Aug 2017 09:48:07 -0700, Kevin Oberman wrote: > On Mon, Aug 14, 2017 at 8:38 AM, Ian Smith wrote: [..] > > > > As far as possible TSC impact, I think older processors had TSC > > > > issues when not all cores ran with the same clock speed. That said, > > > > I am not remotely expert on such issues, so don't take this too > > > > seriously. > > > > I wasn't aware that FreeBSD could yet do different freqs on different > > cores? But I'm less expert than Kevin, and certainly behind the times. [..] > I guess I need to clarify. No, FreeBSD does not have the ability to tun > different cores at different frequencies. I seem to recall that TCC on some > processors could adjust the frequency of a core exceeding a defined > temperature, skipping N of every 8 clock cycles to slow the processor and > reduce the temperature. This is what TCC was designed for. It is entirely > possible that I am not correctly remembering the details of the issue, but > it could only be resolved by switching from TCC to another clocking system. > > If memory serves, and it may not, there was an issue a few years ago (jhb@ > worked the issue) where TSC was varying with frequency and that caused > clock drift. I believe all "modern" processors do not have this issue and > it seems unlikely that any system running 24 cores is old enough that this > might be an issue. > > Sorry for any confusion I may have caused. Not at all. It gave me an excuse to bug Alexander for some state-of-art details, to which he responded magnificently :) Thankyou both, and Ari for entertaining such sport at his expense .. cheers, Ian From owner-freebsd-stable@freebsd.org Tue Aug 15 20:48:17 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A0D1CDCA308 for ; Tue, 15 Aug 2017 20:48:17 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost2.sentex.ca (smarthost2.sentex.ca [205.211.164.50]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 773A084736; Tue, 15 Aug 2017 20:48:17 +0000 (UTC) (envelope-from mike@sentex.net) Received: from lava.sentex.ca (lava.sentex.ca [IPv6:2607:f3e0:0:5::11]) by smarthost2.sentex.ca (8.15.2/8.15.2) with ESMTPS id v7FKm998032608 (version=TLSv1 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Tue, 15 Aug 2017 16:48:09 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [192.168.43.26] (saphire3.sentex.ca [192.168.43.26]) by lava.sentex.ca (8.15.2/8.15.2) with ESMTP id v7FKm7Fp097065; Tue, 15 Aug 2017 16:48:07 -0400 (EDT) (envelope-from mike@sentex.net) Subject: Re: svn commit: r322513 - stable/10/sys/geom/journal To: Kirk McKusick , FreeBSD-STABLE Mailing List References: <201708141912.v7EJCqsc017835@repo.freebsd.org> From: Mike Tancsa Organization: Sentex Communications Message-ID: <01f1450f-cfc3-84c8-d2ad-cdd1486bedb4@sentex.net> Date: Tue, 15 Aug 2017 16:48:06 -0400 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.2.1 MIME-Version: 1.0 In-Reply-To: <201708141912.v7EJCqsc017835@repo.freebsd.org> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.78 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Aug 2017 20:48:17 -0000 Not sure if this is just me or not, but on a nanobsd i386 image, this breaks building the image. ---Mike --- all_subdir_geom_journal --- --- g_journal.o --- /usr/src/sys/modules/geom/geom_journal/../../../geom/journal/g_journal.c:136:1: error: incompatible pointer types initializing 'int *' with an expression of type 'u_long *' (aka 'unsigned long *') [-Werror,-Wincompatible-pointer-types] TUNABLE_INT("kern.geom.journal.cache.limit", &g_journal_cache_limit); ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ @/sys/kernel.h:287:3: note: expanded from macro 'TUNABLE_INT' (var), \ ^~~~~ /usr/src/sys/modules/geom/geom_journal/../../../geom/journal/g_journal.c:178:14: warning: comparison of unsigned expression < 0 is always false [-Wtautological-compare] if (cswitch < 0 || cswitch > 100) ~~~~~~~ ^ ~ 1 warning and 1 error generated. *** [g_journal.o] Error code 1 make[5]: stopped in /usr/src/sys/modules/geom/geom_journal --- all_subdir_hpt27xx --- A failure has been detected in another branch of the parallel make make[4]: stopped in /usr/src/sys/modules/hpt27xx *** [all_subdir_hpt27xx] Error code 2 make[3]: stopped in /usr/src/sys/modules --- all_subdir_geom --- --- all_subdir_geom_label --- A failure has been detected in another branch of the parallel make make[5]: stopped in /usr/src/sys/modules/geom/geom_label *** [all_subdir_geom_label] Error code 2 make[4]: stopped in /usr/src/sys/modules/geom --- all_subdir_drm2 --- A failure has been detected in another branch of the parallel make make[6]: stopped in /usr/src/sys/modules/drm2/radeonkmsfw/R700_rlc *** [all_subdir_R700_rlc] Error code 2 make[5]: stopped in /usr/src/sys/modules/drm2/radeonkmsfw 1 error make[5]: stopped in /usr/src/sys/modules/drm2/radeonkmsfw *** [all_subdir_radeonkmsfw] Error code 2 make[4]: stopped in /usr/src/sys/modules/drm2 1 error make[4]: stopped in /usr/src/sys/modules/drm2 *** [all_subdir_drm2] Error code 2 make[3]: stopped in /usr/src/sys/modules --- all_subdir_geom --- --- all_subdir_geom_gate --- A failure has been detected in another branch of the parallel make make[5]: stopped in /usr/src/sys/modules/geom/geom_gate *** [all_subdir_geom_gate] Error code 2 make[4]: stopped in /usr/src/sys/modules/geom --- all_subdir_geom_journal --- 1 error make[5]: stopped in /usr/src/sys/modules/geom/geom_journal *** [all_subdir_geom_journal] Error code 2 make[4]: stopped in /usr/src/sys/modules/geom --- all_subdir_geom_eli --- A failure has been detected in another branch of the parallel make make[5]: stopped in /usr/src/sys/modules/geom/geom_eli *** [all_subdir_geom_eli] Error code 2 make[4]: stopped in /usr/src/sys/modules/geom 4 errors make[4]: stopped in /usr/src/sys/modules/geom *** [all_subdir_geom] Error code 2 make[3]: stopped in /usr/src/sys/modules 3 errors make[3]: stopped in /usr/src/sys/modules *** [modules-all] Error code 2 make[2]: stopped in /usr/obj/nanobsd.alix2apu/usr/src/sys/apu64 1 error make[2]: stopped in /usr/obj/nanobsd.alix2apu/usr/src/sys/apu64 *** [buildkernel] Error code 2 make[1]: stopped in /usr/src 1 error make[1]: stopped in /usr/src *** [buildkernel] Error code 2 make: stopped in /usr/src 1 error On 8/14/2017 3:12 PM, Kirk McKusick wrote: > Author: mckusick > Date: Mon Aug 14 19:12:51 2017 > New Revision: 322513 > URL: https://svnweb.freebsd.org/changeset/base/322513 > > Log: > MFC of 322178: > > Bug 198500 reports bad sysctl values for gjournal cache limit. > > PR: 198500 > Submitted by: Dr. Andreas Longwitz > Reported by: Eugene Grosbein > Discussed with: kib > Approved by: re (marius) > > Modified: > stable/10/sys/geom/journal/g_journal.c > Directory Properties: > stable/10/ (props changed) > > Modified: stable/10/sys/geom/journal/g_journal.c > ============================================================================== > --- stable/10/sys/geom/journal/g_journal.c Mon Aug 14 19:03:55 2017 (r322512) > +++ stable/10/sys/geom/journal/g_journal.c Mon Aug 14 19:12:51 2017 (r322513) > @@ -131,28 +131,28 @@ SYSCTL_PROC(_kern_geom_journal, OID_AUTO, record_entri > SYSCTL_UINT(_kern_geom_journal, OID_AUTO, optimize, CTLFLAG_RW, > &g_journal_do_optimize, 0, "Try to combine bios on flush and copy"); > > -static u_int g_journal_cache_used = 0; > -static u_int g_journal_cache_limit = 64 * 1024 * 1024; > +static u_long g_journal_cache_used = 0; > +static u_long g_journal_cache_limit = 64 * 1024 * 1024; > TUNABLE_INT("kern.geom.journal.cache.limit", &g_journal_cache_limit); > static u_int g_journal_cache_divisor = 2; > TUNABLE_INT("kern.geom.journal.cache.divisor", &g_journal_cache_divisor); > static u_int g_journal_cache_switch = 90; > static u_int g_journal_cache_misses = 0; > static u_int g_journal_cache_alloc_failures = 0; > -static u_int g_journal_cache_low = 0; > +static u_long g_journal_cache_low = 0; > > static SYSCTL_NODE(_kern_geom_journal, OID_AUTO, cache, CTLFLAG_RW, 0, > "GEOM_JOURNAL cache"); > -SYSCTL_UINT(_kern_geom_journal_cache, OID_AUTO, used, CTLFLAG_RD, > +SYSCTL_ULONG(_kern_geom_journal_cache, OID_AUTO, used, CTLFLAG_RD, > &g_journal_cache_used, 0, "Number of allocated bytes"); > static int > g_journal_cache_limit_sysctl(SYSCTL_HANDLER_ARGS) > { > - u_int limit; > + u_long limit; > int error; > > limit = g_journal_cache_limit; > - error = sysctl_handle_int(oidp, &limit, 0, req); > + error = sysctl_handle_long(oidp, &limit, 0, req); > if (error != 0 || req->newptr == NULL) > return (error); > g_journal_cache_limit = limit; > @@ -160,7 +160,7 @@ g_journal_cache_limit_sysctl(SYSCTL_HANDLER_ARGS) > return (0); > } > SYSCTL_PROC(_kern_geom_journal_cache, OID_AUTO, limit, > - CTLTYPE_UINT | CTLFLAG_RW, NULL, 0, g_journal_cache_limit_sysctl, "I", > + CTLTYPE_ULONG | CTLFLAG_RW, NULL, 0, g_journal_cache_limit_sysctl, "I", > "Maximum number of allocated bytes"); > SYSCTL_UINT(_kern_geom_journal_cache, OID_AUTO, divisor, CTLFLAG_RDTUN, > &g_journal_cache_divisor, 0, > @@ -3059,9 +3059,9 @@ g_journal_switcher(void *arg) > kproc_exit(0); > } > if (error == 0 && g_journal_sync_requested == 0) { > - GJ_DEBUG(1, "Out of cache, force switch (used=%u " > - "limit=%u).", g_journal_cache_used, > - g_journal_cache_limit); > + GJ_DEBUG(1, "Out of cache, force switch (used=%jd " > + "limit=%jd).", (intmax_t)g_journal_cache_used, > + (intmax_t)g_journal_cache_limit); > } > GJ_TIMER_START(1, &bt); > g_journal_do_switch(mp); > _______________________________________________ > svn-src-stable-10@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/svn-src-stable-10 > To unsubscribe, send any mail to "svn-src-stable-10-unsubscribe@freebsd.org" > > -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/ From owner-freebsd-stable@freebsd.org Tue Aug 15 21:05:37 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 06306DCB74C for ; Tue, 15 Aug 2017 21:05:37 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [176.36.249.139]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8AAD1775; Tue, 15 Aug 2017 21:05:35 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kib@localhost [127.0.0.1]) by kib.kiev.ua (8.15.2/8.15.2) with ESMTPS id v7FL5TSM002604 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Wed, 16 Aug 2017 00:05:30 +0300 (EEST) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.10.3 kib.kiev.ua v7FL5TSM002604 Received: (from kostik@localhost) by tom.home (8.15.2/8.15.2/Submit) id v7FL5TCV002602; Wed, 16 Aug 2017 00:05:29 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Wed, 16 Aug 2017 00:05:29 +0300 From: Konstantin Belousov To: Mike Tancsa Cc: Kirk McKusick , FreeBSD-STABLE Mailing List Subject: Re: svn commit: r322513 - stable/10/sys/geom/journal Message-ID: <20170815210529.GM1700@kib.kiev.ua> References: <201708141912.v7EJCqsc017835@repo.freebsd.org> <01f1450f-cfc3-84c8-d2ad-cdd1486bedb4@sentex.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <01f1450f-cfc3-84c8-d2ad-cdd1486bedb4@sentex.net> User-Agent: Mutt/1.8.3 (2017-05-23) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Aug 2017 21:05:37 -0000 On Tue, Aug 15, 2017 at 04:48:06PM -0400, Mike Tancsa wrote: > Not sure if this is just me or not, but on a nanobsd i386 image, this > breaks building the image. > > ---Mike > > --- all_subdir_geom_journal --- > --- g_journal.o --- > /usr/src/sys/modules/geom/geom_journal/../../../geom/journal/g_journal.c:136:1: > error: incompatible pointer types initializing 'int *' with an > expression of type 'u_long *' (aka 'unsigned long *') > [-Werror,-Wincompatible-pointer-types] > TUNABLE_INT("kern.geom.journal.cache.limit", &g_journal_cache_limit); > ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Try this on stable/10. Index: sys/geom/journal/g_journal.c =================================================================== --- sys/geom/journal/g_journal.c (revision 322542) +++ sys/geom/journal/g_journal.c (working copy) @@ -133,7 +133,7 @@ static u_long g_journal_cache_used = 0; static u_long g_journal_cache_limit = 64 * 1024 * 1024; -TUNABLE_INT("kern.geom.journal.cache.limit", &g_journal_cache_limit); +TUNABLE_LONG("kern.geom.journal.cache.limit", &g_journal_cache_limit); static u_int g_journal_cache_divisor = 2; TUNABLE_INT("kern.geom.journal.cache.divisor", &g_journal_cache_divisor); static u_int g_journal_cache_switch = 90; From owner-freebsd-stable@freebsd.org Tue Aug 15 22:35:44 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9328CDD1103; Tue, 15 Aug 2017 22:35:44 +0000 (UTC) (envelope-from julien.charbon@gmail.com) Received: from mail-wr0-f176.google.com (mail-wr0-f176.google.com [209.85.128.176]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2BB6E38EF; Tue, 15 Aug 2017 22:35:43 +0000 (UTC) (envelope-from julien.charbon@gmail.com) Received: by mail-wr0-f176.google.com with SMTP id x43so7341396wrb.3; Tue, 15 Aug 2017 15:35:43 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:subject:to:references:cc:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding; bh=1BRdJioQHmQu/OSDTYnLutICDr9h7FDVnHJOLgreR1I=; b=mPcBk46XOvRvqU7gT/fNOxwrhOcDIwdIddl0l6EwQZrWTqk7grWj7hFom5iAQ+7txF e/czE/RakqzQHziJiiF773xE4p8Pdwr8GfUuZkTXNfdqFEFIppkduQ+VATqnkG1mUtlu C9028598Q8ExHNCuHUesu5yacbtJ8/ah8rXSU+0ZNXckeIlZ2CCJVVjyC9wp72RuyD9Z VP0JR1SYjumfkySrnRDi8zw8SvWt282Z8Lsy9SMf4EeIT8QD2GyqD5mZV+wk++AbZ+4R A1kEwie4O8lpHxConnlToYUpj8DtiSHx8/GD64HL6WggEH6GCFV9EsH1sIzU3hKlfVdi DKvQ== X-Gm-Message-State: AHYfb5hB16GjJ/vSzlhgDC//hMowTpMvcE+rHhBGMoWydZEh90pZwIiD 8YztN/xPmhzuRduzzVc= X-Received: by 10.223.151.65 with SMTP id r59mr20767615wrb.189.1502832821381; Tue, 15 Aug 2017 14:33:41 -0700 (PDT) Received: from [10.100.64.20] ([217.30.88.7]) by smtp.gmail.com with ESMTPSA id l43sm11393378wrl.33.2017.08.15.14.33.39 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 15 Aug 2017 14:33:39 -0700 (PDT) From: Julien Charbon Subject: Re: mlx4en, timer irq @100%... (11.0 stuck on high network load ???) To: Ben RUBSON References: <9c306f10-7c05-d28d-e551-a930603aaafa@selasky.org> <896dd782-cb2c-0259-65d1-b00daae452de@FreeBSD.org> <0DB9F6FF-8BC9-48F5-B359-AC1905B9EB06@gmail.com> <7f14c95d-1ef8-bf82-c469-e6566c3aba66@selasky.org> <76A5EE7E-1D2E-46B4-86F1-F219C3DCE6EA@gmail.com> <4C91C6E5-0725-42E7-9813-1F3ACF3DDD6E@gmail.com> <5840c25e-7472-3276-6df9-1ed4183078ad@selasky.org> <2ADA8C57-2C2D-4F97-9F0B-82D53EDDC649@gmail.com> <061cdf72-6285-8239-5380-58d9d19a1ef7@selasky.org> <92BEE83D-498F-47D5-A53C-39DCDC00A0FD@gmail.com> <5d8960d8-e1ff-8719-320f-d3ae84054714@selasky.org> <6B4A35F7-5694-4945-9575-19ADB678F9FA@gmail.com> <297a784a-3d80-b1a6-652e-a78621fe5a8b@selasky.org> <3ECCFBF1-18D9-4E33-8F39-0C366C3BB8B4@gmail.com> <0a5787c5-8a53-ab09-971a-dc1cd5f3aca0@freebsd.org> Cc: Hans Petter Selasky , FreeBSD Net , hiren , Slawa Olhovchenkov , FreeBSD Stable Message-ID: <645f2ee3-3eaa-660e-2a64-37d53e88322f@freebsd.org> Date: Tue, 15 Aug 2017 23:33:36 +0200 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.11; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Aug 2017 22:35:44 -0000 Hi Ben, On 8/11/17 11:32 AM, Ben RUBSON wrote: >> On 08 Aug 2017, at 13:33, Julien Charbon wrote: >> >> On 8/8/17 10:31 AM, Hans Petter Selasky wrote: >>> >>> Suggested fix attached. >> >> I agree we your conclusion. Just for the record, more precisely this >> regression seems to have been introduced with: >> (...) >> Thus good catch, and your patch looks good. I am going to just verify >> the other in_pcbrele_wlocked() calls in TCP stack. > > Julien, do you plan to make this fix reach 11.0-p12 ? I am checking if your issue is another flavor of the issue fixed by: https://svnweb.freebsd.org/base?view=revision&revision=307551 https://reviews.freebsd.org/D8211 This fix in not in 11.0 but in 11.1. Currently I did not found how an inp in INP_TIMEWAIT state can have been INP_FREED without having its tw set to NULL already except the issue fixed by r307551. Thus could you try to apply this patch: https://github.com/freebsd/freebsd/commit/acb5bfda99b753d9ead3529d04f20087c5f7d0a0.patch and see if you can still reproduce this issue? And in the spirit of r307551 fix and based on Hans patch I will also propose to add a kernel log describing the issue instead of starting an infinite loop when INVARIANT is not set. -- Julien From owner-freebsd-stable@freebsd.org Wed Aug 16 05:46:18 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BCD69DC67CD for ; Wed, 16 Aug 2017 05:46:18 +0000 (UTC) (envelope-from aijazbaig1@gmail.com) Received: from mail-vk0-x232.google.com (mail-vk0-x232.google.com [IPv6:2607:f8b0:400c:c05::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5C9E27109B for ; Wed, 16 Aug 2017 05:46:18 +0000 (UTC) (envelope-from aijazbaig1@gmail.com) Received: by mail-vk0-x232.google.com with SMTP id u133so8974135vke.3 for ; Tue, 15 Aug 2017 22:46:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=B5pzCz/UPGVG1AzpTyzoLZ0u6GaO4X8paI3+tBu7Swc=; b=rwDXKXKDKNA0COhr1VMjakFifU2vM2nCjKDDegqVGs1wqwiIajBNUZAlEtdIlXRmbr XU+xtWcoMKmjaBauaR5jvC49ZNnckMQavP99olfFj70o+G92dN4btI3EEi9WvVJ6gTgs YoCTFncWfWuAiqgnDY/c0SIcFR0IM91ZW/KIGek3zHmPZndxjb5vvnUR2tJr0XtxUylf 6hdZ85S+BZjIptKWf/XKuyDoNghUNozMILgcxIaeUAmdFhyoiwjP4DKm++z5zAod+2La hsvpO5gq0/x0MNhRJqd9/kxnxTaXaJftBkBC9B5cQzMttk+pe6/8lhjXIXON3J5TB4HI +6Xg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=B5pzCz/UPGVG1AzpTyzoLZ0u6GaO4X8paI3+tBu7Swc=; b=UrXJD+YcuCs22g9pecOZifAHWsz244eRXs7iuOKBOm0r5yidpG1iFSWTZlSpmZ3POZ 4M7++ERv3oWLcbTrF3em3o0b1qIOPMgRJJ8HzUJ9utl31GwecHByxugMDPO5dl2QPgX6 kjdKfjq19h2AuMjtygvbkDXPlYtSVEUd+t6I/+AljSIvaD0jMvWbArJDN7Lu+An4qsYc +z9hf89yLj1yOcLRFePKYxz63wWg9Fq5vEiUKmhCcvNL5LrCuBSmXf3Tw8VHiQWgLHM1 wVMesVKNHz/d8wx5Nw1OkByEB82GkzadCBJD3V2YGtmhkHvY9bdvEUYp36UvxA/m4VqK wEow== X-Gm-Message-State: AHYfb5iaOJ/kxKzyOFRuVCie6xZfpQ8OBYmzv7ciG+gALlow0uCU3Z+w ECk+yeVAP0V19WYEx4iCRKaT41ctJT1S X-Received: by 10.31.55.130 with SMTP id e124mr323068vka.181.1502862376680; Tue, 15 Aug 2017 22:46:16 -0700 (PDT) MIME-Version: 1.0 Received: by 10.31.55.198 with HTTP; Tue, 15 Aug 2017 22:46:15 -0700 (PDT) In-Reply-To: References: From: Aijaz Baig Date: Wed, 16 Aug 2017 11:16:15 +0530 Message-ID: Subject: Re: Error in 'make buildworld' on 10.3 To: freebsd-stable@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Aug 2017 05:46:18 -0000 Removed src.conf and removed the parallel make (-j) option while doing a 'buildworld' which took me far but still failed nonetheless. The failure: ===> share/termcap (all) gzip -cn /usr/src/share/termcap/termcap.5 > termcap.5.gz cap_mkdb -l -f termcap /usr/src/share/termcap/termcap ===> share/timedef (all) grep -v '^#' < /usr/src/share/timedef/am_ET.UTF-8.src > am_ET.UTF-8.out grep -v '^#' < /usr/src/share/timedef/be_BY.CP1131.src > be_BY.CP1131.out grep -v '^#' < /usr/src/share/timedef/be_BY.CP1251.src > be_BY.CP1251.out grep -v '^#' < /usr/src/share/timedef/be_BY.ISO8859-5.src > be_BY.ISO8859-5.out grep -v '^#' < /usr/src/share/timedef/be_BY.UTF-8.src > be_BY.UTF-8.out grep -v '^#' < /usr/src/share/timedef/bg_BG.CP1251.src > bg_BG.CP1251.out grep -v '^#' < /usr/src/share/timedef/bg_BG.UTF-8.src > bg_BG.UTF-8.out grep -v '^#' < /usr/src/share/timedef/ca_ES.ISO8859-1.src > ca_ES.ISO8859-1.out grep -v '^#' < /usr/src/share/timedef/ca_ES.UTF-8.src > ca_ES.UTF-8.out grep -v '^#' < /usr/src/share/timedef/cs_CZ.ISO8859-2.src > cs_CZ.ISO8859-2.out grep -v '^#' < /usr/src/share/timedef/cs_CZ.UTF-8.src > cs_CZ.UTF-8.out grep -v '^#' < /usr/src/share/timedef/da_DK.ISO8859-1.src > da_DK.ISO8859-1.out grep -v '^#' < /usr/src/share/timedef/da_DK.UTF-8.src > da_DK.UTF-8.out grep -v '^#' < /usr/src/share/timedef/de_AT.ISO8859-1.src > de_AT.ISO8859-1.out grep -v '^#' < /usr/src/share/timedef/de_AT.UTF-8.src > de_AT.UTF-8.out grep -v '^#' < /usr/src/share/timedef/de_DE.ISO8859-1.src > de_DE.ISO8859-1.out grep -v '^#' < /usr/src/share/timedef/de_DE.UTF-8.src > de_DE.UTF-8.out grep -v '^#' < /usr/src/share/timedef/el_GR.ISO8859-7.src > el_GR.ISO8859-7.out grep -v '^#' < /usr/src/share/timedef/el_GR.UTF-8.src > el_GR.UTF-8.out grep -v '^#' < /usr/src/share/timedef/en_GB.ISO8859-1.src > en_GB.ISO8859-1.out grep -v '^#' < /usr/src/share/timedef/en_US.ISO8859-1.src > en_US.ISO8859-1.out grep -v '^#' < /usr/src/share/timedef/es_ES.ISO8859-1.src > es_ES.ISO8859-1.out grep -v '^#' < /usr/src/share/timedef/es_ES.UTF-8.src > es_ES.UTF-8.out grep -v '^#' < /usr/src/share/timedef/et_EE.ISO8859-15.src > et_EE.ISO8859-15.out grep -v '^#' < /usr/src/share/timedef/et_EE.UTF-8.src > et_EE.UTF-8.out grep -v '^#' < /usr/src/share/timedef/eu_ES.ISO8859-1.src > eu_ES.ISO8859-1.out grep -v '^#' < /usr/src/share/timedef/fi_FI.ISO8859-1.src > fi_FI.ISO8859-1.out grep -v '^#' < /usr/src/share/timedef/fi_FI.UTF-8.src > fi_FI.UTF-8.out grep -v '^#' < /usr/src/share/timedef/fr_FR.ISO8859-1.src > fr_FR.ISO8859-1.out grep -v '^#' < /usr/src/share/timedef/fr_FR.UTF-8.src > fr_FR.UTF-8.out grep -v '^#' < /usr/src/share/timedef/he_IL.UTF-8.src > he_IL.UTF-8.out grep -v '^#' < /usr/src/share/timedef/hi_IN.ISCII-DEV.src > hi_IN.ISCII-DEV.out grep -v '^#' < /usr/src/share/timedef/hr_HR.ISO8859-2.src > hr_HR.ISO8859-2.out grep -v '^#' < /usr/src/share/timedef/hr_HR.UTF-8.src > hr_HR.UTF-8.out grep -v '^#' < /usr/src/share/timedef/hu_HU.ISO8859-2.src > hu_HU.ISO8859-2.out grep -v '^#' < /usr/src/share/timedef/hu_HU.UTF-8.src > hu_HU.UTF-8.out grep -v '^#' < /usr/src/share/timedef/hy_AM.ARMSCII-8.src > hy_AM.ARMSCII-8.out grep -v '^#' < /usr/src/share/timedef/hy_AM.UTF-8.src > hy_AM.UTF-8.out grep -v '^#' < /usr/src/share/timedef/is_IS.ISO8859-1.src > is_IS.ISO8859-1.out grep -v '^#' < /usr/src/share/timedef/is_IS.UTF-8.src > is_IS.UTF-8.out grep -v '^#' < /usr/src/share/timedef/ja_JP.eucJP.src > ja_JP.eucJP.out grep -v '^#' < /usr/src/share/timedef/ja_JP.SJIS.src > ja_JP.SJIS.out grep -v '^#' < /usr/src/share/timedef/ja_JP.UTF-8.src > ja_JP.UTF-8.out grep -v '^#' < /usr/src/share/timedef/it_IT.ISO8859-1.src > it_IT.ISO8859-1.out grep -v '^#' < /usr/src/share/timedef/it_IT.UTF-8.src > it_IT.UTF-8.out grep -v '^#' < /usr/src/share/timedef/kk_KZ.PT154.src > kk_KZ.PT154.out grep -v '^#' < /usr/src/share/timedef/kk_KZ.UTF-8.src > kk_KZ.UTF-8.out grep -v '^#' < /usr/src/share/timedef/ko_KR.eucKR.src > ko_KR.eucKR.out grep -v '^#' < /usr/src/share/timedef/ko_KR.UTF-8.src > ko_KR.UTF-8.out grep -v '^#' < /usr/src/share/timedef/la_LN.ISO8859-1.src > la_LN.ISO8859-1.out grep -v '^#' < /usr/src/share/timedef/lt_LT.ISO8859-4.src > lt_LT.ISO8859-4.out grep -v '^#' < /usr/src/share/timedef/lt_LT.ISO8859-13.src > lt_LT.ISO8859-13.out grep -v '^#' < /usr/src/share/timedef/lt_LT.UTF-8.src > lt_LT.UTF-8.out grep -v '^#' < /usr/src/share/timedef/lv_LV.ISO8859-13.src > lv_LV.ISO8859-13.out grep -v '^#' < /usr/src/share/timedef/lv_LV.UTF-8.src > lv_LV.UTF-8.out grep -v '^#' < /usr/src/share/timedef/mn_MN.UTF-8.src > mn_MN.UTF-8.out grep -v '^#' < /usr/src/share/timedef/nb_NO.ISO8859-1.src > nb_NO.ISO8859-1.out grep -v '^#' < /usr/src/share/timedef/nb_NO.UTF-8.src > nb_NO.UTF-8.out grep -v '^#' < /usr/src/share/timedef/nl_NL.ISO8859-1.src > nl_NL.ISO8859-1.out grep -v '^#' < /usr/src/share/timedef/nn_NO.ISO8859-1.src > nn_NO.ISO8859-1.out grep -v '^#' < /usr/src/share/timedef/nn_NO.UTF-8.src > nn_NO.UTF-8.out grep -v '^#' < /usr/src/share/timedef/pl_PL.ISO8859-2.src > pl_PL.ISO8859-2.out grep -v '^#' < /usr/src/share/timedef/pl_PL.UTF-8.src > pl_PL.UTF-8.out grep -v '^#' < /usr/src/share/timedef/pt_BR.ISO8859-1.src > pt_BR.ISO8859-1.out grep -v '^#' < /usr/src/share/timedef/pt_BR.UTF-8.src > pt_BR.UTF-8.out grep -v '^#' < /usr/src/share/timedef/pt_PT.ISO8859-1.src > pt_PT.ISO8859-1.out grep -v '^#' < /usr/src/share/timedef/pt_PT.UTF-8.src > pt_PT.UTF-8.out grep -v '^#' < /usr/src/share/timedef/ro_RO.ISO8859-2.src > ro_RO.ISO8859-2.out grep -v '^#' < /usr/src/share/timedef/ro_RO.UTF-8.src > ro_RO.UTF-8.out grep -v '^#' < /usr/src/share/timedef/ru_RU.CP1251.src > ru_RU.CP1251.out grep -v '^#' < /usr/src/share/timedef/ru_RU.CP866.src > ru_RU.CP866.out grep -v '^#' < /usr/src/share/timedef/ru_RU.ISO8859-5.src > ru_RU.ISO8859-5.out grep -v '^#' < /usr/src/share/timedef/ru_RU.KOI8-R.src > ru_RU.KOI8-R.out grep -v '^#' < /usr/src/share/timedef/ru_RU.UTF-8.src > ru_RU.UTF-8.out grep -v '^#' < /usr/src/share/timedef/sk_SK.ISO8859-2.src > sk_SK.ISO8859-2.out grep -v '^#' < /usr/src/share/timedef/sk_SK.UTF-8.src > sk_SK.UTF-8.out grep -v '^#' < /usr/src/share/timedef/sl_SI.ISO8859-2.src > sl_SI.ISO8859-2.out grep -v '^#' < /usr/src/share/timedef/sl_SI.UTF-8.src > sl_SI.UTF-8.out grep -v '^#' < /usr/src/share/timedef/sr_YU.ISO8859-2.src > sr_YU.ISO8859-2.out grep -v '^#' < /usr/src/share/timedef/sr_YU.ISO8859-5.src > sr_YU.ISO8859-5.out grep -v '^#' < /usr/src/share/timedef/sr_YU.UTF-8.src > sr_YU.UTF-8.out grep -v '^#' < /usr/src/share/timedef/sv_SE.ISO8859-1.src > sv_SE.ISO8859-1.out grep -v '^#' < /usr/src/share/timedef/sv_SE.UTF-8.src > sv_SE.UTF-8.out grep -v '^#' < /usr/src/share/timedef/tr_TR.ISO8859-9.src > tr_TR.ISO8859-9.out grep -v '^#' < /usr/src/share/timedef/tr_TR.UTF-8.src > tr_TR.UTF-8.out grep -v '^#' < /usr/src/share/timedef/uk_UA.CP1251.src > uk_UA.CP1251.out grep -v '^#' < /usr/src/share/timedef/uk_UA.ISO8859-5.src > uk_UA.ISO8859-5.out grep -v '^#' < /usr/src/share/timedef/uk_UA.KOI8-U.src > uk_UA.KOI8-U.out grep -v '^#' < /usr/src/share/timedef/uk_UA.UTF-8.src > uk_UA.UTF-8.out grep -v '^#' < /usr/src/share/timedef/zh_CN.eucCN.src > zh_CN.eucCN.out grep -v '^#' < /usr/src/share/timedef/zh_CN.GB18030.src > zh_CN.GB18030.out grep -v '^#' < /usr/src/share/timedef/zh_CN.GB2312.src > zh_CN.GB2312.out grep -v '^#' < /usr/src/share/timedef/zh_CN.UTF-8.src > zh_CN.UTF-8.out grep -v '^#' < /usr/src/share/timedef/zh_TW.Big5.src > zh_TW.Big5.out grep -v '^#' < /usr/src/share/timedef/zh_TW.UTF-8.src > zh_TW.UTF-8.out ===> share/vt (all) ===> share/vt/fonts (all) uudecode -p < /usr/src/share/vt/fonts/gallant.fnt.uu > gallant.fnt vtfontcvt /usr/src/share/vt/fonts/vgarom-8x8.hex vgarom-8x8.fnt vtfontcvt /usr/src/share/vt/fonts/vgarom-8x14.hex vgarom-8x14.fnt vtfontcvt /usr/src/share/vt/fonts/vgarom-8x16.hex vgarom-8x16.fnt vtfontcvt /usr/src/share/vt/fonts/vgarom-thin-8x8.hex vgarom-thin-8x8.fnt vtfontcvt /usr/src/share/vt/fonts/vgarom-thin-8x16.hex vgarom-thin-8x16.fnt ===> share/vt/keymaps (all) ===> share/zoneinfo (all) cp -fp /usr/src/share/zoneinfo/../../contrib/tzdata//yearistype.sh yearistype cp: chflags: yearistype: Operation not supported *** Error code 1 Stop. make[4]: stopped in /usr/src/share/zoneinfo *** Error code 1 Stop. make[3]: stopped in /usr/src/share *** Error code 1 Stop. make[2]: stopped in /usr/src *** Error code 1 Stop. make[1]: stopped in /usr/src *** Error code 1 Stop. make: stopped in /usr/src Looks like it failed while building zoneinfo since apparently [file]yearistype[/file] is not supported (*on what? this processor i.e. CPUTYPE*??). Is there a way to skip certain packages (like related to regional localisations since US-EN is fine with me)?? Waiting to hear. On Sun, Aug 13, 2017 at 10:54 PM, Aijaz Baig wrote: > I am trying to buildworld on 10.3 and I encounter an error: > > --- _worldtmp --- > -------------------------------------------------------------- > >>> Rebuilding the temporary build tree > -------------------------------------------------------------- > rm -rf /mnt/ObjDir/usr/src/tmp > rm -rf /mnt/ObjDir/usr/src/lib32 > mkdir -p /mnt/ObjDir/usr/src/tmp/lib > mkdir -p /mnt/ObjDir/usr/src/tmp/usr > mkdir -p /mnt/ObjDir/usr/src/tmp/legacy/bin > mkdir -p /mnt/ObjDir/usr/src/tmp/legacy/usr > mtree -deU -f /usr/src/etc/mtree/BSD.usr.dist -p /mnt/ObjDir/usr/src/tmp/legacy/usr > >/dev/null > mtree -deU -f /usr/src/etc/mtree/BSD.groff.dist -p > /mnt/ObjDir/usr/src/tmp/legacy/usr >/dev/null > mtree -deU -f /usr/src/etc/mtree/BSD.usr.dist -p > /mnt/ObjDir/usr/src/tmp/usr >/dev/null > mtree -deU -f /usr/src/etc/mtree/BSD.include.dist -p > /mnt/ObjDir/usr/src/tmp/usr/include >/dev/null > ln -sf /usr/src/sys /mnt/ObjDir/usr/src/tmp > --- _legacy --- > -------------------------------------------------------------- > >>> stage 1.1: legacy release compatibility shims > -------------------------------------------------------------- > cd /usr/src; MAKEOBJDIRPREFIX=/mnt/ObjDir/usr/src/tmp INSTALL="sh > /usr/src/tools/install.sh" PATH=/mnt/ObjDir/usr/src/tmp/ > legacy/usr/sbin:/mnt/ObjDir/usr/src/tmp/legacy/usr/bin:/ > mnt/ObjDir/usr/src/tmp/legacy/usr/games:/mnt/ObjDir/usr/src/ > tmp/legacy/bin:/sbin:/bin:/usr/sbin:/usr/bin > WORLDTMP=/mnt/ObjDir/usr/src/tmp VERSION="FreeBSD 10.3-RELEASE amd64 > 1003000" MAKEFLAGS="-m /usr/src/tools/build/mk -j 4 -J 15,16 -m > /usr/src/share/mk" COMPILER_TYPE=clang make -f Makefile.inc1 DESTDIR= > BOOTSTRAPPING=1003000 SSP_CFLAGS= -DWITHOUT_HTML -DWITHOUT_INFO > -DNO_LINT -DWITHOUT_MAN -DNO_PIC -DNO_PROFILE -DNO_SHARED > _BOOTSTRAP_MAKEINFO=yes -DNO_CPU_CFLAGS -DNO_WARNS -DNO_CTF -DEARLY_BUILD > -DNO_TESTS legacy > --- legacy --- > ===> tools/build (obj,includes,depend,all,install) > --- obj --- > /mnt/ObjDir/usr/src/tmp/usr/src/tools/build created for > /usr/src/tools/build > --- includes --- > ; cd /usr/src/tools/build; make buildincludes; make installincludes > --- .depend --- > rm -f .depend > mkdep -f .depend -a -I/mnt/ObjDir/usr/src/tmp/legacy/usr/include > -std=gnu99 /usr/src/tools/build/../../contrib/libc-pwcache/pwcache.c > /usr/src/tools/build/../../contrib/libc-pwcache/pwcache.c:82:10: fatal > error: 'namespace.h' file not found > #include "namespace.h" > ^ > 1 error generated. > mkdep: compile failed > *** [.depend] Error code 1 > > make[3]: stopped in /usr/src/tools/build > 1 error > > make[3]: stopped in /usr/src/tools/build > *** [legacy] Error code 2 > > make[2]: stopped in /usr/src > 1 error > > make[2]: stopped in /usr/src > *** [_legacy] Error code 2 > > make[1]: stopped in /usr/src > 1 error > > make[1]: stopped in /usr/src > *** [buildworld] Error code 2 > > make: stopped in /usr/src > 1 error > > make: stopped in /usr/src > > What is this error? Am I missing certain header files? Keen to hear > -- > > Best Regards, > Aijaz Baig > -- Best Regards, Aijaz Baig From owner-freebsd-stable@freebsd.org Wed Aug 16 09:02:13 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4BF4DDCE872; Wed, 16 Aug 2017 09:02:13 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: from mail-wm0-x241.google.com (mail-wm0-x241.google.com [IPv6:2a00:1450:400c:c09::241]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C855476A9E; Wed, 16 Aug 2017 09:02:12 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: by mail-wm0-x241.google.com with SMTP id y206so4014178wmd.5; Wed, 16 Aug 2017 02:02:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=ucFkfzDR5UXtXK24WExu5AySLakUPR4msaDLF92jKDk=; b=pQpw3ynXErfFk2OMu6a33u7eM3XE5WZCMVpogIDeP9TqxYBbqOYmyDxoKxLRPpK04Q inc9HfovRvJasUslBlO0oXm7yVDml6229YbVh+ha6rBVUuqmuHthZbJ7/BCqSOebQig4 mEyalmAeLQ56U2r70GzfWSI7LrsBM3NDu2vx/nqCB4yE+SwruLZh+SnxFR5M9rhCd5wH WthQsf4oOwIqEPND2ea19nfvouJ/OKaWbqTU0yPLMOK3IUkybYMaVNJ/gfyxtDyMYFIX 2ik3TypwKBbjxQk2xFILo5dBkzP3UTTRlOgsDHXW8SIcqym2fM+UMf2kv+qqfCPMIrfL Y9pQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=ucFkfzDR5UXtXK24WExu5AySLakUPR4msaDLF92jKDk=; b=OJ3zKyB2NBOzc/iJI7HHi5H8m00A9zZBz+Btjs3VPRBMfWXeZiykLcLJR/z9iH+4oO 8N72dB+MW6iR8olSgxv/Z2CcTbKEX8Aj9IJDgRBNHWtgM4K88PzT2zrFsKvKHfud3/jy 2vZjU2Cn7eG+giqQUpQYz7LxtmmB4ZWhn7pjMQUdt/FNEL7BYjD77hdXzLHJIkGbdy0O BccJeNzeEpBgkBjGrge0JOdPJU0H6MiIAV6fYzqoGtR4kXuHboQ5N7+Wci1hS0oKq9eu IcVSbuFC3z95PHm7pveAZoSfyFjmO4iYJuyAxERdIsZPLqRhyfZHrvYjG1MwfhWdSrt9 WmiQ== X-Gm-Message-State: AHYfb5h+waTLb2ruhthMZCQDyLPOQiM01xBWBvbV6Eyt7MkxNdTqFmdM DfAedj3KdxSLfKXi7iR3Qw== X-Received: by 10.28.189.68 with SMTP id n65mr803067wmf.15.1502874129300; Wed, 16 Aug 2017 02:02:09 -0700 (PDT) Received: from ben.home (LFbn-1-6951-179.w90-116.abo.wanadoo.fr. [90.116.132.179]) by smtp.gmail.com with ESMTPSA id c34sm425929wra.80.2017.08.16.02.02.07 (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Wed, 16 Aug 2017 02:02:08 -0700 (PDT) Content-Type: text/plain; charset=windows-1252 Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Subject: Re: mlx4en, timer irq @100%... (11.0 stuck on high network load ???) From: Ben RUBSON In-Reply-To: <645f2ee3-3eaa-660e-2a64-37d53e88322f@freebsd.org> Date: Wed, 16 Aug 2017 11:02:06 +0200 Cc: Hans Petter Selasky , FreeBSD Net , hiren , Slawa Olhovchenkov , FreeBSD Stable Content-Transfer-Encoding: quoted-printable Message-Id: <13DE4E6D-CE83-4B5D-BF88-0EFE65111311@gmail.com> References: <9c306f10-7c05-d28d-e551-a930603aaafa@selasky.org> <896dd782-cb2c-0259-65d1-b00daae452de@FreeBSD.org> <0DB9F6FF-8BC9-48F5-B359-AC1905B9EB06@gmail.com> <7f14c95d-1ef8-bf82-c469-e6566c3aba66@selasky.org> <76A5EE7E-1D2E-46B4-86F1-F219C3DCE6EA@gmail.com> <4C91C6E5-0725-42E7-9813-1F3ACF3DDD6E@gmail.com> <5840c25e-7472-3276-6df9-1ed4183078ad@selasky.org> <2ADA8C57-2C2D-4F97-9F0B-82D53EDDC649@gmail.com> <061cdf72-6285-8239-5380-58d9d19a1ef7@selasky.org> <92BEE83D-498F-47D5-A53C-39DCDC00A0FD@gmail.com> <5d8960d8-e1ff-8719-320f-d3ae84054714@selasky.org> <6B4A35F7-5694-4945-9575-19ADB678F9FA@gmail.com> <297a784a-3d80-b1a6-652e-a78621fe5a8b@selasky.org> <3ECCFBF1-18D9-4E33-8F39-0C366C3BB8B4@gmail.com> <0a5787c5-8a53-ab09-971a-dc1cd5f3aca0@freebsd.org> <645f2ee3-3eaa-660e-2a64-37d53e88322f@freebsd.org> To: Julien Charbon X-Mailer: Apple Mail (2.3124) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Aug 2017 09:02:13 -0000 > On 15 Aug 2017, at 23:33, Julien Charbon wrote: >=20 > On 8/11/17 11:32 AM, Ben RUBSON wrote: >>> On 08 Aug 2017, at 13:33, Julien Charbon wrote: >>>=20 >>> On 8/8/17 10:31 AM, Hans Petter Selasky wrote: >>>>=20 >>>> Suggested fix attached. >>>=20 >>> I agree we your conclusion. Just for the record, more precisely = this >>> regression seems to have been introduced with: >>> (...) >>> Thus good catch, and your patch looks good. I am going to just = verify >>> the other in_pcbrele_wlocked() calls in TCP stack. >>=20 >> Julien, do you plan to make this fix reach 11.0-p12 ? >=20 > I am checking if your issue is another flavor of the issue fixed by: >=20 > https://svnweb.freebsd.org/base?view=3Drevision&revision=3D307551 > https://reviews.freebsd.org/D8211 >=20 > This fix in not in 11.0 but in 11.1. Currently I did not found how an > inp in INP_TIMEWAIT state can have been INP_FREED without having its = tw > set to NULL already except the issue fixed by r307551. >=20 > Thus could you try to apply this patch: >=20 > = https://github.com/freebsd/freebsd/commit/acb5bfda99b753d9ead3529d04f20087= c5f7d0a0.patch >=20 > and see if you can still reproduce this issue? Thank you for your answer Julien. Unfortunately, I'm not sure at all how to reproduce the issue. I have other servers which are 100% identical to this one, same = workload, same some-months uptime, but they did not trigger the bug yet. If other network stack experts (I'm not) agree with your analysis, we could then certainly go further with D8211 / r307551. One thing that perhaps might help : # netstat -an | grep TIME_WAIT$ | wc -l 468 Note that due to this running bug, sendmail has lots of difficulties to = send outgoing mails. As soon as I run the above netstat command, I receive a lot of stacked = mails (more than 20 this time). As if netstat was able to somehow help... Number of TIME_WAIT connections however does not decrease, but = increases. > And in the spirit of r307551 fix and based on Hans patch I will also > propose to add a kernel log describing the issue instead of starting = an > infinite loop when INVARIANT is not set. Which should then never be triggered :) Good idea I think ! Thank you again ! Ben From owner-freebsd-stable@freebsd.org Wed Aug 16 09:39:05 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EDB97DD067B for ; Wed, 16 Aug 2017 09:39:05 +0000 (UTC) (envelope-from allbery.b@gmail.com) Received: from mail-ua0-x22e.google.com (mail-ua0-x22e.google.com [IPv6:2607:f8b0:400c:c08::22e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id AE1F277BBB for ; Wed, 16 Aug 2017 09:39:05 +0000 (UTC) (envelope-from allbery.b@gmail.com) Received: by mail-ua0-x22e.google.com with SMTP id y36so11963368uac.5 for ; Wed, 16 Aug 2017 02:39:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=VF/HUTiMRZnhxRhEkf/H1U8k1CZcBQ9iUaI5movw4M8=; b=qoEFYdLkJ5JEAUa75vqPoEjrbdIiSNTkLMMaaCUdcAYK2lYvYoK54HI8TZinQFDl7q SHmOxP5wnelC/RWn3LUbP+i11UIevIkQ8kyC+ZRDio6pirz52Njmsn3bI4AjJsWpUUDa N7skruDN/u9ODca4t2wHUaARtvKCIq2ZjaO0+9A2DUX8naGk4cA27HnFhxRgKKSB/QNk cUPj4Ix5xghV8Zg07v1DOUCFBZMdMi5W5T+H9bo3fkGpla5GzQfLhauaYKOxWuCqggxo dtXsCHLfkIBaEwenrF3Tjf7FoxSPanzsD6F81n8KfvEZfe7ki3jNcQHw8Ioaai4cMOQV FYvQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=VF/HUTiMRZnhxRhEkf/H1U8k1CZcBQ9iUaI5movw4M8=; b=DqdlbQvcnUij6ZHLFFXynxXI13lBC28+2afrux6P35RhQSO3BwJoVJKwPRSbEJeoJO xVIeux6umnxUf/XM1xg9lqRjFka7IJqcdQQAcBubUrgqXWnZGUc0X0IzysvdEHd7id8M Nf8W9anwPn5c/zyyCZ3NiPLdnqUBRV8xGHJgsf8Gb/1ZNYu7AFbctS/WW47z+TtiGgbX a+IQSx479w/EKr4tggVxo/fa4aDm8uvp9VJcxWX8aa7NZxuilBpC9/FrVP7owwgvm3uH TFK381p965B9g8lPSrQkLeeb/oS9LUrBeumUkmg3950JzwW3XmGJ9GaN5HJ8fnTOubI3 YGSg== X-Gm-Message-State: AHYfb5gYExy9LqTQls59cXzg2PtsOlNknmsDwRwHHP/eXkQcVVaRbqOG OJIgc+QDfNYTsUobIxzY9TzFyjfZNiUL X-Received: by 10.176.3.162 with SMTP id 31mr710329uau.149.1502876344681; Wed, 16 Aug 2017 02:39:04 -0700 (PDT) MIME-Version: 1.0 Received: by 10.103.58.202 with HTTP; Wed, 16 Aug 2017 02:39:03 -0700 (PDT) In-Reply-To: References: From: Brandon Allbery Date: Wed, 16 Aug 2017 05:39:03 -0400 Message-ID: Subject: Re: Error in 'make buildworld' on 10.3 To: Aijaz Baig Cc: freebsd-stable Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Aug 2017 09:39:06 -0000 On Wed, Aug 16, 2017 at 1:46 AM, Aijaz Baig wrote: > ===> share/zoneinfo (all) > cp -fp /usr/src/share/zoneinfo/../../contrib/tzdata//yearistype.sh > yearistype > cp: chflags: yearistype: Operation not supported > *** Error code 1 > > (...) > Looks like it failed while building zoneinfo since apparently > [file]yearistype[/file] is not supported (*on what? this processor i.e. > CPUTYPE*??). Is there a way to skip certain packages (like related to > regional localisations since US-EN is fine with me)?? Nothing to do with yearistype /per se/. Most likely you are booted into a securelevel that forbids whatever chflags operation was attempted on that filesystem. -- brandon s allbery kf8nh sine nomine associates allbery.b@gmail.com ballbery@sinenomine.net unix, openafs, kerberos, infrastructure, xmonad http://sinenomine.net From owner-freebsd-stable@freebsd.org Wed Aug 16 20:32:05 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 74F45DCF2D4; Wed, 16 Aug 2017 20:32:05 +0000 (UTC) (envelope-from peixotocassiano@gmail.com) Received: from mail-qk0-x233.google.com (mail-qk0-x233.google.com [IPv6:2607:f8b0:400d:c09::233]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3424B6EACA; Wed, 16 Aug 2017 20:32:05 +0000 (UTC) (envelope-from peixotocassiano@gmail.com) Received: by mail-qk0-x233.google.com with SMTP id z18so26704625qka.4; Wed, 16 Aug 2017 13:32:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=PLAT+npSQtEx5+twCyGzEUGl/krTmQiNNTQF+Rn3qaM=; b=YiKSPEqVetmxlq3LfEFuYx/SlZWl58IIU0il6NOm3Jgfl1ShI75FwIGa5ZX4eUQUaL NwBlwz46sMrArYHla6NN0dc83zeCF7gn0arbVDuJH2J9dlk9O0Q6Q9R/4U1h3n7acZUt o6FPO6dkvXJO5MllNhkPnZcRgb8ZMluudx4XtsDKBfXf0eTzfCeIvM2MmrqeKc7oiEMb kIC3lQYVTXNN6xZYoDvw3Ctgr1eaPBE9WUEHxHxCsaRZ35HBx1MkKpEMHqXuFZCBE0/w Lyw9gIn/2ITERxahuhUZV65OjxUy9fZMjpk9+58eEeCanf8AyVP76V1qOutLC6mvay/i Hqqw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=PLAT+npSQtEx5+twCyGzEUGl/krTmQiNNTQF+Rn3qaM=; b=uBC2Gn7YnW/pMMy9InuyJOJVN6TiwTc+/EyZACsr/gzczXQEha8pVLj6M6fTpDE7nj I3FXRYmK5PB6MQp/yqqHzOUCfsP6TiS+PA7+vW6DU/qeM3qmrzuZ0TWxoUVg88sRE/5K 124PvfXkxtrjDwcj2xxJiCZhaTjWPTvcMaeqs20rj8GCwjtLZKgG7vK5DXefddq+YDeR 3Hpbf9KUOz/DalPUsCe7maeZqEXV4n+cR31sktJcGmRs9oWPAzCkwXbdCSUfW6BT93DH pKL0ZLsJvKrwtA61Bf6Jeu3tveIo97CkzoG/wWWOXKA9g0MgAuM0PFIVp41PkjIlE5Ot FHNA== X-Gm-Message-State: AHYfb5jQL2HL6Pim/QOBq/V7fYpkQ14+qie0w8tN8QfbxkAaSGfdzfm6 rVjJKIpFc7Od+rSZecHV5HbCKfpmRXEF X-Received: by 10.55.123.197 with SMTP id w188mr3799833qkc.282.1502915524194; Wed, 16 Aug 2017 13:32:04 -0700 (PDT) MIME-Version: 1.0 Received: by 10.200.47.72 with HTTP; Wed, 16 Aug 2017 13:32:03 -0700 (PDT) From: Cassiano Peixoto Date: Wed, 16 Aug 2017 17:32:03 -0300 Message-ID: Subject: Denverton CPU on FreeBSD To: freebsd-stable@freebsd.org, freebsd-current@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Aug 2017 20:32:05 -0000 Hi there, Is someone playing with Denverton CPU On FreeBSD? I'm trying to use serial console on FreeBSD with Denverton CPU but doesn't work. I can see the boot process but it stops and I do not have the login prompt. My keyboard doesn't answer as well. I tried it with FreeBSD 10, 11 and 12-CURRENT. Same configuration is working with Rangeley CPU. Any help is welcome. Thanks. From owner-freebsd-stable@freebsd.org Thu Aug 17 10:16:30 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 85468DD916F; Thu, 17 Aug 2017 10:16:30 +0000 (UTC) (envelope-from chris@chrullrich.net) Received: from EUR01-HE1-obe.outbound.protection.outlook.com (mail-he1eur01on0080.outbound.protection.outlook.com [104.47.0.80]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "Microsoft IT SSL SHA2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B8C336ADF4; Thu, 17 Aug 2017 10:16:28 +0000 (UTC) (envelope-from chris@chrullrich.net) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gloomberg.onmicrosoft.com; s=selector1-chrullrich-net; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=Bqr8Gre7/jYITb/ji6nf8cIov0D4uaUpwZPgQw5/ihk=; b=DoKveyWmOKsXu7V6FdNVjeGdNdlVJfNnnyP3sBg9u2WIMqIGKiQFJJoOtFVLabqeLnBxtTHwbYBArIDtL/0TqxopsO+kSL4dibHf6cLsPfcpxrylicrNGPD27jJVOG9K1m6xFbdkCPublaFNv0a4uJniHXW7te8Ttmh9viTrg34= Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=chris@chrullrich.net; Received: from [192.168.92.135] (217.31.70.82) by AM4PR10MB0226.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:200:2b::12) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256_P256) id 15.1.1341.21; Thu, 17 Aug 2017 10:16:25 +0000 Subject: Re: svn commit: r322609 - in stable/11: contrib/netbsd-tests/usr.bin/grep usr.bin/grep To: Kyle Evans References: <201708170426.v7H4Q4SL015844@repo.freebsd.org> From: Christian Ullrich Cc: svn-src-stable@freebsd.org, freebsd-stable@freebsd.org Message-ID: <0cf58b0e-51cd-27f9-1ce5-87ee0e8df207@chrullrich.net> Date: Thu, 17 Aug 2017 12:16:22 +0200 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.2.1 MIME-Version: 1.0 In-Reply-To: <201708170426.v7H4Q4SL015844@repo.freebsd.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Originating-IP: [217.31.70.82] X-ClientProxiedBy: AM5PR0402CA0002.eurprd04.prod.outlook.com (2603:10a6:203:90::12) To AM4PR10MB0226.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:200:2b::12) X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 9bbb8bea-4254-48e1-6606-08d4e559042e X-Microsoft-Antispam: UriScan:; BCL:0; PCL:0; RULEID:(300000500095)(300135000095)(300000501095)(300135300095)(22001)(300000502095)(300135100095)(2017030254152)(2017082002075)(300000503095)(300135400095)(201703131423075)(201702281549075)(300000504095)(300135200095)(300000505095)(300135600095)(300000506095)(300135500095); SRVR:AM4PR10MB0226; X-Microsoft-Exchange-Diagnostics: 1; AM4PR10MB0226; 3:lZ87KY55gQImtmR/67Cv8uFjNKtwG1HPiBnoEbPElLAWlBI5QLFvid3Yl2XV8E8+oXnD7Qz46qJ0Ygpi4kc36FGt85/R39fOcWbXuu/HMcLPRLjApJdVN4h/hRXLxHFnuXYhGBpNW1td4tsTGHLC8h857ZDv0NPbTVAMQOju/cBNVndiPGZGK2PrmnR+LzVLMfUZ5iQpvLwlxkdBMI3s+6AsMtVk4s2+z7GpMWTGAy9/xcGqleHgXoABZP1EgsxX; 25:RAioTfq+LrmIMhTJ41G5j3+YBhD23TemjvKqSzymIam+ZgPqBB2qnFYcgis9ABQV1Gzt3yRpxzMkQky4a3TSDIcA3uGWhZ3CdNNfqP1Ykh9tpx5yPRkSW8bkaO5DSXaY5WnFrzwkICjye7ZyFBF/d61PdAZoi6ZcQsiYyvEOL/sBEgrHik781mB3/UxS5auMmFW+BtQrjFBAc7WRMyB5xmdvW1bIdCqYFfJCbQfFsXuTV/hWrk8qa33FJ9pLkjSA0N3ZiaPzj6EyAXEserkONysciQvic2lXIgZoEH+0pt7l34PNsb+ijpkXmilBjr6MyMFTCspKHOh6A9p+JeRlYQ==; 31:yU9BidF5liOzMclt3MTzCcWvM1D1TQjA8j2Ln83544gBq8qGhS5I8my1MTS1AtzBkhK1oJxO72RQ4m6SLPbJK9p/SVKRf065ZgETR7YuK4n3tGGzRUzcPPKjVCBU4yFdt1BCVRj+4yehaadpgOgDhGKYr7oVOIKacTmJZ0ol8aR2xev+cAnYTAXtPXMlmjtroMdDbDAvmILC4+FZTZOhoBm1rqoSpvwR2YngXQig0l0= X-MS-TrafficTypeDiagnostic: AM4PR10MB0226: X-Microsoft-Exchange-Diagnostics: 1; AM4PR10MB0226; 20:c1R9jQfUAciyjbvmqtIVPjIuYailMeW/ZzsV5lEkn8+iTZBKA9oszB3+fMvU+dtxgt9Ko9rJw38oLjEz887B1lOWOmpdqdQg8Q8qeOUnOr6M3HnAmM7rGQ/Kpd8sxandtKF75sErTzO/vEVp9Yg5mn3IG3bP7dkjIUq61/ATV+zoDqr+rfAq+W+zLpIkok/t9tkjlRJbR8sOvCL0foSq/q7Qec8L1vHv2GAeth9Oy9gRHnqqF1tM+fUxpVQvYmPd5TuQZ7LwozhDp7ksZKHQV5dPoZ879NUX8xCgy8ryz7cNhYrqNo6/MCA/Oc8HCQ6rHwORjF4SAnSbAKAYtD+cQL/EB9lh60kF0HVtjxe3J2i8sfTZFG8GuQxQ00Yyw4299doc3DCJd5Je43IDuJF+C8i188tAPKrnyM4RrS2Kj4roYBMNKgX7R2ilPwOIwyMNn4+J6OIJNeKcMhBJzbizeSJDa1kGoZjgP65kzXzUlAqBrRT5rDf/CQM3qvemv3Qk; 4:1coQ0M3BBQq+oSS5QiZO0X+lU0mHHHmPMLDtfabVvzWVoYqKfYSDe0UW8N66HaJwTqyxBfZOuspNmU6GmcDL7L6FWo4fYjdX8sLEbz4t0h8S4f5NBSeTYKefT3t6QegvUDD1+1a4vyvaXkysvgEgSpVOurXieDZKSt5VkkiHMk7bimUXXUwpvSBkvc3U6hdudYxNo6brWCH0M96H8JVI6apgozXOOYIfjHNmP3mA3TYmRXzX14olUuEgB5QaYJCQ3G3V/ruDdiktp0VpTsTkQbQRyWSWdRxRJhW0v9DZgx4= X-Exchange-Antispam-Report-Test: UriScan:(56005881305849); X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(100000700101)(100105000095)(100000701101)(100105300095)(100000702101)(100105100095)(6040450)(601004)(2401047)(8121501046)(5005006)(3002001)(93006095)(93001095)(100000703101)(100105400095)(10201501046)(6041248)(20161123555025)(20161123564025)(20161123562025)(201703131423075)(201702281528075)(201703061421075)(201703061406153)(2016111802025)(20161123558100)(20161123560025)(6072148)(6043046)(201708071742011)(100000704101)(100105200095)(100000705101)(100105500095); SRVR:AM4PR10MB0226; BCL:0; PCL:0; RULEID:(100000800101)(100110000095)(100000801101)(100110300095)(100000802101)(100110100095)(100000803101)(100110400095)(100000804101)(100110200095)(100000805101)(100110500095); SRVR:AM4PR10MB0226; X-Forefront-PRVS: 0402872DA1 X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10009020)(4630300001)(7370300001)(6009001)(6049001)(39830400002)(189002)(199003)(24454002)(65806001)(4326008)(305945005)(65956001)(66066001)(2906002)(50466002)(3260700006)(33646002)(6916009)(6666003)(6246003)(110136004)(7736002)(966005)(478600001)(6306002)(5660300001)(65826007)(2950100002)(8676002)(6116002)(25786009)(81156014)(3846002)(81166006)(83506001)(117156002)(450100002)(23676002)(50986999)(97736004)(76176999)(54356999)(6486002)(77096006)(101416001)(86362001)(53936002)(64126003)(31686004)(106356001)(105586002)(47776003)(4001350100001)(36756003)(68736007)(230700001)(189998001)(42186005)(229853002)(7350300001)(31696002); DIR:OUT; SFP:1101; SCL:1; SRVR:AM4PR10MB0226; H:[192.168.92.135]; FPR:; SPF:None; PTR:InfoNoRecords; MX:1; A:0; LANG:en; Received-SPF: None (protection.outlook.com: chrullrich.net does not designate permitted sender hosts) X-Microsoft-Exchange-Diagnostics: =?utf-8?B?MTtBTTRQUjEwTUIwMjI2OzIzOkpIMUlXNFJUa1B2ZVJ3dUJOdFpIWDJDR3B4?= =?utf-8?B?ci9NbGxkYytQNWpKalFqMDV3SGVvMVk0WG1OanZ3alE0emhac2V4OFJFVTBo?= =?utf-8?B?VW44OUpGNXZOSmpYSlBTWmQzUG81UklFOGY1SUpHckIydnB5NUZUMFZPaGZh?= =?utf-8?B?Tms5ZU91eDBhdEpJYkRqSDIxUHZrVCtYRm5lWkl5NUVDbmsvdGZWOHZ6anYx?= =?utf-8?B?Z1FZUUNVMEU2SnRDWmRNcmR1aVQyZUVFbWF4UTQwb1VpZHJzbVNiN2p0VFRi?= =?utf-8?B?WWh3eWJnQUZFbVhyR3AzcU1aZG4rWHQrQ0NnVVVtNkNyU1AvTVFSTitHbDFz?= =?utf-8?B?ODFWNUtUZW03OVBCVmJIL1lmRHdHZ200UHhIclM2UjJtTnBqOTJiN1NPMDJF?= =?utf-8?B?dWdhWDNjaFdRcGdTTGZhcTVUY0IybUQrVHZObHNTcERXSWJjcDhwenRQd0hE?= =?utf-8?B?YWRIRnBwcllRTTh3dWdnN2lGV1lNNjhEQlFPbGM3TFRZUUZZZVhKK1UrcXFI?= =?utf-8?B?dXkwWVA3c0ozWW5JMWdOcEY1YkFHcC9kbGoxOFRVck45cEpzYUlldXl0MEJh?= =?utf-8?B?NkZrb29aMFNzSDlHK0hJK3Vzam0yZVhBMFQxTDZxdStERDhoaGtzN2ExNG9o?= =?utf-8?B?ZHc5SnR1MUVzVzVOaWwvUDNmaXgrN01TeVZpeTVrb1FxcDhMVFlDaFRqdGlR?= =?utf-8?B?N29oR094Vkx0UFpCSHRBZ2QzdExnS0NSS1R4QzE2dU5BbWZVaGVxZit1R29Q?= =?utf-8?B?K1NrZTdNbW5wVC9ZamdHUHg0TFBQWkNiTmx5MTB0VGwwbmRtYlB6UVNsMjND?= =?utf-8?B?OHczL09QajdNdjNBcS83TlN1a2NFd0k4c3JFQXRWZDJPQS83WG9tL1dleS84?= =?utf-8?B?d1FDVUttQTFzd3Z6TGVOUEtpTjg0RzFZdVhrNkNmK20rcXdkMW5sTEJJMEk2?= =?utf-8?B?UVBDZitQb1NWdzU1N1E2Y21qSlFkdEpRUWNHRlM0ajZLNEdTMi9lU3k0ZTF0?= =?utf-8?B?bmJkd3c5cUxmY1gxKy9SYUdMM2xNN2llcExYRHdRbGtPSjRHOXh0d3g2SFZj?= =?utf-8?B?aXY4UW5iTHUyTUlBZi9mejJJTVFMaE9OZ0ZhN0tsQkhkMEsvcjFpeHFlWkNs?= =?utf-8?B?M1pGdXVLT01kUHA1NVlnU1F5VE9iMGFSeityK0lSSllrd3l4R1ljMS9pVEdK?= =?utf-8?B?eHB4eklMeks2Nkk2QzJ1emdjeTRmYmlJMkdXRC9rL3NNUlYrQUlIRWVqbTFY?= =?utf-8?B?S3J0WEMvMHIya2JhL2xCem56T1ErR0NtcnN4RWRzNGVBRjZ3QkdiR0s4c2p4?= =?utf-8?B?aCsram9mT2pXdXBaMm5QV3pocE40ZVdOL24vN2MxNW1ab2dGUVFXdFNWeXhY?= =?utf-8?B?R0hLN0VGY0lZYW5vcUpuRE1yT3FZTmt2THBlcmF1T0R5MHNRcUQ1eUpQUHhn?= =?utf-8?B?Q25IL1FzMWFSYndlRDZWVkVkUlIxV1BmYjF1VVZxcXBNc0JnTEFjKzArRDJI?= =?utf-8?B?SzV1WG1ST0dXa1FzUFZvNlUrOTNWUXkxQVllc0RVSjBMUEJWVkNvb3h0Y21C?= =?utf-8?B?UDJSYVJMTU5sWGQvYVMrUUJOcU41NHc3dnZWLzBoLzlZQzFYaEZaaFBmR09E?= =?utf-8?B?N3JIYlJkQ3M2N0ZWdWxmRFo4V21OK0MwN1M4OThodGplOXlyVGJoVWFWdVUv?= =?utf-8?B?ZERKSVErR3ZoS2Q4YStjOEpIYWRVNTFXVWhtWGVPVzFIUUJHbHdzcXM2KzFz?= =?utf-8?B?bWtTMytTbldYUTVRRHNKVVJOM2paYlE3OU9TRHBWbWZ1c3NmNmFPdS9ER00v?= =?utf-8?B?MWhnS2tDQjBzc3lHM1pFc1VUamEzd0hUbFpRaW81dEV1Q3VjdmFqN052QXdx?= =?utf-8?B?YkJsT0tCZHB5bkJkc3JWTllXbHRaSjJjWHI5ZHIrS0FwZ0Z3L2N6ajJBUHY0?= =?utf-8?Q?AZPfVoquims6O2Edlc+/eJDs2GJ0Bw=3D?= X-Microsoft-Exchange-Diagnostics: 1; AM4PR10MB0226; 6:LZ+3Nf2tBtX2eUqCI6uocTUJSFLwgZmyu8g6I7iJH46V5eJKF9CIC5JND1bIbvqA+Ktizt9bjSvrU0MLUU93kWcIRa3ckrz5K3LckN+HoUjTtluWoAVG6T6dqZselaoUxlX7ZtmdzZdCBx5Rb17AVvyGHIq38IK1sBteI0uFWWfi9PiBpdYTsx2q3H7E6HUpV8H8Md4cRXvuU93V92yuvx+/YZsQ6JJPHju8PZ3rqHi3IpmiBgGSF70uQXyH6Z/bXOwHAcJB+qovnNnvgxF6WgZk3pgmarVe2WyowcNDYKLJxERaMStjAjJnGqrFoQAvJH71AJPvTQd20m2E/USz+A==; 5:LTRhX3B30yHA88aFMdEmCbcwI6Y8PdyhZwLBYc2q7+M6eTlQND/QuGfQq6eKtFo1OXlYPqTGZoOZkHoQHoEOeRJ9nyVrTgwbPykFdARL1rnkCHBNOyVzH5EUwXeT83u1YyoN3ixwEaTSs+/tsmgopQ==; 24:hBe+aolnfSt2lh3kVhLXCsrogqv0vnflzEtRnOyJ3GviHKi4EjePr5dlkCw9ayREQWvHkRn2IBPUcJcS7UzDO6O3apnX6OSmSar6fvCumtc=; 7:s7urLIEUQZgwqc1EmWw0DbRBdzm5Fv23cJoymgOKz3P3aE6Uo+lkphntAwUIxDLSvTgJQD9xZeakDwoqOyt2m4aYwYlrylu2Bt1DQhWQOdHhcDOanyf+RxLU1AwKRUw5D2/Q72DkesCQNSYQLvmB1eYey+x/VMLuvVQJNXsFvGCfhc+73PyF+Mg75fdNHdx/XSAa5JrvvtbdAbhhlz5lfxiKKIzJQ77gj9vnamJly3s= SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: chrullrich.net X-MS-Exchange-CrossTenant-OriginalArrivalTime: 17 Aug 2017 10:16:25.0144 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM4PR10MB0226 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 17 Aug 2017 10:16:30 -0000 * Kyle Evans wrote: > Author: kevans > Date: Thu Aug 17 04:26:04 2017 > New Revision: 322609 > URL: https://svnweb.freebsd.org/changeset/base/322609 > > Log: > MFC r318571: bsdgrep: emit more than MAX_LINE_MATCHES per line > Modified: stable/11/usr.bin/grep/util.c > ============================================================================== > --- stable/11/usr.bin/grep/util.c Thu Aug 17 04:18:31 2017 (r322608) > +++ stable/11/usr.bin/grep/util.c Thu Aug 17 04:26:04 2017 (r322609) > @@ -356,11 +366,11 @@ procline(struct parsec *pc) > { > regmatch_t pmatch, lastmatch, chkmatch; > wchar_t wbegin, wend; > - size_t st = 0, nst = 0; > + size_t st, nst; > unsigned int i; > int c = 0, r = 0, lastmatches = 0, leflags = eflags; > size_t startm = 0, matchidx; > - int retry; > + unsigned int retry; /usr/src/usr.bin/grep/util.c:453:26: error: comparison of integers of different signs: 'int' and 'unsigned int' [-Werror,-Wsign-compare] pmatch.rm_so + 1 < retry)) ~~~~~~~~~~~~~~~~ ^ ~~~~~ Why would that fail after MFC? Doesn't head use -Werror too? # uname -a FreeBSD infra-poudriere 11.1-PRERELEASE FreeBSD 11.1-PRERELEASE #0 r[unhelpful]: Thu Jul 13 15:30:11 CEST 2017 toor@infra11build:/usr/obj/usr/src/sys/LOCAL amd64 ]# cc --version FreeBSD clang version 4.0.0 (tags/RELEASE_400/final 297347) (based on LLVM 4.0.0) Target: x86_64-unknown-freebsd11.1 Thread model: posix InstalledDir: /usr/bin -- Christian From owner-freebsd-stable@freebsd.org Thu Aug 17 12:23:35 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 73121DDF292; Thu, 17 Aug 2017 12:23:35 +0000 (UTC) (envelope-from byond.lenox@gmail.com) Received: from mail-ua0-f171.google.com (mail-ua0-f171.google.com [209.85.217.171]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0B62D6F928; Thu, 17 Aug 2017 12:23:34 +0000 (UTC) (envelope-from byond.lenox@gmail.com) Received: by mail-ua0-f171.google.com with SMTP id y36so24244759uac.5; Thu, 17 Aug 2017 05:23:34 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=XAOvEcnjrKRGQ4fRuAgug57KfHYQCdcZFE5NUpM4Tqo=; b=OpdXDNGydzX+/Nh+Clme59+h7FhQwU51J1FcAz5PH75F0upd9RD8ThqLsH49r9Ckmk wlOZox/BPSB6Zbrjqf5WVoymZVfv1FZ7gy7nbDXgYetn9VXDF8tj5l+tKT+W8Q2Nz0VP 2Mw0cjrtv1UpTYpJAKfH2dPr1VErsmmX0Fk1zKP3oKu+iWjbOAzP33HHbz6cAJOyaX7O aDdgmlUXAzgLZauk4JTxBh65j6uH7WxG8m1LFVPYteTlrhSa+Mw4UmQMy9joi6y3t/Uj UtrZm8haKSwBCZS8yaz9np0aZx0Cf4qjdhU8nLvsg7/k2vVS0q6BdyzM2SfSjpZtXbii 6CeQ== X-Gm-Message-State: AHYfb5jL5dc6js0j7xo9fl9+go9y3BDJOb7JTyyGKN1IXaEKErzOcLFV blmgE2/D1O1/4jzVCGc= X-Received: by 10.176.20.201 with SMTP id f9mr3376342uae.134.1502972253414; Thu, 17 Aug 2017 05:17:33 -0700 (PDT) Received: from mail-ua0-f182.google.com (mail-ua0-f182.google.com. [209.85.217.182]) by smtp.gmail.com with ESMTPSA id n133sm637611vke.42.2017.08.17.05.17.32 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 17 Aug 2017 05:17:32 -0700 (PDT) Received: by mail-ua0-f182.google.com with SMTP id r9so14630465uad.0; Thu, 17 Aug 2017 05:17:32 -0700 (PDT) X-Received: by 10.159.55.49 with SMTP id z46mr3038105uad.131.1502972252451; Thu, 17 Aug 2017 05:17:32 -0700 (PDT) MIME-Version: 1.0 Received: by 10.159.56.194 with HTTP; Thu, 17 Aug 2017 05:17:31 -0700 (PDT) Received: by 10.159.56.194 with HTTP; Thu, 17 Aug 2017 05:17:31 -0700 (PDT) In-Reply-To: <0cf58b0e-51cd-27f9-1ce5-87ee0e8df207@chrullrich.net> References: <201708170426.v7H4Q4SL015844@repo.freebsd.org> <0cf58b0e-51cd-27f9-1ce5-87ee0e8df207@chrullrich.net> From: Kyle Evans Date: Thu, 17 Aug 2017 07:17:31 -0500 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: svn commit: r322609 - in stable/11: contrib/netbsd-tests/usr.bin/grep usr.bin/grep To: Christian Ullrich , herbert@mailbox.org, emaste@freebsd.org Cc: FreeBSD-STABLE Mailing List , svn-src-stable@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 17 Aug 2017 12:23:35 -0000 Hi, -HEAD defaults to WITHOUT_GNU_GREP_COMPAT at the moment, so this got missed and I apparently had this addressed in my local build testing due to other bits. @emaste: can I commit the fix for this to -HEAD for MFC immediately? (unsigned int) cast on pmatch.rm_so. Thanks, Kyle Evans On Aug 17, 2017 5:16 AM, "Christian Ullrich" wrote: * Kyle Evans wrote: Author: kevans > Date: Thu Aug 17 04:26:04 2017 > New Revision: 322609 > URL: https://svnweb.freebsd.org/changeset/base/322609 > > Log: > MFC r318571: bsdgrep: emit more than MAX_LINE_MATCHES per line > Modified: stable/11/usr.bin/grep/util.c > ============================================================ > ================== > --- stable/11/usr.bin/grep/util.c Thu Aug 17 04:18:31 2017 > (r322608) > +++ stable/11/usr.bin/grep/util.c Thu Aug 17 04:26:04 2017 > (r322609) > @@ -356,11 +366,11 @@ procline(struct parsec *pc) > { > regmatch_t pmatch, lastmatch, chkmatch; > wchar_t wbegin, wend; > - size_t st = 0, nst = 0; > + size_t st, nst; > unsigned int i; > int c = 0, r = 0, lastmatches = 0, leflags = eflags; > size_t startm = 0, matchidx; > - int retry; > + unsigned int retry; > /usr/src/usr.bin/grep/util.c:453:26: error: comparison of integers of different signs: 'int' and 'unsigned int' [-Werror,-Wsign-compare] pmatch.rm_so + 1 < retry)) ~~~~~~~~~~~~~~~~ ^ ~~~~~ Why would that fail after MFC? Doesn't head use -Werror too? # uname -a FreeBSD infra-poudriere 11.1-PRERELEASE FreeBSD 11.1-PRERELEASE #0 r[unhelpful]: Thu Jul 13 15:30:11 CEST 2017 toor@infra11build:/usr/obj/usr/src/sys/LOCAL amd64 ]# cc --version FreeBSD clang version 4.0.0 (tags/RELEASE_400/final 297347) (based on LLVM 4.0.0) Target: x86_64-unknown-freebsd11.1 Thread model: posix InstalledDir: /usr/bin -- Christian From owner-freebsd-stable@freebsd.org Fri Aug 18 09:11:29 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4F67EDD3D8C; Fri, 18 Aug 2017 09:11:29 +0000 (UTC) (envelope-from sodynet1@gmail.com) Received: from mail-io0-x231.google.com (mail-io0-x231.google.com [IPv6:2607:f8b0:4001:c06::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 1411D7DB47; Fri, 18 Aug 2017 09:11:29 +0000 (UTC) (envelope-from sodynet1@gmail.com) Received: by mail-io0-x231.google.com with SMTP id j32so31133065iod.0; Fri, 18 Aug 2017 02:11:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=OCV2yTbK6sEVYZKoxEko+I53FvTkPqhWG6aALBG7Eac=; b=AgKkH6X78DKXXqMhCHvn0kmk4OEPZB64C+NdMC1N9DGYmSUtWL3fph1leb5mSAtBWi BSyNso9NMiEmfOkcvmbvD7W/X8Ch3oz+xA95QMDcjidEmc+DxvGBLsHBr6oLEfINv0Ub 4GbFw5yGjY5PFRYI7H4TECHGinA9SX89XH0HWWmEvD68zj5UfTWHZypxTky4dkahRV4K Ym6lBV01/fHtIOililFErPhL8B5gggnVXQYRv7FLXKPa2S/w9RVcesvCNDYKFxibHUqL G9Y/GvHHpmRdq+1L3o1/aTCtZuaYQt4esjyO+tZYGl3ijwPMiWt1HsO1k/+RhOso/NX3 X7Og== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=OCV2yTbK6sEVYZKoxEko+I53FvTkPqhWG6aALBG7Eac=; b=JzyAakZ3Zb392+Hj7nJ+++UIavdF23QtaO0MFEVLFCZhskN1EusX5+B4VY8Wwncpgr FZDZ13dsSKsX2his6NOawEdLtdmz6O3Tva0PEvuKkGmP8G8Ga4YrAHIX53mfgg7hn7Jm Qr0x2mkU8x/eW2kNQ/aTP66reZTHBE/hpGELwTas/HoGJOCEwXtv9aUFi3AQHR1Lg9iM ifl9QcGT0+k7Ip4ydBs3qM4lMUfu8nsfRuS4nQRgUqWVX4yuKw5yvHtUcg73gPcRI1hz jJTR7uv4aFPTGsPhV6VIeAjRsX8eoa1PIpOwQ2kK9mIxDNDaOWiwQPJV4OJFL5mRZNte 9PvQ== X-Gm-Message-State: AHYfb5jFPyU4L4AwtfSNN7z6h8kwlOigYjCUW4NtChjC2FNB6DQRvo39 45SQB0Tip4v+sVKj1Q0v+BxiX93TWY9u X-Received: by 10.107.50.77 with SMTP id y74mr7052996ioy.150.1503047488028; Fri, 18 Aug 2017 02:11:28 -0700 (PDT) MIME-Version: 1.0 Received: by 10.2.133.174 with HTTP; Fri, 18 Aug 2017 02:11:27 -0700 (PDT) Received: by 10.2.133.174 with HTTP; Fri, 18 Aug 2017 02:11:27 -0700 (PDT) In-Reply-To: References: From: Sami Halabi Date: Fri, 18 Aug 2017 12:11:27 +0300 Message-ID: Subject: recommendations for file server based zfs appliance To: freebsd-fs@freebsd.org, freebsd-stable@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Aug 2017 09:11:29 -0000 Hi all, I am planning to use zfs appliance for backup purposes, do you have reccomenations for small box with 4-16 gb ram ecc, and 4 hard drives sas/sata. Thanks in advance, Sami From owner-freebsd-stable@freebsd.org Fri Aug 18 09:19:20 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6D824DD44C4 for ; Fri, 18 Aug 2017 09:19:20 +0000 (UTC) (envelope-from petefrench@ingresso.co.uk) Received: from constantine.ingresso.co.uk (unknown [IPv6:2a02:b90:3002:411::3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3836A7E06F for ; Fri, 18 Aug 2017 09:19:19 +0000 (UTC) (envelope-from petefrench@ingresso.co.uk) Received: from [82.39.236.162] (helo=foula.drayhouse.twisted.org.uk) by constantine.ingresso.co.uk with esmtpsa (TLSv1.2:ECDHE-RSA-AES128-GCM-SHA256:128) (Exim 4.89 (FreeBSD)) (envelope-from ) id 1didQy-0005PI-Ve for freebsd-stable@freebsd.org; Fri, 18 Aug 2017 09:19:17 +0000 Subject: Re: recommendations for file server based zfs appliance To: freebsd-stable@freebsd.org References: From: Pete French Message-ID: <750ee484-a43e-c96f-bca2-d36825943dde@ingresso.co.uk> Date: Fri, 18 Aug 2017 10:19:16 +0100 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.11; rv:52.0) Gecko/20100101 Thunderbird/52.2.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-GB Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Aug 2017 09:19:20 -0000 The HP micro servers work very well, and you can pick them up remakably cheaply if you look. I have six of these in various laces, all running ZFS and FreeBSD to perform various funcytions. Not sure about ECC memory support there though. Also theres only one expansion slot, which we ut 10 gig cards into (low profile). They all used to come with ull iLo support too, though I understand the most recent model drops this. -pete. On 18/08/2017 10:11, Sami Halabi wrote: > Hi all, > > I am planning to use zfs appliance for backup purposes, do you have > reccomenations for small box with 4-16 gb ram ecc, and 4 hard drives > sas/sata. > > Thanks in advance, > Sami > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > From owner-freebsd-stable@freebsd.org Fri Aug 18 09:21:16 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9C524DD4689; Fri, 18 Aug 2017 09:21:16 +0000 (UTC) (envelope-from araujobsdport@gmail.com) Received: from mail-vk0-x230.google.com (mail-vk0-x230.google.com [IPv6:2607:f8b0:400c:c05::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 509867E33B; Fri, 18 Aug 2017 09:21:16 +0000 (UTC) (envelope-from araujobsdport@gmail.com) Received: by mail-vk0-x230.google.com with SMTP id u133so30391035vke.3; Fri, 18 Aug 2017 02:21:16 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:reply-to:in-reply-to:references:from:date:message-id :subject:to:cc; bh=gyfa2xal0v20WLLKH0Xc/m8ifPSt61+Knt+sOzxWOWg=; b=A4KoOq9+f/Y8K+YVsVPHm5H30tiQVUp7h0ei4fk6woOlv+CfVWfj1iNMHuO4vsxGh7 TqbWjexLtHMCa/w+8/3E32k2LdmUH8c7lfu46yGBlRp4R0iYiK+DuvJhvu/ygJiZOADH 1OZBpcwPDWDgQfACeJCqvwl3Zn5Lcha0gIHfToFno4LiubxoOIMd9enz+AaobezrCngb DVIDzWh3Kxk1pn29+AqgnhvGiZJfvns36Oqczt+71a/VpkiOhvYz738FlpD3mlA+wkIm PVcmvD7c/7zv5xjr27cDwrkv8wozjwZ+kCHRlOSQBmC4jGzJFwMUj+/meFwp0Y11l0Jy oVYg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:reply-to:in-reply-to:references :from:date:message-id:subject:to:cc; bh=gyfa2xal0v20WLLKH0Xc/m8ifPSt61+Knt+sOzxWOWg=; b=h5a+wcLiYhKdkHQGZiaCUTX+hZsDw3empp2TCAuAysXRpz1O2N7R9x/B9epkwzMw8g WUk4AdXy5C9wkE9J+W9xJ0gS5JZZjvPAhPrsqcET/HNqX1enPbqy9DuiH6nEqhi3SeGM /qQjyeOmnfE16DgzeGOet0tn0TC2f33uGLwReFZypl8ZqGLDmaoxiM7Sl3uwMXtZwvF7 xq7aujx/aIRT23+2wW3Tu0ri8Oj6ns9QmBVG7O5ttKLu6QENti266KDrZCcACsvo78BM O9Y4bGX9BEvZahX/3mcbFlx7iF+tl25qwPxt08a9qHg9UyKipfej9WWR9DPp2keud6yc KXRg== X-Gm-Message-State: AHYfb5gaFpxfreWTPGYIq0ZuD6MXkwpKt8icg3NyYtUUKnmYdCA+awxF DAgUgGCLqAMadtKpCJiuA2ouSgOkHA== X-Received: by 10.31.218.133 with SMTP id r127mr5138031vkg.104.1503048075365; Fri, 18 Aug 2017 02:21:15 -0700 (PDT) MIME-Version: 1.0 Received: by 10.176.17.214 with HTTP; Fri, 18 Aug 2017 02:21:14 -0700 (PDT) Reply-To: araujo@freebsd.org In-Reply-To: References: From: Marcelo Araujo Date: Fri, 18 Aug 2017 17:21:14 +0800 Message-ID: Subject: Re: recommendations for file server based zfs appliance To: Sami Halabi Cc: "freebsd-fs@freebsd.org" , FreeBSD-STABLE Mailing List Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Aug 2017 09:21:16 -0000 2017-08-18 17:11 GMT+08:00 Sami Halabi : > Hi all, > > I am planning to use zfs appliance for backup purposes, do you have > reccomenations for small box with 4-16 gb ram ecc, and 4 hard drives > sas/sata. > > Thanks in advance, > Sami > Take a look at iXsystems, they have a nice FreeNAS-Mini. Best, -- Marcelo Araujo (__)araujo@FreeBSD.org \\\'',)http://www.FreeBSD.org \/ \ ^ Power To Server. .\. /_) From owner-freebsd-stable@freebsd.org Fri Aug 18 10:01:31 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D667ADD6318 for ; Fri, 18 Aug 2017 10:01:31 +0000 (UTC) (envelope-from hausen@punkt.de) Received: from kagate.punkt.de (kagate.punkt.de [217.29.33.131]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4A7D57F5A4 for ; Fri, 18 Aug 2017 10:01:30 +0000 (UTC) (envelope-from hausen@punkt.de) Received: from hugo10.ka.punkt.de (hugo10.ka.punkt.de [217.29.44.10]) by gate2.intern.punkt.de with ESMTP id v7I9ekwS007238; Fri, 18 Aug 2017 11:40:47 +0200 (CEST) Received: from [217.29.44.195] ([217.29.44.195]) by hugo10.ka.punkt.de (8.14.2/8.14.2) with ESMTP id v7I9eknO020869; Fri, 18 Aug 2017 11:40:46 +0200 (CEST) (envelope-from hausen@punkt.de) From: "Patrick M. Hausen" Message-Id: <61BB2282-5D66-410E-A4E8-CE7D78D8898B@punkt.de> Content-Type: multipart/signed; boundary="Apple-Mail=_3959AFAD-8C94-46E5-897A-294D79ADE060"; protocol="application/pgp-signature"; micalg=pgp-sha512 Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: Re: recommendations for file server based zfs appliance Date: Fri, 18 Aug 2017 11:40:46 +0200 In-Reply-To: <750ee484-a43e-c96f-bca2-d36825943dde@ingresso.co.uk> Cc: freebsd-stable@freebsd.org To: Pete French References: <750ee484-a43e-c96f-bca2-d36825943dde@ingresso.co.uk> X-Mailer: Apple Mail (2.3273) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Aug 2017 10:01:31 -0000 --Apple-Mail=_3959AFAD-8C94-46E5-897A-294D79ADE060 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Hi, all, > Am 18.08.2017 um 11:19 schrieb Pete French = : > The HP micro servers work very well, and you can pick them up = remakably cheaply [...] > Not sure about ECC memory support there though. They do support ECC, no problem. They are available with different CPU configurations from as Pete said remarkably cheap Celeron D based systems up to Xeon CPUs. If you want something that conserves power but still features 8 cores, Supermicro has got a small 8-core Atom based system: = https://www.supermicro.nl/products/system/midtower/5028/SYS-5028A-TN4.cfm I run this at home and I am really satisfied with it. ECC too, of = course. Capable of running VMs in bhyve ... I'd suggest just using FreeNAS if you intend to build a file server. And of course you can always order a preconfigured FreeNAS mini from iX Systems. HTH, Patrick --Apple-Mail=_3959AFAD-8C94-46E5-897A-294D79ADE060 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQEcBAEBCgAGBQJZlrYeAAoJEJBvLuLt2olc000H/3N4qHi7uw5G4cEKyVFoG8DX Sak3USRlftMk0gt0iRLWPRa8gfcKYGi5rha4ta1rA8SyUOf8XvUHMPb49ZEgP6of R7I5ZeUSswmKNTq4Le6RVJ8C5xaoXB1W8fyiUT2EJkK6xv4pL0WugOkJsyBZZBFg f+90ozme0KMoZUwnyaqgeZcu12TZxuRaJORyAJPS1GX4PDeFHjVhe7jyfxtlt+Zu BpMCnU0JdxDqaIBpnLE6Am/K/aO0JHVn9fxPCGJa/PUY0MQzDxWQrVIKm4QYrASm NK+/R58GyyNP34KZBId9ZMQ5qHHkrqUdUmdx17b0jmxkZRhbv/niytdQAPVil7A= =asFQ -----END PGP SIGNATURE----- --Apple-Mail=_3959AFAD-8C94-46E5-897A-294D79ADE060-- From owner-freebsd-stable@freebsd.org Fri Aug 18 11:48:51 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 59481DDB0DB for ; Fri, 18 Aug 2017 11:48:51 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-QB1-obe.outbound.protection.outlook.com (mail-eopbgr660043.outbound.protection.outlook.com [40.107.66.43]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "Microsoft IT SSL SHA2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id EBDD48284C for ; Fri, 18 Aug 2017 11:48:49 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from YTXPR01MB0189.CANPRD01.PROD.OUTLOOK.COM (10.165.218.133) by YTXPR01MB0445.CANPRD01.PROD.OUTLOOK.COM (10.165.219.153) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P256) id 15.1.1362.18; Fri, 18 Aug 2017 11:48:48 +0000 Received: from YTXPR01MB0189.CANPRD01.PROD.OUTLOOK.COM ([10.165.218.133]) by YTXPR01MB0189.CANPRD01.PROD.OUTLOOK.COM ([10.165.218.133]) with mapi id 15.01.1362.019; Fri, 18 Aug 2017 11:48:48 +0000 From: Rick Macklem To: "Patrick M. Hausen" , Pete French CC: "freebsd-stable@freebsd.org" Subject: Re: recommendations for file server based zfs appliance Thread-Topic: recommendations for file server based zfs appliance Thread-Index: AQHTGAH9dG8xlnkNT0Ci/6Sgxk1PkKKJ1hwAgAAGAgCAACG3AA== Date: Fri, 18 Aug 2017 11:48:48 +0000 Message-ID: References: <750ee484-a43e-c96f-bca2-d36825943dde@ingresso.co.uk>, <61BB2282-5D66-410E-A4E8-CE7D78D8898B@punkt.de> In-Reply-To: <61BB2282-5D66-410E-A4E8-CE7D78D8898B@punkt.de> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=rmacklem@uoguelph.ca; x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1; YTXPR01MB0445; 6:MvgLRdNFnbcdB6whIhX9r8wM+10As9t7iNQEtHePOVlx+b5CfBbYsIjIkDHEjuAPslBxMNzgpuH+8Qi3wC+2ExTL8S/gXZxjc/1cI1RDg0USNV3yVdRvw7BLSLE6JwAqI0ILHHOunz3cFLc+mYuaMiUTgZzi/B7fpKbQTHJkviCAgnrty7s1rKCulwCky7NcM+yMOpz+1YK/5l2Os+Q65V59cl8kY/JEXuPKkCLa1H721pPYFtMaJaESDamcokvKwGOqmIKHB7cuf2p9HE9Jg6KD8RHe17TKpLSUdKARbfWiC5YxkIDR5uefuZ6vioLNsQTlWQZt4vqRcfgkzbaTTQ==; 5:tMBfG6RYPRDmKeAASmiw6GBrJ1Spa3FfMPs/s0QqCw9ZGd2ROfewlB+U8uWNdtDb+fNZw94hrnHj8RmbQQK+dm/uQkXAc7lQyeO9wegHxDSVLspXOG5cZR7Twwsa6l7gXO7omBa9IpPS9vEt4FBmDA==; 24:QJDJvcWDFLh7UOkB+pu3KwAsBHRUn2fN0hcU+eiPoawezUdTKABQsMHE2K8EhWCSXTwlvHvNlYuE34aOQKiLU7IeoJoU9kOZWHJgQSgJPCI=; 7:lEtC6K8HNQgLIl0JYQdW9dOpiHvGDxrzWxXte+RKlASoOCh8hLts5MZPePQjrAU51HnR2AUz+iI4iRlNlTn70PYZF2IDnjsqqxhy070v8KauTeSHTMSriZ5bmm460c9J0ftgeYL9wPQcm0PgA8qK5A8uoBamlL6kF+NgSY2P4w2njsDtd5VN35vh56mc8ZKouqVKOKHKyPHzxgmOSlEKG0Dlyo4m77zdGFPjazyZRvc= x-ms-exchange-antispam-srfa-diagnostics: SSOS; x-ms-office365-filtering-correlation-id: 4e0c614a-8f1f-41d0-4fcd-08d4e62f1696 x-microsoft-antispam: UriScan:; BCL:0; PCL:0; RULEID:(300000500095)(300135000095)(300000501095)(300135300095)(22001)(300000502095)(300135100095)(2017030254152)(300000503095)(300135400095)(2017052603031)(201703131423075)(201703031133081)(201702281549075)(300000504095)(300135200095)(300000505095)(300135600095)(300000506095)(300135500095); SRVR:YTXPR01MB0445; x-ms-traffictypediagnostic: YTXPR01MB0445: x-exchange-antispam-report-test: UriScan:(158342451672863); x-microsoft-antispam-prvs: x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(100000700101)(100105000095)(100000701101)(100105300095)(100000702101)(100105100095)(6040450)(2401047)(5005006)(8121501046)(10201501046)(3002001)(100000703101)(100105400095)(93006095)(93001095)(6041248)(20161123564025)(20161123558100)(20161123555025)(201703131423075)(201702281529075)(201702281528075)(201703061421075)(201703061406153)(20161123562025)(20161123560025)(6072148)(201708071742011)(100000704101)(100105200095)(100000705101)(100105500095); SRVR:YTXPR01MB0445; BCL:0; PCL:0; RULEID:(100000800101)(100110000095)(100000801101)(100110300095)(100000802101)(100110100095)(100000803101)(100110400095)(100000804101)(100110200095)(100000805101)(100110500095); SRVR:YTXPR01MB0445; x-forefront-prvs: 040359335D x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(6009001)(199003)(24454002)(189002)(8676002)(81166006)(102836003)(81156014)(101416001)(8936002)(33656002)(2906002)(229853002)(74482002)(3660700001)(2950100002)(3280700002)(74316002)(106356001)(97736004)(77096006)(86362001)(6436002)(68736007)(6506006)(105586002)(6246003)(4326008)(53936002)(478600001)(93886005)(2900100001)(7696004)(25786009)(305945005)(189998001)(14454004)(9686003)(55016002)(54356999)(50986999)(76176999)(5660300001)(6306002); DIR:OUT; SFP:1101; SCL:1; SRVR:YTXPR01MB0445; H:YTXPR01MB0189.CANPRD01.PROD.OUTLOOK.COM; FPR:; SPF:None; PTR:InfoNoRecords; A:1; MX:1; LANG:en; received-spf: None (protection.outlook.com: uoguelph.ca does not designate permitted sender hosts) spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-originalarrivaltime: 18 Aug 2017 11:48:48.1945 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-Transport-CrossTenantHeadersStamped: YTXPR01MB0445 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Aug 2017 11:48:51 -0000 Patrick M. Hausen wrote: >Hi, all, > >> Am 18.08.2017 um 11:19 schrieb Pete French : >> The HP micro servers work very well, and you can pick them up remakably = cheaply [...] >> Not sure about ECC memory support there though. > >They do support ECC, no problem. > >They are available with different CPU configurations from >as Pete said remarkably cheap Celeron D based systems >up to Xeon CPUs. > >If you want something that conserves power but still features >8 cores, Supermicro has got a small 8-core Atom based >system: >https://www.supermicro.nl/products/system/midtower/5028/SYS-5028A-TN4.cfm > >I run this at home and I am really satisfied with it. ECC too, of course. >Capable of running VMs in bhyve ... > >I'd suggest just using FreeNAS if you intend to build a file server. >And of course you can always order a preconfigured FreeNAS >mini from iX Systems. I can't help with specific hardware recommendations (fortunately others alr= eady have), but I will mention that "If you are going to get bit, it usually is related= to the network interface(s) on the machine.", due to net driver issues. This shouldn't be a problem with an iX Systems box, since they test it with= FreeNAS (based on FreeBSD). Maybe the folk that made hardware suggestions can post which net interface(= s) they are using and whether they are seeing driver issues? Good luck with it, rick From owner-freebsd-stable@freebsd.org Fri Aug 18 11:58:15 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id ABD08DDB98E for ; Fri, 18 Aug 2017 11:58:15 +0000 (UTC) (envelope-from petefrench@ingresso.co.uk) Received: from constantine.ingresso.co.uk (unknown [IPv6:2a02:b90:3002:411::3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 7B98982D96 for ; Fri, 18 Aug 2017 11:58:15 +0000 (UTC) (envelope-from petefrench@ingresso.co.uk) Received: from dilbert.ingresso.co.uk ([2a02:b90:3002:411::6]) by constantine.ingresso.co.uk with esmtpsa (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256) (Exim 4.89 (FreeBSD)) (envelope-from ) id 1diful-0007RY-Vp; Fri, 18 Aug 2017 11:58:11 +0000 Received: from petefrench by dilbert.ingresso.co.uk with local (Exim 4.89 (FreeBSD)) (envelope-from ) id 1diful-0002B0-Rj; Fri, 18 Aug 2017 12:58:11 +0100 To: hausen@punkt.de, petefrench@ingresso.co.uk, rmacklem@uoguelph.ca Subject: Re: recommendations for file server based zfs appliance Cc: freebsd-stable@freebsd.org In-Reply-To: Message-Id: From: Pete French Date: Fri, 18 Aug 2017 12:58:11 +0100 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Aug 2017 11:58:15 -0000 > Maybe the folk that made hardware suggestions can post which net > interface(s) they are using and whether they are seeing driver issues? The HP boxes have Broadcom ethernet controllers driven with the 'bge' driver, and thatw orks fine. I stick to Intel or Broadcom controllers for gigabit ether where I have a choice. The only 10 gig cards we have are some 2nd hand Mellanox ConnectX-2 cards because they are dirt cheap on eBay. They work fine in FreeBSD using the mlxen driver (add MK_OFED=yes to tour /etc/src.conf) but we have had a lot of problems getting them to talk to anthing other than other identical cards - a set of Qlogic (I think) HP cards would work very occasionally, but most of the time would not find a carrier. We are using twinax copper SFF+ for the 10 gig, maybe I would have got better luck with optical, but it wasnt importnat enough to do any serious testing on. -pete. From owner-freebsd-stable@freebsd.org Fri Aug 18 12:04:04 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BDB74DDC5C1 for ; Fri, 18 Aug 2017 12:04:04 +0000 (UTC) (envelope-from hausen@punkt.de) Received: from kagate.punkt.de (kagate.punkt.de [217.29.33.131]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 5159D83424 for ; Fri, 18 Aug 2017 12:04:03 +0000 (UTC) (envelope-from hausen@punkt.de) Received: from hugo10.ka.punkt.de (hugo10.ka.punkt.de [217.29.44.10]) by gate2.intern.punkt.de with ESMTP id v7IC40St010869 for ; Fri, 18 Aug 2017 14:04:00 +0200 (CEST) Received: from [217.29.44.195] ([217.29.44.195]) by hugo10.ka.punkt.de (8.14.2/8.14.2) with ESMTP id v7IC40tS028171 for ; Fri, 18 Aug 2017 14:04:00 +0200 (CEST) (envelope-from hausen@punkt.de) From: "Patrick M. Hausen" Content-Type: multipart/signed; boundary="Apple-Mail=_FC508D82-E08B-4814-A142-8D34045EB6EE"; protocol="application/pgp-signature"; micalg=pgp-sha512 Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: Re: recommendations for file server based zfs appliance Date: Fri, 18 Aug 2017 14:04:00 +0200 References: To: freebsd-stable In-Reply-To: Message-Id: X-Mailer: Apple Mail (2.3273) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Aug 2017 12:04:04 -0000 --Apple-Mail=_FC508D82-E08B-4814-A142-8D34045EB6EE Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=us-ascii Hi all, > Am 18.08.2017 um 13:58 schrieb Pete French : > >> Maybe the folk that made hardware suggestions can post which net >> interface(s) they are using and whether they are seeing driver issues? > > The HP boxes have Broadcom ethernet controllers driven with the 'bge' > driver, and thatw orks fine. I stick to Intel or Broadcom controllers for > gigabit ether where I have a choice. The Supermicro system I mentioned features 4 Intel igb(4) interfaces. I bridge them to save an extra switch in my home network - works great. BTW: this Supermicro box looks suspiciously similar to at least one generation of the FreeNAS mini ... Patrick --Apple-Mail=_FC508D82-E08B-4814-A142-8D34045EB6EE Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQEcBAEBCgAGBQJZltewAAoJEJBvLuLt2olcq1UH/2uDdvGXWny2UEr+7DgPnrzt 3HfcxuPLWk5XsECuDH4hZx4wWS1wGJaxl035SN9aNM7rANn/VjukbJuRf31edTYC /J7WCJF6Sj8EqN/THx/XtYJWb8TnINeEcUEVOzwWrjkZxzq41l2Gq2xg4zZFfqfN kpWXzajwKStsj58yITiPLI/bXfud+ESmVgy5lhMy8EN9BXPwHTLpaO3z77saKxzq 03J+4nAuO1u8II9B9xms6pr4QtEfutsTLTmZVReZigFCijd/43QrKTo1Lhs1/5o+ adQtJXHJH5gw0zWyR3r0je3Zc+bj+WY86JQR4Folnztyra1KhW1Gr6H74bfS3O8= =gJ7W -----END PGP SIGNATURE----- --Apple-Mail=_FC508D82-E08B-4814-A142-8D34045EB6EE-- From owner-freebsd-stable@freebsd.org Fri Aug 18 12:04:56 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 71520DDC7A2 for ; Fri, 18 Aug 2017 12:04:56 +0000 (UTC) (envelope-from raf@rafal.net) Received: from fallback-in2.mxes.net (fallback-out2.mxes.net [216.86.168.191]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 435A0835FE for ; Fri, 18 Aug 2017 12:04:55 +0000 (UTC) (envelope-from raf@rafal.net) Received: from mxout-08.mxes.net (mxout-08.mxes.net [216.86.168.183]) by fallback-in2.mxes.net (Postfix) with ESMTP id 327322FDD16 for ; Fri, 18 Aug 2017 07:58:18 -0400 (EDT) Received: from [192.168.41.2] (unknown [86.40.118.125]) (using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.mxes.net (Postfix) with ESMTPSA id 83FF0509BB; Fri, 18 Aug 2017 07:58:10 -0400 (EDT) Mime-Version: 1.0 (1.0) Subject: Re: recommendations for file server based zfs appliance From: =?utf-8?Q?Rafa=C5=82_Lukawiecki?= X-Mailer: iPhone Mail (14G60) In-Reply-To: <61BB2282-5D66-410E-A4E8-CE7D78D8898B@punkt.de> Date: Fri, 18 Aug 2017 12:58:07 +0100 Cc: Pete French Message-Id: <4C934D75-FEEC-4047-9B48-8E58B71CCA9D@rafal.net> References: <750ee484-a43e-c96f-bca2-d36825943dde@ingresso.co.uk> <61BB2282-5D66-410E-A4E8-CE7D78D8898B@punkt.de> To: "Patrick M. Hausen" , freebsd-stable@freebsd.org Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Aug 2017 12:04:56 -0000 I use FreeNAS on an old Gen7 HP MicroServer. It works well but jails are too= slow and needing an upgrade. Unfortunately, FreeBSD is *not* (yet?) support= ed on HPE MicroServer Gen10, so you couldn't run FreeNAS on it, see my bug r= eport here https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D221350 and forum discussion here:=20 https://forums.freebsd.org/threads/61936/ HPE MicroServer Gen8 are limited to only 16GB RAM which isn't enough for my n= eeds. I will be using a SuperMicro X10SDV-6C+-TLN4F or X10SDV-4C+-TLN4F in t= he next server, but your needs (CPU) may need a higher or a lower spec, so d= o some research.=20 -- Rafal Lukawiecki > On 18 Aug 2017, at 10:40, Patrick M. Hausen wrote: >=20 > Hi, all, >=20 >> Am 18.08.2017 um 11:19 schrieb Pete French : >> The HP micro servers work very well, and you can pick them up remakably c= heaply [...] >> Not sure about ECC memory support there though. >=20 > They do support ECC, no problem. >=20 > They are available with different CPU configurations from > as Pete said remarkably cheap Celeron D based systems > up to Xeon CPUs. >=20 > If you want something that conserves power but still features > 8 cores, Supermicro has got a small 8-core Atom based > system: > https://www.supermicro.nl/products/system/midtower/5028/SYS-5028A-TN4.cfm >=20 > I run this at home and I am really satisfied with it. ECC too, of course. > Capable of running VMs in bhyve ... >=20 > I'd suggest just using FreeNAS if you intend to build a file server. > And of course you can always order a preconfigured FreeNAS > mini from iX Systems. >=20 > HTH, > Patrick From owner-freebsd-stable@freebsd.org Fri Aug 18 12:15:26 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7486CDDD1D4 for ; Fri, 18 Aug 2017 12:15:26 +0000 (UTC) (envelope-from post@herrhagen.de) Received: from mail.srv.hagen.coffee (brews.the.best.midnight.coffee [176.9.40.102]) by mx1.freebsd.org (Postfix) with ESMTP id 3A6F683CE5 for ; Fri, 18 Aug 2017 12:15:25 +0000 (UTC) (envelope-from post@herrhagen.de) Received: from localhost (unknown [10.0.0.2]) by mail.srv.hagen.coffee (Postfix) with ESMTPSA id B06A52A767 for ; Fri, 18 Aug 2017 14:03:52 +0200 (CEST) Date: Fri, 18 Aug 2017 14:03:51 +0200 From: Stefan Hagen To: freebsd-stable@freebsd.org Subject: Re: recommendations for file server based zfs appliance Message-ID: <20170818120351.GA37121@shell-jail> References: <750ee484-a43e-c96f-bca2-d36825943dde@ingresso.co.uk> <61BB2282-5D66-410E-A4E8-CE7D78D8898B@punkt.de> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Disposition: inline Content-Transfer-Encoding: quoted-printable In-Reply-To: <61BB2282-5D66-410E-A4E8-CE7D78D8898B@punkt.de> Precedence: first-class Priority: normal X-Editor: VIM - Vi IMproved 8.0 X-Operating-System: FreeBSD 11.0-RELEASE-p2 amd64 X-Mailer: Mutt 1.8.3 (2017-05-23) X-GPG: 0x8B8BD6DB OpenPGP: url=https://pgp.herrhagen.de; id=8B8BD6DB User-Agent: Mutt/1.8.3 (2017-05-23) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Aug 2017 12:15:26 -0000 * Patrick M. Hausen wrote: >> Am 18.08.2017 um 11:19 schrieb Pete French : >> The HP micro servers work very well, and you can pick them up remakably = cheaply [...] >> Not sure about ECC memory support there though. > >They do support ECC, no problem. > >They are available with different CPU configurations from >as Pete said remarkably cheap Celeron D based systems >up to Xeon CPUs. I've just sold my Microserver Gen8 (Xeon) just recently. It's a beautiful little machine, but I didn't make me happy in the long run. Reasons: - Limited to 8GB Ram in total - Only 4 HDDs - JBOD support is not great - Harddrives are never going to sleep (not supported) Installing FreeBSD was harder than expected. The machine refused to boot Fr= eeBSD =66rom the internal non-raid SATA ports. I didn't try FreeNAS though. Also, in case you go with a Microserver - I think all non-xeon models do not support AES-NI, which will cut the throughput in case you plan to encrypt y= our drives. iX-Systems would have been my choice to replace this machine until I found = out that I can build something myself that suits my needs even better. Note, I was looking at the 8 bay model and I would have to add around $280 = for shipping and tax to Germany. I'm now going for this custom build: - Fractal Design Define R5 Reason: Silent, enough space for 12 drives - SuperMicro MBD-A1SAI-2550F-O Reason: IPMI, ECC, AES-NI, 64GB Ram, Intel NIC, low power consumption - 4x 8GB Kingson ECC SODIMM Reason: 16GB modules are not yet available - Seasonic X-Series Fanless X-400FL 400W passiv Reason: Fanless -> silent The complete order was around 1000=E2=82=AC That being said, I'm planning to put an older 3ware controller in JBOD mode= in it and I also have SSDs and drives already. The board has only 6 SATA ports. But that would be enough for you. This might be a little big for you. But maybe it gives you ideas. Best Regards, Stefan From owner-freebsd-stable@freebsd.org Fri Aug 18 12:21:24 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 712DDDDD8D4 for ; Fri, 18 Aug 2017 12:21:24 +0000 (UTC) (envelope-from hausen@punkt.de) Received: from kagate.punkt.de (kagate.punkt.de [217.29.33.131]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 1666C24F for ; Fri, 18 Aug 2017 12:21:23 +0000 (UTC) (envelope-from hausen@punkt.de) Received: from hugo10.ka.punkt.de (hugo10.ka.punkt.de [217.29.44.10]) by gate2.intern.punkt.de with ESMTP id v7ICLLtI011271; Fri, 18 Aug 2017 14:21:21 +0200 (CEST) Received: from [217.29.44.195] ([217.29.44.195]) by hugo10.ka.punkt.de (8.14.2/8.14.2) with ESMTP id v7ICLL4w029133; Fri, 18 Aug 2017 14:21:21 +0200 (CEST) (envelope-from hausen@punkt.de) From: "Patrick M. Hausen" Message-Id: Content-Type: multipart/signed; boundary="Apple-Mail=_8CA89453-BF34-44D9-A2A6-FF465C166C46"; protocol="application/pgp-signature"; micalg=pgp-sha512 Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: Re: recommendations for file server based zfs appliance Date: Fri, 18 Aug 2017 14:21:20 +0200 In-Reply-To: <20170818120351.GA37121@shell-jail> Cc: freebsd-stable@freebsd.org To: Stefan Hagen References: <750ee484-a43e-c96f-bca2-d36825943dde@ingresso.co.uk> <61BB2282-5D66-410E-A4E8-CE7D78D8898B@punkt.de> <20170818120351.GA37121@shell-jail> X-Mailer: Apple Mail (2.3273) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Aug 2017 12:21:24 -0000 --Apple-Mail=_8CA89453-BF34-44D9-A2A6-FF465C166C46 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Hi! > Am 18.08.2017 um 14:03 schrieb Stefan Hagen = : >=20 > * Patrick M. Hausen wrote: >>> Am 18.08.2017 um 11:19 schrieb Pete French = : >>> The HP micro servers work very well, and you can pick them up = remakably cheaply [...] >>> Not sure about ECC memory support there though. >>=20 >> They do support ECC, no problem. >>=20 >> They are available with different CPU configurations from >> as Pete said remarkably cheap Celeron D based systems >> up to Xeon CPUs. >=20 > I've just sold my Microserver Gen8 (Xeon) just recently. > It's a beautiful little machine, but I didn't make me happy in the = long run. >=20 > Reasons: > - Limited to 8GB Ram in total > - Only 4 HDDs > - JBOD support is not great > - Harddrives are never going to sleep (not supported) >=20 > Installing FreeBSD was harder than expected. The machine refused to = boot FreeBSD > from the internal non-raid SATA ports. I didn't try FreeNAS though. smbios.system.product=3D"ProLiant MicroServer Gen8" CPU: Intel(R) Xeon(R) CPU E3-1220L V2 @ 2.30GHz (2294.80-MHz K8-class = CPU) 16 GB RAM, FreeBSD installation was no problem at all. What do you mean by "JBOD support"? Disable RAID in the systems BIOS setup, put ZFS on AHCI drives ... ahci0: port = 0x10c0-0x10c7,0x10c8-0x10cb,0x10d0-0x10d7,0x10d8-0x10db,0x10e0-0x10ff = mem 0xfacd0000-0xfacd07ff irq 17 at device 31.2 on pci0 ahci0: [ITHREAD] ahci0: AHCI v1.30 with 6 6Gbps ports, Port Multiplier supported ahcich0: at channel 0 on ahci0 ahcich0: [ITHREAD] ada0 at ahcich0 bus 0 scbus0 target 0 lun 0 ada0: ATA-8 SATA 3.x device ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 1907729MB (3907029168 512 byte sectors: 16H 63S/T 16383C) This is our office file, print and mail server. No FreeNAS this time, just plain FreeBSD. Patrick --Apple-Mail=_8CA89453-BF34-44D9-A2A6-FF465C166C46 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQEcBAEBCgAGBQJZltvBAAoJEJBvLuLt2olcxZMIAKAmAZ6pZPweg2DbV/j68wRI NRbiRcZtdF6XtQQq7UwwVRbG5IrbSAriN2Fu1b6PhbhT3Qr8ZgYhsJppBneUBb+p 88gBonMR1Ze2/yuBL4Pc2OTzVvQ65lYqyZ2J7rbJrqfdKBtsGGrX4Qe2E3dWq4bX VAuMIi0Nqw1DgsKf5LQPumL/K60hoTB2veyIYqRS52JkbnP3B9GdzjHxwVaAJZlM 4zsxIDRgjkP5uJxI6uaxL9wc5bc8qVcvzsttW7E74QBuIziJLH8GgIFPzUA9qUYQ WyCk3es29r4Bh/NGvXgPjr2xze1ZCcHeqZva34T0nFmA0o9ELaZs5VOKyWQMOfo= =5eZq -----END PGP SIGNATURE----- --Apple-Mail=_8CA89453-BF34-44D9-A2A6-FF465C166C46-- From owner-freebsd-stable@freebsd.org Fri Aug 18 12:22:31 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 16C79DDDB70 for ; Fri, 18 Aug 2017 12:22:31 +0000 (UTC) (envelope-from raf@rafal.net) Received: from mxout-08.mxes.net (mxout-08.mxes.net [216.86.168.183]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E724287D for ; Fri, 18 Aug 2017 12:22:30 +0000 (UTC) (envelope-from raf@rafal.net) Received: from [192.168.41.2] (unknown [86.40.118.125]) (using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.mxes.net (Postfix) with ESMTPSA id C3817509B6; Fri, 18 Aug 2017 08:22:28 -0400 (EDT) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (1.0) Subject: Re: recommendations for file server based zfs appliance From: =?utf-8?Q?Rafa=C5=82_Lukawiecki?= X-Mailer: iPhone Mail (14G60) In-Reply-To: Date: Fri, 18 Aug 2017 13:22:25 +0100 Cc: hausen@punkt.de, rmacklem@uoguelph.ca, freebsd-stable@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: To: Pete French X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Aug 2017 12:22:31 -0000 The SuperMicro X10SDV-6C+-TLN4F or X10SDV-4C+-TLN4F have twin 10Gb Intel NIC= and a twin 1Gb, 4 ports in total, plus a management one. Support 128GB ECC R= DIMM in total or 64GB UDIMM.=20 -- Rafal Lukawiecki > On 18 Aug 2017, at 12:58, Pete French wrote: >=20 > The only 10 gig cards we have are > some 2nd hand Mellanox ConnectX-2 cards because they are dirt cheap on > eBay. From owner-freebsd-stable@freebsd.org Fri Aug 18 12:37:01 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B3084DDE8A0 for ; Fri, 18 Aug 2017 12:37:01 +0000 (UTC) (envelope-from post@herrhagen.de) Received: from mail.srv.hagen.coffee (brews.the.best.midnight.coffee [176.9.40.102]) by mx1.freebsd.org (Postfix) with ESMTP id 76B3F12EB for ; Fri, 18 Aug 2017 12:37:00 +0000 (UTC) (envelope-from post@herrhagen.de) Received: from localhost (unknown [10.0.0.2]) by mail.srv.hagen.coffee (Postfix) with ESMTPSA id 710132AE1F for ; Fri, 18 Aug 2017 14:35:10 +0200 (CEST) Date: Fri, 18 Aug 2017 14:35:09 +0200 From: Stefan Hagen To: freebsd-stable@freebsd.org Subject: Re: recommendations for file server based zfs appliance Message-ID: <20170818123509.GA38993@shell-jail> References: <750ee484-a43e-c96f-bca2-d36825943dde@ingresso.co.uk> <61BB2282-5D66-410E-A4E8-CE7D78D8898B@punkt.de> <20170818120351.GA37121@shell-jail> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Disposition: inline In-Reply-To: Precedence: first-class Priority: normal X-Editor: VIM - Vi IMproved 8.0 X-Operating-System: FreeBSD 11.0-RELEASE-p2 amd64 X-Mailer: Mutt 1.8.3 (2017-05-23) X-GPG: 0x8B8BD6DB OpenPGP: url=https://pgp.herrhagen.de; id=8B8BD6DB User-Agent: Mutt/1.8.3 (2017-05-23) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Aug 2017 12:37:01 -0000 Hi Patrick, * Patrick M. Hausen wrote: >smbios.system.product="ProLiant MicroServer Gen8" >CPU: Intel(R) Xeon(R) CPU E3-1220L V2 @ 2.30GHz (2294.80-MHz K8-class CPU) > >16 GB RAM, FreeBSD installation was no problem at all. You got me. I just double checked. 16GB is the limit. You're right. >What do you mean by "JBOD support"? Disable RAID in the systems BIOS >setup, put ZFS on AHCI drives ... Activating JBOD deactivates the B120i raid controller. Unfortnately the temperature sensor is somehow controlled by the raid controller. So enabling JBOD technically works, but the machine is a lot louder than with enabled raid. As a workaround I've built 4 raid arrays with one disk each. It works, but it doesn't feel right to me. It's my home file server sitting basically next to my monitor. In an office environment, you probably don't care about the noise so much. See: https://community.hpe.com/t5/ProLiant-Servers-Netservers/MicroServer-Gen8-is-noisy/td-p/6171563 Best Regards, Stefan From owner-freebsd-stable@freebsd.org Fri Aug 18 12:51:58 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EDC35DDF4DD for ; Fri, 18 Aug 2017 12:51:58 +0000 (UTC) (envelope-from hausen@punkt.de) Received: from kagate.punkt.de (kagate.punkt.de [217.29.33.131]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 367C72034 for ; Fri, 18 Aug 2017 12:51:57 +0000 (UTC) (envelope-from hausen@punkt.de) Received: from hugo10.ka.punkt.de (hugo10.ka.punkt.de [217.29.44.10]) by gate2.intern.punkt.de with ESMTP id v7ICptZY012149 for ; Fri, 18 Aug 2017 14:51:55 +0200 (CEST) Received: from [217.29.44.195] ([217.29.44.195]) by hugo10.ka.punkt.de (8.14.2/8.14.2) with ESMTP id v7ICptl7030805 for ; Fri, 18 Aug 2017 14:51:55 +0200 (CEST) (envelope-from hausen@punkt.de) From: "Patrick M. Hausen" Content-Type: multipart/signed; boundary="Apple-Mail=_929ECC32-0766-4F36-BBDB-6088014BF94B"; protocol="application/pgp-signature"; micalg=pgp-sha512 Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: Re: recommendations for file server based zfs appliance Date: Fri, 18 Aug 2017 14:51:55 +0200 References: <750ee484-a43e-c96f-bca2-d36825943dde@ingresso.co.uk> <61BB2282-5D66-410E-A4E8-CE7D78D8898B@punkt.de> <20170818120351.GA37121@shell-jail> <20170818123509.GA38993@shell-jail> To: freebsd-stable In-Reply-To: <20170818123509.GA38993@shell-jail> Message-Id: <25CD54B5-7284-4BB9-8FD8-19AFD88A04AC@punkt.de> X-Mailer: Apple Mail (2.3273) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Aug 2017 12:51:59 -0000 --Apple-Mail=_929ECC32-0766-4F36-BBDB-6088014BF94B Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Hi Stefan, > Am 18.08.2017 um 14:35 schrieb Stefan Hagen = : >> What do you mean by "JBOD support"? Disable RAID in the systems BIOS >> setup, put ZFS on AHCI drives ... >=20 > Activating JBOD deactivates the B120i raid controller. Unfortnately = the temperature sensor > is somehow controlled by the raid controller. So enabling JBOD = technically works, but the > machine is a lot louder than with enabled raid. As a workaround I've = built 4 raid arrays with one disk each. >=20 > It works, but it doesn't feel right to me. Weird - the machine seems rather quiet to me, but it's in a separate room with the laser printers and no one actually working there. I don't know how to measure noise, unfortunately. I have another Gen8 at my wife's office for their not-for-profit organisation. Quiet as a mouse with FreeNAS 11. This time two also very quiet (most of the time) computer based office desks in that room. My machine here at my office: root@filer:~ # ipmitool sensor UID Light | 0x0 | discrete | 0x0180| na | na = | na | na | na | na Health LED | 0x0 | discrete | 0x0180| na | na = | na | na | na | na 01-Inlet Ambient | 28.000 | degrees C | ok | na | na = | na | na | 42.000 | 46.000 02-CPU | 40.000 | degrees C | ok | na | na = | na | na | 70.000 | na 03-P1 DIMM 1-2 | 42.000 | degrees C | ok | na | na = | na | na | 87.000 | na 04-HD Max | na | | na | na | na = | na | na | 60.000 | na 05-Chipset | 63.000 | degrees C | ok | na | na = | na | na | 105.000 | na 06-Chipset Zone | 48.000 | degrees C | ok | na | na = | na | na | 68.000 | 73.000 07-VR P1 Zone | 52.000 | degrees C | ok | na | na = | na | na | 88.000 | 93.000 08-Supercap Max | na | | na | na | na = | na | na | 65.000 | na 09-iLO Zone | 47.000 | degrees C | ok | na | na = | na | na | 72.000 | 77.000 10-PCI 1 | na | | na | na | na = | na | na | 100.000 | na 11-PCI 1 Zone | 39.000 | degrees C | ok | na | na = | na | na | 64.000 | 69.000 12-Sys Exhaust | 48.000 | degrees C | ok | na | na = | na | na | 68.000 | 73.000 13-LOM | na | | na | na | na = | na | na | 100.000 | na Fan 1 | 25.088 | percent | ok | na | na = | na | na | na | na Power Supply 1 | 0x0 | discrete | 0x0180| na | na = | na | na | na | na Memory | 0x0 | discrete | 0x4080| na | na = | na | na | na | na So, temperature sensor working, too. Or are you referring to the *HDD* temperature? I never put disks to sleep in servers ... Patrick --Apple-Mail=_929ECC32-0766-4F36-BBDB-6088014BF94B Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQEcBAEBCgAGBQJZluLrAAoJEJBvLuLt2olc58EH/jVUbEEpv+Q7iQ1kt8OBpUYk V/UsHTCoCW2YePst/HTv3pjNxA3AyzuuLBSPa5d1q7Ham0Vuzg9f2ku2apzYyEN2 BKLi8YtfcroOECi090+tljZ5/VakGm3XpD7Bj9fmKsIMdYiAkW/C0Y3+re+zPX7d 1CBybrC1QKQxj3kJu9KomhPCqeF7j6USN8LCY3Fq1T4tAzwIgF3w60LJLz0i3/fr DH6u2jQq0wgDrRZqWDuS+lzOdqFPf4CUdc7x0iZqy4A156zIHGr6mP2fmXAA8Yxj a5LDZt+itm51JWzl9FI6HOUVnSjQYBrhIoLjE+sOtWZTGrwQsNomFbjTAwO88u4= =nmGx -----END PGP SIGNATURE----- --Apple-Mail=_929ECC32-0766-4F36-BBDB-6088014BF94B-- From owner-freebsd-stable@freebsd.org Fri Aug 18 12:54:51 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2670ADDF848 for ; Fri, 18 Aug 2017 12:54:51 +0000 (UTC) (envelope-from petefrench@ingresso.co.uk) Received: from constantine.ingresso.co.uk (unknown [IPv6:2a02:b90:3002:411::3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E37C22217 for ; Fri, 18 Aug 2017 12:54:50 +0000 (UTC) (envelope-from petefrench@ingresso.co.uk) Received: from dilbert.ingresso.co.uk ([2a02:b90:3002:411::6]) by constantine.ingresso.co.uk with esmtpsa (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256) (Exim 4.89 (FreeBSD)) (envelope-from ) id 1dignY-000885-PP; Fri, 18 Aug 2017 12:54:48 +0000 Received: from petefrench by dilbert.ingresso.co.uk with local (Exim 4.89 (FreeBSD)) (envelope-from ) id 1dignY-0002sr-JR; Fri, 18 Aug 2017 13:54:48 +0100 Date: Fri, 18 Aug 2017 13:54:48 +0100 To: freebsd-stable@freebsd.org, freebsd-stable-list@textmail.me Subject: Re: recommendations for file server based zfs appliance References: <750ee484-a43e-c96f-bca2-d36825943dde@ingresso.co.uk> <61BB2282-5D66-410E-A4E8-CE7D78D8898B@punkt.de> <20170818120351.GA37121@shell-jail> <20170818123509.GA38993@shell-jail> In-Reply-To: <20170818123509.GA38993@shell-jail> User-Agent: Heirloom mailx 12.4 7/29/08 MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Message-Id: From: Pete French X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Aug 2017 12:54:51 -0000 > temperature sensor is somehow controlled by the raid controller. So enabling > JBOD technically works, but the machine is a lot louder than with enabled > raid. As a workaround I've built 4 raid arrays with one disk each. Upgrade the firmware. That fixed it for me - I run JBOD and the fanes are nice and quiet. Noisy on boot, like all HP servers, but then settle down when the OS starts. I have this positioned under my TV and low noise was the main reason for choosing it. Of course, getting the firmware upgraded means finding an HP firmware maintenance DVD image from somewhere, as they restricted downloading them. -pete. From owner-freebsd-stable@freebsd.org Fri Aug 18 13:02:30 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3CBCCDE0201 for ; Fri, 18 Aug 2017 13:02:30 +0000 (UTC) (envelope-from outbackdingo@gmail.com) Received: from mail-wr0-x22c.google.com (mail-wr0-x22c.google.com [IPv6:2a00:1450:400c:c0c::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C24C02A62 for ; Fri, 18 Aug 2017 13:02:29 +0000 (UTC) (envelope-from outbackdingo@gmail.com) Received: by mail-wr0-x22c.google.com with SMTP id 49so61014409wrw.2 for ; Fri, 18 Aug 2017 06:02:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=1PQKeI8VNv2A5BY3PqVLQrCylG/AxzTBymL+6RuH21c=; b=mWLpuFd0qWpPlJ1rFGKFLXnUtEHXbt3DqXe3bVAxuFkTrio4BBRxwRTfqukQUBONV2 l87z8wu+G2R2G+qORnbroj6mbN1gThRCojaIy6Q4QN/+Y9Gx5/Q4Wkh8U2/SZ9Hk+zvw Y/jSnJUfF/g/zqk3Vl0PBaD6YglhBo4AEJdR+4n6NkgDVovanHOW2z2DHOkbr3v8gPYl MHbqQhYMtp/6nQpTaVAWx2Rb9Tcx5xN42yLePpbADUIeWupK7f9p7LfLvLhUR7vahomY VaEyNY5SlzmFlDIPphbByDS7cXbD95XqnTdHdq9LpX5QnpqCcSBNxM4/XgQRO5dHhCEt PsNg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=1PQKeI8VNv2A5BY3PqVLQrCylG/AxzTBymL+6RuH21c=; b=k/zU7iU4qjr9fJmuH8iC5AoCPLX7Lt/BtCuCLUIellY4g0Bbt3seByAHcKPufZu/Ci vEhOMFmw3MbWXZoq9CgL85IqDfSeRX4kXQ6C22HrHfTJ4LEJ0xIjMbQL/ZTU0WyXk3Z3 XHkuGfXgs1v0B+nPRPPQ5ouaY/PJXGa6wVMR89R09hB1YKkFhrQtuOEgoyouVWrnRp0S UQi5U0KXB6LTWsm5Elry4db0UzqgAZIo3VPX51oWVJCU1NBnWM9hJChqkW/Iee68kNRo BN2Bnh+lvZEMLxZt6Ymd/t9rxAaHEBERcosjA17ocOZjrrCn2pDpJrSXOFq0hrYi8HG3 pmyw== X-Gm-Message-State: AHYfb5gfvV/oIg5DLQCkwEGRPEW0TvU46xWqCTHTwJvUJ5U9UH3Jcl9T m+r4nuOC9Ha9NB0BJYtyyJ+gTkb/sSG8 X-Received: by 10.223.155.9 with SMTP id b9mr5960092wrc.127.1503061348120; Fri, 18 Aug 2017 06:02:28 -0700 (PDT) MIME-Version: 1.0 Received: by 10.223.164.83 with HTTP; Fri, 18 Aug 2017 06:01:47 -0700 (PDT) In-Reply-To: <20170818120351.GA37121@shell-jail> References: <750ee484-a43e-c96f-bca2-d36825943dde@ingresso.co.uk> <61BB2282-5D66-410E-A4E8-CE7D78D8898B@punkt.de> <20170818120351.GA37121@shell-jail> From: Outback Dingo Date: Fri, 18 Aug 2017 09:01:47 -0400 Message-ID: Subject: Re: recommendations for file server based zfs appliance To: Stefan Hagen Cc: freebsd-stable@freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Aug 2017 13:02:30 -0000 On Fri, Aug 18, 2017 at 8:03 AM, Stefan Hagen wrote: > * Patrick M. Hausen wrote: >>> >>> Am 18.08.2017 um 11:19 schrieb Pete French : >>> The HP micro servers work very well, and you can pick them up remakably >>> cheaply [...] >>> Not sure about ECC memory support there though. >> >> >> They do support ECC, no problem. >> >> They are available with different CPU configurations from >> as Pete said remarkably cheap Celeron D based systems >> up to Xeon CPUs. > > > I've just sold my Microserver Gen8 (Xeon) just recently. > It's a beautiful little machine, but I didn't make me happy in the long r= un. > > Reasons: > - Limited to 8GB Ram in total > - Only 4 HDDs > - JBOD support is not great > - Harddrives are never going to sleep (not supported) > > Installing FreeBSD was harder than expected. The machine refused to boot > FreeBSD > from the internal non-raid SATA ports. I didn't try FreeNAS though. > > Also, in case you go with a Microserver - I think all non-xeon models do = not > support AES-NI, which will cut the throughput in case you plan to encrypt > your > drives. > > iX-Systems would have been my choice to replace this machine until I foun= d > out > that I can build something myself that suits my needs even better. > > Note, I was looking at the 8 bay model and I would have to add around $28= 0 > for > shipping and tax to Germany. > > I'm now going for this custom build: > - Fractal Design Define R5 > Reason: Silent, enough space for 12 drives > - SuperMicro MBD-A1SAI-2550F-O > Reason: IPMI, ECC, AES-NI, 64GB Ram, Intel NIC, low power consumption > - 4x 8GB Kingson ECC SODIMM > Reason: 16GB modules are not yet available > - Seasonic X-Series Fanless X-400FL 400W passiv > Reason: Fanless -> silent > > The complete order was around 1000=E2=82=AC > > That being said, I'm planning to put an older 3ware controller in JBOD mo= de > in > it and I also have SSDs and drives already. The board has only 6 SATA por= ts. > But that would be enough for you. > > This might be a little big for you. But maybe it gives you ideas. > > Best Regards, > Stefan > Sorry but need to as do yo want some under powered atom system? or a core i3i7 cpu and 16 Gbs memoery, with 8 GB ports and 6 SATA ports in a small custom build. because thats exactly what we sell and we sell it for less the an XL .... by a few hundred bucs, less the drives. it will easly take 6 3.5 drives and 2 2.5..... IF you really want the specs on a sweet low end system with higher specs then the miniXL and cheaper also then say a super micro or HP box let me know. > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" From owner-freebsd-stable@freebsd.org Fri Aug 18 13:31:43 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9CB38DE1CDC for ; Fri, 18 Aug 2017 13:31:43 +0000 (UTC) (envelope-from post@herrhagen.de) Received: from mail.srv.hagen.coffee (brews.the.best.midnight.coffee [176.9.40.102]) by mx1.freebsd.org (Postfix) with ESMTP id 5DD0F3B22 for ; Fri, 18 Aug 2017 13:31:42 +0000 (UTC) (envelope-from post@herrhagen.de) Received: from localhost (unknown [10.0.0.2]) by mail.srv.hagen.coffee (Postfix) with ESMTPSA id 3C47E2AA51 for ; Fri, 18 Aug 2017 15:29:51 +0200 (CEST) Date: Fri, 18 Aug 2017 15:29:47 +0200 From: Stefan Hagen To: freebsd-stable@freebsd.org Subject: Re: recommendations for file server based zfs appliance Message-ID: <20170818132947.GC38993@shell-jail> References: <750ee484-a43e-c96f-bca2-d36825943dde@ingresso.co.uk> <61BB2282-5D66-410E-A4E8-CE7D78D8898B@punkt.de> <20170818120351.GA37121@shell-jail> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Disposition: inline In-Reply-To: Precedence: first-class Priority: normal X-Editor: VIM - Vi IMproved 8.0 X-Operating-System: FreeBSD 11.0-RELEASE-p2 amd64 X-Mailer: Mutt 1.8.3 (2017-05-23) X-GPG: 0x8B8BD6DB OpenPGP: url=https://pgp.herrhagen.de; id=8B8BD6DB User-Agent: Mutt/1.8.3 (2017-05-23) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Aug 2017 13:31:43 -0000 * Outback Dingo wrote: >Sorry but need to as do yo want some under powered atom system? or a >core i3i7 cpu and 16 Gbs memoery, with 8 GB ports and 6 SATA ports in >a small custom build. >because thats exactly what we sell and we sell it for less the an XL >.... by a few hundred bucs, less the drives. it will easly take 6 3.5 >drives and 2 2.5..... IF you really >want the specs on a sweet low end system with higher specs then the >miniXL and cheaper also then say a super micro or HP box let me know. Who is "we"? Best Regards, Stefan From owner-freebsd-stable@freebsd.org Fri Aug 18 14:31:15 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4FBB9DE510D for ; Fri, 18 Aug 2017 14:31:15 +0000 (UTC) (envelope-from jacinta.martin@collabratesuite.com) Received: from mail-qt0-x247.google.com (mail-qt0-x247.google.com [IPv6:2607:f8b0:400d:c0d::247]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 1F37965A4D for ; Fri, 18 Aug 2017 14:31:15 +0000 (UTC) (envelope-from jacinta.martin@collabratesuite.com) Received: by mail-qt0-x247.google.com with SMTP id u11so49873663qtu.10 for ; Fri, 18 Aug 2017 07:31:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=collabratesuite-com.20150623.gappssmtp.com; s=20150623; h=mime-version:message-id:date:subject:from:to; bh=qG/3/D2Xr9WL9evu9hAWhSj8BZ+5MCUlP1zwIyVq2xE=; b=SjzeIloN/TJMBhKTIjshDIkmlDu3Zm4BUXSzJT7obTszhQEPhaJJi76BIuMkAPeZk5 DCdPdcxVEE2EgBw1MFjGvUNHdCUuZupjbQ2uzsS5HgReGfVNw8zAOILKeYrCYQsyfoMq XrRCsGO61sMRYonSUOP4CeFj082Bd0sF/zAR7QEdylBRNptCGO01PcAAV8BSOyA0iNit 0gx1EGGOHijYkTcLPt/44BIiqlwJfZ9JMJzRUMgqQB+pTH0bR38i83A1vNqEM4QP8Bgj zLasv+iBrf9a4ln4tEtzlgatjh24dD5MAAL2mxbIj0cE8cHidecVdnlYp5SfTtNi/QVL TqlA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:message-id:date:subject:from:to; bh=qG/3/D2Xr9WL9evu9hAWhSj8BZ+5MCUlP1zwIyVq2xE=; b=bsOM78J7xFOCHqZfC87BopWktEuLP119RKaraiteIiE1Xfjnmsx6TkJ9w8fn2XbTa8 H4wC+AsIC/L5rvpY4YPcUxdx6bIxKZvOBy5vaIXvQ/8/MNbJEi1YgWIIuTfMsJfqiyGL PJJj/9n0CpcmivoBcv54RA1FdoWV/Pm9lxXtVZWb3MOdhm4/tAxO7yltJCJEHbNOOjOP XupWjzoNEOIWIg4LKq7wQPUbcp20oMKMQhC96/pMrmf0XCyqToDWd/cK1uj3pHESCjm0 unx1PGeEis/4PLr/TNGHzbnOIM/Qr/4rlOr465KoX2agkl+purWeJ4XuwfP/qYUDJsuU 9BVQ== X-Gm-Message-State: AHYfb5ib/DAQe/tXI/CV84YkLZy34pDWUVQVV/ANkjAG0zwilkq9459W dcUFyjdCsy3A5Ns72o5b9QKrftown7BJ MIME-Version: 1.0 X-Received: by 10.237.50.69 with SMTP id y63mr6278841qtd.125.1503066674146; Fri, 18 Aug 2017 07:31:14 -0700 (PDT) Message-ID: <001a114d75c22fc364055707fbe5@google.com> Date: Fri, 18 Aug 2017 14:31:14 +0000 Subject: AWS Users List From: jacinta.martin@collabratesuite.com To: freebsd-stable@freebsd.org Content-Type: text/plain; charset="UTF-8"; format=flowed; delsp=yes Content-Transfer-Encoding: base64 X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Aug 2017 14:31:15 -0000 PGRpdiBkaXI9Imx0ciI+PHAgIA0KY2xhc3M9Im1fMzk0NDgzMDE3MTk3MjExNzE5N2dtYWlsLW1f OTA3MDM0MTY4MTgxNjc3OTU1OWdtYWlsLW1fODk2NzExMzc5OTAyNjM4OTc5OWdtYWlsLW1fLTEy NTQ4MzU4MjUxOTQzNzQzNTBnbWFpbC1tXy04MTkxNzQ3ODYwMTIxMjI5MDg5Z21haWwtbV8tNzM5 MDM1MzQxOTQ2OTMzNDE0N2dtYWlsLW1fLTYzOTM1NzkzMTcwNTM3Njk0MjVnbWFpbC1tXzYyMDkx NzgyMDQxODg5MTE4MzJnbWFpbC1Nc29Ob1NwYWNpbmciPjxzcGFuICANCnN0eWxlPSJmb250LXNp emU6MTBwdDtmb250LWZhbWlseTpBcmlhbCxzYW5zLXNlcmlmO2NvbG9yOnJnYigzMSw3OCwxMjEp O2JhY2tncm91bmQtaW1hZ2U6aW5pdGlhbDtiYWNrZ3JvdW5kLXBvc2l0aW9uOmluaXRpYWw7YmFj a2dyb3VuZC1zaXplOmluaXRpYWw7YmFja2dyb3VuZC1yZXBlYXQ6aW5pdGlhbDtiYWNrZ3JvdW5k LW9yaWdpbjppbml0aWFsO2JhY2tncm91bmQtY2xpcDppbml0aWFsIj5IZWxsbw0KdGhlcmUsPC9z cGFuPjxzcGFuICANCnN0eWxlPSJmb250LXNpemU6MTBwdDtmb250LWZhbWlseTpBcmlhbCxzYW5z LXNlcmlmO2NvbG9yOnJnYigzMSw3OCwxMjEpIj48YnI+DQo8c3BhbiAgDQpzdHlsZT0iYmFja2dy b3VuZC1pbWFnZTppbml0aWFsO2JhY2tncm91bmQtcG9zaXRpb246aW5pdGlhbDtiYWNrZ3JvdW5k LXNpemU6aW5pdGlhbDtiYWNrZ3JvdW5kLXJlcGVhdDppbml0aWFsO2JhY2tncm91bmQtb3JpZ2lu OmluaXRpYWw7YmFja2dyb3VuZC1jbGlwOmluaXRpYWwiPsKgIMKgPC9zcGFuPjxicj4NCjxzcGFu ICANCnN0eWxlPSJiYWNrZ3JvdW5kLWltYWdlOmluaXRpYWw7YmFja2dyb3VuZC1wb3NpdGlvbjpp bml0aWFsO2JhY2tncm91bmQtc2l6ZTppbml0aWFsO2JhY2tncm91bmQtcmVwZWF0OmluaXRpYWw7 YmFja2dyb3VuZC1vcmlnaW46aW5pdGlhbDtiYWNrZ3JvdW5kLWNsaXA6aW5pdGlhbCI+TWlnaHQg IA0Kd2FudCB0byBrbm93IHdoZXRoZXIgeW91IGFyZSBrZWVuIG9uIG9idGFpbmluZzwvc3Bhbj48 L3NwYW4+PGI+PGZvbnQgIA0KY29sb3I9IiMxZjRlNzkiPsKgPC9mb250PjxzcGFuICANCmNsYXNz PSJtXzM5NDQ4MzAxNzE5NzIxMTcxOTdnbWFpbC1tXzkwNzAzNDE2ODE4MTY3Nzk1NTlnbWFpbC1t Xzg5NjcxMTM3OTkwMjYzODk3OTlnbWFpbC1tXy0xMjU0ODM1ODI1MTk0Mzc0MzUwZ21haWwtbV8t ODE5MTc0Nzg2MDEyMTIyOTA4OWdtYWlsLW1fLTczOTAzNTM0MTk0NjkzMzQxNDdnbWFpbC1tXy02 MzkzNTc5MzE3MDUzNzY5NDI1Z21haWwtbV82MjA5MTc4MjA0MTg4OTExODMyZ21haWwtZ2kiPjxm b250ICANCmNvbG9yPSIjMWY0ZTc5Ij5BV1PCoDwvZm9udD48L3NwYW4+PC9iPjxzcGFuICANCnN0 eWxlPSJmb250LXNpemU6MTBwdDtmb250LWZhbWlseTpBcmlhbCxzYW5zLXNlcmlmO2NvbG9yOnJn YigzMSw3OCwxMjEpO2JhY2tncm91bmQtaW1hZ2U6aW5pdGlhbDtiYWNrZ3JvdW5kLXBvc2l0aW9u OmluaXRpYWw7YmFja2dyb3VuZC1zaXplOmluaXRpYWw7YmFja2dyb3VuZC1yZXBlYXQ6aW5pdGlh bDtiYWNrZ3JvdW5kLW9yaWdpbjppbml0aWFsO2JhY2tncm91bmQtY2xpcDppbml0aWFsIj5MZWFk cyAgDQpmb3IgeW91cg0KbWFya2V0aW5nIGVmZm9ydC4gPC9zcGFuPjxzcGFuICANCnN0eWxlPSJm b250LXNpemU6MTBwdDtmb250LWZhbWlseTpBcmlhbCxzYW5zLXNlcmlmO2NvbG9yOnJnYigzMSw3 OCwxMjEpIj48YnI+DQo8YnI+DQo8c3BhbiAgDQpzdHlsZT0iYmFja2dyb3VuZC1pbWFnZTppbml0 aWFsO2JhY2tncm91bmQtcG9zaXRpb246aW5pdGlhbDtiYWNrZ3JvdW5kLXNpemU6aW5pdGlhbDti YWNrZ3JvdW5kLXJlcGVhdDppbml0aWFsO2JhY2tncm91bmQtb3JpZ2luOmluaXRpYWw7YmFja2dy b3VuZC1jbGlwOmluaXRpYWwiPkRhdGEgIA0KRmllbGRzOiBOYW1lLCBUaXRsZSwgRW1haWwsIFBo b25lIE51bWJlcnMsDQpDb21wYW55IE5hbWUsIGFuZCBDb21wYW55IERldGFpbHMgbGlrZSBQaHlz aWNhbCBBZGRyZXNzLCBXZWIgQWRkcmVzcywgIA0KUmV2ZW51ZQ0KU2l6ZSwgRW1wbG95ZWUgU2l6 ZSBhbmQgaW5kdXN0cnkuPC9zcGFuPjxicj4NCjxicj4NCjxzcGFuICANCnN0eWxlPSJiYWNrZ3Jv dW5kLWltYWdlOmluaXRpYWw7YmFja2dyb3VuZC1wb3NpdGlvbjppbml0aWFsO2JhY2tncm91bmQt c2l6ZTppbml0aWFsO2JhY2tncm91bmQtcmVwZWF0OmluaXRpYWw7YmFja2dyb3VuZC1vcmlnaW46 aW5pdGlhbDtiYWNrZ3JvdW5kLWNsaXA6aW5pdGlhbCI+UGxlYXNlICANCnJldmlldyBhbmQgbGV0 IG1lIGtub3cgeW91ciB0aG91Z2h0cyBJDQp3aWxsIGdldCBiYWNrIHRvIHlvdSB3aXRoIGEgbW9y ZSBpbmZvcm1hdGlvbiBhbmQgUHJpY2UgTGlzdCBMYXN0ICANClZlcmlmaWNhdGlvbg0KRGF0ZTog MDcvMDMvMjAxNy48L3NwYW4+PGJyPg0KPGJyPg0KPHNwYW4gIA0Kc3R5bGU9ImJhY2tncm91bmQt aW1hZ2U6aW5pdGlhbDtiYWNrZ3JvdW5kLXBvc2l0aW9uOmluaXRpYWw7YmFja2dyb3VuZC1zaXpl OmluaXRpYWw7YmFja2dyb3VuZC1yZXBlYXQ6aW5pdGlhbDtiYWNrZ3JvdW5kLW9yaWdpbjppbml0 aWFsO2JhY2tncm91bmQtY2xpcDppbml0aWFsIj5SZWdhcmRzLDwvc3Bhbj48YnI+DQo8Yj48c3Bh biAgDQpzdHlsZT0iYmFja2dyb3VuZC1pbWFnZTppbml0aWFsO2JhY2tncm91bmQtcG9zaXRpb246 aW5pdGlhbDtiYWNrZ3JvdW5kLXNpemU6aW5pdGlhbDtiYWNrZ3JvdW5kLXJlcGVhdDppbml0aWFs O2JhY2tncm91bmQtb3JpZ2luOmluaXRpYWw7YmFja2dyb3VuZC1jbGlwOmluaXRpYWwiPkphY2lu dGE8L3NwYW4+PC9iPjxicj4NCjxicj4NCjxzcGFuICANCnN0eWxlPSJiYWNrZ3JvdW5kLWltYWdl OmluaXRpYWw7YmFja2dyb3VuZC1wb3NpdGlvbjppbml0aWFsO2JhY2tncm91bmQtc2l6ZTppbml0 aWFsO2JhY2tncm91bmQtcmVwZWF0OmluaXRpYWw7YmFja2dyb3VuZC1vcmlnaW46aW5pdGlhbDti YWNrZ3JvdW5kLWNsaXA6aW5pdGlhbCI+U2FsZXMgIA0KRXhlY3V0aXZlPC9zcGFuPjxicj4NCjxi cj4NCjxzcGFuICANCnN0eWxlPSJiYWNrZ3JvdW5kLWltYWdlOmluaXRpYWw7YmFja2dyb3VuZC1w b3NpdGlvbjppbml0aWFsO2JhY2tncm91bmQtc2l6ZTppbml0aWFsO2JhY2tncm91bmQtcmVwZWF0 OmluaXRpYWw7YmFja2dyb3VuZC1vcmlnaW46aW5pdGlhbDtiYWNrZ3JvdW5kLWNsaXA6aW5pdGlh bCI+VG8gIA0Kb3B0LW91dCByZXNwb25zZSDigJhSZW1vdmXigJkgaW4gdGhlIHN1YmplY3QgIA0K bGluZTwvc3Bhbj7CoDxzcGFuPjwvc3Bhbj48L3NwYW4+PC9wPg0KDQo8cCAgDQpjbGFzcz0ibV8z OTQ0ODMwMTcxOTcyMTE3MTk3Z21haWwtbV85MDcwMzQxNjgxODE2Nzc5NTU5Z21haWwtbV84OTY3 MTEzNzk5MDI2Mzg5Nzk5Z21haWwtbV8tMTI1NDgzNTgyNTE5NDM3NDM1MGdtYWlsLW1fLTgxOTE3 NDc4NjAxMjEyMjkwODlnbWFpbC1tXy03MzkwMzUzNDE5NDY5MzM0MTQ3Z21haWwtbV8tNjM5MzU3 OTMxNzA1Mzc2OTQyNWdtYWlsLW1fNjIwOTE3ODIwNDE4ODkxMTgzMmdtYWlsLU1zb05vU3BhY2lu ZyI+PHNwYW4gIA0Kc3R5bGU9ImZvbnQtc2l6ZToxMHB0O2ZvbnQtZmFtaWx5OkFyaWFsLHNhbnMt c2VyaWY7Y29sb3I6cmdiKDMxLDc4LDEyMSkiPsKgPHNwYW4+PC9zcGFuPjwvc3Bhbj48L3A+PC9k aXY+DQo8cD4mbmJzcDs8L3A+PGEgc3R5bGU9J2Rpc3BsYXk6IGJsb2NrOyBtYXJnaW46IDMycHgg MCA0MHB4IDA7IHBhZGRpbmc6ICANCjEwcHg7IGZvbnQtc2l6ZTogMWVtOyB0ZXh0LWFsaWduOiBj ZW50ZXI7IGJvcmRlcjogMDsgYm9yZGVyLXRvcDogMXB4IHNvbGlkICANCmdyYXk7ICcgaHJlZj0n aHR0cHM6Ly9nb28uZ2wvMmtzZFJ2Jz5wb3dlcmVkIGJ5IEdTTS4gRnJlZSBtYWlsIG1lcmdlIGFu ZCAgDQplbWFpbCBtYXJrZXRpbmcgc29mdHdhcmUgZm9yIEdtYWlsLjwvYT4NCg== From owner-freebsd-stable@freebsd.org Sat Aug 19 21:04:09 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 877F6DE4880 for ; Sat, 19 Aug 2017 21:04:09 +0000 (UTC) (envelope-from marius@alchemy.franken.de) Received: from alchemy.franken.de (alchemy.franken.de [194.94.249.214]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "alchemy.franken.de", Issuer "alchemy.franken.de" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 31BA364C87; Sat, 19 Aug 2017 21:04:08 +0000 (UTC) (envelope-from marius@alchemy.franken.de) Received: from alchemy.franken.de (localhost [127.0.0.1]) by alchemy.franken.de (8.15.2/8.15.2/ALCHEMY.FRANKEN.DE) with ESMTPS id v7JL41DR085278 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Sat, 19 Aug 2017 23:04:01 +0200 (CEST) (envelope-from marius@alchemy.franken.de) Received: (from marius@localhost) by alchemy.franken.de (8.15.2/8.15.2/Submit) id v7JL41Ln085277; Sat, 19 Aug 2017 23:04:01 +0200 (CEST) (envelope-from marius) Date: Sat, 19 Aug 2017 23:04:01 +0200 From: Marius Strobl To: freebsd-stable@FreeBSD.org Cc: FreeBSD Release Engineering Team Subject: FreeBSD 10.4-BETA1 Now Available Message-ID: <20170819210401.GB71127@alchemy.franken.de> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="U+BazGySraz5kW0T" Content-Disposition: inline User-Agent: Mutt/1.5.24 (2015-08-30) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 19 Aug 2017 21:04:09 -0000 --U+BazGySraz5kW0T Content-Type: text/plain; charset=us-ascii Content-Disposition: inline The first BETA build of the 10.4-RELEASE release cycle is now available. Installation images are available for: o amd64 GENERIC o i386 GENERIC o ia64 GENERIC o powerpc GENERIC o powerpc64 GENERIC64 o sparc64 GENERIC o armv6 CUBOX-HUMMINGBOARD o armv6 GUMSTIX o armv6 PANDABOARD Note regarding arm/armv6 images: For convenience for those without console access to the system, a freebsd user with a password of freebsd is available by default for ssh(1) access. Additionally, the root user password is set to root. It is strongly recommended to change the password for both users after gaining access to the system. Installer images and memory stick images are available here: https://download.freebsd.org/ftp/releases/ISO-IMAGES/10.4/ The image checksums follow at the end of this e-mail. If you notice problems you can report them through the Bugzilla PR system or on the -stable mailing list. If you would like to use SVN to do a source based update of an existing system, use the "stable/10" branch. A list of changes since 10.3-RELEASE are available in the stable/10 release notes: https://www.freebsd.org/relnotes/10-STABLE/relnotes/article.html Please note, the release notes page is not yet complete, and will be updated on an ongoing basis as the 10.4-RELEASE cycle progresses. === Known Issues === o During initial testing of 10.4-BETA1 it turned out that the BEAGLEBONE, RPI-B and WANDBOARD images do not boot. Thus, they have not been made available. Images for these boards will be published again at a later point in the 10.4-RELEASE cycle once the underlying problems have been addressed. o The 2017Q3 package set used in the 10.4-RELEASE cycle does not include KDE4 packages for amd64 and i386. Thus, such packages are not part of the amd64 and i386 DVD images either. === Virtual Machine Disk Images === VM disk images are available for the amd64 and i386 architectures. Disk images may be downloaded from the following URL (or any of the FreeBSD FTP mirrors): https://download.freebsd.org/ftp/releases/VM-IMAGES/10.4-BETA1/ The partition layout is: ~ 16 kB - freebsd-boot GPT partition type (bootfs GPT label) ~ 1 GB - freebsd-swap GPT partition type (swapfs GPT label) ~ 20 GB - freebsd-ufs GPT partition type (rootfs GPT label) The disk images are available in QCOW2, VHD, VMDK, and raw disk image formats. The image download size is approximately 160 MB and 128 MB respectively (amd64/i386), decompressing to a 21 GB sparse image. === Amazon EC2 AMI Images === FreeBSD/amd64 EC2 AMIs are available in the following regions: Created AMI in ap-south-1 region: ami-08135667 Created AMI in eu-west-2 region: ami-56574732 Created AMI in eu-west-1 region: ami-2cbc4055 Created AMI in ap-northeast-2 region: ami-58d80036 Created AMI in ap-northeast-1 region: ami-0611e160 Created AMI in sa-east-1 region: ami-59d7a635 Created AMI in ca-central-1 region: ami-34952b50 Created AMI in ap-southeast-1 region: ami-ebf59188 Created AMI in ap-southeast-2 region: ami-a56873c6 Created AMI in eu-central-1 region: ami-607bd30f Created AMI in us-east-1 region: ami-86ccf3fd Created AMI in us-east-2 region: ami-8f486bea Created AMI in us-west-1 region: ami-8ed1fbee Created AMI in us-west-2 region: ami-21d53959 === Vagrant Images === FreeBSD/amd64 images are available on the Hashicorp Atlas site, and can be installed by running: % vagrant init freebsd/FreeBSD-10.4-BETA1 % vagrant up === Upgrading === The freebsd-update(8) utility supports binary upgrades of amd64 and i386 systems running earlier FreeBSD releases. Systems running earlier FreeBSD releases can upgrade as follows: # freebsd-update upgrade -r 10.4-BETA1 During this process, freebsd-update(8) may ask the user to help by merging some configuration files or by confirming that the automatically performed merging was done correctly. # freebsd-update install The system must be rebooted with the newly installed kernel before continuing. # shutdown -r now After rebooting, freebsd-update needs to be run again to install the new userland components: # freebsd-update install It is recommended to rebuild and install all applications if possible, especially if upgrading from an earlier FreeBSD release, for example, FreeBSD 9.x. Alternatively, the user can install misc/compat9x and other compatibility libraries, afterwards the system must be rebooted into the new userland: # shutdown -r now Finally, after rebooting, freebsd-update needs to be run again to remove stale files: # freebsd-update install == ISO CHECKSUMS == o 10.4-BETA1 amd64 GENERIC: SHA512 (FreeBSD-10.4-BETA1-amd64-bootonly.iso) = b62ba87bf0e0d55cebe8995c30e7dd92cba1f4d94b9c2130bf4477a2ef1f242b4b2d68eb930538338ab9a3844a4243483afff2385db5b61397b88077addd4fb8 SHA512 (FreeBSD-10.4-BETA1-amd64-bootonly.iso.xz) = 58a782b4c0d14589e59eea6f9fd358469ce7d416dc4a4857b4640525e3c5c4735a6510ca487220839eff96f5bdf0136f0b488faf5cecd0860f26e9b65538170e SHA512 (FreeBSD-10.4-BETA1-amd64-disc1.iso) = 54dd4a737dd13c6502bfe2020f56d88703625000d3f6b3cacccd3544bc033d1920a1882a194077ad0dae594ae6f5bfd3f31acde6a405c8bfcd3316d2df1d2782 SHA512 (FreeBSD-10.4-BETA1-amd64-disc1.iso.xz) = 63ecb7002ac8d4e9ba31823ab2e388b02035742039ae9293206b4b5479047287642bc30363fc23dc84dcc4e9278f62fec154e6c8c85c6acb440233ed166da33e SHA512 (FreeBSD-10.4-BETA1-amd64-dvd1.iso) = c3ff2ab49049e797b98c3c81f77aa022d72461532b47850fc5813ffc0db595c06009187d24b5b7748f663813c38a740d772933b46ad17ebe63d5d78783bc43d2 SHA512 (FreeBSD-10.4-BETA1-amd64-dvd1.iso.xz) = d94e1359f158e35e24aad62d6fe1b07d55bf925c581b467738c4482f7394e28ffed4ce17ea6cb4359cb2285357089eec1ffdcdefd303aec9760b8561ed9c118a SHA512 (FreeBSD-10.4-BETA1-amd64-memstick.img) = 90ac0de27ea85c3c0e5a03e392a87af0f5f1a8a182ca077f8c74cc7922538e0575f09999f4fd89fec0ab68cb4e9019c98c486bcd8dea12f1e120d0dd13dc4612 SHA512 (FreeBSD-10.4-BETA1-amd64-memstick.img.xz) = 1d3f7403ec688f711a29cc84644d9586da9fb556db59408cdd919d1d2697634056e044f5660e74e0eda0b056adb1c33a17e1856e00014a23b4e84cafca63bbdc SHA512 (FreeBSD-10.4-BETA1-amd64-mini-memstick.img) = 81a56a20ea49bb11812eb4265192c1e127e68330bba800db6912c52d94e1f7daae93d7361594501d0820bae5a6d374fec803e23db2a693db9d280baf01b09a4a SHA512 (FreeBSD-10.4-BETA1-amd64-mini-memstick.img.xz) = b5c31628850f4a471f340212c2052c75e0ac79326267eb6d0a357fc29b6d8e049f27f40f18d46978ef95c6fa2b5134cd608f9344e12ea609c313cc929a9a8929 SHA512 (FreeBSD-10.4-BETA1-amd64-uefi-bootonly.iso) = f85bc53727f380670f554761abc07663ed2a996557ce6698eebc1b0fb7b61c03a0f9ac96abceea1d9a0b7268815ea0365675a83cf43628a102bb794427cf00e3 SHA512 (FreeBSD-10.4-BETA1-amd64-uefi-bootonly.iso.xz) = 11fd83ddd61f2ee28cb75b84e043658bbd690817719a915cdba96aa76652d2a5bdb5ad15b8e9ad9ddb7aa4ec06549c38bf35d0bbe971a266577cba58bd162581 SHA512 (FreeBSD-10.4-BETA1-amd64-uefi-disc1.iso) = 3dd7c876d6f905daa4053f57637d4ec95d28583483f468faf3a658316850792cf2162a846d73486f5480e0bd28102db19bda983f77cc773818c4523cea94d276 SHA512 (FreeBSD-10.4-BETA1-amd64-uefi-disc1.iso.xz) = a290661619777c2cd7c30b442da0b41ed6242db3ba859c1ad56efe0ab4f9513e2adc0b3205ed6f9beebd7749f0f6be22754c90848527ff7ae7642210d8c89f70 SHA512 (FreeBSD-10.4-BETA1-amd64-uefi-dvd1.iso) = 59b10fbbffd16e4319e11d4970dd0269ed0c07198d7dc0675f542850fa64483df8809e734e80295b64be1ee544026fda8b092d0c4fc27148e2e35e67e818ceea SHA512 (FreeBSD-10.4-BETA1-amd64-uefi-dvd1.iso.xz) = f881d89d465e4ae8d537f06d92cdfecc1a9bfd05a3c74be79835ec219bded5cc4886b925f57692987e699f6434e87bdcc06d035e55eb1ac50664eef8bcde2fe9 SHA512 (FreeBSD-10.4-BETA1-amd64-uefi-memstick.img) = 910209021dddd12a22b1e74f9536b5b229c5073ce7aef540918aa44371713c4f643ce2c163c835c893b037ece51a15cb671ffd262a5bff7d0c14f659151a176f SHA512 (FreeBSD-10.4-BETA1-amd64-uefi-memstick.img.xz) = 9fca5dc4bab1cc3cd5270978e3054ca851c51fbfffece745e28af5744f9ceae0bd32d517d73d53f93d07989f8f6ce5457e09745d5cd08b8841ac1890db54f299 SHA512 (FreeBSD-10.4-BETA1-amd64-uefi-mini-memstick.img) = fad43fe233e65845c36515195b809a708a73933542abb79feec9c2b035b5cf2d7f6f28cc41c98efb9d7325bfe0899a6ff9fa87f761bb537d283ed2f2851b261b SHA512 (FreeBSD-10.4-BETA1-amd64-uefi-mini-memstick.img.xz) = c15075e503b9c927eece59b9381e4763139423d74156e01da8be93cef2e734028fcc9ad7ba0c4124578b05187ef8f1d2ba459836c747ee96437d0ed3499d492b SHA256 (FreeBSD-10.4-BETA1-amd64-bootonly.iso) = 4062a2194d89bf646aa4da21c543581f567471c95569a39dcb877698b5776ae6 SHA256 (FreeBSD-10.4-BETA1-amd64-bootonly.iso.xz) = ee447bded8b952ad9fbbcc19cc9c2954ed8cdc689232efed502e0a2032682b50 SHA256 (FreeBSD-10.4-BETA1-amd64-disc1.iso) = 5a3858ccb08a245f7db310dc120ce426f84dbdd97cae3cce8a74bda57ac345bf SHA256 (FreeBSD-10.4-BETA1-amd64-disc1.iso.xz) = cafaa3605f4fd9897225ac630e03a0599bc6da90d62320be9aadf5551507fbcb SHA256 (FreeBSD-10.4-BETA1-amd64-dvd1.iso) = b3ca555b6a21a9b265b7a614d0145fe963dd5a329c0f9587df9af0308ad1eb41 SHA256 (FreeBSD-10.4-BETA1-amd64-dvd1.iso.xz) = bca7fc10f58b565219f0a722655a5332dece92c97af239050d8f5bbf0f7b75df SHA256 (FreeBSD-10.4-BETA1-amd64-memstick.img) = 822d4ccb11ea43b054809ff75d57e78354d4520a640ab82371741af45ef83bbf SHA256 (FreeBSD-10.4-BETA1-amd64-memstick.img.xz) = 129e1d3a431093bb11164eed7a50f8c99311c4be4f738a7dd96690426506b53b SHA256 (FreeBSD-10.4-BETA1-amd64-mini-memstick.img) = a2926ca4aa1010b9d1afeb746adf2866eca2381229ce955e0d08b7a1347031a4 SHA256 (FreeBSD-10.4-BETA1-amd64-mini-memstick.img.xz) = 8dc6dc02c80b922434106938d9538e255dbb8d1da67335205ebfa8826a417745 SHA256 (FreeBSD-10.4-BETA1-amd64-uefi-bootonly.iso) = f274fb66141cef42ae1f1aabe053063c0167d877813ff52858e2dae96039b91d SHA256 (FreeBSD-10.4-BETA1-amd64-uefi-bootonly.iso.xz) = b5115bbee03422f5bbfdc0e2807d28e468021906c8534b5bfb9db530e17f4126 SHA256 (FreeBSD-10.4-BETA1-amd64-uefi-disc1.iso) = a92157eb2dd5f1d56d5d81e344e07821fbee4df2a0bbaf83ae90c9269b63484d SHA256 (FreeBSD-10.4-BETA1-amd64-uefi-disc1.iso.xz) = 58f9ec3d70e5ab7e83b8c755b67c35838bb495cfbd6af62fa7e9b95094516c69 SHA256 (FreeBSD-10.4-BETA1-amd64-uefi-dvd1.iso) = 7515947bd466e152832934c6b6fbf4ab910642edf32a0582fc70c3dd2415a01d SHA256 (FreeBSD-10.4-BETA1-amd64-uefi-dvd1.iso.xz) = 4e5fe49ed8011c5a85af452f1e79476b5d9cf0c5d07753b1bff954e0120234fd SHA256 (FreeBSD-10.4-BETA1-amd64-uefi-memstick.img) = 8eea0086c96fa278d9efa7f3467de9de2ab425f07dd89962a4deffb2a11d40f2 SHA256 (FreeBSD-10.4-BETA1-amd64-uefi-memstick.img.xz) = 0cd0549e1d4f2b113436e2cc4190162029a665f4c809a9b0e2edafd698ab79b4 SHA256 (FreeBSD-10.4-BETA1-amd64-uefi-mini-memstick.img) = d21709117da50290e963afe1ebe6644ecf4c3bec02026ebbbae1b805bf51ba50 SHA256 (FreeBSD-10.4-BETA1-amd64-uefi-mini-memstick.img.xz) = 914913789d15969a96c0dfb073ceef469176be63cb8cc9b54a9a4cf7eec30f0e o 10.4-BETA1 i386 GENERIC: SHA512 (FreeBSD-10.4-BETA1-i386-bootonly.iso) = 4fda3a6617b3e0b924e576dc77e71472e1d163f68ca72a414a736a5724bf90df5a60897dacfd601880bc7e3053204606078c691c44921381a44e1cf3b6cc6b69 SHA512 (FreeBSD-10.4-BETA1-i386-bootonly.iso.xz) = ff3edbb3bcc97ed297269a1dcd88f6544113c1fd0aea93f707410aa97644742a2b56279b2b892ef674d36eef57c1de26fe8ab8945b43ef6d931f920b506fd598 SHA512 (FreeBSD-10.4-BETA1-i386-disc1.iso) = 4f10ff77372de6267680873d5e0a004750cb723f29cd25f377bb16ef96a1b89a6170d7392a84cf345b1d6dd487584107349b7430afeba7e1ce9ceceedb581d92 SHA512 (FreeBSD-10.4-BETA1-i386-disc1.iso.xz) = 8ab95dd17aa080b6b635d97e9f3afcb8fe4b8da6736850eeac9eb38338f47a59d660c16b8c8d126263918714461ec144f627677029c907e6455a711439fcc13a SHA512 (FreeBSD-10.4-BETA1-i386-dvd1.iso) = 04358dd6f47fe12dd8be2468a54d5552bc6120b3e1cac9b5bb8a385b17fa7a11ca5213eed919a7b96d02eb691c59745263bb079a774daa11d7343442448ec3a0 SHA512 (FreeBSD-10.4-BETA1-i386-dvd1.iso.xz) = 419614f1ddb15ce81fca4a992f82d9ccf0d07622a982845eb36899c32978c903e7c37390c1ba68a29eb29a848cd5c92c200a4dca9e988e29347d07c4eec6d267 SHA512 (FreeBSD-10.4-BETA1-i386-memstick.img) = f9aa6765cdb8463601cbb91ad68e881c053af20367566c263c9cbf0aa86d78de3eb9dc15bfa0fa8a1c5488480e5fd4b4c81ae59a74cab5dbae6b13edb2bc5742 SHA512 (FreeBSD-10.4-BETA1-i386-memstick.img.xz) = 13bedc9d2544b62fda5f322ee4bbc101f0f9219e71953669bac3ebef9d06f48d15565764614293ca68581eab8df724dc47027cb9af495e277797baf9c0cddd9f SHA512 (FreeBSD-10.4-BETA1-i386-mini-memstick.img) = 27878472bf70c38ab76af26ee932b6c2d5e6a517650d00c5acbaa1e7a596b469f89ed30cfcb31443c5d4bca2d1fc423978f26f453dc02f895f5714e301a3b297 SHA512 (FreeBSD-10.4-BETA1-i386-mini-memstick.img.xz) = a0e752907103540bc61b9367daefa1a3e02f422ab68fdc02dfc0227c35c929c0c4309036e2ea78c9cb094a52e0f467a3838d8eed5f8411f8774eb2ba9616cc1f SHA256 (FreeBSD-10.4-BETA1-i386-bootonly.iso) = fd0f16c270876715291705deec7e92b9304256609d53e8144da77a5a68a8e1c3 SHA256 (FreeBSD-10.4-BETA1-i386-bootonly.iso.xz) = fb7024d36430aaf920ba522e9af55c558db1360a515a54ad76d4cbda83e8626c SHA256 (FreeBSD-10.4-BETA1-i386-disc1.iso) = 32df98199715eb8b4da1c5954d1b92002f7faa63faf5cf395b297bff405c5438 SHA256 (FreeBSD-10.4-BETA1-i386-disc1.iso.xz) = e1ae50d5850d4eebeb420fe5326702a8e9d985441dccfb44de870af66135ae46 SHA256 (FreeBSD-10.4-BETA1-i386-dvd1.iso) = 1539461f501d88dbf75c3e11c56713dae27fdd0d58b23642f1214104397ef60b SHA256 (FreeBSD-10.4-BETA1-i386-dvd1.iso.xz) = ccfe321606bd5b0e3a4d49d50db67681d4eb551657f395d970939ac6cdb8e7d3 SHA256 (FreeBSD-10.4-BETA1-i386-memstick.img) = 8077669708a102c89f0e2d02a52072eb967b0c4477a798469c940dd593d46804 SHA256 (FreeBSD-10.4-BETA1-i386-memstick.img.xz) = 5926c0e90a2f8e95ed47167b0a3b911a255ff08cc5875f9305802e5a5d107938 SHA256 (FreeBSD-10.4-BETA1-i386-mini-memstick.img) = 1a3edda0a7e2a303bbc75d96f00527fd11f43d8d1b3a6922c7c0c31eb2dc6466 SHA256 (FreeBSD-10.4-BETA1-i386-mini-memstick.img.xz) = 013ff35f9f1a21eae25fc049a5c12e12cc042b3fe79457b4dfeeed523eaac97a o 10.4-BETA1 ia64 GENERIC: SHA512 (FreeBSD-10.4-BETA1-ia64-bootonly.iso) = 9dcbde067cfc7dd279003daee3e7cf868791fc71975792879fe7eb23a17d3df9daf9652c7df82b7d2141d353dd4732773c83c8c7c40c2e1b7ce302177b334d01 SHA512 (FreeBSD-10.4-BETA1-ia64-bootonly.iso.xz) = 80c2e9e8a3e0ef6f884e735cb77316434009e589d37a245eb55eaef9f0d038e51eeef8941da1574e292880c283373c45e819e1f4abcc9a6d05dfb42e5dd527e7 SHA512 (FreeBSD-10.4-BETA1-ia64-disc1.iso) = bdd52cf436c08793f7d097c1fd097fc61afa07b5ab4b3501958837fb28371d81ae2adc3fda9b3cac33a4ca2d0a1817df802cb1ab28a799c33fbb88fb2219d4ee SHA512 (FreeBSD-10.4-BETA1-ia64-disc1.iso.xz) = 83c5f36042b971bdfb9f8746a704edfb3363d3850e4101cb0e2eb9527f4f6373b9e9c4e4d60764a2d88e6b626c64048b3208e6799eeaf0c7a64e6c8f765fdb69 SHA512 (FreeBSD-10.4-BETA1-ia64-dvd1.iso) = 4d7d5f8054dcb96b2141acb6d76ac5e62d5ac30ced7828e568f4a87a76187a469d31b2762b5b098c9c485bab8e6c6f31270d8c52ba09b9b976ed8f780cb91a98 SHA512 (FreeBSD-10.4-BETA1-ia64-dvd1.iso.xz) = 5825d5e51eb821373b0da65b993834ef86836d18ccb7a1ad347dcbc1bf483d04b5142648755abadf4a68c3115605dd966b8e2442a66b2206f38f3a107924779d SHA512 (FreeBSD-10.4-BETA1-ia64-memstick.img) = d61b050b9044ec37067b11b49a423f5d638345bb5e24ce4c410d04fa2c8f82bb59edf8895dce40b8247a78fc95ad9d8872111191389bc5d29262004be92dd800 SHA512 (FreeBSD-10.4-BETA1-ia64-memstick.img.xz) = f825c65cd813c7d49236a82cb52284a9fab148bd7b5bbeddb7027447badaa772a1d05e101f9e094c173180ccbf938d32bc3aed7ce9d37bcb34559a432bc2ed6d SHA512 (FreeBSD-10.4-BETA1-ia64-mini-memstick.img) = 7acae0f28fc80555da9d0e4b9d1cbedb77eb08c69423f9e7e683a8b515386c2b40918314e54d75f939994dbb48510ef79619cef59c2c32e6d4ab100e9c02e76e SHA512 (FreeBSD-10.4-BETA1-ia64-mini-memstick.img.xz) = 6ac8324c18267d5e2383ccbdb1802102510a5ac0d0000e09b8beecaed7282b88af7f73166168d4e8fe8e2cd5204d4b5f07c49c6f795a335a215ed7fef89c5f90 SHA256 (FreeBSD-10.4-BETA1-ia64-bootonly.iso) = ec1fc5c49ebff74f0b12d395f37217286653ecc4d858f4d19abe2088c246af53 SHA256 (FreeBSD-10.4-BETA1-ia64-bootonly.iso.xz) = f88168e93a037d840087d176fd1f462f64cd1cc78eeac71dcd2ece75ebd1490b SHA256 (FreeBSD-10.4-BETA1-ia64-disc1.iso) = d526f099ea5de5e861d54a84ae095692c8a8f1cb6f191a48699386c542613d4a SHA256 (FreeBSD-10.4-BETA1-ia64-disc1.iso.xz) = d1c96c52743625625a536e15a76b1a77c0ae2acdaeae7abe8f31fced7a11b5b8 SHA256 (FreeBSD-10.4-BETA1-ia64-dvd1.iso) = e25c343e4b8cb542b62370ba175b39ff0696c43382b0bc11516d5218836fe829 SHA256 (FreeBSD-10.4-BETA1-ia64-dvd1.iso.xz) = 4f68c566a88d7647f7a2fdd69b40d6b4cd87310a9980cc4842969401c31c7413 SHA256 (FreeBSD-10.4-BETA1-ia64-memstick.img) = 168466630fe4c42130ae894c3075812e77692819e9af5be2ab1f817f867abad0 SHA256 (FreeBSD-10.4-BETA1-ia64-memstick.img.xz) = e4a48adfd4a79a0336778eae6149660c34a050d66fd1cd88a23cccb0736309f1 SHA256 (FreeBSD-10.4-BETA1-ia64-mini-memstick.img) = 9a0451924cc94d2544cfc3fe132e6d0f4945ecc459aa1fe12c732677dd5017d6 SHA256 (FreeBSD-10.4-BETA1-ia64-mini-memstick.img.xz) = 3f281bebbdc6122780d4a98f167c9440432e1a2eee7d029575eaa43a2f92e4d9 o 10.4-BETA1 powerpc GENERIC: SHA512 (FreeBSD-10.4-BETA1-powerpc-bootonly.iso) = db696b384ece609524d4fdad3995cdb79f3891a34ce3a2aaba89910bd5dc1d713053a90785c8972bebef0b9e685eae76ab3d4befca6e924ef65833dbaa002bd5 SHA512 (FreeBSD-10.4-BETA1-powerpc-bootonly.iso.xz) = b0b985092f7aacfc31e98877c8ec91c5609af84401fd8bcf2fab81693fb453974fd4d7a7a3c512f07971116ee0dd8dc3a636d11ad5f7c48dbbcc60ba33dc9ee7 SHA512 (FreeBSD-10.4-BETA1-powerpc-disc1.iso) = fd41398c789e1fb4e05b8f32476076c3b6e6c70316837eb46f7df05aa2d540b4c392364852cbdbfc5c110fd7cbe8edac9892aff425c376bd27448b4476eb3625 SHA512 (FreeBSD-10.4-BETA1-powerpc-disc1.iso.xz) = dba28571051611c8e72946a7dfe720755b31be3678d1c6f4fd50c24ef64b2c8db7478db704182199fd99feb40d16223221466e994e2ce1d41e6177e3b620e72c SHA512 (FreeBSD-10.4-BETA1-powerpc-dvd1.iso) = f0587e586b20f9f40990c87af42b07e96a80991f3ed2317caa40d2d06cc5ba3adedddee7a38d27c77af614f18ea1edbdb75587e9a7ffeeeeabb799d0cb09fd41 SHA512 (FreeBSD-10.4-BETA1-powerpc-dvd1.iso.xz) = eb7f4544339eec77f778390d9bc26bd7781e879620917984b28470668a26a9ac37855f873c231d187579649d4ea61482b31bf3b0db925f732e13987d909cdfc4 SHA512 (FreeBSD-10.4-BETA1-powerpc-memstick.img) = 192a1eb0fa760481cda9dd3c5d4b65b426826de954badf8d8607ae8fa4ef0d254b3db97cc4519c232b1dfc9ac6e0987810695fada23ddc343d1d1a8f2011a7cb SHA512 (FreeBSD-10.4-BETA1-powerpc-memstick.img.xz) = de6a32d6fb5aba9c4f77e9d63c6fae15b6e4999ce66b107fde04846d4874c236c060db80df4f60619d8176defae9a32a9892dbe3a2bec1976dbe8d5d8462976f SHA512 (FreeBSD-10.4-BETA1-powerpc-mini-memstick.img) = e76567ea9b192e395fbc255943d849bc2da2fb2de0261dce2c6de9700b1cbd11238dc6736c28019e3e7ba99c7be39aadd0642e37bb0970698704fa01870ed92a SHA512 (FreeBSD-10.4-BETA1-powerpc-mini-memstick.img.xz) = ceb29828984d73985aa2a7121eaafd737d70bee63b1b3f91338e1d504549f07d7b9e37137c55a598a584d355f6c8a466663e0dbe498ce772205df6badd84eb09 SHA256 (FreeBSD-10.4-BETA1-powerpc-bootonly.iso) = 6b4a23c5424afc7c509fc146804ec2ba51ad5a06831155d26a2e103c7bda2dc7 SHA256 (FreeBSD-10.4-BETA1-powerpc-bootonly.iso.xz) = b66ce7ba3f1ec5840db063e934c8e41678240bbf9bd630514efc364a6a5aeb92 SHA256 (FreeBSD-10.4-BETA1-powerpc-disc1.iso) = c32a07f611f62a095ed327e49ac8879b24f52535b9fe06443f0dac87e86b63be SHA256 (FreeBSD-10.4-BETA1-powerpc-disc1.iso.xz) = a39f359535f8e69cb751677411363982aba9b6c9bb6424eb69cd5ec340d251b0 SHA256 (FreeBSD-10.4-BETA1-powerpc-dvd1.iso) = 29887853e218c69cd628dcd68744ef65bc774ff39f80bb4c801c9132dd3feb59 SHA256 (FreeBSD-10.4-BETA1-powerpc-dvd1.iso.xz) = d2f69ac9d60578eb68b554bc5a47a02b06042dbc2741409f7fc7b8576953740b SHA256 (FreeBSD-10.4-BETA1-powerpc-memstick.img) = 6364b78a5d15d14da2b13c45d35d2822cf25b295799b29662ae2f1b11ba9f75a SHA256 (FreeBSD-10.4-BETA1-powerpc-memstick.img.xz) = 6d90e04968292120d658a4206a37574471ec3c7581d8413008361433472e1dee SHA256 (FreeBSD-10.4-BETA1-powerpc-mini-memstick.img) = 2e807ae81611d1d345cdc7043f1ac017777d2f4cda831051ee7b3525e8326774 SHA256 (FreeBSD-10.4-BETA1-powerpc-mini-memstick.img.xz) = 213b87fc4083d66efd79a0d949a7c742e8d0dadacbb7cb3693fad4ca0eb0be5c o 10.4-BETA1 powerpc64 GENERIC64: SHA512 (FreeBSD-10.4-BETA1-powerpc-powerpc64-bootonly.iso) = 69ce9d52481943aeccf3a50b5fc542cbb2f043f675c00a34d7cbf279d504b426059c5e988df2d85b5738ef52c7aac8868c16c154b9b4f6119e1e3a53b0010a53 SHA512 (FreeBSD-10.4-BETA1-powerpc-powerpc64-bootonly.iso.xz) = 5b49e08918f5c4488e1a96bd0bcb02dfb863b5e6f93f6241075b9a4395324e8afd91545a8f39dee832d2692eeae4b7aa76cf9f27c6a04c11f3b3ee665ee6bd6b SHA512 (FreeBSD-10.4-BETA1-powerpc-powerpc64-disc1.iso) = 583f8242244edc1347b166e5a6cf450e2546281792fd679fc08483887caf7fa997ccf9f9b7ce3dd59789ff47711b8b2bea19c52d664a055bd2e8e6b2805f5949 SHA512 (FreeBSD-10.4-BETA1-powerpc-powerpc64-disc1.iso.xz) = 96b8c6850396506ffde0f26d0b1ffc8182987b549b566e0dddfd13e8df0ff0fe5bed508cf1a6305223a56c358938379c913dea28cc68fab258aadaa570f33804 SHA512 (FreeBSD-10.4-BETA1-powerpc-powerpc64-dvd1.iso) = 3ebb0a67a28f623d9c7c9548a379d1261ee7786c85d3839c460a465f8d24e1e831d1b1187c3356234256f1f8f900f19f490db7436e095c5d860af98f574b99e9 SHA512 (FreeBSD-10.4-BETA1-powerpc-powerpc64-dvd1.iso.xz) = 28bc8bcf9692d7893701fe7c64bfe4a9e6c9327eb2eaf6419c059b2bd285b1d5e7976f40b57806e2619ad2eaef0b1a63360842e43be7738176d0b5ff5ff70559 SHA512 (FreeBSD-10.4-BETA1-powerpc-powerpc64-memstick.img) = 9dec8cb8dc9e59958d46fd8952765fe4aaf05225596aa6bfe9b33d4df3a48eb53cb97f2581093a764eaae06b245ba0f2ec87d8a88d1c8f43c90a70cb8f24e41b SHA512 (FreeBSD-10.4-BETA1-powerpc-powerpc64-memstick.img.xz) = c9ef7edf828d1bdaa7546004793015cb19a2ed815b124311f7d295631b5bc963ae107c69c74f656b0dba2c858cf7e79cb62eafdf022bf2645a75e85a7ae963db SHA512 (FreeBSD-10.4-BETA1-powerpc-powerpc64-mini-memstick.img) = ff2bcbd8e3bacd062125ac6e0fc0ebe34b6d79b93c267978c68dd021423db5da78a970c0babe01fdc51d3ff11398e9a980e6e6925a6df814dfff083b215fead7 SHA512 (FreeBSD-10.4-BETA1-powerpc-powerpc64-mini-memstick.img.xz) = 9c9135c9d9791871bc55f692ca8e44d47f502abd0db2a5e8e7c741054dbe542651acd40f4ac902f3f5ea8f5ef16f1a2e715c67f8696d1e705e445cbf520fe34b SHA256 (FreeBSD-10.4-BETA1-powerpc-powerpc64-bootonly.iso) = d0924147a4cd2f4d0acc2006f5d0b474853beae80977162d1c7bfe9f20f96223 SHA256 (FreeBSD-10.4-BETA1-powerpc-powerpc64-bootonly.iso.xz) = e6904dc5fe3c202409380e076f359f513f9b2108229160d99951c2df2c74658c SHA256 (FreeBSD-10.4-BETA1-powerpc-powerpc64-disc1.iso) = a88408e1b4b17d5cddbf87e52a331f9d1cec3636205a38c68b086d4ad4e9bfdd SHA256 (FreeBSD-10.4-BETA1-powerpc-powerpc64-disc1.iso.xz) = 9b1c107d7616425536b58ed17febfd0a6d8f6a04af45ba7286b31ef70e1f69a3 SHA256 (FreeBSD-10.4-BETA1-powerpc-powerpc64-dvd1.iso) = 1b1b8433deb29e8c15fae1890eebafe4d082f761bee546daf763f164ec8c3b42 SHA256 (FreeBSD-10.4-BETA1-powerpc-powerpc64-dvd1.iso.xz) = 8f0f1c9c1556e78c03652100b6a2c993b10e7e62ce34937b298d12c6f7bfe77c SHA256 (FreeBSD-10.4-BETA1-powerpc-powerpc64-memstick.img) = d32f8e704d4b0330a05eab5e4d044846c826fc95c5e6beea93cb97007f6bb964 SHA256 (FreeBSD-10.4-BETA1-powerpc-powerpc64-memstick.img.xz) = 889e368933d565831fe497876829b5ace8be1c724cabdb98dff2218a510792b0 SHA256 (FreeBSD-10.4-BETA1-powerpc-powerpc64-mini-memstick.img) = 3e205435d582ba02fb63b768e8bd5895a518f1d8b018fc95389e8ed7919e3c71 SHA256 (FreeBSD-10.4-BETA1-powerpc-powerpc64-mini-memstick.img.xz) = b0c49987814140902c62715d67db42013efb034c817dff54db4f2ccf3d3f8ae3 o 10.4-BETA1 sparc64 GENERIC: SHA512 (FreeBSD-10.4-BETA1-sparc64-bootonly.iso) = 3c623f220ebb2699387f3a230e93c378d1aa76c30a81a47c1e267f070128aac901223aad255004639b89f3dfc2224b6afe3940710e242728b6b61ff05c84bc77 SHA512 (FreeBSD-10.4-BETA1-sparc64-bootonly.iso.xz) = 20ad61955e9834f22efeec09a9a8efc19220a650406add38265983031ce8ab8b81a1534dc95cac246955ca6e378ad28f03ee35fe52f1144eac684331d1ab94e8 SHA512 (FreeBSD-10.4-BETA1-sparc64-disc1.iso) = 613e36048c22bdfa5989dac8a28e4b9bdbc77bd32ad2d3c56cffa3990137cae9b63f96c83c82c474ca6eff15ff49f968d20647e524cb93ad0204780467923c41 SHA512 (FreeBSD-10.4-BETA1-sparc64-disc1.iso.xz) = e38c537592863928d8cad08998cdb357f560c5408fc6897aed310f1bf36b63c103af922b9d717dd212ab171993ecf32b56a84df8e049c3ccee36999c789c45cb SHA512 (FreeBSD-10.4-BETA1-sparc64-dvd1.iso) = a05f97f2479f6d97b1dd82a6e3757f3dfa3a557b006db7e19c4e15ff3ff6c3485712d22a919dd38c6c9dc04e038a40705d84fdc900a2aeb97058714abbc122c3 SHA512 (FreeBSD-10.4-BETA1-sparc64-dvd1.iso.xz) = c9174a06c05620686c2ea04f100724a962e4087bfcbfee92a94e952364984c5d4b2eaa3db8c2930bbf6d6e69ada1c84ad4eb139da1918b55ec1d7de2a3db56a4 SHA256 (FreeBSD-10.4-BETA1-sparc64-bootonly.iso) = 900c15f2e7ebdf48db86bf3113eeaaef9ff06a3f700d54798511995ebcf17acf SHA256 (FreeBSD-10.4-BETA1-sparc64-bootonly.iso.xz) = 25cf68380dc4f6981e54303192db9f42ab2d8a380c5d5d4b3d5e373a8536f7fb SHA256 (FreeBSD-10.4-BETA1-sparc64-disc1.iso) = 0d1737bb4adc49d0ef8db1a4fced522f0b72fe9dcaa9b082ad227896347045d0 SHA256 (FreeBSD-10.4-BETA1-sparc64-disc1.iso.xz) = eba47cb8dd9f39f5525cfbc943cc6dfab50e252276eb8a8f3c900a96077ddd3e SHA256 (FreeBSD-10.4-BETA1-sparc64-dvd1.iso) = 1d0f48b34e98456fa52926224bba45a700072587faa855b39439f2276783941f SHA256 (FreeBSD-10.4-BETA1-sparc64-dvd1.iso.xz) = ca3f3f1beedd21f70cb3a849978a20560f5a583b979ea9039710db3d8cf0b5da o 10.4-BETA1 armv6 CUBOX-HUMMINGBOARD: SHA512 (FreeBSD-10.4-BETA1-arm-armv6-CUBOX-HUMMINGBOARD.img.xz) = f019d0ab2e9d949e1c2d275c703d07ccc2d6efca4dc26c9ea0f34e4955354e3ef4aedf8d132693eaedc6e150e1c10c618bf076f142cc902cfdd6ff27b26c5fec SHA256 (FreeBSD-10.4-BETA1-arm-armv6-CUBOX-HUMMINGBOARD.img.xz) = 84998d05877ec6d7aa2f98ae8e04127022af131c680b92a7515d020f620eac92 o 10.4-BETA1 armv6 GUMSTIX: SHA512 (FreeBSD-10.4-BETA1-arm-armv6-GUMSTIX.img.xz) = 1145a1994b2ef36a8d672ec2b04e551f603a37a8054f0ca078f4bf2b7ed5c3826b55bd75323edacf3ef23208783a54893eb87409067710c4a19ea046f9908fdb SHA256 (FreeBSD-10.4-BETA1-arm-armv6-GUMSTIX.img.xz) = 22fc49b7a2d95b74eb5198b1c6f58f13f62f7b0150818e488d5f47b6082316ef o 10.4-BETA1 armv6 PANDABOARD: SHA512 (FreeBSD-10.4-BETA1-arm-armv6-PANDABOARD.img.xz) = 359bccda29e8759ff08b13ed9d56301a325838053e45916a3de36ac9212e0e2b695fa7a7ca129fc5528a2968e0f2b87fe7cb120f62f183313072a54e24dcc9d1 SHA256 (FreeBSD-10.4-BETA1-arm-armv6-PANDABOARD.img.xz) = 24e78928bc05f2be751a7b007f64fe868a07606975ef40bcae35be0cc04dfe23 == VM IMAGE CHECKSUMS == o 10.4-BETA1 amd64: SHA512 (FreeBSD-10.4-BETA1-amd64.qcow2.xz) = 8e137cbac551a2edcc9a57438a2faaf0c845d17138d632df92653b773ec5c7cca139ae6f4162689a31a993181a1a358fcb9cbcd3c774003363582ed20a4d4b7c SHA512 (FreeBSD-10.4-BETA1-amd64.raw.xz) = fe504374ffd152375d4eedfa298fd782bdb2062678eb70d70e278fbb8c0c997dafc2701187a2c30546e8cd90dcb2a8a15fe2121a93ed291ae69f3484c12e9b28 SHA512 (FreeBSD-10.4-BETA1-amd64.vhd.xz) = 324caa5a64acdd5804cd40c18c0037731243f31ce96bb877d89d6b1bb11f2fa9a65a1446bf5abee73f262f72724d3f5906b19e880d9e78c317d2f188822e48f0 SHA512 (FreeBSD-10.4-BETA1-amd64.vmdk.xz) = 195bbf80d36a47587d2bfc75ba963b0ab10f69120f1b2772b1236172951f635c9e7b5e7aab27150aff412a3ccc86b382b7481a73bc82d955b862b12ad4487327 SHA256 (FreeBSD-10.4-BETA1-amd64.qcow2.xz) = 04fddf1b5998deadf6eb60f4eb61444046fdbacdda16ec9a66b619f2f1119e86 SHA256 (FreeBSD-10.4-BETA1-amd64.raw.xz) = 7aa19e771f52a55a19c880191f9bd2c90f86aab14298fa460cb5ed1aa0e309f3 SHA256 (FreeBSD-10.4-BETA1-amd64.vhd.xz) = f8da7a3de2be00458e8f30217421f991e7adfe363b1ede2dc670d02be4cd5c7c SHA256 (FreeBSD-10.4-BETA1-amd64.vmdk.xz) = 0bd93396d334c503f8c900ef48a47796369f1ea6dbbb2541c7f8595de08cde40 o 10.4-BETA1 i386: SHA512 (FreeBSD-10.4-BETA1-i386.qcow2.xz) = 75dd9afb50f4b7f3e98825a5a841612861258711dbb82246361e1f66568acacdb93049954238a505c07be10a4bca1bcba58e2d36b500fb222f1e8d7c36204445 SHA512 (FreeBSD-10.4-BETA1-i386.raw.xz) = d69603fa147b7b3edc802a5d66a8bdc874c566c9d8f61617b2a26ca4eca4e8d5f8acbe7fbbbcfb7b37a3fd60a182746ebcf9a574f3736c1f2dc1243c0fcd5913 SHA512 (FreeBSD-10.4-BETA1-i386.vhd.xz) = b1156545f9780ad755da5c2fde7b4c8649d593c70f2acd31b81e213b099bf2a0732d392e51135ca821e04639075e12c93ecab6b0865cc22673b9fda250f04376 SHA512 (FreeBSD-10.4-BETA1-i386.vmdk.xz) = 0c8a6b554fca1054fef878f9af8feee11ea31554cc83a9d316f9ff288164fc8f90c8ec80205b5e8ee72c9d7f4d2d68768a411a2a3a00f63619d2666a51403fd0 SHA256 (FreeBSD-10.4-BETA1-i386.qcow2.xz) = d698741095118c40da14060c80e52865a8c12940d6cc9ae7fb3fc8f7cd19714f SHA256 (FreeBSD-10.4-BETA1-i386.raw.xz) = 48ead9910f32c4d01412c28376c597a10ed79f542dfb7cf69c260f0e4f87dd48 SHA256 (FreeBSD-10.4-BETA1-i386.vhd.xz) = 015c2820439d1af0aa8e2187b776f9b4c640275335737a7b1393fc521517a8a7 SHA256 (FreeBSD-10.4-BETA1-i386.vmdk.xz) = 5903b950592e41966f316e6e7febe6862c4f4ea289283fda4d8db1cff4b78b67 Regards Marius --U+BazGySraz5kW0T Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQJ8BAEBCgBmBQJZmKe7XxSAAAAAAC4AKGlzc3Vlci1mcHJAbm90YXRpb25zLm9w ZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXQ1M0Q5QjQzNTVGOTU5ODBGQzVENzZCMDIy MEI3MERFMTNGMUQxRTRGAAoJECC3DeE/HR5PpcoP+wbZtSyuYWvWLqkFle19NQ1t A1vZFgID1KOSq6vww96f7oJsBPkKYSV/JspvxLyb3t/ZQZ1RJPeke4SN94b1CoOj AXgWDsbMpwENQQGIsO/3slZf7kFIgF3ZjuVzSy3mQrCQwc0o7XuqPiQRSN4yNvf/ l+cQJcOoexR70tTMCtZIlM4qQOYNyMimSC2uWrATeBuxMUnCX/441JqlO770IGCa NNstWpo/XJ4AudxT2nAFGgtyvLRiYXZqhd2kJIxq5OiAhaRIkHWWUMNqpH1QKVVY xz/dhxnw6D9Q+ZU6vj6QJgOBYBssmuX+DjVyTg7mcyOz4e0AIwgBsK10ECcbBic6 pTqRvy9TCTtlzsfdv0hwqJY9+a4EyOkvvRC/rvE5BGD65oVR31ZrIDx3XioptgLb Z8TTh96XYCBOd+ItNYm0YYyb+KFwShDzFoHNi/oJjtMnsAHS4wcda/dns1FEnw7T 1KBfWKzfgPR2up+VcM4ExmjbL2+KbJOgBDiAKdMWe9M0UNtkXvy7EUM9Pwrm5Kvy mO0zl3L+O1kKEpdrNvvpjdQ9vkROSnfhRZH18gaCrrRbRHPgnhbT7zFapKtW5tXA QF9tanem30qrfuYacshtgvw4sK8HLWQRZn+E7NstnF9IRPwc+yRLglNYxo710Fnk lDPNxrqtj8ypWhTDPr5N =GfCF -----END PGP SIGNATURE----- --U+BazGySraz5kW0T--