From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 16 00:30:39 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 3D148351 for ; Sun, 16 Nov 2014 00:30:39 +0000 (UTC) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 06026C1A for ; Sun, 16 Nov 2014 00:30:38 +0000 (UTC) Received: from [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a] (saphire3.sentex.ca [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a]) by smarthost1.sentex.ca (8.14.9/8.14.9) with ESMTP id sAG0UbHx063701; Sat, 15 Nov 2014 19:30:37 -0500 (EST) (envelope-from mike@sentex.net) Message-ID: <5467F02F.3090304@sentex.net> Date: Sat, 15 Nov 2014 19:30:39 -0500 From: Mike Tancsa Organization: Sentex Communications User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.2.0 MIME-Version: 1.0 To: Zaphod Beeblebrox , FreeBSD Hackers Subject: Re: OT-ish SATA port replicators vs. SAS "expanders" References: In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.75 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 16 Nov 2014 00:30:39 -0000 On 11/15/2014 5:42 PM, Zaphod Beeblebrox wrote: > > The problem with the LSI 2008 is that it doesn't support SATA port > replicators (while it does support SAS expanders). > > What is the real difference? Is it possible to hack the driver to support > (obviously not booting from) SATA port replicators on the LSI? I cant speak to your expanders question, but we too have had too many issues with sata port multipliers. We are using a pair of LSI 9240-8i with the disks just in JBOD mode for ZFS and its been FAR more clean and easy to manage. Performance is excellent too. The cards can be had for ~$100 and expander cards about $150. Quite good performance too. # camcontrol devlist at scbus0 target 8 lun 0 (pass0,da0) at scbus0 target 9 lun 0 (pass1,da1) at scbus0 target 10 lun 0 (pass2,da2) at scbus0 target 11 lun 0 (pass3,da3) at scbus0 target 13 lun 0 (pass4,da4) at scbus0 target 15 lun 0 (pass5,da5) at scbus1 target 0 lun 0 (pass6,da6) at scbus1 target 1 lun 0 (pass7,da7) at scbus1 target 2 lun 0 (pass8,da8) at scbus1 target 3 lun 0 (pass9,da9) at scbus1 target 4 lun 0 (pass10,da10) at scbus1 target 5 lun 0 (pass11,da11) ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/ From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 16 00:35:48 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4E646470 for ; Sun, 16 Nov 2014 00:35:48 +0000 (UTC) Received: from mail-qg0-f43.google.com (mail-qg0-f43.google.com [209.85.192.43]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 10DE5C47 for ; Sun, 16 Nov 2014 00:35:47 +0000 (UTC) Received: by mail-qg0-f43.google.com with SMTP id f51so13936085qge.30 for ; Sat, 15 Nov 2014 16:35:41 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=9oQlPhRg3U2mJh/0WgoHVQnbyYh7LF81Dri5NQJ1WGQ=; b=kyV5/UjC5T23zzutTDf+co+7YualObkrzCdkrsaD28XniDpTw0IrgKGb8A0Y0Oe2yW NiMj0GnHXQR6+DtOvVYLj74XL7RcxhLRmCS5zaNfX1te0jp5VtEqiuRfIJsDiYz/ypnC IiNRAN0EblDHZo5UJ0vTEwgBGcAXngZ1UhHj7dDoRaSEznZdaQLdpoueYwkdftKLZr9Z lp2xp57/q4svpq9sYO6mifYfWmU0HLSuh112FL+TSvq6VAjCwXIbzkCufqRo6fCDkCwa 5DUQdIX1V9Ks8B2E/6LdGOeaB4CKsknJoC0qWkfVPer5zx01DxyoTMuhI322UfmvYQ5x 8XIA== X-Gm-Message-State: ALoCoQk6dcSM0xcW0Xzrk43Us8Mhy1Z8pG3Od3zSIsZNEzhdwJ2/laqEQvQNltGR2aFBIo3Evwix MIME-Version: 1.0 X-Received: by 10.224.131.135 with SMTP id x7mr22978565qas.38.1416098140943; Sat, 15 Nov 2014 16:35:40 -0800 (PST) Received: by 10.140.95.193 with HTTP; Sat, 15 Nov 2014 16:35:40 -0800 (PST) In-Reply-To: References: Date: Sat, 15 Nov 2014 17:35:40 -0700 Message-ID: Subject: Re: OT-ish SATA port replicators vs. SAS "expanders" From: Brandon Vincent To: FreeBSD Hackers Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 16 Nov 2014 00:35:48 -0000 On Sat, Nov 15, 2014 at 3:42 PM, Zaphod Beeblebrox wrote: > What is the real difference? Is it possible to hack the driver to support > (obviously not booting from) SATA port replicators on the LSI? This website has a lot of good information on the benefits of using SAS expanders versus SATA port replicators [1]. Most of the storage requirements demanded by large enterprise organizations can only be met using SAS expanders (e.g. multipath I/O). You should also consider that while SATA port replicators work, they are not as nearly as reliable as SAS expanders [2]. SAS is typically utilized for high performance storage applications that have a high reliability requirement. In the end, your choice of solution depends on your application. Are you working in a data warehouse with a five nines availability requirement or are you experimenting at home? For the later, SATA is the economical choice, while SATA doesn't quite cut it for the enterprise requirement. Where did you find that the LSI chipset doesn't support SATA port replicators? Brandon Vincent [1] http://www.sasexpanders.com [2] https://www.usenix.org/system/files/fastpw13-paper7_0.pdf From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 16 02:08:47 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id DBBFECFC for ; Sun, 16 Nov 2014 02:08:47 +0000 (UTC) Received: from mario.brtsvcs.net (mario.brtsvcs.net [199.48.128.182]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B17085F5 for ; Sun, 16 Nov 2014 02:08:47 +0000 (UTC) Received: from chombo.houseloki.net (unknown [IPv6:2601:7:2580:674:21c:c0ff:fe7f:96ee]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mario.brtsvcs.net (Postfix) with ESMTPSA id 93E892C160F; Sun, 16 Nov 2014 02:08:44 +0000 (UTC) Received: from [IPv6:2601:7:2580:674:baca:3aff:fe83:bd29] (ivy.libssl.so [IPv6:2601:7:2580:674:baca:3aff:fe83:bd29]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by chombo.houseloki.net (Postfix) with ESMTPSA id 022379EE; Sat, 15 Nov 2014 18:08:41 -0800 (PST) Message-ID: <54680726.1010708@bluerosetech.com> Date: Sat, 15 Nov 2014 18:08:38 -0800 From: Darren Pilgrim User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: Zaphod Beeblebrox , FreeBSD Hackers , FreeBSD Hackers Subject: Re: OT-ish SATA port replicators vs. SAS "expanders" References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 16 Nov 2014 02:08:47 -0000 On 11/15/2014 2:42 PM, Zaphod Beeblebrox wrote: > First... seriously... whoever was working on this naming convention thought > "expanders" was a good name? [...] > What is the real difference? Is it possible to hack the driver to support > (obviously not booting from) SATA port replicators on the LSI? Yes, the nomenclature isn't great. In short: An SAS expander is basically a multi-lane version of fibre channel without all that WWN nonsense. You usually get two or four SAS lanes per port. These are external with fancy cables. SAS expanders are often simply labelled as "external SAS port". A SATA port replicator (or port multiplier) is more like a USB hub: you plug the replicator into a host SATA port and it provides more than one SATA port for devices. I've yet to see one without interoperability problems. They also add a big risk: if one of the devices on a replicator has a problem, the host can't reset individual replicated ports--just the host port. From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 16 05:18:04 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id EB4F1680 for ; Sun, 16 Nov 2014 05:18:04 +0000 (UTC) Received: from ipmail06.adl2.internode.on.net (ipmail06.adl2.internode.on.net [150.101.137.129]) by mx1.freebsd.org (Postfix) with ESMTP id 7E4CC8DB for ; Sun, 16 Nov 2014 05:18:03 +0000 (UTC) Received: from ppp118-210-137-175.lns20.adl6.internode.on.net (HELO midget.dons.net.au) ([118.210.137.175]) by ipmail06.adl2.internode.on.net with ESMTP; 16 Nov 2014 15:47:57 +1030 Received: from [10.0.2.95] ([10.0.2.95]) (authenticated bits=0) by midget.dons.net.au (8.14.6/8.14.4) with ESMTP id sAG5HjlQ061810 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NO); Sun, 16 Nov 2014 15:47:53 +1030 (CST) (envelope-from darius@dons.net.au) Subject: Re: Newbus question Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Content-Type: text/plain; charset=windows-1252 From: "O'Connor, Daniel" In-Reply-To: <20141115133525.51a25bfa@kan> Date: Sun, 16 Nov 2014 15:47:39 +1030 Content-Transfer-Encoding: quoted-printable Message-Id: References: <20141115121730.3a5bac94@kan> <20141115180302.GL17068@kib.kiev.ua> <20141115133525.51a25bfa@kan> To: Alexander Kabaev X-Mailer: Apple Mail (2.1878.6) X-Spam-Score: -1.106 () BAYES_00,HELO_MISC_IP,RDNS_NONE X-Scanned-By: MIMEDefang 2.73 on 10.0.2.1 X-Mailman-Approved-At: Sun, 16 Nov 2014 12:22:56 +0000 Cc: Konstantin Belousov , FreeBSD Hackers X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 16 Nov 2014 05:18:05 -0000 On 16 Nov 2014, at 5:05, Alexander Kabaev wrote: >> I think that debugging should be available much earlier than the >> device tree is explored and devices are attached. It probably makes >> sense to operate the debugging port outside the newbus at all, in >> particular, before the pci and acpi machinery is initialized. >>=20 >> You might want a callback from ehci driver when it appropriated the >> resources, to handle the case of bar realocation. >=20 > If one wants early debugger, then whole thing will need to be split > into pre-newbus and after-newbus part, similar to dcons. OK thanks. I think for now I=92ll just ignore the EHCI driver and get it working as = a device driver which attaches to an EHCI controller. After that works I=92ll look at the early part, hopefully it won=92t be = too difficult :) -- Daniel O'Connor "The nice thing about standards is that there are so many of them to choose from." -- Andrew Tanenbaum GPG Fingerprint - 5596 B766 97C0 0E94 4347 295E E593 DC20 7B3F CE8C From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 16 19:23:31 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 9D113ACF for ; Sun, 16 Nov 2014 19:23:31 +0000 (UTC) Received: from mail-vc0-x233.google.com (mail-vc0-x233.google.com [IPv6:2607:f8b0:400c:c03::233]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 516D3CFB for ; Sun, 16 Nov 2014 19:23:31 +0000 (UTC) Received: by mail-vc0-f179.google.com with SMTP id le20so5278120vcb.10 for ; Sun, 16 Nov 2014 11:23:30 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=ES0uuyn1WASZv76rPHB2YBsHDLzch2Y39ryzTOB1Npc=; b=NljTYoGAEv3ud9dgykWpMYkLQMPv9lmrkBRzdg6wy9WlSm8md+9SCjMmyi4nmJTOXm f5Ir2bGSQhAl734boK1g5auBCn6n+tZumly1hlQ0yq7+1Y+69qOVQu8xyo5OchgYozRO B5Un7E8qtRUz90tQaL/lYvOI6aaYoucHvqzbsqcDi2WSFI2BinDsIKETwVAKaHTPpHbH /9FlxAIHNk/B6wPXief+K6tl+MdowBKX6gX6O1wLTiLXtbnMNVyUFqNp2FYL/jB7znRB AuUYQMifiIsHk3OIrfVUJBjxxFoXJdoeBk3nfv3Rgo8DkPhcJwvpzWaj5XxlnZoLu8S/ JepA== MIME-Version: 1.0 X-Received: by 10.52.165.65 with SMTP id yw1mr17514105vdb.23.1416165810196; Sun, 16 Nov 2014 11:23:30 -0800 (PST) Received: by 10.220.118.19 with HTTP; Sun, 16 Nov 2014 11:23:30 -0800 (PST) In-Reply-To: References: Date: Sun, 16 Nov 2014 14:23:30 -0500 Message-ID: Subject: Re: OT-ish SATA port replicators vs. SAS "expanders" From: Zaphod Beeblebrox To: Brandon Vincent Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: FreeBSD Hackers X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 16 Nov 2014 19:23:31 -0000 On Sat, Nov 15, 2014 at 7:35 PM, Brandon Vincent wrote: > > In the end, your choice of solution depends on your application. Are > you working in a data warehouse with a five nines availability > requirement or are you experimenting at home? For the later, SATA is > the economical choice, while SATA doesn't quite cut it for the > enterprise requirement. > This is a home array that has media and also stores backups of business data. > > Where did you find that the LSI chipset doesn't support SATA port > replicators? > Well... when I plug in my LSI 2008 and attach one of it's ports to my ProBox eSATA port, it only "sees" one disk, despite the LSI 2008 saying that it supports dozens of total disks. FYI, the exact model is: AOC-USAS2-L8IR ... the 'R' version supporting RAID that I don't need and supposedly many disks per port (which I did need). From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 16 19:25:52 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 7A843C25 for ; Sun, 16 Nov 2014 19:25:52 +0000 (UTC) Received: from mail-vc0-x232.google.com (mail-vc0-x232.google.com [IPv6:2607:f8b0:400c:c03::232]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 30865D27 for ; Sun, 16 Nov 2014 19:25:52 +0000 (UTC) Received: by mail-vc0-f178.google.com with SMTP id hq12so7179850vcb.37 for ; Sun, 16 Nov 2014 11:25:51 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=LzZb90yyPo6WmoSQJbePSBioYdY6NdmQzC3T/aDKahY=; b=gYUYro8lj7c1g0lXN1xAXJYgoaB64dFJub3xP/CeItaQURuInaz+Ppqkn1QNNvRCQh 3BNKF63FChXQ+hU1iLj6ynA7cUkCwmmWd1xvksBaROxA+gh6p4N/2ZTgM3ycqoG8CjU7 YAHvzyOIUZvQr/8CFwk61aQbV1IeEkTFvL0a9RarTjVPJfcUVpn6qnCEM5VUfFem0X8j gjbMB89KOoCo0wnj4C43EvjLzsLkmiqDTrPyJCAd23tHX7ml5kUW52SsQhUdRGVrTIAo bhhuVYeNX2+V7Lb04I3n3O4WDyS1zvGXfB0oE4msrRLbXohDoYgeK2xN/WOWa1tKTHW5 93OA== MIME-Version: 1.0 X-Received: by 10.221.36.73 with SMTP id sz9mr20774975vcb.17.1416165951271; Sun, 16 Nov 2014 11:25:51 -0800 (PST) Received: by 10.220.118.19 with HTTP; Sun, 16 Nov 2014 11:25:51 -0800 (PST) In-Reply-To: <54680726.1010708@bluerosetech.com> References: <54680726.1010708@bluerosetech.com> Date: Sun, 16 Nov 2014 14:25:51 -0500 Message-ID: Subject: Re: OT-ish SATA port replicators vs. SAS "expanders" From: Zaphod Beeblebrox To: Darren Pilgrim Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: FreeBSD Hackers X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 16 Nov 2014 19:25:52 -0000 On Sat, Nov 15, 2014 at 9:08 PM, Darren Pilgrim < list_freebsd@bluerosetech.com> wrote: > A SATA port replicator (or port multiplier) is more like a USB hub: you > plug the replicator into a host SATA port and it provides more than one > SATA port for devices. I've yet to see one without interoperability > problems. They also add a big risk: if one of the devices on a replicator > has a problem, the host can't reset individual replicated ports--just the > host port. > > I have used the Mediasonic 'Probox' 4 drive eSATA for some years. I have 6 of them now. If you were running a standard RAID, you'd have the problem that one drive can take down the array and that you'd have huge trouble recovering. However, ZFS handles this well... From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 16 23:51:03 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 87DC3A1B for ; Sun, 16 Nov 2014 23:51:03 +0000 (UTC) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F646B87 for ; Sun, 16 Nov 2014 23:51:03 +0000 (UTC) Received: from [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a] (saphire3.sentex.ca [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a]) by smarthost1.sentex.ca (8.14.9/8.14.9) with ESMTP id sAGNp2VI067030; Sun, 16 Nov 2014 18:51:02 -0500 (EST) (envelope-from mike@sentex.net) Message-ID: <54693866.9040009@sentex.net> Date: Sun, 16 Nov 2014 18:51:02 -0500 From: Mike Tancsa Organization: Sentex Communications User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.2.0 MIME-Version: 1.0 To: Zaphod Beeblebrox Subject: Re: OT-ish SATA port replicators vs. SAS "expanders" References: In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.75 Cc: FreeBSD Hackers X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 16 Nov 2014 23:51:03 -0000 On 11/16/2014 2:23 PM, Zaphod Beeblebrox wrote: > Well... when I plug in my LSI 2008 and attach one of it's ports to my > ProBox eSATA port, it only "sees" one disk, despite the LSI 2008 saying > that it supports dozens of total disks. FYI, the exact model is: I don think a port multiplier is the same as a SAS expander and a SAS/SATA controller does not necessarily support port multipliers. ---Mike ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/ From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 17 00:26:26 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 1D80836A for ; Mon, 17 Nov 2014 00:26:26 +0000 (UTC) Received: from mail-qg0-f45.google.com (mail-qg0-f45.google.com [209.85.192.45]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D2F11EFD for ; Mon, 17 Nov 2014 00:26:25 +0000 (UTC) Received: by mail-qg0-f45.google.com with SMTP id z107so14278329qgd.32 for ; Sun, 16 Nov 2014 16:26:19 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=Da+lFbmq7EXEdFdxbYpH2T4r/MZzQKj2n9KryXemH0g=; b=E54LKnLgSI6WuH/XXFTlgCNJIQyrwSwP8a9FLMTIveDERpM4B2J8KmimS2xgXa0SrF qBZvCCUe2TB810RkF0/lfY/7a0N8rwn9QXW3HSKELSCqvpBP/jV04YuOorzubIewLu6l BMK5BnBkvzo4JuqJHHqxmZm35lNZlVwhRsQbE0vTRoPA0YatXGsUJLhKCKZtXgU/9ffu e6MSt/jyWC5R25VVPZrJYlfG8cIj7tlt/n4j9PufIGx5GUEhbEXLp0vCFw9iwcXdq5Ox akL5BA5ACQw3Ugv5Hu9NDKWLpVbj1dPzi/kBDkD/7eqFnYsPwjx9edVFAc7lVcdMyd6S Ly1Q== X-Gm-Message-State: ALoCoQnA8GvQdCl693mr6gxTZ/9p5w3cLAGViWS0bUyNl0csMToU0rC/AzyuhfOWZzuJyzz3WVj7 MIME-Version: 1.0 X-Received: by 10.140.85.83 with SMTP id m77mr29448263qgd.93.1416183979581; Sun, 16 Nov 2014 16:26:19 -0800 (PST) Received: by 10.140.95.193 with HTTP; Sun, 16 Nov 2014 16:26:19 -0800 (PST) In-Reply-To: <54693866.9040009@sentex.net> References: <54693866.9040009@sentex.net> Date: Sun, 16 Nov 2014 17:26:19 -0700 Message-ID: Subject: Re: OT-ish SATA port replicators vs. SAS "expanders" From: Brandon Vincent To: FreeBSD Hackers Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2014 00:26:26 -0000 On Sun, Nov 16, 2014 at 4:51 PM, Mike Tancsa wrote: > I don think a port multiplier is the same as a SAS expander and a SAS/SATA > controller does not necessarily support port multipliers. You're absolutely correct. The SATA specifications if I recall correctly, outline that providing support for port multipliers is optional. Not to mention, the vast majority of chipsets that do have support for port multipliers only provide the slower command-based switching method [1], The LSI SAS 2008 chipset is not what you typically find on the cheap consumer "fake RAID" cards which most people have [2]. Most people who purchase this card are purchasing it for SAS, true RAID, performance, and reliability. Thus, LSI is only going to provide support for the far superior SAS expander technology. Brandon Vincent [1] https://www.sata-io.org/port-multipliers [2] http://en.wikipedia.org/wiki/RAID#Firmware.2Fdriver-based From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 17 00:49:56 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 18F0ECC8 for ; Mon, 17 Nov 2014 00:49:56 +0000 (UTC) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id D291A12B for ; Mon, 17 Nov 2014 00:49:55 +0000 (UTC) Received: from [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a] (saphire3.sentex.ca [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a]) by smarthost1.sentex.ca (8.14.9/8.14.9) with ESMTP id sAH0ntP7071575 for ; Sun, 16 Nov 2014 19:49:55 -0500 (EST) (envelope-from mike@sentex.net) Message-ID: <54694633.7000906@sentex.net> Date: Sun, 16 Nov 2014 19:49:55 -0500 From: Mike Tancsa Organization: Sentex Communications User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.2.0 MIME-Version: 1.0 To: FreeBSD Hackers Subject: Re: OT-ish SATA port replicators vs. SAS "expanders" References: <54693866.9040009@sentex.net> In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.75 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2014 00:49:56 -0000 On 11/16/2014 7:26 PM, Brandon Vincent wrote: > On Sun, Nov 16, 2014 at 4:51 PM, Mike Tancsa wrote: >> I don think a port multiplier is the same as a SAS expander and a SAS/SATA >> controller does not necessarily support port multipliers. > > You're absolutely correct. The SATA specifications if I recall > correctly, outline that providing support for port multipliers is > optional. Not to mention, the vast majority of chipsets that do have > support for port multipliers only provide the slower command-based > switching method [1], The LSI SAS 2008 chipset is not what you > typically find on the cheap consumer "fake RAID" cards which most > people have [2]. > > Most people who purchase this card are purchasing it for SAS, true > RAID, performance, and reliability. Thus, LSI is only going to provide > support for the far superior SAS expander technology. We also got rid of all those external 4 port PMs and replaced it with one NORCO RPC-4220 The pricing is quite reasonable and less expensive then using PMs and so far MUCH more reliable. ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/ From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 17 11:08:44 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id E6875AA2 for ; Mon, 17 Nov 2014 11:08:44 +0000 (UTC) Received: from kerio.tuxis.nl (alcyone.saas.tuxis.net [31.3.111.19]) by mx1.freebsd.org (Postfix) with ESMTP id 65F4F34E for ; Mon, 17 Nov 2014 11:08:42 +0000 (UTC) X-Footer: dHV4aXMubmw= Received: from [31.3.104.222] ([31.3.104.222]) by kerio.tuxis.nl (Kerio Connect 8.4.0 RC 1) for freebsd-hackers@freebsd.org; Mon, 17 Nov 2014 12:08:34 +0100 Date: Mon, 17 Nov 2014 12:08:34 +0100 Subject: Re: Slow nfsd write performance, tweaks needed X-Mailer: Kerio Connect 8.4.0 RC 1/Kerio Connect client X-User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.101 Safari/537.36 Message-ID: <3176881007-17726@kerio.tuxis.nl> X-Priority: 3 Importance: Normal In-Reply-To: <2826701214-10966@kerio.tuxis.nl> MIME-Version: 1.0 MIME-Version: 1.0 MIME-Version: 1.0 MIME-Version: 1.0 MIME-Version: 1.0 MIME-Version: 1.0 MIME-Version: 1.0 MIME-Version: 1.0 MIME-Version: 1.0 MIME-Version: 1.0 MIME-Version: 1.0 From: Mark Schouten To: freebsd-hackers@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg="sha1"; boundary="=-3Zzp9AtdhjR9S0QcWG6Q" X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2014 11:08:45 -0000 --=-3Zzp9AtdhjR9S0QcWG6Q Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Hi, Mark Schouten , 13-11-2014 11:17: I am in the process of switching from a ZFS On Linux-based NFS-server to a = FreeBSD-based NFS-server. The FreeBSD implementation of ZFS is way superiou= r over ZoL, and the box serves as storage for a virtualizationplatform, so = stability is welcome. :)=20 =20 =20 The box is stable, but performs terribly. Surely, I'm doing something wrong= , but I would like some tips and tricks to speed things up.=20 Thanks for all your responses. I've setup a testserver to do some benchmark= s, here are the results. Things are tested from inside a VM, that runs insi= de a Proxmox-VM, that runs on my Desktop (that performs pretty good, BTW :)= ) So, command used to benchmark is: 'bonnie++ -u root -d . -r 1024' Locally on the zfs/nfs/ctl-server itself: =C2=A0 =C2=A01m42.91s iscsi (using the new ctld on FreeBSD 10): =C2=A0 =C2=A01m55.203s nfs on linux desktop (on which the vms are running too) =C2=A0 =C2=A04m42.267s ufs via nfs from FreeBSD 10: =C2=A0 =C2=A020m35.644s zfs via nfs from FreeBSD 10: =C2=A0 =C2=A024m23.225s zfs with sync disabled via nfs from FreeBSD 10: =C2=A0 =C2=A021m0.191s The same FreeBSD testbox is used for all tests, which was doing nothing but= the benchmark. What I've learned from these benchmarks is this: * NFS on FreeBSD just sucks, bigtime * NFS on Linux performs 'ok' * iScsi on FreeBSD is fast, very fast Two questions remain:=C2=A0 * How stable is ctl(d)? * How does it perform with more iops and clients? If anyone has any input on that, I'd be grateful. Regards,=C2=A0 --=C2=A0 Kerio Operator in de Cloud? https://www.kerioindecloud.nl/ Mark Schouten | Tuxis Internet Engineering KvK:=C2=A061527076=C2=A0| http://www.tuxis.nl/ T: 0318 200208 | info@tuxis.nl = --=-3Zzp9AtdhjR9S0QcWG6Q Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Disposition: attachment; filename="smime.p7s" Content-Description: Electronic Signature S/MIME Content-Transfer-Encoding: base64 MIIRwQYJKoZIhvcNAQcCoIIRsjCCEa4CAQExCzAJBgUrDgMCGgUAMAsGCSqGSIb3DQEHAaCCDt4w ggUbMIIEA6ADAgECAhAsv+VdGX6YsSHI/WRu2j2JMA0GCSqGSIb3DQEBBQUAMIGTMQswCQYDVQQG EwJHQjEbMBkGA1UECBMSR3JlYXRlciBNYW5jaGVzdGVyMRAwDgYDVQQHEwdTYWxmb3JkMRowGAYD VQQKExFDT01PRE8gQ0EgTGltaXRlZDE5MDcGA1UEAxMwQ09NT0RPIENsaWVudCBBdXRoZW50aWNh dGlvbiBhbmQgU2VjdXJlIEVtYWlsIENBMB4XDTE0MDcwMTAwMDAwMFoXDTE1MDcwMTIzNTk1OVow HjEcMBoGCSqGSIb3DQEJARYNbWFya0B0dXhpcy5ubDCCASIwDQYJKoZIhvcNAQEBBQADggEPADCC AQoCggEBANHu3SxlMZOG5GA0/mqtRXR1QmWwhUXzmCIprI0IPtSBWSA31YBJ5qcmXRhLzaiTB3Fr UpIGkW5aAZnDms9DD64kasF3oZE00Fvfnj/BDGbw098px1PukKfg4hasbTaELAjQTSUj8xRSHzKk VVynvLA/YmyRT/+u3ueK4wdaxcej241xH6mNfZeiKMAvbkv6Tm9vdup0BtqqbRSKcnc01KKrspun Eh73jLIUhP21uJv8vuOTxS1I9zJSlhIcMCEapjBQ+26cQl+s+qBuAs/LP3UPVytSbxvicdhDxtqH npN2h3jJ/+J86zGfQi8bG7EamsULTGHkbgIJL9AdKZRgAKECAwEAAaOCAd0wggHZMB8GA1UdIwQY MBaAFHoTTgB0W8Z4Y2QnwS/ioFu8ecV7MB0GA1UdDgQWBBR+dMZE22X/SMCyTxYzIP+NMZBNXTAO BgNVHQ8BAf8EBAMCBaAwDAYDVR0TAQH/BAIwADAgBgNVHSUEGTAXBggrBgEFBQcDBAYLKwYBBAGy MQEDBQIwEQYJYIZIAYb4QgEBBAQDAgUgMEYGA1UdIAQ/MD0wOwYMKwYBBAGyMQECAQEBMCswKQYI KwYBBQUHAgEWHWh0dHBzOi8vc2VjdXJlLmNvbW9kby5uZXQvQ1BTMFcGA1UdHwRQME4wTKBKoEiG Rmh0dHA6Ly9jcmwuY29tb2RvY2EuY29tL0NPTU9ET0NsaWVudEF1dGhlbnRpY2F0aW9uYW5kU2Vj dXJlRW1haWxDQS5jcmwwgYgGCCsGAQUFBwEBBHwwejBSBggrBgEFBQcwAoZGaHR0cDovL2NydC5j b21vZG9jYS5jb20vQ09NT0RPQ2xpZW50QXV0aGVudGljYXRpb25hbmRTZWN1cmVFbWFpbENBLmNy dDAkBggrBgEFBQcwAYYYaHR0cDovL29jc3AuY29tb2RvY2EuY29tMBgGA1UdEQQRMA+BDW1hcmtA dHV4aXMubmwwDQYJKoZIhvcNAQEFBQADggEBAIB8FhqaML1EzfvgNwwHDC3k0ICeMerOncgee6uJ KLxwU2mstttX5jtAmgK9RuDOu+TrMkkpF2yxYMTPpSM8nL7r+N/kdogu5Bustol8WTsW1e5vs+Nh hJYFORk113ouur1kSjXuHF8TWy+/PjFJBS/xm/H+/fkghppRU+4Dj2IReUBvlexAPYr4VDxjV7AD xPOXqTQkP15LWGvhTz2YVbJ3IAVOyUNkRhr9QwzToUxXa9k/QAOpXMuvS74AT2RBV/YCEEx7ebRD MAR6lZcbYiV8sXv1ASbnMdO3Fh2F98g+5rJn5PfFH8qLpapsZx0I2/axtSG09QMDJqXd3Ab6NpEw ggUaMIIEAqADAgECAhBtGeqnGU9qMyLmIjJ6qnHeMA0GCSqGSIb3DQEBBQUAMIGuMQswCQYDVQQG EwJVUzELMAkGA1UECBMCVVQxFzAVBgNVBAcTDlNhbHQgTGFrZSBDaXR5MR4wHAYDVQQKExVUaGUg VVNFUlRSVVNUIE5ldHdvcmsxITAfBgNVBAsTGGh0dHA6Ly93d3cudXNlcnRydXN0LmNvbTE2MDQG A1UEAxMtVVROLVVTRVJGaXJzdC1DbGllbnQgQXV0aGVudGljYXRpb24gYW5kIEVtYWlsMB4XDTEx MDQyODAwMDAwMFoXDTIwMDUzMDEwNDgzOFowgZMxCzAJBgNVBAYTAkdCMRswGQYDVQQIExJHcmVh dGVyIE1hbmNoZXN0ZXIxEDAOBgNVBAcTB1NhbGZvcmQxGjAYBgNVBAoTEUNPTU9ETyBDQSBMaW1p dGVkMTkwNwYDVQQDEzBDT01PRE8gQ2xpZW50IEF1dGhlbnRpY2F0aW9uIGFuZCBTZWN1cmUgRW1h aWwgQ0EwggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQCShIRbS1eY1F4vi6ThQMijU1hf ZmXxMk73nzJ9VdB4TFW3QpTg+SdxB8XGaaS5MsTxQBqQzCdWYn8XtXFpruUgG+TLY15gyqJB9mrh o/+43x9IbWVDjCouK2M4d9+xF6zC2oIC1tQyatRnbyATj1w1+uVUgK/YcQodNwoCUFNslR2pEBS0 mZVZEjH/CaLSTNxS297iQAFbSGjdxUq04O0kHzqvcV8H46y/FDuwJXFoPfQP1hdYRhWBPGiLi4MP bXohV+Y0sNsyfuNK4aVScmQmkU6lkg//4LFg/RpvaFGZY40ai6XMQpubfSJj06mg/M6ekN9EGfRc WzW6FvOnm//BAgMBAAGjggFLMIIBRzAfBgNVHSMEGDAWgBSJgmd9xJ0mcABLtFBIfN49rgRufTAd BgNVHQ4EFgQUehNOAHRbxnhjZCfBL+KgW7x5xXswDgYDVR0PAQH/BAQDAgEGMBIGA1UdEwEB/wQI MAYBAf8CAQAwEQYDVR0gBAowCDAGBgRVHSAAMFgGA1UdHwRRME8wTaBLoEmGR2h0dHA6Ly9jcmwu dXNlcnRydXN0LmNvbS9VVE4tVVNFUkZpcnN0LUNsaWVudEF1dGhlbnRpY2F0aW9uYW5kRW1haWwu Y3JsMHQGCCsGAQUFBwEBBGgwZjA9BggrBgEFBQcwAoYxaHR0cDovL2NydC51c2VydHJ1c3QuY29t L1VUTkFkZFRydXN0Q2xpZW50X0NBLmNydDAlBggrBgEFBQcwAYYZaHR0cDovL29jc3AudXNlcnRy dXN0LmNvbTANBgkqhkiG9w0BAQUFAAOCAQEAhda+eFdVbTN/RFL+QtUGqAEDgIr7DbL9Sr/2r0FJ 9RtaxdKtG3NuPukmfOZMmMEwKN/L+0I8oSU+CnXW0D05hmbRoZu1TZtvryhsHa/l6nRaqNqxwPF1 ei+eupN5yv7ikR5WdLL4jdPgQ3Ib7Y/9YDkgR/uLrzplSDyYPaUlv73vYOBJ5RbI6z9Dg/Dg7g3B 080zX5vQvWBqszv++tTJOjwf7Zv/m0kzvkIpOYPuM2kugp1FTahp2oAbHj3SGl18R5mlmwhtEpmG 1l1XBxunML5LSUS4kH7K0Xk467Qz+qA6XSZYnmFVGLQh1ZnV4ENAQjC+6qXnlNKw/vN1+X9u5zCC BJ0wggOFoAMCAQICEDQ96SusJzT/j8s0lPvMcFQwDQYJKoZIhvcNAQEFBQAwbzELMAkGA1UEBhMC U0UxFDASBgNVBAoTC0FkZFRydXN0IEFCMSYwJAYDVQQLEx1BZGRUcnVzdCBFeHRlcm5hbCBUVFAg TmV0d29yazEiMCAGA1UEAxMZQWRkVHJ1c3QgRXh0ZXJuYWwgQ0EgUm9vdDAeFw0wNTA2MDcwODA5 MTBaFw0yMDA1MzAxMDQ4MzhaMIGuMQswCQYDVQQGEwJVUzELMAkGA1UECBMCVVQxFzAVBgNVBAcT DlNhbHQgTGFrZSBDaXR5MR4wHAYDVQQKExVUaGUgVVNFUlRSVVNUIE5ldHdvcmsxITAfBgNVBAsT GGh0dHA6Ly93d3cudXNlcnRydXN0LmNvbTE2MDQGA1UEAxMtVVROLVVTRVJGaXJzdC1DbGllbnQg QXV0aGVudGljYXRpb24gYW5kIEVtYWlsMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA sjmFpPJ9q0E7YkY3rs3BYHW8OWX5ShpHornMSMxqmNVNNRm5pELlzkniii8efNIxB8dOtINknS4p 1aJkxIW9hVE1eaROaJB7HHqkkqgX8pgV8pPMyaQylbsMTzC9mKALi+VuG6JG+ni8om+rWV6lL8/K 2m2qL+usobNqqrcuZzWLeeEeaYji5kbNoKXqvgvOdjp6Dpvq/NonWz1zHyLmSGHGTPNpsaguG7bU MSAsvIKKjqQOpdeJQ/wWWq8dcdcRWdq6hw2v+vPhwvCkxWeM1tZUOt4KpLoDd7NlyP0e03RiqhjK aJMeoYV+9Udly/hNVyh00jT/MLbu9mIwFIws6wIDAQABo4H0MIHxMB8GA1UdIwQYMBaAFK29mHo0 tCb3+sQmVO8DveAky1QaMB0GA1UdDgQWBBSJgmd9xJ0mcABLtFBIfN49rgRufTAOBgNVHQ8BAf8E BAMCAQYwDwYDVR0TAQH/BAUwAwEB/zARBgNVHSAECjAIMAYGBFUdIAAwRAYDVR0fBD0wOzA5oDeg NYYzaHR0cDovL2NybC51c2VydHJ1c3QuY29tL0FkZFRydXN0RXh0ZXJuYWxDQVJvb3QuY3JsMDUG CCsGAQUFBwEBBCkwJzAlBggrBgEFBQcwAYYZaHR0cDovL29jc3AudXNlcnRydXN0LmNvbTANBgkq hkiG9w0BAQUFAAOCAQEAAbyc42MosPMxAcLfe91ioAGdIzEPnJJzU1HqH0z61p/Eyi9nfngzD3QW uZGHkfWKJvpkcADYHvkLBGJQh5OB1Nr1I9s0u4VWtHA0bniDNx6FHMURFZJfhxe9rGr98cLRzIlf sXzwPlHyNfN87GCYazor4O/fs32G67Ub9VvsonyYE9cAULnRLXPeA3h04QWFMV7LmrmdlMa5lDd1 ctxE+2fo8PolHlKn2iXpR+CgxzygTrEKNvt3SJ/vl4r7tP7jlBSog7xcLT/SYHFg7sJxggzpiDbj 2iC0o6BsqpZLuICOdcpJB/Y7FLrf3AXZn9vgsuZNoHgm5+ctbn9fxh6IFTGCAqswggKnAgEBMIGo MIGTMQswCQYDVQQGEwJHQjEbMBkGA1UECBMSR3JlYXRlciBNYW5jaGVzdGVyMRAwDgYDVQQHEwdT YWxmb3JkMRowGAYDVQQKExFDT01PRE8gQ0EgTGltaXRlZDE5MDcGA1UEAxMwQ09NT0RPIENsaWVu dCBBdXRoZW50aWNhdGlvbiBhbmQgU2VjdXJlIEVtYWlsIENBAhAsv+VdGX6YsSHI/WRu2j2JMAkG BSsOAwIaBQCggdgwGAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMTQx MTE3MTEwODM0WjAjBgkqhkiG9w0BCQQxFgQUyhXh35k1AfBGTueh7sj6U+nC7jkweQYJKoZIhvcN AQkPMWwwajALBglghkgBZQMEASowCwYJYIZIAWUDBAEWMAsGCWCGSAFlAwQBAjAKBggqhkiG9w0D BzAOBggqhkiG9w0DAgICAIAwDQYIKoZIhvcNAwICAUAwBwYFKw4DAgcwDQYIKoZIhvcNAwICASgw DQYJKoZIhvcNAQEBBQAEggEAcKOJJDP93tBdaIuPlOHcnkXPzl8KJ4ASiEZQLeIe4eNysOYiPBen x1i6zEmLAXTwVv3Icl2odREGIguaDaqyK/7PBDKbrb0P7TylI9KmtH61HOwMvyjncRU9YzXSSpwh pabdywf82IQw0SzHXQzDmBLOvOGvIr5Ze9n2R5LovxLrVwdpEfPXRaFMd/EjD2VMXQotpZJLC1BJ tWkH0nt1zZZL1ZoRFynbV4GFcm22rLSxg/WEVgsoOwRODvBIT51DEktwFVm0R9Ue+TqbElal4aD+ L1yLfDvz0aC0lieFSKA57O2r8BwCfnl5C3MivF0lj5opUKzfeO+PI2x5nTx38A== --=-3Zzp9AtdhjR9S0QcWG6Q-- From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 17 14:54:27 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 3086EAB4; Mon, 17 Nov 2014 14:54:27 +0000 (UTC) Received: from udns.ultimatedns.net (unknown [IPv6:2602:d1:b4d6:e600:4261:86ff:fef6:aa2a]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id EEF63F80; Mon, 17 Nov 2014 14:54:26 +0000 (UTC) Received: from ultimatedns.net (localhost [127.0.0.1]) by udns.ultimatedns.net (8.14.9/8.14.9) with ESMTP id sAHEt7F2081999; Mon, 17 Nov 2014 06:55:09 -0800 (PST) (envelope-from bsd-lists@bsdforge.com) To: Luigi Rizzo , Rui Paulo In-Reply-To: <2FA736F4-8D06-4BBC-81DC-3E3A646BD391@me.com> References: , <2FA736F4-8D06-4BBC-81DC-3E3A646BD391@me.com> From: "Chris H" Subject: Re: comments on code-in tasks for FreeBSD (Re: FreeBSD + Google Code-In 2014 = we need ideas.) Date: Mon, 17 Nov 2014 06:55:09 -0800 Content-Type: text/plain; charset=UTF-8; format=fixed MIME-Version: 1.0 Message-id: <121786de210f46237d17adb9b4febc53@ultimatedns.net> Content-Transfer-Encoding: 8bit Cc: "freebsd-hackers@freebsd.org" , FreeBSD CURRENT , "Wojciech A. Koszek" , Alan Somers X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2014 14:54:27 -0000 On Thu, 13 Nov 2014 19:55:16 -0800 Rui Paulo wrote > On Nov 13, 2014, at 17:40, Luigi Rizzo wrote: > > But please nuke the current list -- it is completely inadequate > > for the code-in candidates and misleading for whoever wants to > > suggest new tasks. Again i am not saying that the projects > > suggested there are not important, just belong somewhere else > > e.g. gsoc. > > I refrained from voicing my opinion while the call for help was going on, but > I completely agree that the target age of this Google initiative is > inadequate to FreeBSD. The target population is 13 years to 17 years old and > I cannot even imagine a 13 year old knowing what FreeBSD is. > > I'm not sure we should participate in Code In ever again and perhaps we > should focus our efforts on Summer of Code only. @Luigi Very insightful. Thanks for taking the time to share your thoughts. :) @Rui Would tasks in re, or Mk/ be too far off base? --Chris > > -- > Rui Paulo > > > > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 17 15:29:32 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 3E16B3CC for ; Mon, 17 Nov 2014 15:29:32 +0000 (UTC) Received: from mail-qg0-x233.google.com (mail-qg0-x233.google.com [IPv6:2607:f8b0:400d:c04::233]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id EAB2A3E0 for ; Mon, 17 Nov 2014 15:29:31 +0000 (UTC) Received: by mail-qg0-f51.google.com with SMTP id l89so815828qgf.38 for ; Mon, 17 Nov 2014 07:29:31 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=NWGzjQspUeAiGLCmUM+4ulrqV3UR18v6ymKD9HnM8WI=; b=UJUTwCGS6dccI0mHN48Ctvf4IxSqgeQzd54f4KNEwmLjTIRTe5fS1IvFJQBQ0GQyqv TNlT7nFxb4g80JycsbDik13nXH/HWwcldh6KQ26HEl7w9/I2lKn0qU1Ft7O5mta5A0gB hOYrWuJUyi1LxO6VYuGucKTElV9+L5z9HOKYgBHfXwaQVRKrEWrM9bWwdfXUuT7IqJfS RFcPGj7P18x4RLoaXzeGW8u5Wdw6tPvemm5HyIYgL3+sGHQs7Wk2AHOAm2XY2vEE02E/ cXd/NkvfIW5TY9u/hbTgCGnrFiYAa94EynF5c7a/MeXn8Ld6QYMfWks3UCryfssjuJtL ukoA== MIME-Version: 1.0 X-Received: by 10.229.104.3 with SMTP id m3mr35348956qco.0.1416238171118; Mon, 17 Nov 2014 07:29:31 -0800 (PST) Received: by 10.140.42.55 with HTTP; Mon, 17 Nov 2014 07:29:31 -0800 (PST) Date: Mon, 17 Nov 2014 13:29:31 -0200 Message-ID: Subject: This topic is mainly for developers of FreeBSD that develop in machine code, until even in binary code. From: =?UTF-8?Q?fran=C3=A7ai_s?= To: freebsd-hackers@freebsd.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2014 15:29:32 -0000 This subject is irresistible to me,I like so much of this issue that get out tears out of my eyes. This topic is mainly for developers of FreeBSD that develop in machine code, until even in binary code. A FreeBSD developer told me via private message that the the most FreeBSD developers don=E2=80=99t develop in machine code, in other words, the mino= rity FreeBSD developers develop in machine code, until even in binary code. He told me this: "We either create a macro expands to something like ".word =E2=80=9C = or sometimes the .word is just hard coded inline when there=E2=80=99s on= ly going to be one of them. Sometimes we expose them both in assembly and in C code, in which case what we do varies a bit to accommodate the different language=E2=80=99s syntax. It is rare, but has happened, that we only expos= e it to C code. Generally, though, we try to add support for the opcodes to gas so that we get the constraint testing it does (making sure the opcode is supported at the level you are compiling, making sure it isn=E2=80=99t in a delay slot o= r violating some other precondition for its use)." "You pointed me at macros that defined operations in terms of opcodes the assembler didn=E2=80=99t understand with the workaround being the assembler directive using .word followed by by some hex value to encode the opcode." "Most developers of FreeBSD don=E2=80=99t write directly in machine code i= n FreeBSD development, and don=E2=80=99t care. Some developers use the marcos= that I described sometimes when doing specific, low-level coding. A handful of developers create the marcos directly or use the .word directives in their work to make certain things work that cannot work otherwise. People generally don=E2=80=99t write in raw machine opcodes. That is indepe= ndent of FreeBSD. However, a few, specialized people will find the need to do it from time to time. Usually because they are porting FreeBSD to a newer processor that needs newer opcodes to do context switching, optimize interrupt handling, code with a new type of cache coherency, etc. These people look up the assembler in the docs from the vendor and then create the .word workaround to make sure things work. If they have the time, they may add it to our somewhat ancient gas assembler as well." "Almost nobody writes directly in binary. There are some exceptions, sometimes though." The following link leads to tutorial that teaches programming Assembly in to FreeBSD: http://www.freebsd.org/doc/en_US.ISO8859-1/books/developers-handbook/x86.ht= ml Also exist tutorial that teaches programming in machine code to FreeBSD? From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 17 15:34:29 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 720909BF for ; Mon, 17 Nov 2014 15:34:29 +0000 (UTC) Received: from kerio.tuxis.nl (alcyone.saas.tuxis.net [31.3.111.19]) by mx1.freebsd.org (Postfix) with ESMTP id E42986C2 for ; Mon, 17 Nov 2014 15:34:28 +0000 (UTC) X-Footer: dHV4aXMubmw= Received: from [31.3.104.222] ([31.3.104.222]) by kerio.tuxis.nl (Kerio Connect 8.4.0 RC 1) for mark@tuxis.nl; Mon, 17 Nov 2014 16:34:24 +0100 Date: Mon, 17 Nov 2014 16:34:24 +0100 Subject: Re: Slow nfsd write performance, tweaks needed X-Mailer: Kerio Connect 8.4.0 RC 1/Kerio Connect client X-User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.101 Safari/537.36 Message-ID: <3194069010-2731@kerio.tuxis.nl> X-Priority: 3 Importance: Normal In-Reply-To: <3176881007-17726@kerio.tuxis.nl> MIME-Version: 1.0 MIME-Version: 1.0 MIME-Version: 1.0 From: Mark Schouten To: Mark Schouten , freebsd-hackers@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg="sha1"; boundary="=-jk3hNIIPmdD2XyTiNqeA" X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2014 15:34:29 -0000 --=-jk3hNIIPmdD2XyTiNqeA Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Hi, Mark Schouten , 17-11-2014 12:08: =20 The box is stable, but performs terribly. Surely, I'm doing something wrong= , but I would like some tips and tricks to speed things up.=20 So I upgraded to 10.1: iscsi:=C2=A0 =C2=A0=C2=A01m58.694s Linux nfs: =C2=A0 4m37.826s ufs via nfs: =C2=A0=C2=A02m49.135s zfs via nfs: =C2=A0=C2=A04m22.415s zfs with sync=3Ddisabled via nfs: =C2=A0=C2=A02m26.411s Please note that this is *with* sync on the Linux NFS Client. So this line in the 10.1 releasenotes actually means a lot: "Kernel RPC code, which is a base of NFS server took multiple optimizations= , that significantly improved its performance and=C2=A0SMP=C2=A0scalability= .=C2=A0(Sponsored by iXsystems)" So, indeed. Thanks iXsystems :) Met vriendelijke groeten, --=C2=A0 Kerio Operator in de Cloud? https://www.kerioindecloud.nl/ Mark Schouten | Tuxis Internet Engineering KvK:=C2=A061527076=C2=A0| http://www.tuxis.nl/ T: 0318 200208 | info@tuxis.nl= --=-jk3hNIIPmdD2XyTiNqeA Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Disposition: attachment; filename="smime.p7s" Content-Description: Electronic Signature S/MIME Content-Transfer-Encoding: base64 MIIRwQYJKoZIhvcNAQcCoIIRsjCCEa4CAQExCzAJBgUrDgMCGgUAMAsGCSqGSIb3DQEHAaCCDt4w ggUbMIIEA6ADAgECAhAsv+VdGX6YsSHI/WRu2j2JMA0GCSqGSIb3DQEBBQUAMIGTMQswCQYDVQQG EwJHQjEbMBkGA1UECBMSR3JlYXRlciBNYW5jaGVzdGVyMRAwDgYDVQQHEwdTYWxmb3JkMRowGAYD VQQKExFDT01PRE8gQ0EgTGltaXRlZDE5MDcGA1UEAxMwQ09NT0RPIENsaWVudCBBdXRoZW50aWNh dGlvbiBhbmQgU2VjdXJlIEVtYWlsIENBMB4XDTE0MDcwMTAwMDAwMFoXDTE1MDcwMTIzNTk1OVow HjEcMBoGCSqGSIb3DQEJARYNbWFya0B0dXhpcy5ubDCCASIwDQYJKoZIhvcNAQEBBQADggEPADCC AQoCggEBANHu3SxlMZOG5GA0/mqtRXR1QmWwhUXzmCIprI0IPtSBWSA31YBJ5qcmXRhLzaiTB3Fr UpIGkW5aAZnDms9DD64kasF3oZE00Fvfnj/BDGbw098px1PukKfg4hasbTaELAjQTSUj8xRSHzKk VVynvLA/YmyRT/+u3ueK4wdaxcej241xH6mNfZeiKMAvbkv6Tm9vdup0BtqqbRSKcnc01KKrspun Eh73jLIUhP21uJv8vuOTxS1I9zJSlhIcMCEapjBQ+26cQl+s+qBuAs/LP3UPVytSbxvicdhDxtqH npN2h3jJ/+J86zGfQi8bG7EamsULTGHkbgIJL9AdKZRgAKECAwEAAaOCAd0wggHZMB8GA1UdIwQY MBaAFHoTTgB0W8Z4Y2QnwS/ioFu8ecV7MB0GA1UdDgQWBBR+dMZE22X/SMCyTxYzIP+NMZBNXTAO BgNVHQ8BAf8EBAMCBaAwDAYDVR0TAQH/BAIwADAgBgNVHSUEGTAXBggrBgEFBQcDBAYLKwYBBAGy MQEDBQIwEQYJYIZIAYb4QgEBBAQDAgUgMEYGA1UdIAQ/MD0wOwYMKwYBBAGyMQECAQEBMCswKQYI KwYBBQUHAgEWHWh0dHBzOi8vc2VjdXJlLmNvbW9kby5uZXQvQ1BTMFcGA1UdHwRQME4wTKBKoEiG Rmh0dHA6Ly9jcmwuY29tb2RvY2EuY29tL0NPTU9ET0NsaWVudEF1dGhlbnRpY2F0aW9uYW5kU2Vj dXJlRW1haWxDQS5jcmwwgYgGCCsGAQUFBwEBBHwwejBSBggrBgEFBQcwAoZGaHR0cDovL2NydC5j b21vZG9jYS5jb20vQ09NT0RPQ2xpZW50QXV0aGVudGljYXRpb25hbmRTZWN1cmVFbWFpbENBLmNy dDAkBggrBgEFBQcwAYYYaHR0cDovL29jc3AuY29tb2RvY2EuY29tMBgGA1UdEQQRMA+BDW1hcmtA dHV4aXMubmwwDQYJKoZIhvcNAQEFBQADggEBAIB8FhqaML1EzfvgNwwHDC3k0ICeMerOncgee6uJ KLxwU2mstttX5jtAmgK9RuDOu+TrMkkpF2yxYMTPpSM8nL7r+N/kdogu5Bustol8WTsW1e5vs+Nh hJYFORk113ouur1kSjXuHF8TWy+/PjFJBS/xm/H+/fkghppRU+4Dj2IReUBvlexAPYr4VDxjV7AD xPOXqTQkP15LWGvhTz2YVbJ3IAVOyUNkRhr9QwzToUxXa9k/QAOpXMuvS74AT2RBV/YCEEx7ebRD MAR6lZcbYiV8sXv1ASbnMdO3Fh2F98g+5rJn5PfFH8qLpapsZx0I2/axtSG09QMDJqXd3Ab6NpEw ggUaMIIEAqADAgECAhBtGeqnGU9qMyLmIjJ6qnHeMA0GCSqGSIb3DQEBBQUAMIGuMQswCQYDVQQG EwJVUzELMAkGA1UECBMCVVQxFzAVBgNVBAcTDlNhbHQgTGFrZSBDaXR5MR4wHAYDVQQKExVUaGUg VVNFUlRSVVNUIE5ldHdvcmsxITAfBgNVBAsTGGh0dHA6Ly93d3cudXNlcnRydXN0LmNvbTE2MDQG A1UEAxMtVVROLVVTRVJGaXJzdC1DbGllbnQgQXV0aGVudGljYXRpb24gYW5kIEVtYWlsMB4XDTEx MDQyODAwMDAwMFoXDTIwMDUzMDEwNDgzOFowgZMxCzAJBgNVBAYTAkdCMRswGQYDVQQIExJHcmVh dGVyIE1hbmNoZXN0ZXIxEDAOBgNVBAcTB1NhbGZvcmQxGjAYBgNVBAoTEUNPTU9ETyBDQSBMaW1p dGVkMTkwNwYDVQQDEzBDT01PRE8gQ2xpZW50IEF1dGhlbnRpY2F0aW9uIGFuZCBTZWN1cmUgRW1h aWwgQ0EwggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQCShIRbS1eY1F4vi6ThQMijU1hf ZmXxMk73nzJ9VdB4TFW3QpTg+SdxB8XGaaS5MsTxQBqQzCdWYn8XtXFpruUgG+TLY15gyqJB9mrh o/+43x9IbWVDjCouK2M4d9+xF6zC2oIC1tQyatRnbyATj1w1+uVUgK/YcQodNwoCUFNslR2pEBS0 mZVZEjH/CaLSTNxS297iQAFbSGjdxUq04O0kHzqvcV8H46y/FDuwJXFoPfQP1hdYRhWBPGiLi4MP bXohV+Y0sNsyfuNK4aVScmQmkU6lkg//4LFg/RpvaFGZY40ai6XMQpubfSJj06mg/M6ekN9EGfRc WzW6FvOnm//BAgMBAAGjggFLMIIBRzAfBgNVHSMEGDAWgBSJgmd9xJ0mcABLtFBIfN49rgRufTAd BgNVHQ4EFgQUehNOAHRbxnhjZCfBL+KgW7x5xXswDgYDVR0PAQH/BAQDAgEGMBIGA1UdEwEB/wQI MAYBAf8CAQAwEQYDVR0gBAowCDAGBgRVHSAAMFgGA1UdHwRRME8wTaBLoEmGR2h0dHA6Ly9jcmwu dXNlcnRydXN0LmNvbS9VVE4tVVNFUkZpcnN0LUNsaWVudEF1dGhlbnRpY2F0aW9uYW5kRW1haWwu Y3JsMHQGCCsGAQUFBwEBBGgwZjA9BggrBgEFBQcwAoYxaHR0cDovL2NydC51c2VydHJ1c3QuY29t L1VUTkFkZFRydXN0Q2xpZW50X0NBLmNydDAlBggrBgEFBQcwAYYZaHR0cDovL29jc3AudXNlcnRy dXN0LmNvbTANBgkqhkiG9w0BAQUFAAOCAQEAhda+eFdVbTN/RFL+QtUGqAEDgIr7DbL9Sr/2r0FJ 9RtaxdKtG3NuPukmfOZMmMEwKN/L+0I8oSU+CnXW0D05hmbRoZu1TZtvryhsHa/l6nRaqNqxwPF1 ei+eupN5yv7ikR5WdLL4jdPgQ3Ib7Y/9YDkgR/uLrzplSDyYPaUlv73vYOBJ5RbI6z9Dg/Dg7g3B 080zX5vQvWBqszv++tTJOjwf7Zv/m0kzvkIpOYPuM2kugp1FTahp2oAbHj3SGl18R5mlmwhtEpmG 1l1XBxunML5LSUS4kH7K0Xk467Qz+qA6XSZYnmFVGLQh1ZnV4ENAQjC+6qXnlNKw/vN1+X9u5zCC BJ0wggOFoAMCAQICEDQ96SusJzT/j8s0lPvMcFQwDQYJKoZIhvcNAQEFBQAwbzELMAkGA1UEBhMC U0UxFDASBgNVBAoTC0FkZFRydXN0IEFCMSYwJAYDVQQLEx1BZGRUcnVzdCBFeHRlcm5hbCBUVFAg TmV0d29yazEiMCAGA1UEAxMZQWRkVHJ1c3QgRXh0ZXJuYWwgQ0EgUm9vdDAeFw0wNTA2MDcwODA5 MTBaFw0yMDA1MzAxMDQ4MzhaMIGuMQswCQYDVQQGEwJVUzELMAkGA1UECBMCVVQxFzAVBgNVBAcT DlNhbHQgTGFrZSBDaXR5MR4wHAYDVQQKExVUaGUgVVNFUlRSVVNUIE5ldHdvcmsxITAfBgNVBAsT GGh0dHA6Ly93d3cudXNlcnRydXN0LmNvbTE2MDQGA1UEAxMtVVROLVVTRVJGaXJzdC1DbGllbnQg QXV0aGVudGljYXRpb24gYW5kIEVtYWlsMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA sjmFpPJ9q0E7YkY3rs3BYHW8OWX5ShpHornMSMxqmNVNNRm5pELlzkniii8efNIxB8dOtINknS4p 1aJkxIW9hVE1eaROaJB7HHqkkqgX8pgV8pPMyaQylbsMTzC9mKALi+VuG6JG+ni8om+rWV6lL8/K 2m2qL+usobNqqrcuZzWLeeEeaYji5kbNoKXqvgvOdjp6Dpvq/NonWz1zHyLmSGHGTPNpsaguG7bU MSAsvIKKjqQOpdeJQ/wWWq8dcdcRWdq6hw2v+vPhwvCkxWeM1tZUOt4KpLoDd7NlyP0e03RiqhjK aJMeoYV+9Udly/hNVyh00jT/MLbu9mIwFIws6wIDAQABo4H0MIHxMB8GA1UdIwQYMBaAFK29mHo0 tCb3+sQmVO8DveAky1QaMB0GA1UdDgQWBBSJgmd9xJ0mcABLtFBIfN49rgRufTAOBgNVHQ8BAf8E BAMCAQYwDwYDVR0TAQH/BAUwAwEB/zARBgNVHSAECjAIMAYGBFUdIAAwRAYDVR0fBD0wOzA5oDeg NYYzaHR0cDovL2NybC51c2VydHJ1c3QuY29tL0FkZFRydXN0RXh0ZXJuYWxDQVJvb3QuY3JsMDUG CCsGAQUFBwEBBCkwJzAlBggrBgEFBQcwAYYZaHR0cDovL29jc3AudXNlcnRydXN0LmNvbTANBgkq hkiG9w0BAQUFAAOCAQEAAbyc42MosPMxAcLfe91ioAGdIzEPnJJzU1HqH0z61p/Eyi9nfngzD3QW uZGHkfWKJvpkcADYHvkLBGJQh5OB1Nr1I9s0u4VWtHA0bniDNx6FHMURFZJfhxe9rGr98cLRzIlf sXzwPlHyNfN87GCYazor4O/fs32G67Ub9VvsonyYE9cAULnRLXPeA3h04QWFMV7LmrmdlMa5lDd1 ctxE+2fo8PolHlKn2iXpR+CgxzygTrEKNvt3SJ/vl4r7tP7jlBSog7xcLT/SYHFg7sJxggzpiDbj 2iC0o6BsqpZLuICOdcpJB/Y7FLrf3AXZn9vgsuZNoHgm5+ctbn9fxh6IFTGCAqswggKnAgEBMIGo MIGTMQswCQYDVQQGEwJHQjEbMBkGA1UECBMSR3JlYXRlciBNYW5jaGVzdGVyMRAwDgYDVQQHEwdT YWxmb3JkMRowGAYDVQQKExFDT01PRE8gQ0EgTGltaXRlZDE5MDcGA1UEAxMwQ09NT0RPIENsaWVu dCBBdXRoZW50aWNhdGlvbiBhbmQgU2VjdXJlIEVtYWlsIENBAhAsv+VdGX6YsSHI/WRu2j2JMAkG BSsOAwIaBQCggdgwGAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMTQx MTE3MTUzNDI0WjAjBgkqhkiG9w0BCQQxFgQUOHcbqACfCxGqLpbwwC+ea2HFDScweQYJKoZIhvcN AQkPMWwwajALBglghkgBZQMEASowCwYJYIZIAWUDBAEWMAsGCWCGSAFlAwQBAjAKBggqhkiG9w0D BzAOBggqhkiG9w0DAgICAIAwDQYIKoZIhvcNAwICAUAwBwYFKw4DAgcwDQYIKoZIhvcNAwICASgw DQYJKoZIhvcNAQEBBQAEggEAKNIi6TXpOmfHdMWtOawoET0PSGUT3Bg7tWQcR6ynMXWRkGtPAKkY 6qrd5XauKd+SGcWwKD/IKQJI+61TndAujVSagzWIbRqB5Pep1wZnX49FjC7jnUA6YdjIAA+z5O0p m1GeoAAgFcXo3syA4UPJRemkwwQohrI4FIfYBLYoIowBQAh0+0U9xKb9yeffoVww+JxVrnh6ybKt KdX0vD0rHWmjr8i65A8q5hI+OsnM/ogy8ZsKnz2VHke9V7T8v5MOsJ0238To0tHQ6fevFWvhRaKW ngXmtFNJcXqBkx7SM2P46CFokSAgOb1GhMIrUHlFfJ1rDpwpWYkSBZKcCVl47A== --=-jk3hNIIPmdD2XyTiNqeA-- From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 17 16:54:00 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 41BC4AEF; Mon, 17 Nov 2014 16:54:00 +0000 (UTC) Received: from elvis.mu.org (elvis.mu.org [IPv6:2001:470:1f05:b76::196]) by mx1.freebsd.org (Postfix) with ESMTP id 2844737E; Mon, 17 Nov 2014 16:54:00 +0000 (UTC) Received: from AlfredMacbookAir.local (c-76-21-10-192.hsd1.ca.comcast.net [76.21.10.192]) by elvis.mu.org (Postfix) with ESMTPSA id D1680341F874; Mon, 17 Nov 2014 08:53:59 -0800 (PST) Message-ID: <546A2827.3000607@mu.org> Date: Mon, 17 Nov 2014 08:53:59 -0800 From: Alfred Perlstein User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: Chris H , Luigi Rizzo , Rui Paulo Subject: Re: comments on code-in tasks for FreeBSD (Re: FreeBSD + Google Code-In 2014 = we need ideas.) References: , <2FA736F4-8D06-4BBC-81DC-3E3A646BD391@me.com> <121786de210f46237d17adb9b4febc53@ultimatedns.net> In-Reply-To: <121786de210f46237d17adb9b4febc53@ultimatedns.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: "freebsd-hackers@freebsd.org" , FreeBSD CURRENT , "Wojciech A. Koszek" , Alan Somers , Kris Moore X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2014 16:54:00 -0000 On 11/17/14, 6:55 AM, Chris H wrote: > On Thu, 13 Nov 2014 19:55:16 -0800 Rui Paulo wrote > >> On Nov 13, 2014, at 17:40, Luigi Rizzo wrote: >>> But please nuke the current list -- it is completely inadequate >>> for the code-in candidates and misleading for whoever wants to >>> suggest new tasks. Again i am not saying that the projects >>> suggested there are not important, just belong somewhere else >>> e.g. gsoc. >> I refrained from voicing my opinion while the call for help was going on, but >> I completely agree that the target age of this Google initiative is >> inadequate to FreeBSD. The target population is 13 years to 17 years old and >> I cannot even imagine a 13 year old knowing what FreeBSD is. >> >> I'm not sure we should participate in Code In ever again and perhaps we >> should focus our efforts on Summer of Code only. > @Luigi > Very insightful. Thanks for taking the time to share your thoughts. :) > > @Rui > Would tasks in re, or Mk/ be too far off base? > > [[ cc'd Kris ]] Maybe PCBSD has some ideas for code-in? It's a bit easier on newbies than FreeBSD. Mind you, I was using FreeBSD at 19 years old (would have used it earlier if I'd know about it), coding in assembler at 14... so there are people out there. I just think for it to be something people will want to do it's going to be less "edit these text files to improve process" and more "make dancing daemons happen on the console." -Alfred From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 17 17:08:55 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id E3B763A3 for ; Mon, 17 Nov 2014 17:08:55 +0000 (UTC) Received: from phk.freebsd.dk (phk.freebsd.dk [130.225.244.222]) by mx1.freebsd.org (Postfix) with ESMTP id 9B07D771 for ; Mon, 17 Nov 2014 17:08:55 +0000 (UTC) Received: from critter.freebsd.dk (unknown [192.168.60.3]) by phk.freebsd.dk (Postfix) with ESMTP id 2757D3BD32; Mon, 17 Nov 2014 17:08:49 +0000 (UTC) Received: from critter.freebsd.dk (localhost [127.0.0.1]) by critter.freebsd.dk (8.14.9/8.14.9) with ESMTP id sAHH8mCB010818; Mon, 17 Nov 2014 17:08:49 GMT (envelope-from phk@freebsd.org) To: =?UTF-8?Q?fran=C3=A7ai_s?= Subject: Re: This topic is mainly for developers of FreeBSD that develop in machine code, until even in binary code. In-reply-to: From: "Poul-Henning Kamp" References: MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-ID: <10816.1416244128.1@critter.freebsd.dk> Date: Mon, 17 Nov 2014 17:08:48 +0000 Message-ID: <10817.1416244128@critter.freebsd.dk> Cc: freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2014 17:08:56 -0000 -------- Don't feed the troll. Thank you. -- Poul-Henning Kamp | UNIX since Zilog Zeus 3.20 phk@FreeBSD.ORG | TCP/IP since RFC 956 FreeBSD committer | BSD since 4.3-tahoe Never attribute to malice what can adequately be explained by incompetence. From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 17 21:42:21 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id B6257CF7 for ; Mon, 17 Nov 2014 21:42:21 +0000 (UTC) Received: from mail-ie0-x232.google.com (mail-ie0-x232.google.com [IPv6:2607:f8b0:4001:c03::232]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 8B2F3AD8 for ; Mon, 17 Nov 2014 21:42:21 +0000 (UTC) Received: by mail-ie0-f178.google.com with SMTP id tp5so3338384ieb.9 for ; Mon, 17 Nov 2014 13:42:21 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=aqZJe528glVCqaSBM9xM2q3OCCJVWH26PNMJCTBlZnI=; b=0Lf6OMrFzxCJM3pyv4gbsFyXhC7wTxTw1aZdgdrEnLz/83CnSICshIF7yHg75n4yuo 2VvANigeMwkCNMKILhgAo++6Th9odLUgVQz+i33Wcei8xrhrKBefJcXVi9Y+bwx1lT+s P0sQFc9V0DMuH3Flu97itgNR5QQxoaoR8OW02VNYZbXoZHuzfRbPNXVNHxc6yaZwbxac u6GFkvC/pikAch51OJqzheIFdZi2uxrX7na1/7otQ4bZCj77fjVwX4edXyjmMVPwYTFd k0mZ3J5Pt6SQdc6M9yiS1GHyO2sEjeLvVrleGtnhijIJKK8K17s+n37otcewxaa11NSd OYfw== MIME-Version: 1.0 X-Received: by 10.50.73.67 with SMTP id j3mr28569343igv.1.1416260540997; Mon, 17 Nov 2014 13:42:20 -0800 (PST) Sender: jdavidlists@gmail.com Received: by 10.43.96.202 with HTTP; Mon, 17 Nov 2014 13:42:20 -0800 (PST) In-Reply-To: <3176881007-17726@kerio.tuxis.nl> References: <2826701214-10966@kerio.tuxis.nl> <3176881007-17726@kerio.tuxis.nl> Date: Mon, 17 Nov 2014 16:42:20 -0500 X-Google-Sender-Auth: 7SiKKvDYZkSflmyoaAjVnDKtOlc Message-ID: Subject: Re: Slow nfsd write performance, tweaks needed From: J David To: Mark Schouten Content-Type: text/plain; charset=UTF-8 Cc: "freebsd-hackers@freebsd.org" X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2014 21:42:21 -0000 On Mon, Nov 17, 2014 at 6:08 AM, Mark Schouten wrote: > Thanks for all your responses. I've setup a testserver to do some benchmarks, here are the results. Things are tested from inside a VM, that runs inside a Proxmox-VM, that runs on my Desktop (that performs pretty good, BTW :)) One thing that might also affect your performance testing is that FreeBSD disk I/O under KVM -- which is what Proxmox uses to run FreeBSD -- has historically been pretty terrible, especially with ZFS. The reasons for this are understood, I think, but last I heard the author of the virtio block driver was time-constrained and hadn't had a chance to work on it. Thanks! From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 17 22:50:48 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 501C9758 for ; Mon, 17 Nov 2014 22:50:48 +0000 (UTC) Received: from h2.funkthat.com (gate2.funkthat.com [208.87.223.18]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "funkthat.com", Issuer "funkthat.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 0D23A2B9 for ; Mon, 17 Nov 2014 22:50:47 +0000 (UTC) Received: from h2.funkthat.com (localhost [127.0.0.1]) by h2.funkthat.com (8.14.3/8.14.3) with ESMTP id sAHMoiVk036915 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Mon, 17 Nov 2014 14:50:45 -0800 (PST) (envelope-from jmg@h2.funkthat.com) Received: (from jmg@localhost) by h2.funkthat.com (8.14.3/8.14.3/Submit) id sAHMoiZV036914; Mon, 17 Nov 2014 14:50:44 -0800 (PST) (envelope-from jmg) Date: Mon, 17 Nov 2014 14:50:44 -0800 From: John-Mark Gurney To: Brandon Vincent Subject: Re: OT-ish SATA port replicators vs. SAS "expanders" Message-ID: <20141117225044.GS24601@funkthat.com> Mail-Followup-To: Brandon Vincent , FreeBSD Hackers References: <54693866.9040009@sentex.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.3i X-Operating-System: FreeBSD 7.2-RELEASE i386 X-PGP-Fingerprint: 54BA 873B 6515 3F10 9E88 9322 9CB1 8F74 6D3F A396 X-Files: The truth is out there X-URL: http://resnet.uoregon.edu/~gurney_j/ X-Resume: http://resnet.uoregon.edu/~gurney_j/resume.html X-TipJar: bitcoin:13Qmb6AeTgQecazTWph4XasEsP7nGRbAPE X-to-the-FBI-CIA-and-NSA: HI! HOW YA DOIN? can i haz chizburger? X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.2 (h2.funkthat.com [127.0.0.1]); Mon, 17 Nov 2014 14:50:45 -0800 (PST) Cc: FreeBSD Hackers X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2014 22:50:48 -0000 Brandon Vincent wrote this message on Sun, Nov 16, 2014 at 17:26 -0700: > On Sun, Nov 16, 2014 at 4:51 PM, Mike Tancsa wrote: > > I don think a port multiplier is the same as a SAS expander and a SAS/SATA > > controller does not necessarily support port multipliers. > > You're absolutely correct. The SATA specifications if I recall > correctly, outline that providing support for port multipliers is > optional. Not to mention, the vast majority of chipsets that do have > support for port multipliers only provide the slower command-based > switching method [1], The LSI SAS 2008 chipset is not what you > typically find on the cheap consumer "fake RAID" cards which most > people have [2]. > > Most people who purchase this card are purchasing it for SAS, true > RAID, performance, and reliability. Thus, LSI is only going to provide > support for the far superior SAS expander technology. If you go w/ SATA PMs, make sure you get a controller that supports FIS-base switching instead of command based switching... You'll get much better performance w/ NCQ support... As for if the LSI SAS 2008 will support FBS, probably not, as it'll require the driver and/or firmware to be aware of how to handle things... This page has a list which includes if the controller supports FIS/FBS: https://ata.wiki.kernel.org/index.php/SATA_hardware_features It doesn't list the Marvell 88SE9235 that I'm using (but not w/ PMs), but Marvell's site says it does, and it uses the ahci driver, which means it should if you have a new enough version of FreeBSD that supports PMs... -- John-Mark Gurney Voice: +1 415 225 5579 "All that I will do, has been done, All that I have, has not." From owner-freebsd-hackers@FreeBSD.ORG Tue Nov 18 09:45:55 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 1CB1C190 for ; Tue, 18 Nov 2014 09:45:55 +0000 (UTC) Received: from kerio.tuxis.nl (alcyone.saas.tuxis.net [31.3.111.19]) by mx1.freebsd.org (Postfix) with ESMTP id 86DC0B58 for ; Tue, 18 Nov 2014 09:45:52 +0000 (UTC) X-Footer: dHV4aXMubmw= Received: from [31.3.104.222] ([31.3.104.222]) by kerio.tuxis.nl (Kerio Connect 8.4.0 RC 1) for j.david.lists@gmail.com; Tue, 18 Nov 2014 10:45:48 +0100 Date: Tue, 18 Nov 2014 10:45:48 +0100 Subject: Re: Slow nfsd write performance, tweaks needed X-Mailer: Kerio Connect 8.4.0 RC 1/Kerio Connect client X-User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/38.0.2125.101 Safari/537.36 Message-ID: <3259708377-17839@kerio.tuxis.nl> From: Mark Schouten To: J David X-Priority: 3 Importance: Normal In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg="sha1"; boundary="=-vIA3I6IFa/VFeupG0bjI" X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: "freebsd-hackers@freebsd.org" X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Nov 2014 09:45:55 -0000 --=-vIA3I6IFa/VFeupG0bjI Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Hi, J David , 17-11-2014 22:42: On Mon, Nov 17, 2014 at 6:08 AM, Mark Schouten wrote:=20 > Thanks for all your responses. I've setup a testserver to do some benchma= rks, here are the results. Things are tested from inside a VM, that runs in= side a Proxmox-VM, that runs on my Desktop (that performs pretty good, BTW = :))=20 =20 One thing that might also affect your performance testing is that=20 FreeBSD disk I/O under KVM -- which is what Proxmox uses to run=20 FreeBSD -- has historically been pretty terrible, especially with ZFS.=20 The reasons for this are understood, I think, but last I heard the=20 author of the virtio block driver was time-constrained and hadn't had=20 a chance to work on it. I see that I've been unclear. FreeBSD was not running on the Proxmox-VM. F= reeBSD was running on a 8Core Xeon with 32GB of RAM. Met vriendelijke groeten, --=C2=A0 Kerio Operator in de Cloud? https://www.kerioindecloud.nl/ Mark Schouten | Tuxis Internet Engineering KvK:=C2=A061527076=C2=A0| http://www.tuxis.nl/ T: 0318 200208 | info@tuxis.nl= --=-vIA3I6IFa/VFeupG0bjI Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Disposition: attachment; filename="smime.p7s" Content-Description: Electronic Signature S/MIME Content-Transfer-Encoding: base64 MIIRwQYJKoZIhvcNAQcCoIIRsjCCEa4CAQExCzAJBgUrDgMCGgUAMAsGCSqGSIb3DQEHAaCCDt4w ggUbMIIEA6ADAgECAhAsv+VdGX6YsSHI/WRu2j2JMA0GCSqGSIb3DQEBBQUAMIGTMQswCQYDVQQG EwJHQjEbMBkGA1UECBMSR3JlYXRlciBNYW5jaGVzdGVyMRAwDgYDVQQHEwdTYWxmb3JkMRowGAYD VQQKExFDT01PRE8gQ0EgTGltaXRlZDE5MDcGA1UEAxMwQ09NT0RPIENsaWVudCBBdXRoZW50aWNh dGlvbiBhbmQgU2VjdXJlIEVtYWlsIENBMB4XDTE0MDcwMTAwMDAwMFoXDTE1MDcwMTIzNTk1OVow HjEcMBoGCSqGSIb3DQEJARYNbWFya0B0dXhpcy5ubDCCASIwDQYJKoZIhvcNAQEBBQADggEPADCC AQoCggEBANHu3SxlMZOG5GA0/mqtRXR1QmWwhUXzmCIprI0IPtSBWSA31YBJ5qcmXRhLzaiTB3Fr UpIGkW5aAZnDms9DD64kasF3oZE00Fvfnj/BDGbw098px1PukKfg4hasbTaELAjQTSUj8xRSHzKk VVynvLA/YmyRT/+u3ueK4wdaxcej241xH6mNfZeiKMAvbkv6Tm9vdup0BtqqbRSKcnc01KKrspun Eh73jLIUhP21uJv8vuOTxS1I9zJSlhIcMCEapjBQ+26cQl+s+qBuAs/LP3UPVytSbxvicdhDxtqH npN2h3jJ/+J86zGfQi8bG7EamsULTGHkbgIJL9AdKZRgAKECAwEAAaOCAd0wggHZMB8GA1UdIwQY MBaAFHoTTgB0W8Z4Y2QnwS/ioFu8ecV7MB0GA1UdDgQWBBR+dMZE22X/SMCyTxYzIP+NMZBNXTAO BgNVHQ8BAf8EBAMCBaAwDAYDVR0TAQH/BAIwADAgBgNVHSUEGTAXBggrBgEFBQcDBAYLKwYBBAGy MQEDBQIwEQYJYIZIAYb4QgEBBAQDAgUgMEYGA1UdIAQ/MD0wOwYMKwYBBAGyMQECAQEBMCswKQYI KwYBBQUHAgEWHWh0dHBzOi8vc2VjdXJlLmNvbW9kby5uZXQvQ1BTMFcGA1UdHwRQME4wTKBKoEiG Rmh0dHA6Ly9jcmwuY29tb2RvY2EuY29tL0NPTU9ET0NsaWVudEF1dGhlbnRpY2F0aW9uYW5kU2Vj dXJlRW1haWxDQS5jcmwwgYgGCCsGAQUFBwEBBHwwejBSBggrBgEFBQcwAoZGaHR0cDovL2NydC5j b21vZG9jYS5jb20vQ09NT0RPQ2xpZW50QXV0aGVudGljYXRpb25hbmRTZWN1cmVFbWFpbENBLmNy dDAkBggrBgEFBQcwAYYYaHR0cDovL29jc3AuY29tb2RvY2EuY29tMBgGA1UdEQQRMA+BDW1hcmtA dHV4aXMubmwwDQYJKoZIhvcNAQEFBQADggEBAIB8FhqaML1EzfvgNwwHDC3k0ICeMerOncgee6uJ KLxwU2mstttX5jtAmgK9RuDOu+TrMkkpF2yxYMTPpSM8nL7r+N/kdogu5Bustol8WTsW1e5vs+Nh hJYFORk113ouur1kSjXuHF8TWy+/PjFJBS/xm/H+/fkghppRU+4Dj2IReUBvlexAPYr4VDxjV7AD xPOXqTQkP15LWGvhTz2YVbJ3IAVOyUNkRhr9QwzToUxXa9k/QAOpXMuvS74AT2RBV/YCEEx7ebRD MAR6lZcbYiV8sXv1ASbnMdO3Fh2F98g+5rJn5PfFH8qLpapsZx0I2/axtSG09QMDJqXd3Ab6NpEw ggUaMIIEAqADAgECAhBtGeqnGU9qMyLmIjJ6qnHeMA0GCSqGSIb3DQEBBQUAMIGuMQswCQYDVQQG EwJVUzELMAkGA1UECBMCVVQxFzAVBgNVBAcTDlNhbHQgTGFrZSBDaXR5MR4wHAYDVQQKExVUaGUg VVNFUlRSVVNUIE5ldHdvcmsxITAfBgNVBAsTGGh0dHA6Ly93d3cudXNlcnRydXN0LmNvbTE2MDQG A1UEAxMtVVROLVVTRVJGaXJzdC1DbGllbnQgQXV0aGVudGljYXRpb24gYW5kIEVtYWlsMB4XDTEx MDQyODAwMDAwMFoXDTIwMDUzMDEwNDgzOFowgZMxCzAJBgNVBAYTAkdCMRswGQYDVQQIExJHcmVh dGVyIE1hbmNoZXN0ZXIxEDAOBgNVBAcTB1NhbGZvcmQxGjAYBgNVBAoTEUNPTU9ETyBDQSBMaW1p dGVkMTkwNwYDVQQDEzBDT01PRE8gQ2xpZW50IEF1dGhlbnRpY2F0aW9uIGFuZCBTZWN1cmUgRW1h aWwgQ0EwggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQCShIRbS1eY1F4vi6ThQMijU1hf ZmXxMk73nzJ9VdB4TFW3QpTg+SdxB8XGaaS5MsTxQBqQzCdWYn8XtXFpruUgG+TLY15gyqJB9mrh o/+43x9IbWVDjCouK2M4d9+xF6zC2oIC1tQyatRnbyATj1w1+uVUgK/YcQodNwoCUFNslR2pEBS0 mZVZEjH/CaLSTNxS297iQAFbSGjdxUq04O0kHzqvcV8H46y/FDuwJXFoPfQP1hdYRhWBPGiLi4MP bXohV+Y0sNsyfuNK4aVScmQmkU6lkg//4LFg/RpvaFGZY40ai6XMQpubfSJj06mg/M6ekN9EGfRc WzW6FvOnm//BAgMBAAGjggFLMIIBRzAfBgNVHSMEGDAWgBSJgmd9xJ0mcABLtFBIfN49rgRufTAd BgNVHQ4EFgQUehNOAHRbxnhjZCfBL+KgW7x5xXswDgYDVR0PAQH/BAQDAgEGMBIGA1UdEwEB/wQI MAYBAf8CAQAwEQYDVR0gBAowCDAGBgRVHSAAMFgGA1UdHwRRME8wTaBLoEmGR2h0dHA6Ly9jcmwu dXNlcnRydXN0LmNvbS9VVE4tVVNFUkZpcnN0LUNsaWVudEF1dGhlbnRpY2F0aW9uYW5kRW1haWwu Y3JsMHQGCCsGAQUFBwEBBGgwZjA9BggrBgEFBQcwAoYxaHR0cDovL2NydC51c2VydHJ1c3QuY29t L1VUTkFkZFRydXN0Q2xpZW50X0NBLmNydDAlBggrBgEFBQcwAYYZaHR0cDovL29jc3AudXNlcnRy dXN0LmNvbTANBgkqhkiG9w0BAQUFAAOCAQEAhda+eFdVbTN/RFL+QtUGqAEDgIr7DbL9Sr/2r0FJ 9RtaxdKtG3NuPukmfOZMmMEwKN/L+0I8oSU+CnXW0D05hmbRoZu1TZtvryhsHa/l6nRaqNqxwPF1 ei+eupN5yv7ikR5WdLL4jdPgQ3Ib7Y/9YDkgR/uLrzplSDyYPaUlv73vYOBJ5RbI6z9Dg/Dg7g3B 080zX5vQvWBqszv++tTJOjwf7Zv/m0kzvkIpOYPuM2kugp1FTahp2oAbHj3SGl18R5mlmwhtEpmG 1l1XBxunML5LSUS4kH7K0Xk467Qz+qA6XSZYnmFVGLQh1ZnV4ENAQjC+6qXnlNKw/vN1+X9u5zCC BJ0wggOFoAMCAQICEDQ96SusJzT/j8s0lPvMcFQwDQYJKoZIhvcNAQEFBQAwbzELMAkGA1UEBhMC U0UxFDASBgNVBAoTC0FkZFRydXN0IEFCMSYwJAYDVQQLEx1BZGRUcnVzdCBFeHRlcm5hbCBUVFAg TmV0d29yazEiMCAGA1UEAxMZQWRkVHJ1c3QgRXh0ZXJuYWwgQ0EgUm9vdDAeFw0wNTA2MDcwODA5 MTBaFw0yMDA1MzAxMDQ4MzhaMIGuMQswCQYDVQQGEwJVUzELMAkGA1UECBMCVVQxFzAVBgNVBAcT DlNhbHQgTGFrZSBDaXR5MR4wHAYDVQQKExVUaGUgVVNFUlRSVVNUIE5ldHdvcmsxITAfBgNVBAsT GGh0dHA6Ly93d3cudXNlcnRydXN0LmNvbTE2MDQGA1UEAxMtVVROLVVTRVJGaXJzdC1DbGllbnQg QXV0aGVudGljYXRpb24gYW5kIEVtYWlsMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA sjmFpPJ9q0E7YkY3rs3BYHW8OWX5ShpHornMSMxqmNVNNRm5pELlzkniii8efNIxB8dOtINknS4p 1aJkxIW9hVE1eaROaJB7HHqkkqgX8pgV8pPMyaQylbsMTzC9mKALi+VuG6JG+ni8om+rWV6lL8/K 2m2qL+usobNqqrcuZzWLeeEeaYji5kbNoKXqvgvOdjp6Dpvq/NonWz1zHyLmSGHGTPNpsaguG7bU MSAsvIKKjqQOpdeJQ/wWWq8dcdcRWdq6hw2v+vPhwvCkxWeM1tZUOt4KpLoDd7NlyP0e03RiqhjK aJMeoYV+9Udly/hNVyh00jT/MLbu9mIwFIws6wIDAQABo4H0MIHxMB8GA1UdIwQYMBaAFK29mHo0 tCb3+sQmVO8DveAky1QaMB0GA1UdDgQWBBSJgmd9xJ0mcABLtFBIfN49rgRufTAOBgNVHQ8BAf8E BAMCAQYwDwYDVR0TAQH/BAUwAwEB/zARBgNVHSAECjAIMAYGBFUdIAAwRAYDVR0fBD0wOzA5oDeg NYYzaHR0cDovL2NybC51c2VydHJ1c3QuY29tL0FkZFRydXN0RXh0ZXJuYWxDQVJvb3QuY3JsMDUG CCsGAQUFBwEBBCkwJzAlBggrBgEFBQcwAYYZaHR0cDovL29jc3AudXNlcnRydXN0LmNvbTANBgkq hkiG9w0BAQUFAAOCAQEAAbyc42MosPMxAcLfe91ioAGdIzEPnJJzU1HqH0z61p/Eyi9nfngzD3QW uZGHkfWKJvpkcADYHvkLBGJQh5OB1Nr1I9s0u4VWtHA0bniDNx6FHMURFZJfhxe9rGr98cLRzIlf sXzwPlHyNfN87GCYazor4O/fs32G67Ub9VvsonyYE9cAULnRLXPeA3h04QWFMV7LmrmdlMa5lDd1 ctxE+2fo8PolHlKn2iXpR+CgxzygTrEKNvt3SJ/vl4r7tP7jlBSog7xcLT/SYHFg7sJxggzpiDbj 2iC0o6BsqpZLuICOdcpJB/Y7FLrf3AXZn9vgsuZNoHgm5+ctbn9fxh6IFTGCAqswggKnAgEBMIGo MIGTMQswCQYDVQQGEwJHQjEbMBkGA1UECBMSR3JlYXRlciBNYW5jaGVzdGVyMRAwDgYDVQQHEwdT YWxmb3JkMRowGAYDVQQKExFDT01PRE8gQ0EgTGltaXRlZDE5MDcGA1UEAxMwQ09NT0RPIENsaWVu dCBBdXRoZW50aWNhdGlvbiBhbmQgU2VjdXJlIEVtYWlsIENBAhAsv+VdGX6YsSHI/WRu2j2JMAkG BSsOAwIaBQCggdgwGAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMTQx MTE4MDk0NTQ4WjAjBgkqhkiG9w0BCQQxFgQUz42l3SrgFrO/TWhmofqqfB69lvcweQYJKoZIhvcN AQkPMWwwajALBglghkgBZQMEASowCwYJYIZIAWUDBAEWMAsGCWCGSAFlAwQBAjAKBggqhkiG9w0D BzAOBggqhkiG9w0DAgICAIAwDQYIKoZIhvcNAwICAUAwBwYFKw4DAgcwDQYIKoZIhvcNAwICASgw DQYJKoZIhvcNAQEBBQAEggEAzYUV/pnHZrdBPb0RqDQUpyvLKcyQdNoJDSJTB9MZ/cwqF9mdJAq2 jR0NnOIJ+zImEnmQKZKz4G1EWXKs6gtRp/uYUXQq2APGJ5uRVB5IZQdHqVMyH+/RKUfUDw4RjqoI jat3Kpv8OTpucrH2o0ldsqsVPHKCg9nLrtBOxXMSA3/mVQqkCigSpepEzZhxzVCsjgqUvilAGR/G 0bjXKAw/STOPxB8aMVyfuHLNSLC55mOnBBPRj5uy8voO2u2R2+ip6ybEt23D5y8Wne58uimjFudj oc40Srt1K3bXKaAYEPCBgsol79AvV8ZY8ZsvBMo1YvfjZXrpjezLO0qKnveMKA== --=-vIA3I6IFa/VFeupG0bjI-- From owner-freebsd-hackers@FreeBSD.ORG Tue Nov 18 15:48:41 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4C70935E for ; Tue, 18 Nov 2014 15:48:41 +0000 (UTC) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 228588B6 for ; Tue, 18 Nov 2014 15:48:40 +0000 (UTC) Received: from [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a] (saphire3.sentex.ca [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a]) by smarthost1.sentex.ca (8.14.9/8.14.9) with ESMTP id sAIFmdMd027131 for ; Tue, 18 Nov 2014 10:48:39 -0500 (EST) (envelope-from mike@sentex.net) Message-ID: <546B6A54.1060403@sentex.net> Date: Tue, 18 Nov 2014 10:48:36 -0500 From: Mike Tancsa Organization: Sentex Communications User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.2.0 MIME-Version: 1.0 To: FreeBSD Hackers Subject: Re: OT-ish SATA port replicators vs. SAS "expanders" References: <54693866.9040009@sentex.net> <20141117225044.GS24601@funkthat.com> In-Reply-To: <20141117225044.GS24601@funkthat.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.75 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Nov 2014 15:48:41 -0000 On 11/17/2014 5:50 PM, John-Mark Gurney wrote: > Brandon Vincent wrote this message on Sun, Nov 16, 2014 at 17:26 -0700: >> On Sun, Nov 16, 2014 at 4:51 PM, Mike Tancsa wrote: >>> I don think a port multiplier is the same as a SAS expander and a SAS/SATA >>> controller does not necessarily support port multipliers. >> >> You're absolutely correct. The SATA specifications if I recall >> correctly, outline that providing support for port multipliers is >> optional. Not to mention, the vast majority of chipsets that do have >> support for port multipliers only provide the slower command-based >> switching method [1], The LSI SAS 2008 chipset is not what you >> typically find on the cheap consumer "fake RAID" cards which most >> people have [2]. >> >> Most people who purchase this card are purchasing it for SAS, true >> RAID, performance, and reliability. Thus, LSI is only going to provide >> support for the far superior SAS expander technology. > > If you go w/ SATA PMs, make sure you get a controller that supports > FIS-base switching instead of command based switching... You'll get > much better performance w/ NCQ support... As for if the LSI SAS 2008 > will support FBS, probably not, as it'll require the driver and/or > firmware to be aware of how to handle things... Performance was pretty good, but reliability was really poor for us. Not sure if it was the cages, cables, or a firmware issue in the card (SiI3132) or cages or a driver issue. But we would regularly see errors such as kernel: siisch0: Timeout on slot 18 kernel: siisch0: siis_timeout is 00040000 ss 001ff800 rs 001ff800 es 00000000 sts 80112000 serr 00000000 kernel: siisch0: ... waiting for slots 001bf800 kernel: siisch0: Timeout on slot 19 kernel: siisch2: Error while READ LOG EXT kernel: (ada10:siisch2:0:2:0): WRITE_FPDMA_QUEUED. ACB: 61 ab 95 98 71 40 b6 00 00 00 00 00 kernel: (ada10:siisch2:0:2:0): CAM status: ATA Status Error kernel: (ada10:siisch2:0:2:0): ATA status: 00 () kernel: (ada10:siisch2:0:2:0): RES: 00 00 00 00 00 00 00 00 00 00 00 kernel: (ada10:siisch2:0:2:0): Retrying command kernel: siisch2: Error while READ LOG EXT But after having swapped things far too many times, we switched to a pair of LSI 9240-8i, and using the same disks (wiped and started fresh), we have yet to get any of the old errors prior to re-using the disks (there were no SMART errors logged), we did a long test as well as wrote to every sector (no errors). Two weeks later, still no errors. Even better performance too. pool: zbackup1 state: ONLINE scan: none requested config: NAME STATE READ WRITE CKSUM zbackup1 ONLINE 0 0 0 raidz2-0 ONLINE 0 0 0 da0p1 ONLINE 0 0 0 da1p1 ONLINE 0 0 0 da2p1 ONLINE 0 0 0 da3p1 ONLINE 0 0 0 da4p1 ONLINE 0 0 0 da5p1 ONLINE 0 0 0 raidz2-2 ONLINE 0 0 0 da6 ONLINE 0 0 0 da7 ONLINE 0 0 0 da8 ONLINE 0 0 0 da9 ONLINE 0 0 0 da10 ONLINE 0 0 0 da11 ONLINE 0 0 0 logs ada1p2 ONLINE 0 0 0 errors: No known data errors In the end, the price really is not that much different for the hardware. -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/ From owner-freebsd-hackers@FreeBSD.ORG Tue Nov 18 20:08:56 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id F2D6F77D for ; Tue, 18 Nov 2014 20:08:55 +0000 (UTC) Received: from mail-ig0-x243.google.com (mail-ig0-x243.google.com [IPv6:2607:f8b0:4001:c05::243]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id BD3B3C54 for ; Tue, 18 Nov 2014 20:08:55 +0000 (UTC) Received: by mail-ig0-f195.google.com with SMTP id l13so1665089iga.2 for ; Tue, 18 Nov 2014 12:08:55 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=S0Q7t3ylSUQ7ocDYMIxhaDzaNfEBUSEVFL1wTxzu55c=; b=uV+2NlwWd1HuJ8rXPuofzF+BBOho1OBfYDse2joYMJKV1Z8b+mRShE8GV9DCklt0fS ij6WzjB0sZQeIeSE7IPtM6jXq1Sbr1LrsZi8TDi4YE69EMJ7uE5TesmlRJG5h4pGjPY9 rmcnfZU8WRy31WHo1u0/zokPX99xzlR4YwNTUKQJ7Y1Ddn/1oDKgnPlYUqFHhChDnmei 9+8emAfgTox5SUidRR9Q+FaordnzMHpkPeV6RtuytIlVEQFvUTCLJDndDYfCgsHh5Thi JomHVzBzurEoFB+cIfvFOYArwhrIaET4dcpc1rOfwyv6YUAceEg5DGNkK6NJJSCDcBSV gKXg== MIME-Version: 1.0 X-Received: by 10.50.134.9 with SMTP id pg9mr36082072igb.28.1416341335165; Tue, 18 Nov 2014 12:08:55 -0800 (PST) Received: by 10.64.147.164 with HTTP; Tue, 18 Nov 2014 12:08:55 -0800 (PST) Date: Tue, 18 Nov 2014 12:08:55 -0800 Message-ID: Subject: Running 8 building 10 gives "Out of file descriptors" ? From: Dieter BSD To: freebsd-hackers@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Nov 2014 20:08:56 -0000 amd64 running 8.2 Attempting to update to 10.1 Need to build custom 10.1 kernel on machine running 8.2. Installed binaries and src off to the side. Attempts to compile kernel directly failed. Attempts to build 10.1 "make" as 8.2 binary failed. Chroot to 10.1 tree. Attempt to build kernel (using stock GENERIC config file and stock sources for now) failed: >>> stage 3.1: making dependencies -------------------------------------------------------------- cd /usr/obj/usr/src/sys/GENERIC; MAKEOBJDIRPREFIX=/usr/obj MACHINE_ARCH=amd64 \ MACHINE=amd64 CPUTYPE= GROFF_BIN_PATH=/usr/obj/usr/src/tmp/legacy/usr/bin GR\ OFF_FONT_PATH=/usr/obj/usr/src/tmp/legacy/usr/share/groff_font GROFF_TMAC_PATH\ =/usr/obj/usr/src/tmp/legacy/usr/share/tmac _SHLIBDIRPREFIX=/usr/obj/usr/src/t\ mp _LDSCRIPTROOT= VERSION="FreeBSD 10.1-RELEASE amd64 1001000" INSTALL="sh /\ usr/src/tools/install.sh" PATH=/usr/obj/usr/src/tmp/legacy/usr/sbin:/usr/obj/u\ sr/src/tmp/legacy/usr/bin:/usr/obj/usr/src/tmp/legacy/usr/games:/usr/obj/usr/sr\ c/tmp/legacy/bin:/usr/obj/usr/src/tmp/usr/sbin:/usr/obj/usr/src/tmp/usr/bin:/us\ r/obj/usr/src/tmp/usr/games:/sbin:/bin:/usr/sbin:/usr/bin CC="cc " CXX="c++ " \ CPP="cpp " AS="as" AR="ar" LD="ld" NM=nm OBJDUMP= RANLIB=ranlib STRINGS= COMP\ ILER_TYPE=clang make -m /usr/src/share/mk KERNEL=kernel depend -DNO_MODULES_O\ BJ machine -> /usr/src/sys/amd64/include x86 -> /usr/src/sys/x86/include cc -c -O2 -pipe -fno-strict-aliasing -std=c99 -g -Wall -Wredundant-decls -Wnes\ ted-externs -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Winline -\ Wcast-qual -Wundef -Wno-pointer-sign -fformat-extensions -Wmissing-include-dirs\ -fdiagnostics-show-option -Wno-error-tautological-compare -Wno-error-empty-bod\ y -Wno-error-parentheses-equality -Wno-error-unused-function -nostdinc -I. -I/u\ sr/src/sys -I/usr/src/sys/contrib/altq -I/usr/src/sys/contrib/ipfilter -I/usr/s\ rc/sys/dev/ath -I/usr/src/sys/dev/ath/ath_hal -I/usr/src/sys/contrib/dev/ath/at\ h_hal -I/usr/src/sys/contrib/ngatm -I/usr/src/sys/dev/twa -I/usr/src/sys/dev/cx\ gb -I/usr/src/sys/dev/cxgbe -I/usr/src/sys/contrib/libfdt -D_KERNEL -DHAVE_KERN\ EL_OPTION_HEADERS -include opt_global.h -fno-omit-frame-pointer -mno-omit-leaf-\ frame-pointer -mno-aes -mno-avx -mcmodel=kernel -mno-red-zone -mno-mmx -mno-sse\ -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fstack-protector \ -gdwarf-2 /usr/src/sys/amd64/amd64/genassym.c NM='nm' sh /usr/src/sys/kern/genassym.sh genassym.o > assym.s Out of file descriptors *** Error code 2 Maybe I need to build the 10.1 toolchain as 8.2 binaries? nice -20 make kernel-toolchain > /tmp/make_kernel_toolchain_out 2>&1 Result: mkdep -f .depend -a -I/usr/src/tools/build/../../contrib/libc-pwcache -I/usr\ /src/tools/build/../../lib/libc/include -I/usr/obj/usr/src/tmp/legacy/usr/inclu\ de -std=gnu99 /usr/src/tools/build/../../contrib/libc-pwcache/pwcache.c Out of file descriptors Wrote a very small C program. Result: getdtablesize() returned 11095 The 10.1 mkdep is the same as 8.2 except for comments. It seems unlikely that it really needs more than 11095 file descriptors. So what is going on, and how do I fix it? [ Obviously I have thought of booting stock 10.1 and then building new kernel, but I can't take the machine down that long. ] From owner-freebsd-hackers@FreeBSD.ORG Tue Nov 18 21:29:15 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id D10A2763 for ; Tue, 18 Nov 2014 21:29:15 +0000 (UTC) Received: from mho-01-ewr.mailhop.org (mho-03-ewr.mailhop.org [204.13.248.66]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 93A2A694 for ; Tue, 18 Nov 2014 21:29:15 +0000 (UTC) Received: from [73.34.117.227] (helo=ilsoft.org) by mho-01-ewr.mailhop.org with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.72) (envelope-from ) id 1XqqKn-000D2M-ER; Tue, 18 Nov 2014 21:29:13 +0000 Received: from [172.22.42.240] (revolution.hippie.lan [172.22.42.240]) by ilsoft.org (8.14.9/8.14.9) with ESMTP id sAILTC2t006632; Tue, 18 Nov 2014 14:29:12 -0700 (MST) (envelope-from ian@FreeBSD.org) X-Mail-Handler: Dyn Standard SMTP by Dyn X-Originating-IP: 73.34.117.227 X-Report-Abuse-To: abuse@dyndns.com (see http://www.dyndns.com/services/sendlabs/outbound_abuse.html for abuse reporting information) X-MHO-User: U2FsdGVkX1+HkAWVpIiFTzclk290ceAr X-Authentication-Warning: paranoia.hippie.lan: Host revolution.hippie.lan [172.22.42.240] claimed to be [172.22.42.240] Subject: Re: Running 8 building 10 gives "Out of file descriptors" ? From: Ian Lepore To: Dieter BSD In-Reply-To: References: Content-Type: text/plain; charset="us-ascii" Date: Tue, 18 Nov 2014 14:29:11 -0700 Message-ID: <1416346151.1147.62.camel@revolution.hippie.lan> Mime-Version: 1.0 X-Mailer: Evolution 2.32.1 FreeBSD GNOME Team Port Content-Transfer-Encoding: 7bit Cc: freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Nov 2014 21:29:15 -0000 On Tue, 2014-11-18 at 12:08 -0800, Dieter BSD wrote: > amd64 running 8.2 > Attempting to update to 10.1 > Need to build custom 10.1 kernel on machine running 8.2. > Installed binaries and src off to the side. > Attempts to compile kernel directly failed. > Attempts to build 10.1 "make" as 8.2 binary failed. > Chroot to 10.1 tree. > Attempt to build kernel (using stock GENERIC config file and stock sources > for now) failed: > > >>> stage 3.1: making dependencies > -------------------------------------------------------------- > cd /usr/obj/usr/src/sys/GENERIC; MAKEOBJDIRPREFIX=/usr/obj MACHINE_ARCH=amd64 \ > MACHINE=amd64 CPUTYPE= GROFF_BIN_PATH=/usr/obj/usr/src/tmp/legacy/usr/bin GR\ > OFF_FONT_PATH=/usr/obj/usr/src/tmp/legacy/usr/share/groff_font GROFF_TMAC_PATH\ > =/usr/obj/usr/src/tmp/legacy/usr/share/tmac _SHLIBDIRPREFIX=/usr/obj/usr/src/t\ > mp _LDSCRIPTROOT= VERSION="FreeBSD 10.1-RELEASE amd64 1001000" INSTALL="sh /\ > usr/src/tools/install.sh" PATH=/usr/obj/usr/src/tmp/legacy/usr/sbin:/usr/obj/u\ > sr/src/tmp/legacy/usr/bin:/usr/obj/usr/src/tmp/legacy/usr/games:/usr/obj/usr/sr\ > c/tmp/legacy/bin:/usr/obj/usr/src/tmp/usr/sbin:/usr/obj/usr/src/tmp/usr/bin:/us\ > r/obj/usr/src/tmp/usr/games:/sbin:/bin:/usr/sbin:/usr/bin CC="cc " CXX="c++ " \ > CPP="cpp " AS="as" AR="ar" LD="ld" NM=nm OBJDUMP= RANLIB=ranlib STRINGS= COMP\ > ILER_TYPE=clang make -m /usr/src/share/mk KERNEL=kernel depend -DNO_MODULES_O\ > BJ > machine -> /usr/src/sys/amd64/include > x86 -> /usr/src/sys/x86/include > cc -c -O2 -pipe -fno-strict-aliasing -std=c99 -g -Wall -Wredundant-decls -Wnes\ > ted-externs -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Winline -\ > Wcast-qual -Wundef -Wno-pointer-sign -fformat-extensions -Wmissing-include-dirs\ > -fdiagnostics-show-option -Wno-error-tautological-compare -Wno-error-empty-bod\ > y -Wno-error-parentheses-equality -Wno-error-unused-function -nostdinc -I. -I/u\ > sr/src/sys -I/usr/src/sys/contrib/altq -I/usr/src/sys/contrib/ipfilter -I/usr/s\ > rc/sys/dev/ath -I/usr/src/sys/dev/ath/ath_hal -I/usr/src/sys/contrib/dev/ath/at\ > h_hal -I/usr/src/sys/contrib/ngatm -I/usr/src/sys/dev/twa -I/usr/src/sys/dev/cx\ > gb -I/usr/src/sys/dev/cxgbe -I/usr/src/sys/contrib/libfdt -D_KERNEL -DHAVE_KERN\ > EL_OPTION_HEADERS -include opt_global.h -fno-omit-frame-pointer -mno-omit-leaf-\ > frame-pointer -mno-aes -mno-avx -mcmodel=kernel -mno-red-zone -mno-mmx -mno-sse\ > -msoft-float -fno-asynchronous-unwind-tables -ffreestanding -fstack-protector \ > -gdwarf-2 /usr/src/sys/amd64/amd64/genassym.c > NM='nm' sh /usr/src/sys/kern/genassym.sh genassym.o > assym.s > Out of file descriptors > *** Error code 2 > > > Maybe I need to build the 10.1 toolchain as 8.2 binaries? > nice -20 make kernel-toolchain > /tmp/make_kernel_toolchain_out 2>&1 > Result: > mkdep -f .depend -a -I/usr/src/tools/build/../../contrib/libc-pwcache -I/usr\ > /src/tools/build/../../lib/libc/include -I/usr/obj/usr/src/tmp/legacy/usr/inclu\ > de -std=gnu99 /usr/src/tools/build/../../contrib/libc-pwcache/pwcache.c > Out of file descriptors > > Wrote a very small C program. Result: > getdtablesize() returned 11095 > > The 10.1 mkdep is the same as 8.2 except for comments. > > It seems unlikely that it really needs more than 11095 file descriptors. > So what is going on, and how do I fix it? > > [ Obviously I have thought of booting stock 10.1 and then building > new kernel, but I can't take the machine down that long. ] I've been building 10.x and 11.x world and kernel from source on an 8.2 (and more recently now 8.4) system for a couple years, as recently as last night. I've never needed to do anything special. When I check sysctl kern.maxfiles it's set to 12328, not so different from yours. I wonder if some long-running process on your system is leaking away descriptors? A 'procstat -af' might help find that. -- Ian From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 19 02:22:25 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4901AF81 for ; Wed, 19 Nov 2014 02:22:25 +0000 (UTC) Received: from mail-ig0-x232.google.com (mail-ig0-x232.google.com [IPv6:2607:f8b0:4001:c05::232]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0A7A0885 for ; Wed, 19 Nov 2014 02:22:25 +0000 (UTC) Received: by mail-ig0-f178.google.com with SMTP id hl2so209199igb.5 for ; Tue, 18 Nov 2014 18:22:24 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=FHlPbVVa2WelSR5mLdnZElnTI+dN+QU0k9kj7O+r0d4=; b=LtirPTV5slX56lAPDSfXGhVSwhZoU4pa/8+BZJ+DrGNhPUgNYN4yQ9gWFYkqKR4mYX mwSbAy8rTUMrEu6VtGqm8o4SyecT+z2qWDq7Ygc3vQiQQsLfmPadNlpWocZKlvubr2tB TL57AzvuxjsFy3Dq21sG+7qTTpcTL35pJCWvPYrgpizL2ct6FDSx/4Krm0qRlwepR8MA TjlB0xTh6mE4tLpOBet7L9NxQV1avstVVjOrytWfipXP80z6lq0tHjeckbkp/U+0Jgem 9maxDzyau1xKILbjrAhzb9e3noafuKZGjwS8DKFZfC0SF0T3PGV2IBrlxdEJ4poMiPjG IGZQ== MIME-Version: 1.0 X-Received: by 10.50.73.67 with SMTP id j3mr697590igv.1.1416363744237; Tue, 18 Nov 2014 18:22:24 -0800 (PST) Received: by 10.64.147.164 with HTTP; Tue, 18 Nov 2014 18:22:24 -0800 (PST) Date: Tue, 18 Nov 2014 18:22:24 -0800 Message-ID: Subject: Re: Running 8 building 10 gives "Out of file descriptors" ? From: Dieter BSD To: freebsd-hackers@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Nov 2014 02:22:25 -0000 > I've been building 10.x and 11.x world and kernel from source on an 8.2 > (and more recently now 8.4) system for a couple years, as recently as > last night. I've never needed to do anything special. When I check > sysctl kern.maxfiles it's set to 12328, not so different from yours. > > I wonder if some long-running process on your system is leaking away > descriptors? A 'procstat -af' might help find that. Uptime is less than 3 days. (System hung a couple days ago, shutting off the signal to the display. No core dump. No clues as to *why* it hung. *grumble* ) >> getdtablesize() returned 11095 kern.maxfiles: 12328 # procstat -af | wc -l 1912 I ran while true ; do procstat -af | wc -l; sleep 0.03 ; done in one window, and make kernel-toolchain in another window. Never got above 2000. Not absolute proof, but it looks like it is not really running out of descriptors. chmod 0 /usr/bin/mkdep gives the expected permission denied. (proves that it is trying to run /usr/bin/mkdep) Restore the mode and change /usr/bin/mkdep to #!/bin/sh echo hello from mkdep and I'm back to "Out of file descriptors". And it doesn't print hello. So... make (I assume?) thinks (incorrectly?) that it is running out of file descriptors attempting to run /usr/bin/mkdep? From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 19 02:52:01 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4DD1F622 for ; Wed, 19 Nov 2014 02:52:01 +0000 (UTC) Received: from mho-01-ewr.mailhop.org (mho-03-ewr.mailhop.org [204.13.248.66]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 224AEB0C for ; Wed, 19 Nov 2014 02:52:00 +0000 (UTC) Received: from [73.34.117.227] (helo=ilsoft.org) by mho-01-ewr.mailhop.org with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.72) (envelope-from ) id 1XqvN9-000MfI-PV; Wed, 19 Nov 2014 02:51:59 +0000 Received: from [172.22.42.240] (revolution.hippie.lan [172.22.42.240]) by ilsoft.org (8.14.9/8.14.9) with ESMTP id sAJ2pwGo007127; Tue, 18 Nov 2014 19:51:58 -0700 (MST) (envelope-from ian@FreeBSD.org) X-Mail-Handler: Dyn Standard SMTP by Dyn X-Originating-IP: 73.34.117.227 X-Report-Abuse-To: abuse@dyndns.com (see http://www.dyndns.com/services/sendlabs/outbound_abuse.html for abuse reporting information) X-MHO-User: U2FsdGVkX1960yCz/Tpmui3qiVOstMCF X-Authentication-Warning: paranoia.hippie.lan: Host revolution.hippie.lan [172.22.42.240] claimed to be [172.22.42.240] Subject: Re: Running 8 building 10 gives "Out of file descriptors" ? From: Ian Lepore To: Dieter BSD In-Reply-To: References: Content-Type: text/plain; charset="us-ascii" Date: Tue, 18 Nov 2014 19:51:58 -0700 Message-ID: <1416365518.1147.84.camel@revolution.hippie.lan> Mime-Version: 1.0 X-Mailer: Evolution 2.32.1 FreeBSD GNOME Team Port Content-Transfer-Encoding: 7bit Cc: freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Nov 2014 02:52:01 -0000 On Tue, 2014-11-18 at 18:22 -0800, Dieter BSD wrote: > > I've been building 10.x and 11.x world and kernel from source on an 8.2 > > (and more recently now 8.4) system for a couple years, as recently as > > last night. I've never needed to do anything special. When I check > > sysctl kern.maxfiles it's set to 12328, not so different from yours. > > > > I wonder if some long-running process on your system is leaking away > > descriptors? A 'procstat -af' might help find that. > > Uptime is less than 3 days. (System hung a couple days ago, shutting off > the signal to the display. No core dump. No clues as to *why* it hung. > *grumble* ) > > >> getdtablesize() returned 11095 > > kern.maxfiles: 12328 > > # procstat -af | wc -l > 1912 > > I ran > while true ; do procstat -af | wc -l; sleep 0.03 ; done > in one window, and > make kernel-toolchain > in another window. Never got above 2000. Not absolute proof, but > it looks like it is not really running out of descriptors. > > chmod 0 /usr/bin/mkdep > gives the expected permission denied. (proves that it is trying to > run /usr/bin/mkdep) > > Restore the mode and change /usr/bin/mkdep to > #!/bin/sh > echo hello from mkdep > and I'm back to "Out of file descriptors". And it doesn't print hello. > > So... make (I assume?) thinks (incorrectly?) that it is running out of > file descriptors attempting to run /usr/bin/mkdep? Oh. Hrm. The only thing in the source that says that exact message is in /bin/sh input.c, and it looks like this: fd2 = fcntl(fd, F_DUPFD_CLOEXEC, 10); close(fd); if (fd2 < 0) error("Out of file descriptors"); So you have guess what the actual error is, or hack the code to print errno or something. -- Ian From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 19 07:37:51 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 004CBCA4 for ; Wed, 19 Nov 2014 07:37:50 +0000 (UTC) Received: from nm8-vm5.bullet.mail.ne1.yahoo.com (nm8-vm5.bullet.mail.ne1.yahoo.com [98.138.91.230]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B31C9BAA for ; Wed, 19 Nov 2014 07:37:49 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1416382560; bh=PfilFlz9rNKkTaCFiyEq4JpCBnKFBRxe6yNK6ukdJsI=; h=Subject:From:Date:To:From:Subject; b=lJ7PRWruF06GQBLALQmpwBj6UWU5uDC5M1Sbb4QFeHlrmEk5s/eDg17n37vgsikQzJyGbnr489+vrYUFqd8G1qcAXOvEbJ4deLy2r0wL8B+1ueKpL41+0K/Q3hHITSV3FcYnCtSMvVbHHOTzXGw0Lm4q6ZzizsVCa2mwVWqAstA5ATa0TnoCTMx1mqAC96wmU5+yZEW7Q8gmeV/fYYdFwKdUzucrUPvmVQzyR9tSr+slyVRIDafNwHZD0bp8OQNLMr06eTT+dVmHCZaqOwD0bs2nvqREeiQCBj8P4KVpc4WVGsQYEInXJzxmQyb+W5wCJYyoy5EK3Dg9pGY5zwP2Dg== DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s2048; d=yahoo.com; b=EyPO759JQj/wz6uR1cbzUPOvryQ3pAQCFlo+EoDB7RXvt7Fdff7VggRt0WG7Mzoty73bE5qpF4i7uonOkSGuG5eL/NLXJXgDsRjFumCf0PoAKwVQnB0A5VtdAP1ASBzJ6Wej4wP/kd88cMNNE7CQYWMlhsY/8Ir7VvUSl3QaZsF7f5D7WMVh89OaqG0wGggWzaIhYckTsAJK3IImUpU8GEILCCgrUxio68IdtzKoWg/ErcvTL3utAhwlbT0cw3m44hvBbi6VX9XnLCqiOY8K+c7zw1CQlkH4rsa94APeFsOtudAF940Gurg2Iti2x8pTnfxC4eIIrDoS5X8GKNUGew==; Received: from [98.138.226.176] by nm8.bullet.mail.ne1.yahoo.com with NNFMP; 19 Nov 2014 07:36:00 -0000 Received: from [98.138.226.58] by tm11.bullet.mail.ne1.yahoo.com with NNFMP; 19 Nov 2014 07:36:00 -0000 Received: from [127.0.0.1] by smtp209.mail.ne1.yahoo.com with NNFMP; 19 Nov 2014 07:36:00 -0000 X-Yahoo-Newman-Id: 592889.27257.bm@smtp209.mail.ne1.yahoo.com X-Yahoo-Newman-Property: ymail-3 X-YMail-OSG: 1LeeysIVM1nrm5jT9A5h7pp4T4wHA4JADfi1Tb4S_1yjnWy TVhDtqGXDKQSg1MG84SKtZIaOrlcqN6kYL8CGFgElbeL4Vh43NjUmC5a4UUg 9i2LKpNC0tVeaSaAil8lK7d.20NfnzSYcNHzPgSUyADMoWopU3IB_HaqXiwI MCtMPguROShhjFCnT1F6jM_vuhLSLh7Zw.VS1.tEA9WZueX6L90N6wrCrq.h FyDB6tCtvKqAR43c0m8Rzn9yVvf_ZGMTe_SBW87cTqaWNoHDOshJ7rO575ex nuvuofGja4Zohcr1d3xF1JQqnsu_ZyX3HAfHYKoK9wMeKNGjSS8FLotEtfAX eTGmQH4rUrZ_2GBHHhctUH62nzycxCI9BvU4xl3IuapatTvTIeAySmk7q2Mt GqWz1ss9ftE9tROt7godsXiC6eCMXReJsllqwfaGnltxYt9VpDD8TO775UXi vxsVEp.4uPYPKFmJQjR7LtjvdaGHe2gw8GLHUZfCYXFbBN_3jns5Q.p2mHIu 7CJZ6SR064Wtat9Sm9UuhxNMj41JYHBYO6zHiVz0U7OWxmQethJHlZ3K1wBb 9wngIfcGxd7Bvjusqpkk- X-Yahoo-SMTP: LAFNfTaswBDguI7meB90l2l3wOU- Subject: Unable upgrade to 10.1-RELEASE From: by Content-Type: text/plain; charset=us-ascii X-Mailer: iPhone Mail (11D257) Message-Id: <199BCEB7-135C-454D-9C87-492FE9A8CEB5@yahoo.com> Date: Wed, 19 Nov 2014 15:35:45 +0800 To: freebsd-hackers@freebsd.org Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (1.0) X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Nov 2014 07:37:51 -0000 Hi, I am running 10.0-RELEASE-p12 with my laptop(i386). But when I run #freebsd-update -r 10.1-RELEASE upgrade I always got "Fetching 1 metadata files... failed.". Is there anything happened with update.freebsd.org? by From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 19 07:38:38 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 8C2C2D89 for ; Wed, 19 Nov 2014 07:38:38 +0000 (UTC) Received: from mail-ig0-x22c.google.com (mail-ig0-x22c.google.com [IPv6:2607:f8b0:4001:c05::22c]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 575BEBB6 for ; Wed, 19 Nov 2014 07:38:38 +0000 (UTC) Received: by mail-ig0-f172.google.com with SMTP id hl2so2443106igb.11 for ; Tue, 18 Nov 2014 23:38:37 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=Sd38SVKitu6aTF23xAIYaFk4WmLUAR6P+vZgEmtb1j0=; b=vW4b3blKGR/8lHTXpMLtBn82GQiFTGLPfH6wlMH3fQ8ETaAZnHcO4QlQQRitDK4xBq j5d6q7M2/u7xrEE2BbNtaraH6XZ6KN+k7K4FmkpNgsAZ4ZXuzhYPKrAotYgWpnU6J/Kd 3GicKd6y2UpqS2LTHi4uHMMokSiUAWzJr3Y73DjzUfSqQqeRjwhstMOopWb0bjxYtWJx m4rD134NVmSeWvmTCi9lex4t60myjxuzA/r2/5LLwuWo7jXbEV8c1mFx74ybsuAgM5G6 bCPtNww5jt1/VvHbV+7rxo8OoGwmFFh7qwfEl6Tx4GdZ9elkcc5II7ss8oZBe2mz4Xi4 pFOQ== MIME-Version: 1.0 X-Received: by 10.50.134.9 with SMTP id pg9mr1894039igb.28.1416382717717; Tue, 18 Nov 2014 23:38:37 -0800 (PST) Received: by 10.64.147.164 with HTTP; Tue, 18 Nov 2014 23:38:37 -0800 (PST) Date: Tue, 18 Nov 2014 23:38:37 -0800 Message-ID: Subject: Re: Running 8 building 10 gives "Out of file descriptors" ? From: Dieter BSD To: freebsd-hackers@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Nov 2014 07:38:38 -0000 > Oh. Hrm. The only thing in the source that says that exact message is > in /bin/sh input.c, and it looks like this: > > fd2 = fcntl(fd, F_DUPFD_CLOEXEC, 10); > close(fd); > if (fd2 < 0) > error("Out of file descriptors"); > > So you have guess what the actual error is, or hack the code to print > errno or something. THANK YOU! I had cp-ed bash into the chroot, so... changed my toy mkdep to bash and it worked fine. Then a couple lines later make tried to run sh again and sh drops the ball again. OK, so I made /bin/sh a symlink to /bin/bash and it is grinding away. Over an hour now, and the logfile is 3.6 MB and counting. With sh it failed in about 10 seconds. That code should print the name of the program complaining, and yes, should print errno. I suppose I ought to do that and find out why fcntl is failing. From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 19 19:07:02 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id ED0107EC for ; Wed, 19 Nov 2014 19:07:02 +0000 (UTC) Received: from mail-ie0-x244.google.com (mail-ie0-x244.google.com [IPv6:2607:f8b0:4001:c03::244]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B86C932F for ; Wed, 19 Nov 2014 19:07:02 +0000 (UTC) Received: by mail-ie0-f196.google.com with SMTP id rp18so176726iec.11 for ; Wed, 19 Nov 2014 11:07:02 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=3BocN1Zgh427yXk/yC5TrfsnfZbnrqqxhN/wdquHA9o=; b=uASI8LJoVuOTHSiLAMW8FoZIcSVbmlH/VH1Z3y74XSkdoJiv1KaR1opJ4dKyRt5gHe BtPADHSWSu9l9wgzhLjVHPOp1EBGlp/D9ye/YAtMHSuktUwfWfRVsJ8k4GTK8vMWWoBO jnaqM3YGG0XfxHbPCPF7yik9utpnB3pJbAOyDnTMHeSr5soV0uGAt5IiWolaCIfVoqaV Bhw+wh2eOp0pd6aHtDxHnu7agQax/jsVjhq/AG5d/xOr5erMi3j+scmG71gYc2TElU1z uHammjG5Yex7yxhDCz8LNKkq3T9UZ3f3558VpfXEj5uAxlu58XDQxWaC8uaPN/u3YvMK 4oPA== MIME-Version: 1.0 X-Received: by 10.50.164.226 with SMTP id yt2mr12102992igb.22.1416424022155; Wed, 19 Nov 2014 11:07:02 -0800 (PST) Received: by 10.64.147.164 with HTTP; Wed, 19 Nov 2014 11:07:02 -0800 (PST) Date: Wed, 19 Nov 2014 11:07:02 -0800 Message-ID: Subject: Re: Running 8 building 10 gives "Out of file descriptors" ? From: Dieter BSD To: freebsd-hackers@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Nov 2014 19:07:03 -0000 if (fd < 10) { fd2 = fcntl(fd, F_DUPFD_CLOEXEC, 10); close(fd); if (fd2 < 0) { int limit; limit = getdtablesize(); fprintf(stderr, "sh: setinputfile(): fcntl() returned %d ge\ tdtablesize() returned %d\n", fd2, limit); perror("sh: fcntl(F_DUPFD_CLOEXEC) failed:"); error("sh: Out of file descriptors?"); } fd = fd2; } Result: sh: setinputfile(): fcntl() returned -1 getdtablesize() returned 11095 sh: fcntl(F_DUPFD_CLOEXEC) failed:: Invalid argument sh: Out of file descriptors? find /usr/include/ | xargs grep F_DUPFD_CLOEXEC gives no hits in 8.2, but /usr/include/sys/fcntl.h: /new/freebsd/usr/include/fcntl.h: #define F_DUPFD_CLOEXEC 17 /* Like F_DUPFD, but FD_CLOEXEC is set */ in 10.1 So, F_DUPFD_CLOEXEC was added after 8.2, and someone changed sh to use it, but couldn't be bothered to fix the error message. If someone would like to fix this, they don't need to build a toolchain, they can use a 2 line script: #!/bin/sh echo Hello, World! So Ian, how did you avoid running into this problem? From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 19 20:18:11 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id F2BB81E6 for ; Wed, 19 Nov 2014 20:18:11 +0000 (UTC) Received: from mho-02-ewr.mailhop.org (mho-02-ewr.mailhop.org [204.13.248.72]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id C754EDAC for ; Wed, 19 Nov 2014 20:18:11 +0000 (UTC) Received: from [73.34.117.227] (helo=ilsoft.org) by mho-02-ewr.mailhop.org with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.72) (envelope-from ) id 1XrBha-000CGV-Fg; Wed, 19 Nov 2014 20:18:10 +0000 Received: from [172.22.42.240] (revolution.hippie.lan [172.22.42.240]) by ilsoft.org (8.14.9/8.14.9) with ESMTP id sAJKI9dE009060; Wed, 19 Nov 2014 13:18:09 -0700 (MST) (envelope-from ian@FreeBSD.org) X-Mail-Handler: Dyn Standard SMTP by Dyn X-Originating-IP: 73.34.117.227 X-Report-Abuse-To: abuse@dyndns.com (see http://www.dyndns.com/services/sendlabs/outbound_abuse.html for abuse reporting information) X-MHO-User: U2FsdGVkX18bvxzFvzWc9DgHKtRrM65i X-Authentication-Warning: paranoia.hippie.lan: Host revolution.hippie.lan [172.22.42.240] claimed to be [172.22.42.240] Subject: Re: Running 8 building 10 gives "Out of file descriptors" ? From: Ian Lepore To: Dieter BSD In-Reply-To: References: Content-Type: text/plain; charset="us-ascii" Date: Wed, 19 Nov 2014 13:18:08 -0700 Message-ID: <1416428288.1147.140.camel@revolution.hippie.lan> Mime-Version: 1.0 X-Mailer: Evolution 2.32.1 FreeBSD GNOME Team Port Content-Transfer-Encoding: 7bit Cc: freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Nov 2014 20:18:12 -0000 On Wed, 2014-11-19 at 11:07 -0800, Dieter BSD wrote: > if (fd < 10) { > fd2 = fcntl(fd, F_DUPFD_CLOEXEC, 10); > close(fd); > if (fd2 < 0) > { > int limit; > limit = getdtablesize(); > fprintf(stderr, "sh: setinputfile(): fcntl() returned %d ge\ > tdtablesize() returned %d\n", fd2, limit); > perror("sh: fcntl(F_DUPFD_CLOEXEC) failed:"); > error("sh: Out of file descriptors?"); > } > fd = fd2; > } > > Result: > sh: setinputfile(): fcntl() returned -1 getdtablesize() returned 11095 > sh: fcntl(F_DUPFD_CLOEXEC) failed:: Invalid argument > sh: Out of file descriptors? > > find /usr/include/ | xargs grep F_DUPFD_CLOEXEC > gives no hits in 8.2, but > /usr/include/sys/fcntl.h: > /new/freebsd/usr/include/fcntl.h: > #define F_DUPFD_CLOEXEC 17 /* Like F_DUPFD, but FD_CLOEXEC is set */ > in 10.1 > > So, F_DUPFD_CLOEXEC was added after 8.2, and someone changed sh to > use it, but couldn't be bothered to fix the error message. > > If someone would like to fix this, they don't need to build a toolchain, > they can use a 2 line script: > > #!/bin/sh > echo Hello, World! > > So Ian, how did you avoid running into this problem? Ohhhh... hmm. That must have been MFC'd to 8-stable after I had updated my 8.2 to 8.4 (which was quite a while ago, more than a year now I guess). I think this means it's no longer possible to bootstrap a system older than 8.4 in a single step. You'd need to go 8.2 -> 8.4 then install that and reboot to go forward from there. I'm not sure there's an easy fix for that, but we could at least update the check in Makefile.inc1 to stop the build and tell you that you can't bootstrap a system older than 8.4 (right now the cutoff check is 8.0). I'm not sure what the project policy is in terms of fixing this (no matter how hard it may be) versus changing the cutoff warning. I'll look into it. -- Ian From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 19 21:06:29 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id BF2CB8F3; Wed, 19 Nov 2014 21:06:29 +0000 (UTC) Received: from h2.funkthat.com (gate2.funkthat.com [208.87.223.18]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "funkthat.com", Issuer "funkthat.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 9228838D; Wed, 19 Nov 2014 21:06:28 +0000 (UTC) Received: from h2.funkthat.com (localhost [127.0.0.1]) by h2.funkthat.com (8.14.3/8.14.3) with ESMTP id sAJL6Re2081699 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Wed, 19 Nov 2014 13:06:27 -0800 (PST) (envelope-from jmg@h2.funkthat.com) Received: (from jmg@localhost) by h2.funkthat.com (8.14.3/8.14.3/Submit) id sAJL6RHA081698; Wed, 19 Nov 2014 13:06:27 -0800 (PST) (envelope-from jmg) Date: Wed, 19 Nov 2014 13:06:26 -0800 From: John-Mark Gurney To: Ian Lepore Subject: Re: Running 8 building 10 gives "Out of file descriptors" ? Message-ID: <20141119210626.GT24601@funkthat.com> Mail-Followup-To: Ian Lepore , Dieter BSD , freebsd-hackers@freebsd.org References: <1416365518.1147.84.camel@revolution.hippie.lan> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1416365518.1147.84.camel@revolution.hippie.lan> User-Agent: Mutt/1.4.2.3i X-Operating-System: FreeBSD 7.2-RELEASE i386 X-PGP-Fingerprint: 54BA 873B 6515 3F10 9E88 9322 9CB1 8F74 6D3F A396 X-Files: The truth is out there X-URL: http://resnet.uoregon.edu/~gurney_j/ X-Resume: http://resnet.uoregon.edu/~gurney_j/resume.html X-TipJar: bitcoin:13Qmb6AeTgQecazTWph4XasEsP7nGRbAPE X-to-the-FBI-CIA-and-NSA: HI! HOW YA DOIN? can i haz chizburger? X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.2 (h2.funkthat.com [127.0.0.1]); Wed, 19 Nov 2014 13:06:27 -0800 (PST) Cc: freebsd-hackers@freebsd.org, Dieter BSD X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Nov 2014 21:06:29 -0000 Ian Lepore wrote this message on Tue, Nov 18, 2014 at 19:51 -0700: > On Tue, 2014-11-18 at 18:22 -0800, Dieter BSD wrote: > > > I've been building 10.x and 11.x world and kernel from source on an 8.2 > > > (and more recently now 8.4) system for a couple years, as recently as > > > last night. I've never needed to do anything special. When I check > > > sysctl kern.maxfiles it's set to 12328, not so different from yours. > > > > > > I wonder if some long-running process on your system is leaking away > > > descriptors? A 'procstat -af' might help find that. > > > > Uptime is less than 3 days. (System hung a couple days ago, shutting off > > the signal to the display. No core dump. No clues as to *why* it hung. > > *grumble* ) > > > > >> getdtablesize() returned 11095 > > > > kern.maxfiles: 12328 > > > > # procstat -af | wc -l > > 1912 > > > > I ran > > while true ; do procstat -af | wc -l; sleep 0.03 ; done > > in one window, and > > make kernel-toolchain > > in another window. Never got above 2000. Not absolute proof, but > > it looks like it is not really running out of descriptors. > > > > chmod 0 /usr/bin/mkdep > > gives the expected permission denied. (proves that it is trying to > > run /usr/bin/mkdep) > > > > Restore the mode and change /usr/bin/mkdep to > > #!/bin/sh > > echo hello from mkdep > > and I'm back to "Out of file descriptors". And it doesn't print hello. > > > > So... make (I assume?) thinks (incorrectly?) that it is running out of > > file descriptors attempting to run /usr/bin/mkdep? > > Oh. Hrm. The only thing in the source that says that exact message is > in /bin/sh input.c, and it looks like this: > > fd2 = fcntl(fd, F_DUPFD_CLOEXEC, 10); > close(fd); > if (fd2 < 0) > error("Out of file descriptors"); > > So you have guess what the actual error is, or hack the code to print > errno or something. ktrace+kdump can give you the return value of fcntl... -- John-Mark Gurney Voice: +1 415 225 5579 "All that I will do, has been done, All that I have, has not." From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 19 21:57:03 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 9DD1AF23; Wed, 19 Nov 2014 21:57:03 +0000 (UTC) Received: from mx1.stack.nl (relay02.stack.nl [IPv6:2001:610:1108:5010::104]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client CN "mailhost.stack.nl", Issuer "CA Cert Signing Authority" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 60C2DBED; Wed, 19 Nov 2014 21:57:03 +0000 (UTC) Received: from snail.stack.nl (snail.stack.nl [IPv6:2001:610:1108:5010::131]) by mx1.stack.nl (Postfix) with ESMTP id 61BBA358C68; Wed, 19 Nov 2014 22:57:00 +0100 (CET) Received: by snail.stack.nl (Postfix, from userid 1677) id 5212728494; Wed, 19 Nov 2014 22:57:00 +0100 (CET) Date: Wed, 19 Nov 2014 22:57:00 +0100 From: Jilles Tjoelker To: Ian Lepore Subject: Re: Running 8 building 10 gives "Out of file descriptors" ? Message-ID: <20141119215700.GA42114@stack.nl> References: <1416428288.1147.140.camel@revolution.hippie.lan> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1416428288.1147.140.camel@revolution.hippie.lan> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-hackers@freebsd.org, Dieter BSD X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Nov 2014 21:57:03 -0000 On Wed, Nov 19, 2014 at 01:18:08PM -0700, Ian Lepore wrote: > On Wed, 2014-11-19 at 11:07 -0800, Dieter BSD wrote: > > if (fd < 10) { > > fd2 = fcntl(fd, F_DUPFD_CLOEXEC, 10); > > close(fd); > > if (fd2 < 0) > > { > > int limit; > > limit = getdtablesize(); > > fprintf(stderr, "sh: setinputfile(): fcntl() returned %d ge\ > > tdtablesize() returned %d\n", fd2, limit); > > perror("sh: fcntl(F_DUPFD_CLOEXEC) failed:"); > > error("sh: Out of file descriptors?"); > > } > > fd = fd2; > > } > > Result: > > sh: setinputfile(): fcntl() returned -1 getdtablesize() returned 11095 > > sh: fcntl(F_DUPFD_CLOEXEC) failed:: Invalid argument > > sh: Out of file descriptors? > > find /usr/include/ | xargs grep F_DUPFD_CLOEXEC > > gives no hits in 8.2, but > > /usr/include/sys/fcntl.h: > > /new/freebsd/usr/include/fcntl.h: > > #define F_DUPFD_CLOEXEC 17 /* Like F_DUPFD, but FD_CLOEXEC is set */ > > in 10.1 > > So, F_DUPFD_CLOEXEC was added after 8.2, and someone changed sh to > > use it, but couldn't be bothered to fix the error message. > > If someone would like to fix this, they don't need to build a toolchain, > > they can use a 2 line script: > > #!/bin/sh > > echo Hello, World! > > So Ian, how did you avoid running into this problem? > Ohhhh... hmm. That must have been MFC'd to 8-stable after I had updated > my 8.2 to 8.4 (which was quite a while ago, more than a year now I > guess). > I think this means it's no longer possible to bootstrap a system older > than 8.4 in a single step. You'd need to go 8.2 -> 8.4 then install > that and reboot to go forward from there. I'm not sure there's an easy > fix for that, but we could at least update the check in Makefile.inc1 to > stop the build and tell you that you can't bootstrap a system older than > 8.4 (right now the cutoff check is 8.0). > I'm not sure what the project policy is in terms of fixing this (no > matter how hard it may be) versus changing the cutoff warning. I'll > look into it. Updating the check in Makefile.inc1 makes sense. If building from 8.2 is supposed to work, it would make most sense to revert r250267. I don't think making the source a #ifdef mess is worth it, given that using O_CLOEXEC and F_DUPFD_CLOEXEC is only a minor optimization in sh and not a correctness issue like in threaded programs (including libc which may be used from threaded programs). Not being able to use kernel features in sh that were MFC'ed back three stable branches ago makes me sad, though. -- Jilles Tjoelker From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 19 23:08:10 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 73E875CA for ; Wed, 19 Nov 2014 23:08:10 +0000 (UTC) Received: from mail-ig0-x236.google.com (mail-ig0-x236.google.com [IPv6:2607:f8b0:4001:c05::236]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3F3D93B2 for ; Wed, 19 Nov 2014 23:08:10 +0000 (UTC) Received: by mail-ig0-f182.google.com with SMTP id hn15so1867199igb.3 for ; Wed, 19 Nov 2014 15:08:09 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=SL4dN36VIm3yDeh7rrerR3OaJE/saiCjl9UOjSht8mo=; b=XtPHsKXN4anvKNVWScjL4xJMFARUq1atSl6zg5H1SiBEv1pb0/Kk8y0J7jZDqF1B7k GZLtog5E1qojKjPwx7Y/dDTh4fYbkPmQmXp+G3kQ5i4k4xF+X4ciDBxTKogEPnF/JlOn YE393alZEOU2HslDdQPlRn06b2J6F9hUtHneC/9YfLDA9HkriHqLA83mONco17eJ3vJG M+NoaqAFzI11HPZ6OMfGd/+l/J6SsrAWM1S8yM3WXnz45I2zjWmruhVs9d9gqQcOXd8R TOx/3yX1BflwQwGe2bT4RvU44yeM+6oELTFwoJDKkwgqQkY2cWOCLyd7wxwQNVSkpfA/ aIkw== MIME-Version: 1.0 X-Received: by 10.42.179.195 with SMTP id br3mr5016402icb.37.1416438489744; Wed, 19 Nov 2014 15:08:09 -0800 (PST) Received: by 10.64.147.164 with HTTP; Wed, 19 Nov 2014 15:08:09 -0800 (PST) Date: Wed, 19 Nov 2014 15:08:09 -0800 Message-ID: Subject: Re: comments on code-in tasks for FreeBSD From: Dieter BSD To: freebsd-hackers@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Nov 2014 23:08:10 -0000 > I cannot even imagine a 13 year old knowing what FreeBSD is. Why not? They've probably heard of Apple and Linux. If we want to increase the number of people improving BSD we want to encourage, not discourage them. Teens may not have decades of experience and a PhD in CS, but they often have energy and interest. Let *them* decide what they want to tackle and what they don't. Remember the stories of some teacher putting an "impossible" problem on the board, and the next day some kid has solved it. There used to be a PR database with things that needed improving. But these problems were just minor little things like kernel panics, lost data, and other unimportant stuff that no one ever works on fixing. Certainly wouldn't want some kid finding a fix for a problem that wasn't shiny enough for the old folks to tackle. From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 19 23:09:41 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id C580C6C7 for ; Wed, 19 Nov 2014 23:09:41 +0000 (UTC) Received: from mail-ie0-x22d.google.com (mail-ie0-x22d.google.com [IPv6:2607:f8b0:4001:c03::22d]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 90DA73D3 for ; Wed, 19 Nov 2014 23:09:41 +0000 (UTC) Received: by mail-ie0-f173.google.com with SMTP id y20so1637267ier.4 for ; Wed, 19 Nov 2014 15:09:41 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=bfKo62A+rMKxwC6EBxvRzY2NJ/lxGk+hJlpRCUYPF7k=; b=NH6XeRdoWUS9b5d+txpnnjDDzJbY862/llQtV2qk0Y8fM3oTbh8B80q3NlU+txJzw4 ea+us9trTA+6i8t/WsTq4IP0VED1bHMSwacPEoqagse5wdjDqgTOnFohvq6KXxCCyO/q S9ERKXULN7Pb0y/G8ECPzdSR8oqzrm4PrejP7e/y3ORhHLo1IfxKxdP8GdOUzH3rsLD/ ppIGxQar6dDTgDkZiQHnpi9YM9+RvpSj804RdxmSs7R8zsvbXi4G5f/XtAcBdnChSlbP a7d4JfoRfXbiT5kyHxL8QUGlXq1T3BH0335s2z5Gtyn7PUx3kx2w/6TdQB+wkg1xJInO p3cw== MIME-Version: 1.0 X-Received: by 10.42.179.195 with SMTP id br3mr5021740icb.37.1416438581130; Wed, 19 Nov 2014 15:09:41 -0800 (PST) Received: by 10.64.147.164 with HTTP; Wed, 19 Nov 2014 15:09:41 -0800 (PST) Date: Wed, 19 Nov 2014 15:09:41 -0800 Message-ID: Subject: Re: Running 8 building 10 gives "Out of file descriptors" ? From: Dieter BSD To: freebsd-hackers@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Nov 2014 23:09:41 -0000 By "fix this", I meant fix the brain dead error message from sh. 1 - The code should print the name of the program complaining. 2 - The code should print the errno string, and what caused the error ( fcntl(F_DUPFD_CLOEXEC) ). 3 - The code should not stupidly print "Out of file descriptors", since that might not be the problem. From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 19 23:11:59 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 661A17DF for ; Wed, 19 Nov 2014 23:11:59 +0000 (UTC) Received: from mail-ie0-x22e.google.com (mail-ie0-x22e.google.com [IPv6:2607:f8b0:4001:c03::22e]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 32003660 for ; Wed, 19 Nov 2014 23:11:59 +0000 (UTC) Received: by mail-ie0-f174.google.com with SMTP id rl12so1647878iec.19 for ; Wed, 19 Nov 2014 15:11:58 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=UJAapiyeUIUrlkNFXCX7ZafN4urlVIA7tdc4a4UcfZM=; b=RmCkaWjG1SdWKzuZaUsGXJMzEZk/UhpqyGfxG8cZV6x8CRTHOrAxl0E6sPufk3ZRkF b7NoNFZiRTDHSQ/sg3sCTMaeLWdchuSwJaG/mK784rjqimLnQJaqXcwrBGWRtw7G99E0 YpO3tYCmK11oEagwm6ycvB6y4xYcEi6K7dgLkhCm6+ICQDuH2v1EBKyoNWEtyhqtOI4T 5Lefh3292GkoudXo+0ic3++Btnw1GnXrB7ri6qFMPCBUlBiLtrkFdUtgdkyc40TvBtgK LLNSSSVOjpAyHEGWb26GLECBMxqYEFBIe9O/8mhiRua6gG8WJRAeDGzzeISy/xgwgqlC QxXA== MIME-Version: 1.0 X-Received: by 10.107.130.30 with SMTP id e30mr31116iod.87.1416438718692; Wed, 19 Nov 2014 15:11:58 -0800 (PST) Received: by 10.64.147.164 with HTTP; Wed, 19 Nov 2014 15:11:58 -0800 (PST) Date: Wed, 19 Nov 2014 15:11:58 -0800 Message-ID: Subject: Running 8 building 10 part2: ctfmerge hangs From: Dieter BSD To: freebsd-hackers@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Nov 2014 23:11:59 -0000 amd64 running 8.2 Attempting to build 10.1 kernel in chroot I copied 8.2's /bin/sh to the chroot to avoid F_DUPFD_CLOEXEC problem. cd /usr/src [ in chroot ] nice -20 make buildkernel KERNCONF=GENERIC >> $LOGFILE 2>&1 It grinds away awhile, then ctfmerge hangs. End of logfile: ctfconvert -L VERSION -g vers.o linking kernel.debug ctfmerge -L VERSION -g -o kernel.debug locore.o [ ...] hack.So vers.o USER PID %CPU %MEM VSZ RSS TT STAT STARTED TIME COMMAND root 10007 0.0 0.1 23224 4580 10 IN+ 11:25AM 0:00.07 [ctfmerge] -rwxr-xr-x 1 root wheel 117461957 Nov 19 11:25 kernel.debug It is now 12:12pm. The machine is otherwise idle. Copied the 8.2 ctfmerge to the chroot, added -v and removed most of the arguments, and it still hangs. cd /usr/obj/usr/src/sys/GENERIC VERSION="FreeBSD 10.1-RELEASE amd64 1001000" /tmp/ctfmerge -v -L VERSION -o kernel.debug.verbose cam.o Added a bunch of debugging printfs to ctfmerge.c, but trapped in header file hell trying to get it to compile. From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 19 23:47:32 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 2BD315CB for ; Wed, 19 Nov 2014 23:47:32 +0000 (UTC) Received: from mho-01-ewr.mailhop.org (mho-03-ewr.mailhop.org [204.13.248.66]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 00AC09DE for ; Wed, 19 Nov 2014 23:47:31 +0000 (UTC) Received: from [73.34.117.227] (helo=ilsoft.org) by mho-01-ewr.mailhop.org with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.72) (envelope-from ) id 1XrEy9-000DSn-S7; Wed, 19 Nov 2014 23:47:30 +0000 Received: from [172.22.42.240] (revolution.hippie.lan [172.22.42.240]) by ilsoft.org (8.14.9/8.14.9) with ESMTP id sAJNlS32009425; Wed, 19 Nov 2014 16:47:28 -0700 (MST) (envelope-from ian@FreeBSD.org) X-Mail-Handler: Dyn Standard SMTP by Dyn X-Originating-IP: 73.34.117.227 X-Report-Abuse-To: abuse@dyndns.com (see http://www.dyndns.com/services/sendlabs/outbound_abuse.html for abuse reporting information) X-MHO-User: U2FsdGVkX18ZrZtMsAkOQ9T0q75o8yKu X-Authentication-Warning: paranoia.hippie.lan: Host revolution.hippie.lan [172.22.42.240] claimed to be [172.22.42.240] Subject: Re: Running 8 building 10 part2: ctfmerge hangs From: Ian Lepore To: Dieter BSD In-Reply-To: References: Content-Type: text/plain; charset="us-ascii" Date: Wed, 19 Nov 2014 16:47:28 -0700 Message-ID: <1416440848.1147.156.camel@revolution.hippie.lan> Mime-Version: 1.0 X-Mailer: Evolution 2.32.1 FreeBSD GNOME Team Port Content-Transfer-Encoding: 7bit Cc: freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Nov 2014 23:47:32 -0000 On Wed, 2014-11-19 at 15:11 -0800, Dieter BSD wrote: > amd64 running 8.2 > Attempting to build 10.1 kernel in chroot > I copied 8.2's /bin/sh to the chroot to avoid F_DUPFD_CLOEXEC problem. > cd /usr/src [ in chroot ] > nice -20 make buildkernel KERNCONF=GENERIC >> $LOGFILE 2>&1 > > It grinds away awhile, then ctfmerge hangs. > > End of logfile: > ctfconvert -L VERSION -g vers.o > linking kernel.debug > ctfmerge -L VERSION -g -o kernel.debug locore.o [ ...] hack.So vers.o > > USER PID %CPU %MEM VSZ RSS TT STAT STARTED TIME COMMAND > root 10007 0.0 0.1 23224 4580 10 IN+ 11:25AM 0:00.07 [ctfmerge] > > -rwxr-xr-x 1 root wheel 117461957 Nov 19 11:25 kernel.debug > > It is now 12:12pm. > > The machine is otherwise idle. > > Copied the 8.2 ctfmerge to the chroot, added -v and removed most of > the arguments, and it still hangs. > > cd /usr/obj/usr/src/sys/GENERIC > VERSION="FreeBSD 10.1-RELEASE amd64 1001000" > /tmp/ctfmerge -v -L VERSION -o kernel.debug.verbose cam.o > > Added a bunch of debugging printfs to ctfmerge.c, but trapped in > header file hell trying to get it to compile. There may be no path to success from 8.2. I have a vague memory that a colleague at work starting running into problems like this (ctfmerge was one of them I think), and we played with things for a few hours (WITHOUT_CTF in make.conf only got us on to a new problem). Eventually we gave up and updated his machine to 8.4. That was for building 11-current but it may apply to 10 as well. -- Ian From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 00:52:45 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id A053D51B for ; Thu, 20 Nov 2014 00:52:45 +0000 (UTC) Received: from udns.ultimatedns.net (unknown [IPv6:2602:d1:b4d6:e600:4261:86ff:fef6:aa2a]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 77FCCD1 for ; Thu, 20 Nov 2014 00:52:45 +0000 (UTC) Received: from ultimatedns.net (localhost [127.0.0.1]) by udns.ultimatedns.net (8.14.9/8.14.9) with ESMTP id sAK0rboT094917; Wed, 19 Nov 2014 16:53:37 -0800 (PST) (envelope-from bsd-lists@bsdforge.com) To: freebsd-hackers@freebsd.org, Dieter BSD In-Reply-To: References: From: "Chris H" Subject: Re: comments on code-in tasks for FreeBSD Date: Wed, 19 Nov 2014 16:53:38 -0800 Content-Type: text/plain; charset=UTF-8; format=fixed MIME-Version: 1.0 Message-id: Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2014 00:52:45 -0000 On Wed, 19 Nov 2014 15:08:09 -0800 Dieter BSD wrote > > I cannot even imagine a 13 year old knowing what FreeBSD is. > > Why not? They've probably heard of Apple and Linux. > If we want to increase the number of people improving > BSD we want to encourage, not discourage them. > > Teens may not have decades of experience and a PhD in CS, > but they often have energy and interest. Let *them* decide > what they want to tackle and what they don't. Remember the > stories of some teacher putting an "impossible" problem on the > board, and the next day some kid has solved it. > > There used to be a PR database with things that needed improving. > But these problems were just minor little things like kernel > panics, lost data, and other unimportant stuff that no one ever > works on fixing. Certainly wouldn't want some kid finding a fix > for a problem that wasn't shiny enough for the old folks to tackle. +1 --Chris > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 00:58:56 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id C75D1647; Thu, 20 Nov 2014 00:58:56 +0000 (UTC) Received: from dmz-mailsec-scanner-5.mit.edu (dmz-mailsec-scanner-5.mit.edu [18.7.68.34]) by mx1.freebsd.org (Postfix) with ESMTP id 69FE9F9; Thu, 20 Nov 2014 00:58:56 +0000 (UTC) X-AuditID: 12074422-f79bf6d000000ffe-10-546d3b9cc55d Received: from mailhub-auth-4.mit.edu ( [18.7.62.39]) (using TLS with cipher AES256-SHA (256/256 bits)) (Client did not present a certificate) by dmz-mailsec-scanner-5.mit.edu (Symantec Messaging Gateway) with SMTP id CA.86.04094.C9B3D645; Wed, 19 Nov 2014 19:53:48 -0500 (EST) Received: from outgoing.mit.edu (outgoing-auth-1.mit.edu [18.9.28.11]) by mailhub-auth-4.mit.edu (8.13.8/8.9.2) with ESMTP id sAK0rlRJ016856; Wed, 19 Nov 2014 19:53:48 -0500 Received: from multics.mit.edu (system-low-sipb.mit.edu [18.187.2.37]) (authenticated bits=56) (User authenticated as kaduk@ATHENA.MIT.EDU) by outgoing.mit.edu (8.13.8/8.12.4) with ESMTP id sAK0rjCu024869 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Wed, 19 Nov 2014 19:53:47 -0500 Received: (from kaduk@localhost) by multics.mit.edu (8.12.9.20060308) id sAK0rj0H000957; Wed, 19 Nov 2014 19:53:45 -0500 (EST) Date: Wed, 19 Nov 2014 19:53:45 -0500 (EST) From: Benjamin Kaduk To: Ian Lepore Subject: Re: Running 8 building 10 part2: ctfmerge hangs In-Reply-To: <1416440848.1147.156.camel@revolution.hippie.lan> Message-ID: References: <1416440848.1147.156.camel@revolution.hippie.lan> User-Agent: Alpine 1.10 (GSO 962 2008-03-14) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFvrPIsWRmVeSWpSXmKPExsUixG6nrjvHOjfE4O1PI4v2hbvZLLZv/sdo 8eT4G2YHZo8Zn+azeOycdZc9gCmKyyYlNSezLLVI3y6BK2Nb727WgousFfO6D7M1MG5n6WLk 5JAQMJE43bKZDcIWk7hwbz2QzcUhJDCbSWLTgqmMEM5GRokd6++AdQgJHGKSWH5JACLRwCix YcpqJpAEi4C2ROuFTawgNpuAisTMNxvBxooIKEhsmbeaGcRmFnCUOLLmMtggYQELiU2Ni8Bq OAXsJC5P6WcEsXmBan6vaIDa3MQoseXUHLAGUQEdidX7p7BAFAlKnJz5hAViqJbE8unbWCYw Cs5CkpqFJLWAkWkVo2xKbpVubmJmTnFqsm5xcmJeXmqRrqlebmaJXmpK6SZGcNi6KO1g/HlQ 6RCjAAejEg9vgkVuiBBrYllxZe4hRkkOJiVR3iNaQCG+pPyUyozE4oz4otKc1OJDjBIczEoi vOycQDnelMTKqtSifJiUNAeLkjjvph98IUIC6YklqdmpqQWpRTBZGQ4OJQleCyugRsGi1PTU irTMnBKENBMHJ8hwHqDhfCA1vMUFibnFmekQ+VOMuhwtTW97mYRY8vLzUqXEeVVAigRAijJK 8+DmwNLNK0ZxoLeEedtBqniAqQpu0iugJUxAS+ZsyARZUpKIkJJqYFyUUuvlciOaY/YnE762 RJYKr+izpl7fPjNUS2xhZr0T11fXeFLQ3Kg4dsdUx50ZiRFJHz9dPmhS8G53pNfSVaUH3DME 32iwmFwTDw6xv5Gid4Vh8qTeVgmXLjWx1a9337nIvDA+s4jDpPdG0hw7waQLsu6+z7dv9lG7 7Hrp/cZr6wNLLrydqsRSnJFoqMVcVJwIAMBo94kSAwAA Cc: freebsd-hackers@freebsd.org, Dieter BSD X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2014 00:58:56 -0000 On Wed, 19 Nov 2014, Ian Lepore wrote: > There may be no path to success from 8.2. I have a vague memory that a > colleague at work starting running into problems like this (ctfmerge was > one of them I think), and we played with things for a few hours > (WITHOUT_CTF in make.conf only got us on to a new problem). Eventually > we gave up and updated his machine to 8.4. That was for building > 11-current but it may apply to 10 as well. It has always been the case that the supported upgrade procedure involves updating to the tip of the current stable branch before updating to (e.g.) -current. Sometimes other procedures also work, but it is not surprising that the first upgrade is needed. -Ben From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 07:22:47 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 66F307FF for ; Thu, 20 Nov 2014 07:22:47 +0000 (UTC) Received: from mail-ie0-x241.google.com (mail-ie0-x241.google.com [IPv6:2607:f8b0:4001:c03::241]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3391EB08 for ; Thu, 20 Nov 2014 07:22:47 +0000 (UTC) Received: by mail-ie0-f193.google.com with SMTP id rl12so342328iec.8 for ; Wed, 19 Nov 2014 23:22:46 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=lIjUxbZZ0nxUMpzRqIs20LwCzIQw6zU2z14qOOBz6SY=; b=FbUM+MQYxGS14WRNvm8LGpD+i5+wZhGvOc3m0DUYDoLAB/rnyuc9viFW3Wd4dOHeJe LKojN2qoNkIi2GOkCuxjIWhrm+9AlDYdjjkwrddVL/L9TjIS5fVdtDogK+yRTMsDfS0j WZ2q68FtkyjyvBbWeR+CdfNXq0HprZLUWtXu0eSqN74uPHirJ/WLRdDxqSJH/hbevpPE 3ul+1KKGee8FWBT0IqylyEVm0OBTxhAS4uB8aXjNp5V6CqTQ/iLW4aKIsioGHf8eLSha kFpk3WtSIDMdtrxkQNHzCayhkMpidkd/TCfAcx0wTxXhEfp4v6LxP3HLqPcON7B8Jgz9 EAfg== MIME-Version: 1.0 X-Received: by 10.50.73.67 with SMTP id j3mr7876430igv.1.1416468166581; Wed, 19 Nov 2014 23:22:46 -0800 (PST) Received: by 10.64.147.164 with HTTP; Wed, 19 Nov 2014 23:22:46 -0800 (PST) Date: Wed, 19 Nov 2014 23:22:46 -0800 Message-ID: Subject: Re: Running 8 building 10 part2: ctfmerge hangs From: Dieter BSD To: freebsd-hackers@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2014 07:22:47 -0000 After thinking about this a bit, it looks like ctfmerge is broken. 8.2 ctfmerge running under 8.2 kernel. Use a bogus argument and it complains. (So it *is* running before it goes into a coma.) But with normal arguments it quickly falls asleep. Thus it is broken. But... if I run it under gdb, it says program exited normally: (gdb) run -v -L VERSION -o kernel.debug.verbose cam.o Starting program: /new/freebsd/tmp/ctfmerge -v -L VERSION -o kernel.debug.verbose cam.o (no debugging symbols found)...(no debugging symbols found)... (no debugging symbols found)...(no debugging symbols found)... (no debugging symbols found)...[New LWP 100342] (no debugging symbols found)...(no debugging symbols found)... [New Thread 800e041c0 (LWP 100342)] [New Thread 800e0ae40 (LWP 100405)] [Thread 800e0ae40 (LWP 100405) exited] GFun: 7 SFun: 1 GVar: 4 SVar: 9 T 73 SOU: 76 Program exited normally. (gdb) And the kernel file shrank from 117MB to 20MB, so it did something. From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 17:06:12 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 3AC5E630; Thu, 20 Nov 2014 17:06:12 +0000 (UTC) Received: from udns.ultimatedns.net (unknown [IPv6:2602:d1:b4d6:e600:4261:86ff:fef6:aa2a]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E1F1D885; Thu, 20 Nov 2014 17:06:11 +0000 (UTC) Received: from ultimatedns.net (localhost [127.0.0.1]) by udns.ultimatedns.net (8.14.9/8.14.9) with ESMTP id sAKH78gS071061; Thu, 20 Nov 2014 09:07:08 -0800 (PST) (envelope-from bsd-lists@bsdforge.com) To: "FreeBSD STABLE" , "FreeBSD CURRENT" From: "Chris H" Subject: send-pr must live Date: Thu, 20 Nov 2014 09:07:08 -0800 Content-Type: text/plain; charset=UTF-8; format=fixed MIME-Version: 1.0 Message-id: Content-Transfer-Encoding: 8bit Cc: freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2014 17:06:12 -0000 Greetings, While I recognize that send-pr has pretty much become useless, with the advent of bugzilla, being made the new "official" FreeBSD bug reporting system. I really miss send-pr, and was hoping I could revive it, eg; integrate it with bugzilla. I had even contemplated adding a feature that would allow it to also work with local port/system building structures people often use to build, and maintain FreeBSD. Any objections to my reviving send-pr? Thank you for all your time, and consideration. --Chris From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 17:57:08 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id C36CE2CA for ; Thu, 20 Nov 2014 17:57:08 +0000 (UTC) Received: from bigwig.baldwin.cx (bigwig.baldwin.cx [IPv6:2001:470:1f11:75::1]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9E382F14 for ; Thu, 20 Nov 2014 17:57:08 +0000 (UTC) Received: from jhbbsd.localnet (unknown [209.249.190.124]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id 847D5B923; Thu, 20 Nov 2014 12:57:07 -0500 (EST) From: John Baldwin To: freebsd-hackers@freebsd.org Subject: Re: 1 gig superpages Date: Thu, 20 Nov 2014 11:18:55 -0500 User-Agent: KMail/1.13.5 (FreeBSD/8.4-CBSD-20140415; KDE/4.5.5; amd64; ; ) References: In-Reply-To: MIME-Version: 1.0 Content-Type: Text/Plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Message-Id: <201411201118.56050.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Thu, 20 Nov 2014 12:57:07 -0500 (EST) Cc: Sebastian Kuzminsky X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2014 17:57:08 -0000 On Monday, November 10, 2014 11:15:09 am Sebastian Kuzminsky wrote: > Hello hackers, I'm announcing the availability of a branch adding support for 1 GB superpages to FreeBSD. > > https://github.com/Seb-LineRate/freebsd/commits/seb/stable-10/1-gig-pages > > The branch is based on work done by Line Rate Systems and F5 Networks, and used in our LROS load-balancing product. > > Our product is based on FreeBSD 9.1; the branch I linked to above is our 1 gig page support rebased onto stable/10. I probably messed something up in the rebase, as lots of things changed both in pmap and vm since 9.1. There are also a handful of commits that i haven't gotten to yet, but they are less consequential - just performance improvements to the buddy allocator. I hope to push those over the next few days. > > It should be relatively easy to rebase the branch onto Current. > > > This is a work in progress, and I would appreciate feedback and comments. So my initial thoughts from having looked at this very briefly is that this is a bit hackish. In particular, the reservation system already supports multiple levels of reservations so that you could have a separate reservation layer for 1GB pages. However, that alone doesn't get you exactly what you want, which is that you want to guarantee a specific page size. This is also something that would be nice to have for 2MB pages as well, and I have talked a bit about that with Alan in the past. What I do think would be useful would be to have a new mmap flag which requests that a mapping not use demotion/promotion but fully use any reservations it makes. You could also have it fail if it can't get reservations for the entire range. Alan suggests to call this MAP_HUGETLB to match Linux since it would provide similar semantics. If you then add 1GB pages as an second reservation level on amd64 and make the semantics of MAP_HUGETLB such that it uses the largest reservations possible for the mapping size (so a request for 1G uses 1G page instead of 2M pages), then that would give you what you want without having various 1G-specific functions scattered in MI code, etc. It will also be more useful for other platforms going forward (some of which support multiple page sizes that aren't just the 'trim a tree layer' PSE-style you have on x86). -- John Baldwin From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 17:57:11 2014 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 5040D331; Thu, 20 Nov 2014 17:57:11 +0000 (UTC) Received: from bigwig.baldwin.cx (bigwig.baldwin.cx [IPv6:2001:470:1f11:75::1]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 276A2F15; Thu, 20 Nov 2014 17:57:11 +0000 (UTC) Received: from jhbbsd.localnet (unknown [209.249.190.124]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id 22604B968; Thu, 20 Nov 2014 12:57:10 -0500 (EST) From: John Baldwin To: freebsd-hackers@freebsd.org Subject: Re: [BUG] Getting path to program binary sometimes fails Date: Thu, 20 Nov 2014 11:25:29 -0500 User-Agent: KMail/1.13.5 (FreeBSD/8.4-CBSD-20140415; KDE/4.5.5; amd64; ; ) References: <91809230-5E81-4A6E-BFD6-BE8815A06BB2@logicnow.com> <20141113170758.GY17068@kib.kiev.ua> In-Reply-To: MIME-Version: 1.0 Content-Type: Text/Plain; charset="windows-1252" Content-Transfer-Encoding: quoted-printable Message-Id: <201411201125.30087.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Thu, 20 Nov 2014 12:57:10 -0500 (EST) Cc: Konstantin Belousov , Mike Gelfand , "hackers@freebsd.org" X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2014 17:57:11 -0000 On Friday, November 14, 2014 4:54:18 am Mike Gelfand wrote: > On Nov 13, 2014, at 8:07 PM, Konstantin Belousov =20 wrote: >=20 > > This is not a defect. The vnode->path translation uses namecache, which > > could be purged at any time. The behaviour is typical for most unix > > implementations. Linux and new Solaris have 'rigid' namecache, where > > name entry lifetime is the same as the vnode lifetime it is attached to. > > I am not aware of any useful consequences of such design, except > > vn_fullpath() working more reliable, but at the cost of increased > > memory usage. >=20 > The man page for sysctl(3) states that =93Unless explicitly noted below,= =20 sysctl() returns a consistent snapshot of the data requested=94 (surely we = don=92t=20 expect half the path being returned; I=92m just trying to read thoroughly).= =20 Later on there are no special notes on {CTL_KERN, KERN_PROC,=20 KERN_PROC_PATHNAME}; at least no notes on the unstable behavior being=20 observed, and no funny details of internal implementation you describe. ERR= ORS=20 section only describes ENOENT condition as =93The name array specifies a va= lue=20 that is unknown,=94 which certainly is not the case here. Note that sysctl(3) is describing a generic interface that mostly returns integers. The language is trying to state that when you read the values you get a consistent snapshot of whatever logical values a node provides. (e.g= =2E=20 for a 64-bit int on a 32-bit system it will try to return a consistent value rather than one which mixes 32-bit halves from different values of the=20 associated varaible, or things like the kern.cp_times sysctl (for the=20 cp_times[] array) will return a consistent snapshot of the entire array of= =20 ints). It is not saying that a node is not permitted to say "I have no val= id data at this time." If anything, I think that a node is obligated to return that instead of a partial data (as you somewhat noted). > Since you=92re saying that current behavior is not a defect, maybe=20 documentation is wrong (incomplete, misleading) then? I will readily accept= =20 the =93not a defect=94 explanation, but only if one wouldn=92t have to ask = you every=20 time this oddity is met. If this is the expected error condition, what shou= ld=20 I do to get the path reliably? Should I retry (and how many times)? You=92r= e=20 saying cache is being purged; does it mean that when I ask for path then ca= che=20 is populated again? Does it guarantee then that I=92ll be able to get the p= ath=20 on next call? Could you guarantee that I=92ll be able to get the path at al= l if=20 I fail two or more times? Should I rely on ENOENT specifically when retryin= g? Is this over NFS? NFS is more aggressive than local filesystems in purging name cache entries because there are inherent races in NFS with certain=20 fileservers (ones that don't use sub-second timestamps), so by default entr= ies=20 always expire after about a minute. You can change that via the 'nametimeo= '=20 mount option (takes a count in seconds). =2D-=20 John Baldwin From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 17:25:51 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 870C114A; Thu, 20 Nov 2014 17:25:51 +0000 (UTC) Received: from mail-ob0-x234.google.com (mail-ob0-x234.google.com [IPv6:2607:f8b0:4003:c01::234]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49254B69; Thu, 20 Nov 2014 17:25:51 +0000 (UTC) Received: by mail-ob0-f180.google.com with SMTP id wp4so2566793obc.39 for ; Thu, 20 Nov 2014 09:25:50 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=EygNMTTfIMilhMwDjnDg4usPlC8VZ1/UbzjwK45FDJ4=; b=PmtBR1pZKGlC2FyjZA4AIJta8N7aNBUYDFwM4H3rvXVzVlpivIEb/wVwCnui8Ba+ig z/ZQjDGEea7EwolOGU2JWhF/pKGgUFLIiyMUuy2GudOZknbRMeVEiqjGtypaKRuJfh2b 8pb/Jt5MOceIwsyGdyynHanriX7vuw/PM5YD72ySy5jbFHBb/mTy4K4dUjX9HoxWAQDm drPAWFSHMWwqEO0IoX7SXkXqVtb3btUuKRj6lq2GVkHQ7Za/fYmR6B9NFKnD109+KF6i TvSclV5za+Otl/BUeHXADuBx5eXeQbBmOzBZfdxrRMZWH9f7ZW3bpoIVnDF/FVNYUci/ mxfw== MIME-Version: 1.0 X-Received: by 10.60.161.115 with SMTP id xr19mr42541085oeb.8.1416504350626; Thu, 20 Nov 2014 09:25:50 -0800 (PST) Received: by 10.202.59.133 with HTTP; Thu, 20 Nov 2014 09:25:50 -0800 (PST) In-Reply-To: References: Date: Thu, 20 Nov 2014 23:25:50 +0600 Message-ID: Subject: Re: send-pr must live From: Muhammad Moinur Rahman <5u623l20@gmail.com> To: Chris H X-Mailman-Approved-At: Thu, 20 Nov 2014 17:57:33 +0000 Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: freebsd-hackers@freebsd.org, FreeBSD STABLE , FreeBSD CURRENT X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2014 17:25:51 -0000 Nice idea. However I am working on reviving porttools to migrate within bugzilla system. Maybe we can share some ideas. BR, Muhammad On Thu, Nov 20, 2014 at 11:07 PM, Chris H wrote: > Greetings, > While I recognize that send-pr has pretty much > become useless, with the advent of bugzilla, being made > the new "official" FreeBSD bug reporting system. I really > miss send-pr, and was hoping I could revive it, eg; > integrate it with bugzilla. I had even contemplated adding > a feature that would allow it to also work with local > port/system building structures people often use to build, > and maintain FreeBSD. > Any objections to my reviving send-pr? > > Thank you for all your time, and consideration. > > --Chris > > > _______________________________________________ > freebsd-current@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" > From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 17:39:54 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id E029B9EB; Thu, 20 Nov 2014 17:39:54 +0000 (UTC) Received: from mx.waitman.net (mx.waitman.net [136.0.16.173]) by mx1.freebsd.org (Postfix) with ESMTP id C7CA4CEC; Thu, 20 Nov 2014 17:39:54 +0000 (UTC) Received: by mx.waitman.net (Postfix, from userid 2) id 509ED435B6; Thu, 20 Nov 2014 09:40:16 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=waitman.net; s=default; t=1416505216; bh=fno9McsvKYOX20BlnMd4YxNMDIpEMIfDS5T9tUfat3M=; h=In-Reply-To:References:Date:Subject:From:To:Cc:Reply-To; b=F6cjN4u0ljQ+QVyA0Uu6nTDbskH1HRNY7Aq/hkHi8B70pD7tBRzl4sasquIPUp771 hf9CwazOl2yhqVXHMnIX9emmxxIfHSxdzMlYj0szZCyyVdvJulZan4svN7xvQsj7k1 qvl99XzOtLPxzagkY9v54GA8QJZeQazvKJfzEAMc= Received: from 70.90.171.37 by mx.waitman.net with HTTP; Thu, 20 Nov 2014 09:40:16 -0800 Message-ID: In-Reply-To: References: Date: Thu, 20 Nov 2014 09:40:16 -0800 Subject: Re: send-pr must live From: "Waitman Gobble" To: "Muhammad Moinur Rahman" <5u623l20@gmail.com> Reply-To: waitman@waitman.net User-Agent: SquirrelMail/1.5.2 [SVN] MIME-Version: 1.0 Content-Type: text/plain;charset=iso-8859-1 Content-Transfer-Encoding: 8bit X-Mailman-Approved-At: Thu, 20 Nov 2014 17:57:43 +0000 Cc: freebsd-hackers@freebsd.org, FreeBSD STABLE , FreeBSD CURRENT , Chris H X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2014 17:39:55 -0000 On Thu, November 20, 2014 9:25 am, Muhammad Moinur Rahman wrote: > Nice idea. However I am working on reviving porttools to migrate within > bugzilla system. Maybe we can share some ideas. > > BR, > Muhammad > > > On Thu, Nov 20, 2014 at 11:07 PM, Chris H wrote: > > >> Greetings, >> While I recognize that send-pr has pretty much >> become useless, with the advent of bugzilla, being made the new >> "official" FreeBSD bug reporting system. I really >> miss send-pr, and was hoping I could revive it, eg; integrate it with >> bugzilla. I had even contemplated adding a feature that would allow it >> to also work with local port/system building structures people often use >> to build, and maintain FreeBSD. Any objections to my reviving send-pr? >> >> >> Thank you for all your time, and consideration. >> >> >> --Chris >> >> >> >> _______________________________________________ >> freebsd-current@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-current >> To unsubscribe, send any mail to >> "freebsd-current-unsubscribe@freebsd.org" >> >> > _______________________________________________ > freebsd-current@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" > > I liked using send-pr. It looks like Bugzilla 5.0 will have a native REST API but current versions use plugin. Also I believe Bugzilla supports an email interface so it could be possible to keep send-pr as a shell script. -- Waitman Gobble Los Altos California USA +1.510-830-7975 From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 18:09:02 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 6FD37BC9; Thu, 20 Nov 2014 18:09:02 +0000 (UTC) Received: from udns.ultimatedns.net (unknown [IPv6:2602:d1:b4d6:e600:4261:86ff:fef6:aa2a]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 406D4E4; Thu, 20 Nov 2014 18:09:02 +0000 (UTC) Received: from ultimatedns.net (localhost [127.0.0.1]) by udns.ultimatedns.net (8.14.9/8.14.9) with ESMTP id sAKI9xbB088551; Thu, 20 Nov 2014 10:09:59 -0800 (PST) (envelope-from bsd-lists@bsdforge.com) To: "Muhammad Moinur Rahman" <5u623l20@gmail.com>, "Waitman Gobble" In-Reply-To: References: , From: "Chris H" Subject: Re: send-pr must live Date: Thu, 20 Nov 2014 10:09:59 -0800 Content-Type: text/plain; charset=UTF-8; format=fixed MIME-Version: 1.0 Message-id: <11d24756184c5b6f3339f6e645957f86@ultimatedns.net> Content-Transfer-Encoding: 8bit Cc: freebsd-hackers@freebsd.org, FreeBSD STABLE , FreeBSD CURRENT X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2014 18:09:02 -0000 On Thu, 20 Nov 2014 09:40:16 -0800 "Waitman Gobble" wrote > On Thu, November 20, 2014 9:25 am, Muhammad Moinur Rahman wrote: > > Nice idea. However I am working on reviving porttools to migrate within > > bugzilla system. Maybe we can share some ideas. > > > > BR, > > Muhammad > > > > > > On Thu, Nov 20, 2014 at 11:07 PM, Chris H wrote: > > > > > >> Greetings, > >> While I recognize that send-pr has pretty much > >> become useless, with the advent of bugzilla, being made the new > >> "official" FreeBSD bug reporting system. I really > >> miss send-pr, and was hoping I could revive it, eg; integrate it with > >> bugzilla. I had even contemplated adding a feature that would allow it > >> to also work with local port/system building structures people often use > >> to build, and maintain FreeBSD. Any objections to my reviving send-pr? > >> > >> > >> Thank you for all your time, and consideration. > >> > >> > >> --Chris > >> > >> > >> > >> _______________________________________________ > >> freebsd-current@freebsd.org mailing list > >> http://lists.freebsd.org/mailman/listinfo/freebsd-current > >> To unsubscribe, send any mail to > >> "freebsd-current-unsubscribe@freebsd.org" > >> > >> > > _______________________________________________ > > freebsd-current@freebsd.org mailing list > > http://lists.freebsd.org/mailman/listinfo/freebsd-current > > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" > > > > > > I liked using send-pr. It looks like Bugzilla 5.0 will have a native REST > API but current versions use plugin. Also I believe Bugzilla supports an > email interface so it could be possible to keep send-pr as a shell script. Indeed. It is perfectly inclined to use email. Which makes [initial] integration perfectly *trivial*. :) As to it having been shell based. While there's nothing wrong with that at all, in fact it's advantageous in many respects. I was toying with the idea of perhaps converting (augmenting) it to being Perl based, by way of a statically linked mini-perl interpreter. I thought it would better *empower* it, also providing for a more "user friendly" dialog. But, like I said; just *toying* with the idea. :) --Chris > > > > -- > Waitman Gobble > Los Altos California USA > +1.510-830-7975 From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 18:26:10 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id AB9553D4; Thu, 20 Nov 2014 18:26:10 +0000 (UTC) Received: from mail-wi0-x236.google.com (mail-wi0-x236.google.com [IPv6:2a00:1450:400c:c05::236]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 39C7832E; Thu, 20 Nov 2014 18:26:10 +0000 (UTC) Received: by mail-wi0-f182.google.com with SMTP id h11so6304596wiw.15 for ; Thu, 20 Nov 2014 10:26:08 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=wCxDUrA2UG1Gz/Xf3+YNp8drUcPvKUoWR3aNQlAT4dI=; b=dLSqhxQIQvalJhiG6YoPQ5KdXyWhUPhqpTibzKx4eCMSizyNd6nyo3D1/i1YnMpGoL xh+KFamFCNMaSJwK8sXwJKG3tWHMmbtvQ7YChNHt5xM+WQxB4a5nCPwFNbexmyE/dNxw Qf/01HPbDR0Wx5csrbbU1+7ItOu9d3E1fBTtDnVQ8itrhB9NhtTcUPUnNvP1sgjNQxGp dpQ9aB69jGmOmGTT5n0UHj/U494BNQIfjnqioAKi54z69BTYeXX7d7Xnb30yztfOgCFp MhlL73As6ho5/RsaVzJ0OKaR/XXOw+6vzT4qK/1QzYtHO6FZlwLGB8OXR9IIAtktKa7t +tbw== MIME-Version: 1.0 X-Received: by 10.194.47.226 with SMTP id g2mr69924715wjn.68.1416507968412; Thu, 20 Nov 2014 10:26:08 -0800 (PST) Sender: adrian.chadd@gmail.com Received: by 10.216.106.136 with HTTP; Thu, 20 Nov 2014 10:26:08 -0800 (PST) In-Reply-To: <11d24756184c5b6f3339f6e645957f86@ultimatedns.net> References: <11d24756184c5b6f3339f6e645957f86@ultimatedns.net> Date: Thu, 20 Nov 2014 10:26:08 -0800 X-Google-Sender-Auth: RNO5kzpdqgp6onjOgQ11Wzg8FtM Message-ID: Subject: Re: send-pr must live From: Adrian Chadd To: Chris H Content-Type: text/plain; charset=UTF-8 Cc: Muhammad Moinur Rahman <5u623l20@gmail.com>, "freebsd-hackers@freebsd.org" , Waitman Gobble , FreeBSD CURRENT , FreeBSD STABLE X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2014 18:26:10 -0000 Hi! If you'd like to make it work then please do - just make sure you check with the bugteam about it. I'm worried that you're signing them up for more work (dealing with email spam again) which I /think/ they don't have to deal with now. -adrian On 20 November 2014 10:09, Chris H wrote: > On Thu, 20 Nov 2014 09:40:16 -0800 "Waitman Gobble" wrote > >> On Thu, November 20, 2014 9:25 am, Muhammad Moinur Rahman wrote: >> > Nice idea. However I am working on reviving porttools to migrate within >> > bugzilla system. Maybe we can share some ideas. >> > >> > BR, >> > Muhammad >> > >> > >> > On Thu, Nov 20, 2014 at 11:07 PM, Chris H wrote: >> > >> > >> >> Greetings, >> >> While I recognize that send-pr has pretty much >> >> become useless, with the advent of bugzilla, being made the new >> >> "official" FreeBSD bug reporting system. I really >> >> miss send-pr, and was hoping I could revive it, eg; integrate it with >> >> bugzilla. I had even contemplated adding a feature that would allow it >> >> to also work with local port/system building structures people often use >> >> to build, and maintain FreeBSD. Any objections to my reviving send-pr? >> >> >> >> >> >> Thank you for all your time, and consideration. >> >> >> >> >> >> --Chris >> >> >> >> >> >> >> >> _______________________________________________ >> >> freebsd-current@freebsd.org mailing list >> >> http://lists.freebsd.org/mailman/listinfo/freebsd-current >> >> To unsubscribe, send any mail to >> >> "freebsd-current-unsubscribe@freebsd.org" >> >> >> >> >> > _______________________________________________ >> > freebsd-current@freebsd.org mailing list >> > http://lists.freebsd.org/mailman/listinfo/freebsd-current >> > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" >> > >> > >> >> I liked using send-pr. It looks like Bugzilla 5.0 will have a native REST >> API but current versions use plugin. Also I believe Bugzilla supports an >> email interface so it could be possible to keep send-pr as a shell script. > Indeed. It is perfectly inclined to use email. Which makes > [initial] integration perfectly *trivial*. :) > As to it having been shell based. While there's nothing wrong with > that at all, in fact it's advantageous in many respects. I was toying > with the idea of perhaps converting (augmenting) it to being Perl > based, by way of a statically linked mini-perl interpreter. I thought > it would better *empower* it, also providing for a more "user friendly" > dialog. But, like I said; just *toying* with the idea. :) > > --Chris > >> >> >> >> -- >> Waitman Gobble >> Los Altos California USA >> +1.510-830-7975 > > > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 19:22:10 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id BF54CAC4; Thu, 20 Nov 2014 19:22:10 +0000 (UTC) Received: from udns.ultimatedns.net (unknown [IPv6:2602:d1:b4d6:e600:4261:86ff:fef6:aa2a]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 87DF2ED9; Thu, 20 Nov 2014 19:22:10 +0000 (UTC) Received: from ultimatedns.net (localhost [127.0.0.1]) by udns.ultimatedns.net (8.14.9/8.14.9) with ESMTP id sAKJN71j009325; Thu, 20 Nov 2014 11:23:07 -0800 (PST) (envelope-from bsd-lists@bsdforge.com) To: Adrian Chadd In-Reply-To: References: <11d24756184c5b6f3339f6e645957f86@ultimatedns.net>, From: "Chris H" Subject: Re: send-pr must live Date: Thu, 20 Nov 2014 11:23:07 -0800 Content-Type: text/plain; charset=UTF-8; format=fixed MIME-Version: 1.0 Message-id: <9898ebc3c470ac0c6e3df470c6028e90@ultimatedns.net> Content-Transfer-Encoding: 8bit Cc: Muhammad Moinur Rahman <5u623l20@gmail.com>, "freebsd-hackers@freebsd.org" , Waitman Gobble , FreeBSD CURRENT , FreeBSD STABLE X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2014 19:22:11 -0000 On Thu, 20 Nov 2014 10:26:08 -0800 Adrian Chadd wrote > On 20 November 2014 10:09, Chris H wrote: > > On Thu, 20 Nov 2014 09:40:16 -0800 "Waitman Gobble" > > wrote > > >> On Thu, November 20, 2014 9:25 am, Muhammad Moinur Rahman wrote: > >> > Nice idea. However I am working on reviving porttools to migrate within > >> > bugzilla system. Maybe we can share some ideas. > >> > > >> > BR, > >> > Muhammad > >> > > >> > > >> > On Thu, Nov 20, 2014 at 11:07 PM, Chris H > >> > wrote: >> > > >> > > >> >> Greetings, > >> >> While I recognize that send-pr has pretty much > >> >> become useless, with the advent of bugzilla, being made the new > >> >> "official" FreeBSD bug reporting system. I really > >> >> miss send-pr, and was hoping I could revive it, eg; integrate it with > >> >> bugzilla. I had even contemplated adding a feature that would allow it > >> >> to also work with local port/system building structures people often > >> >> use to build, and maintain FreeBSD. Any objections to my reviving > >> >> send-pr? >> >> > >> >> > >> >> Thank you for all your time, and consideration. > >> >> > >> >> > >> >> --Chris > >> >> > >> >> > >> >> > >> >> _______________________________________________ > >> >> freebsd-current@freebsd.org mailing list > >> >> http://lists.freebsd.org/mailman/listinfo/freebsd-current > >> >> To unsubscribe, send any mail to > >> >> "freebsd-current-unsubscribe@freebsd.org" > >> >> > >> >> > >> > _______________________________________________ > >> > freebsd-current@freebsd.org mailing list > >> > http://lists.freebsd.org/mailman/listinfo/freebsd-current > >> > To unsubscribe, send any mail to > >> > "freebsd-current-unsubscribe@freebsd.org" >> > > >> > > >> > >> I liked using send-pr. It looks like Bugzilla 5.0 will have a native REST > >> API but current versions use plugin. Also I believe Bugzilla supports an > >> email interface so it could be possible to keep send-pr as a shell script. > > Indeed. It is perfectly inclined to use email. Which makes > > [initial] integration perfectly *trivial*. :) > > As to it having been shell based. While there's nothing wrong with > > that at all, in fact it's advantageous in many respects. I was toying > > with the idea of perhaps converting (augmenting) it to being Perl > > based, by way of a statically linked mini-perl interpreter. I thought > > it would better *empower* it, also providing for a more "user friendly" > > dialog. But, like I said; just *toying* with the idea. :) > > > > --Chris > > > >> > >> > >> > >> -- > >> Waitman Gobble > >> Los Altos California USA > >> +1.510-830-7975 > > > > > > _______________________________________________ > > freebsd-hackers@freebsd.org mailing list > > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" > Hi! > > If you'd like to make it work then please do - just make sure you > check with the bugteam about it. I'm worried that you're signing them > up for more work (dealing with email spam again) which I /think/ they > don't have to deal with now. > > > -adrian > > Thanks for the reply adrian. Count on it. I hate SPAM more than the bugteam! And as a result, I have some _very_ good strategies already employed. So "keeping things clean" should prove a trivial matter. I've already started the process. I'm loading up a copy of devel/bugzilla44 now. Thanks again, for your reply, Adrian -- even if it was an evil top post. ;) --Chris > _______________________________________________ > freebsd-current@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 20:14:41 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4A140C7A; Thu, 20 Nov 2014 20:14:41 +0000 (UTC) Received: from mail-pa0-x231.google.com (mail-pa0-x231.google.com [IPv6:2607:f8b0:400e:c03::231]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 11C036B3; Thu, 20 Nov 2014 20:14:41 +0000 (UTC) Received: by mail-pa0-f49.google.com with SMTP id eu11so3191786pac.8 for ; Thu, 20 Nov 2014 12:14:40 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=references:mime-version:in-reply-to:content-type :content-transfer-encoding:message-id:cc:from:subject:date:to; bh=ImO27GboyaxhKuKi73WN55bL7CVZzoWjtXXMm6CTE40=; b=gBswdy/tQ6lCFxHfN+OJQNAmh5OqLor7Bfa26uJIhYueV9fhOX/it6YQTtk0qOTegL M5eq8yOX1mnOzRweq94RTLggLWsGWsOVsp3KXTjydXw9tMwuoDIO5TYqvoeMeMTrdtcK cAg+UpuzWKpVMb9C5AGhz8GD5AZrH9YbTj/FQAIRdtg10mqguehXoewr5izXTPph4PBb i28zNvLWFGVaeLi2ORabKuuo6ZrrHbhWIoyQtj80WFgzYpdVJ9GuvrP0rFmjVWmIreNv 7nbpMe8AhJDKDweWayvZ/Ust71PEyA9aqfdCyCc1uOXRmarpMBPtDdn+gf4cmARhe+2N DM7Q== X-Received: by 10.68.194.199 with SMTP id hy7mr205644pbc.17.1416514480586; Thu, 20 Nov 2014 12:14:40 -0800 (PST) Received: from [10.30.20.156] (mobile-166-171-120-059.mycingular.net. [166.171.120.59]) by mx.google.com with ESMTPSA id fl2sm2842043pab.0.2014.11.20.12.14.39 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Thu, 20 Nov 2014 12:14:39 -0800 (PST) References: <11d24756184c5b6f3339f6e645957f86@ultimatedns.net> <9898ebc3c470ac0c6e3df470c6028e90@ultimatedns.net> Mime-Version: 1.0 (1.0) In-Reply-To: <9898ebc3c470ac0c6e3df470c6028e90@ultimatedns.net> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Message-Id: X-Mailer: iPhone Mail (12B411) From: Garrett Cooper Subject: Re: send-pr must live Date: Thu, 20 Nov 2014 12:14:35 -0800 To: Chris H X-Mailman-Approved-At: Thu, 20 Nov 2014 20:19:01 +0000 Cc: Adrian Chadd , FreeBSD STABLE , FreeBSD CURRENT , "freebsd-hackers@freebsd.org" , Muhammad Moinur Rahman <5u623l20@gmail.com>, Waitman Gobble X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2014 20:14:41 -0000 Please take a look at python-bugzilla (you'll need to install setuptools fro= m ports, then run "easy_install python-bugzilla"). If that interface is suff= icient and easy enough to use, I'll document some quick recipes for how to u= se it on the wiki and import it as a port. Cheers!= From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 20:34:25 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 84E4F572; Thu, 20 Nov 2014 20:34:25 +0000 (UTC) Received: from mho-01-ewr.mailhop.org (mho-03-ewr.mailhop.org [204.13.248.66]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 53B2E932; Thu, 20 Nov 2014 20:34:24 +0000 (UTC) Received: from [73.34.117.227] (helo=ilsoft.org) by mho-01-ewr.mailhop.org with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.72) (envelope-from ) id 1XrYQj-0005Xy-SZ; Thu, 20 Nov 2014 20:34:18 +0000 Received: from [172.22.42.240] (revolution.hippie.lan [172.22.42.240]) by ilsoft.org (8.14.9/8.14.9) with ESMTP id sAKKYFwx001680; Thu, 20 Nov 2014 13:34:15 -0700 (MST) (envelope-from ian@FreeBSD.org) X-Mail-Handler: Dyn Standard SMTP by Dyn X-Originating-IP: 73.34.117.227 X-Report-Abuse-To: abuse@dyndns.com (see http://www.dyndns.com/services/sendlabs/outbound_abuse.html for abuse reporting information) X-MHO-User: U2FsdGVkX19JU+xgxmCn6ptvr7qR0fdf X-Authentication-Warning: paranoia.hippie.lan: Host revolution.hippie.lan [172.22.42.240] claimed to be [172.22.42.240] Subject: Re: send-pr must live From: Ian Lepore To: Garrett Cooper In-Reply-To: References: <11d24756184c5b6f3339f6e645957f86@ultimatedns.net> <9898ebc3c470ac0c6e3df470c6028e90@ultimatedns.net> Content-Type: text/plain; charset="us-ascii" Date: Thu, 20 Nov 2014 13:34:14 -0700 Message-ID: <1416515654.1147.219.camel@revolution.hippie.lan> Mime-Version: 1.0 X-Mailer: Evolution 2.32.1 FreeBSD GNOME Team Port Content-Transfer-Encoding: 7bit Cc: Muhammad Moinur Rahman <5u623l20@gmail.com>, "freebsd-hackers@freebsd.org" , Adrian Chadd , Waitman Gobble , Chris H X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2014 20:34:25 -0000 On Thu, 2014-11-20 at 12:14 -0800, Garrett Cooper wrote: > Please take a look at python-bugzilla (you'll need to install setuptools from ports, then run "easy_install python-bugzilla"). If that interface is sufficient and easy enough to use, I'll document some quick recipes for how to use it on the wiki and import it as a port. > > Cheers! Now that this thread is getting into the hacking-level details of getting this done, I propose trimming current@ and stable@ from the CC list and letting hackers@ be the one list this is discussed on, which I have done in the CC of this message. -- Ian From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 21:50:23 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 581E5A08; Thu, 20 Nov 2014 21:50:23 +0000 (UTC) Received: from udns.ultimatedns.net (unknown [IPv6:2602:d1:b4d6:e600:4261:86ff:fef6:aa2a]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 285B118E; Thu, 20 Nov 2014 21:50:23 +0000 (UTC) Received: from ultimatedns.net (localhost [127.0.0.1]) by udns.ultimatedns.net (8.14.9/8.14.9) with ESMTP id sAKLpJeE058720; Thu, 20 Nov 2014 13:51:20 -0800 (PST) (envelope-from bsd-lists@bsdforge.com) To: Garrett Cooper In-Reply-To: References: <11d24756184c5b6f3339f6e645957f86@ultimatedns.net> <9898ebc3c470ac0c6e3df470c6028e90@ultimatedns.net>, From: "Chris H" Subject: Re: send-pr must live Date: Thu, 20 Nov 2014 13:51:20 -0800 Content-Type: text/plain; charset=UTF-8; format=fixed MIME-Version: 1.0 Message-id: <83bde838aaa0d084c046e11363f41d59@ultimatedns.net> Content-Transfer-Encoding: 8bit Cc: Adrian Chadd , FreeBSD STABLE , FreeBSD CURRENT , "freebsd-hackers@freebsd.org" , Muhammad Moinur Rahman <5u623l20@gmail.com>, Waitman Gobble X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2014 21:50:23 -0000 On Thu, 20 Nov 2014 12:14:35 -0800 Garrett Cooper wrote > Please take a look at python-bugzilla Hmm... no sign of it. Do you possibly mean; py-bugzillatools? Just groping. > (you'll need to install setuptools from > ports, then run "easy_install python-bugzilla"). If that interface is > sufficient and easy enough to use, I'll document some quick recipes for how > to use it on the wiki and import it as a port. > > Cheers! --Chris From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 23:25:14 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 18D9F9EF; Thu, 20 Nov 2014 23:25:14 +0000 (UTC) Received: from udns.ultimatedns.net (unknown [IPv6:2602:d1:b4d6:e600:4261:86ff:fef6:aa2a]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id DBC0EE21; Thu, 20 Nov 2014 23:25:13 +0000 (UTC) Received: from ultimatedns.net (localhost [127.0.0.1]) by udns.ultimatedns.net (8.14.9/8.14.9) with ESMTP id sAKNQBJq087104; Thu, 20 Nov 2014 15:26:11 -0800 (PST) (envelope-from bsd-lists@bsdforge.com) To: NGie Cooper In-Reply-To: References: <11d24756184c5b6f3339f6e645957f86@ultimatedns.net> <9898ebc3c470ac0c6e3df470c6028e90@ultimatedns.net> <83bde838aaa0d084c046e11363f41d59@ultimatedns.net>, From: "Chris H" Subject: Re: send-pr must live Date: Thu, 20 Nov 2014 15:26:11 -0800 Content-Type: text/plain; charset=UTF-8; format=fixed MIME-Version: 1.0 Message-id: <35d89f1ddccfddcb2c8ec9599fb83383@ultimatedns.net> Content-Transfer-Encoding: 8bit Cc: Muhammad Moinur Rahman <5u623l20@gmail.com>, "freebsd-hackers@freebsd.org" , Adrian Chadd , Waitman Gobble X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2014 23:25:14 -0000 On Thu, 20 Nov 2014 15:10:30 -0800 NGie Cooper wrote > On Thu, Nov 20, 2014 at 1:51 PM, Chris H wrote: > > On Thu, 20 Nov 2014 12:14:35 -0800 Garrett Cooper > > wrote > > >> Please take a look at python-bugzilla > > Hmm... no sign of it. Do you possibly mean; py-bugzillatools? > > Just groping. > > All the hints were in my original reply... Ahh. I speak Perl. Sorry. Sure. Makes perfect sense. Thanks. > > [root@wkstn-lnx-ngie ngie]# easy_install python-bugzilla > Searching for python-bugzilla > Reading https://pypi.python.org/simple/python-bugzilla/ > Best match: python-bugzilla 1.1.0 > Downloading > https://pypi.python.org/packages/source/p/python-bugzilla/python-bugzilla-1.1 > .0.tar.gz#md5=c95befd1fecad21f742beaa8180538c0 Processing > python-bugzilla-1.1.0.tar.gz Writing > /tmp/easy_install-lR6lpK/python-bugzilla-1.1.0/setup.cfg Running > python-bugzilla-1.1.0/setup.py -q bdist_egg --dist-dir > /tmp/easy_install-lR6lpK/python-bugzilla-1.1.0/egg-dist-tmp-yjKZ_J zip_safe > flag not set; analyzing archive contents... Adding python-bugzilla 1.1.0 to > easy-install.pth file Installing bugzilla script to /usr/bin > > Installed /usr/lib/python2.7/site-packages/python_bugzilla-1.1.0-py2.7.egg > Processing dependencies for python-bugzilla > Finished processing dependencies for python-bugzilla --Chris From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 23:10:31 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 299B14DA; Thu, 20 Nov 2014 23:10:31 +0000 (UTC) Received: from mail-ie0-x22d.google.com (mail-ie0-x22d.google.com [IPv6:2607:f8b0:4001:c03::22d]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E04A6C6C; Thu, 20 Nov 2014 23:10:30 +0000 (UTC) Received: by mail-ie0-f173.google.com with SMTP id y20so3828228ier.18 for ; Thu, 20 Nov 2014 15:10:30 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=UTXX32UakTY9K51pmn6MuUjWXVzuYawmydeBw/4c4fU=; b=PtUtubZLP5ei385Pg4Fkh076mM5UupsolmOzOMpvNQefaGl/4xIsL4/ESRmt/kLM5E JLeJxEczjJ0RVVMHeNBkOLNslYBQYDQ/7qljhuafNMMop+D/ptgzRu6aJyTKv+vJOsMT 3BTkvwcbgJWoF9xhD3auiekeCzL8WpnUVpLUjLasXcfemc+iSkBOg6N1ee0sXNgjTWwy 4LEKyViwaBPoLAbtN7puKLQsOLJXIqgUV0rq3RiTLHOt3f/daFWmaM08yXyKNeA9T2Uo MZh89zIvmJMRBN86S+oLTXJrbLor3vcrY7W8EPqHePdVic0y5AXTP5KjyBa/IGBk17pw AIAg== MIME-Version: 1.0 X-Received: by 10.50.39.80 with SMTP id n16mr587055igk.49.1416525030159; Thu, 20 Nov 2014 15:10:30 -0800 (PST) Received: by 10.50.42.162 with HTTP; Thu, 20 Nov 2014 15:10:30 -0800 (PST) In-Reply-To: <83bde838aaa0d084c046e11363f41d59@ultimatedns.net> References: <11d24756184c5b6f3339f6e645957f86@ultimatedns.net> <9898ebc3c470ac0c6e3df470c6028e90@ultimatedns.net> <83bde838aaa0d084c046e11363f41d59@ultimatedns.net> Date: Thu, 20 Nov 2014 15:10:30 -0800 Message-ID: Subject: Re: send-pr must live From: NGie Cooper To: Chris H Content-Type: text/plain; charset=UTF-8 X-Mailman-Approved-At: Thu, 20 Nov 2014 23:41:42 +0000 Cc: Adrian Chadd , FreeBSD STABLE , FreeBSD CURRENT , "freebsd-hackers@freebsd.org" , Muhammad Moinur Rahman <5u623l20@gmail.com>, Waitman Gobble X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2014 23:10:31 -0000 On Thu, Nov 20, 2014 at 1:51 PM, Chris H wrote: > On Thu, 20 Nov 2014 12:14:35 -0800 Garrett Cooper wrote > >> Please take a look at python-bugzilla > Hmm... no sign of it. Do you possibly mean; py-bugzillatools? > Just groping. All the hints were in my original reply... [root@wkstn-lnx-ngie ngie]# easy_install python-bugzilla Searching for python-bugzilla Reading https://pypi.python.org/simple/python-bugzilla/ Best match: python-bugzilla 1.1.0 Downloading https://pypi.python.org/packages/source/p/python-bugzilla/python-bugzilla-1.1.0.tar.gz#md5=c95befd1fecad21f742beaa8180538c0 Processing python-bugzilla-1.1.0.tar.gz Writing /tmp/easy_install-lR6lpK/python-bugzilla-1.1.0/setup.cfg Running python-bugzilla-1.1.0/setup.py -q bdist_egg --dist-dir /tmp/easy_install-lR6lpK/python-bugzilla-1.1.0/egg-dist-tmp-yjKZ_J zip_safe flag not set; analyzing archive contents... Adding python-bugzilla 1.1.0 to easy-install.pth file Installing bugzilla script to /usr/bin Installed /usr/lib/python2.7/site-packages/python_bugzilla-1.1.0-py2.7.egg Processing dependencies for python-bugzilla Finished processing dependencies for python-bugzilla From owner-freebsd-hackers@FreeBSD.ORG Fri Nov 21 01:50:23 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 07E55A29 for ; Fri, 21 Nov 2014 01:50:23 +0000 (UTC) Received: from mail-ob0-x22b.google.com (mail-ob0-x22b.google.com [IPv6:2607:f8b0:4003:c01::22b]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C130BDFF for ; Fri, 21 Nov 2014 01:50:22 +0000 (UTC) Received: by mail-ob0-f171.google.com with SMTP id uz6so3271600obc.2 for ; Thu, 20 Nov 2014 17:50:22 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=GkjS78OXJb3dZoe1beknaEoVHUNskmvNESny3d1jy98=; b=FSvgVYlhFsClXSsN5vUeKISStUwxyvk+yMHH/dEy5YnzvS7GEMmevOY0a4iWSd7D8c O0JXLBfICTbv5nNKWXa4FX4vuH0rrpPMdj7glp0c4klIuDXhXO1h6/nrZw6B/eo92KmJ UhobsV/DWfllAXSJOPSXJaLfgfMFdWkYAnHwrQ39K/F69evstuoca8Q9DQXSol9F76s7 Ja4LS2JC6retI4WwVa6J2GW4ypWeGNGQ5MnL3i08EXi22vd3wOF1px/XWg/7y5P5PA2I twXxtpLPD3/Unbj7VyDbmHnNZp+FMEdYGL1+i5rvsskoqGEgcgRIdJS4kXRaW9JP31HQ gC3Q== MIME-Version: 1.0 X-Received: by 10.182.44.229 with SMTP id h5mr167328obm.86.1416534622130; Thu, 20 Nov 2014 17:50:22 -0800 (PST) Received: by 10.76.0.138 with HTTP; Thu, 20 Nov 2014 17:50:22 -0800 (PST) Date: Thu, 20 Nov 2014 20:50:22 -0500 Message-ID: Subject: Debugging the ZDB debugger. From: Zaphod Beeblebrox To: FreeBSD Hackers Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Nov 2014 01:50:23 -0000 So ... I have several zfs filesystems with errors that may or may not be real. I've talked about this in the mailing lists before, and I was endeavoring to chase this all down with zdb ... to see what was real. zdb -dd vr2/tmp <--- works zdb -ddd vr2/tmp <--- crashes zdb -dddd vr2/tmp <--- also crashes. When I run "gdb -c zdb.core zdb" I get a whole bunch of: [New Thread 803406c00 (LWP 101333/zdb)] [New Thread 803406800 (LWP 101332/zdb)] [New Thread 803406400 (LWP 100598/zdb)] (probably 30 or so) and then: (gdb) bt #0 0x00000000004098a9 in ?? () #1 0x0000000000406222 in ?? () #2 0x000000000040528f in ?? () #3 0x0000000800632000 in ?? () #4 0x0000000000000000 in ?? () Seeing this, I went to the /usr/src/cddl/usr.sbin/zdb directory and tried recompiling ... but it already puts -g in there --- so ... What do I need to do to debug the debugger? From owner-freebsd-hackers@FreeBSD.ORG Fri Nov 21 01:55:39 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id AE039C2B for ; Fri, 21 Nov 2014 01:55:39 +0000 (UTC) Received: from mail-yk0-x22a.google.com (mail-yk0-x22a.google.com [IPv6:2607:f8b0:4002:c07::22a]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6A48AEB5 for ; Fri, 21 Nov 2014 01:55:39 +0000 (UTC) Received: by mail-yk0-f170.google.com with SMTP id q200so1875637ykb.29 for ; Thu, 20 Nov 2014 17:55:38 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=Y6HUHkDRKmZrtBBxgEYpeiJqFui0ax4vJoUaTTRF35Q=; b=CHp/qDhkJfjQMmoFlvh/MLDUPi2HPU1lXC1TXK6uVbz7xBeEpSo0ftYU9gF+VYwDDV XW4lM0S8X0e3Srp7GDzi30BoUcB3rl0bdUi42LcYY/FvFuixISiSGgM1kMNZj1/85AYG ExajNo7+nOfzBLhz0RPKanY53hjPGjh1a0eG368f1fISTJzbVz4T+jFuXO73kC2uzQAA u5GKBW9mSbfgtaUbxDCVxjDtFQpBg9VYrwj9GKfOMNXDepD4/8pi9sIxaW63yhbY9TBO 4kVG7Xiy9CHSHdWTbXGohldoEOtTMEfLKQ8lBa4LhxSmXTP/eU/lPJqWDsXitvWIGLo/ 49PQ== MIME-Version: 1.0 X-Received: by 10.170.204.23 with SMTP id v23mr87752yke.115.1416534938610; Thu, 20 Nov 2014 17:55:38 -0800 (PST) Sender: kmacybsd@gmail.com Received: by 10.170.82.197 with HTTP; Thu, 20 Nov 2014 17:55:38 -0800 (PST) In-Reply-To: References: Date: Thu, 20 Nov 2014 17:55:38 -0800 X-Google-Sender-Auth: 0fYqg8RrTejCQyAFo0HvFeBaCfk Message-ID: Subject: Re: Debugging the ZDB debugger. From: "K. Macy" To: Zaphod Beeblebrox Content-Type: text/plain; charset=UTF-8 Cc: FreeBSD Hackers X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Nov 2014 01:55:39 -0000 On Thu, Nov 20, 2014 at 5:50 PM, Zaphod Beeblebrox wrote: > So ... I have several zfs filesystems with errors that may or may not be > real. I've talked about this in the mailing lists before, and I was > endeavoring to chase this all down with zdb ... to see what was real. > > zdb -dd vr2/tmp <--- works > > zdb -ddd vr2/tmp <--- crashes > > zdb -dddd vr2/tmp <--- also crashes. > > When I run "gdb -c zdb.core zdb" I get a whole bunch of: > > [New Thread 803406c00 (LWP 101333/zdb)] > [New Thread 803406800 (LWP 101332/zdb)] > [New Thread 803406400 (LWP 100598/zdb)] > > (probably 30 or so) and then: > > (gdb) bt > #0 0x00000000004098a9 in ?? () > #1 0x0000000000406222 in ?? () > #2 0x000000000040528f in ?? () > #3 0x0000000800632000 in ?? () > #4 0x0000000000000000 in ?? () Executables typically get stripped on install. Try the one in your build directory: Breakpoint 5, dump_uint8 (os=0x8069ae800, object=8, data=0x0, size=0) at /usr/home/kmacy/devel/freebsd-vm-merge/cddl/usr.sbin/zdb/../../../cddl/contrib/opensolaris/cmd/zdb/zdb.c:384 384 } (gdb) bt #0 dump_uint8 (os=0x8069ae800, object=8, data=0x0, size=0) at /usr/home/kmacy/devel/freebsd-vm-merge/cddl/usr.sbin/zdb/../../../cddl/contrib/opensolaris/cmd/zdb/zdb.c:384 #1 0x000000000040c81f in dump_object (os=0x8069ae800, object=8, verbosity=6, print_header=0x7fffffe57814) at /usr/home/kmacy/devel/freebsd-vm-merge/cddl/usr.sbin/zdb/../../../cddl/contrib/opensolaris/cmd/zdb/zdb.c:1838 #2 0x000000000040a169 in dump_dir (os=0x8069ae800) at /usr/home/kmacy/devel/freebsd-vm-merge/cddl/usr.sbin/zdb/../../../cddl/contrib/opensolaris/cmd/zdb/zdb.c:1965 #3 0x0000000000407186 in main (argc=0, argv=) at /usr/home/kmacy/devel/freebsd-vm-merge/cddl/usr.sbin/zdb/../../../cddl/contrib/opensolaris/cmd/zdb/zdb.c:3700 (gdb) > Seeing this, I went to the /usr/src/cddl/usr.sbin/zdb directory and tried > recompiling ... but it already puts -g in there --- so ... > > What do I need to do to debug the debugger? > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" From owner-freebsd-hackers@FreeBSD.ORG Fri Nov 21 03:18:02 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 8FEE32AE for ; Fri, 21 Nov 2014 03:18:02 +0000 (UTC) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.freebsd.org (Postfix) with ESMTP id 7EE9F9CC for ; Fri, 21 Nov 2014 03:18:02 +0000 (UTC) Received: from u10-2-32-011.office.norse-data.com (unknown [50.204.88.51]) by elvis.mu.org (Postfix) with ESMTPSA id D959A341F850 for ; Thu, 20 Nov 2014 19:17:55 -0800 (PST) Message-ID: <546EAEE3.4070702@mu.org> Date: Thu, 20 Nov 2014 19:17:55 -0800 From: Alfred Perlstein User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.2.0 MIME-Version: 1.0 To: freebsd-hackers@freebsd.org Subject: Re: send-pr must live References: In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Nov 2014 03:18:02 -0000 On 11/20/14 9:07 AM, Chris H wrote: > Greetings, > While I recognize that send-pr has pretty much > become useless, with the advent of bugzilla, being made > the new "official" FreeBSD bug reporting system. I really > miss send-pr, and was hoping I could revive it, eg; > integrate it with bugzilla. I had even contemplated adding > a feature that would allow it to also work with local > port/system building structures people often use to build, > and maintain FreeBSD. > Any objections to my reviving send-pr? > > Thank you for all your time, and consideration. > > --Chris Done. It's here: https://github.com/splbio/bugzilla-freebsd -Alfred From owner-freebsd-hackers@FreeBSD.ORG Fri Nov 21 06:25:29 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id E0778C8F; Fri, 21 Nov 2014 06:25:28 +0000 (UTC) Received: from mail-ob0-x22d.google.com (mail-ob0-x22d.google.com [IPv6:2607:f8b0:4003:c01::22d]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A29D6C97; Fri, 21 Nov 2014 06:25:28 +0000 (UTC) Received: by mail-ob0-f173.google.com with SMTP id uy5so3558000obc.32 for ; Thu, 20 Nov 2014 22:25:28 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=LuY5HVqr7s82gpK37dkkFaEebxzR7jcGV8yE8o1rxUo=; b=zsgS+wIuxLS380s0W4sz3DMRRdkJH0Jh2mUni2FBBhDxkUkYI4oiZL/KNaYrkqzEX1 p7dW/j0bhhnLSIB0mcf8MSBxnSWanL61eaCUA/PMOQtai4YGV4EC7aTiRGPkUephFw0b yBycPnAFkCsXaZqpxbwHmLzCCLRFcX55mWwqxXUV/w+rvmIrDeehDWUlN3OZmJLBy564 0u66/y83qCXn8uZrdxbHlsRPUofhOYYy2m5Kn+cXRCL1tuaw26vRjDyVuHUC9+/yL8iJ eX6DAKG4g19gayMPF15H0TXmBu2ORnSXSPWPbXXnDyCpwRHNMNDF0CsfGJHiUSkkhpoA 1r5Q== MIME-Version: 1.0 X-Received: by 10.182.65.105 with SMTP id w9mr707416obs.60.1416551128044; Thu, 20 Nov 2014 22:25:28 -0800 (PST) Received: by 10.76.0.138 with HTTP; Thu, 20 Nov 2014 22:25:27 -0800 (PST) In-Reply-To: References: Date: Fri, 21 Nov 2014 01:25:27 -0500 Message-ID: Subject: Re: Debugging the ZDB debugger. From: Zaphod Beeblebrox To: "K. Macy" Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: FreeBSD Hackers X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Nov 2014 06:25:29 -0000 Ok... that advice got me somewhere... now my stack is: (gdb) bt #0 0x00000000004098a9 in dump_dir (os=0x80d302000) at /usr/src/cddl/usr.sbin/zdb/../../../cddl/contrib/opensolaris/cmd/zdb/zdb.c:1464 #1 0x0000000000406222 in main (argc=0, argv=) at /usr/src/cddl/usr.sbin/zdb/../../../cddl/contrib/opensolaris/cmd/zdb/zdb.c:3604 and we got here on a segmentation fault. Now ... I'm a little confused: (gdb) frame 0 #0 0x00000000004098a9 in dump_dir (os=0x80d302000) at /usr/src/cddl/usr.sbin/zdb/../../../cddl/contrib/opensolaris/cmd/zdb/zdb.c:1464 1464 zdb_nicenum(dl->dl_phys->dl_used, bytes); (gdb) p dl No symbol "dl" in current context. (gdb) p *dl No symbol "dl" in current context. I thought for a second that I was using gdb wrong (it's been awhile), but: (gdb) frame 1 #1 0x0000000000406222 in main (argc=0, argv=) at /usr/src/cddl/usr.sbin/zdb/../../../cddl/contrib/opensolaris/cmd/zdb/zdb.c:3604 3604 dump_dir(os); (gdb) p os $3 = (objset_t *) 0x80d302000 ... my first thought was "is the stack trashed"? ... but shouldn't gdb know what 'dl' is regardless of the process state? Then I realized that line 1464 isn't in dump_dir() ... it's in dump_dead() help? From owner-freebsd-hackers@FreeBSD.ORG Fri Nov 21 06:32:47 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 10B7DDB for ; Fri, 21 Nov 2014 06:32:47 +0000 (UTC) Received: from mail-yh0-x233.google.com (mail-yh0-x233.google.com [IPv6:2607:f8b0:4002:c01::233]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id BFD5DD86 for ; Fri, 21 Nov 2014 06:32:46 +0000 (UTC) Received: by mail-yh0-f51.google.com with SMTP id a41so2064905yho.38 for ; Thu, 20 Nov 2014 22:32:46 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=lmvbE7YIC0yRvqhzbhRoO0E+MHG3je1Jln7qnxD6zQo=; b=EHSaqWctDWt0gkc6AeXgQZ87OCVxmYlJ+DS7iZwPFgNuknaTeVLN0WrkOz7DSbKAFY iqlVCvueb/293oV1ZXBMcGCnjLZd3nVbU9Zr+2d0IFtXim4+dOFg16wgiBZXykCHUdNM HInYehbvPRJXTnozPKZKMBGXN2SxSaX87aKQlAuwTWbiekPELKmzDoDYsQXOv5msZsi3 iSms/UVSIhFwQhZRHINgDK5jtbQlGpzzA+dSIek5laLPGFbhtA1Mdl40/6Q0ZW93YQvC jxXz/9p9mYFX8LM64n2yCl10w5+Hdfbx7+euLoRbZqrFoT+Ac3roWRfzKMzdjqYxvIsa Mryw== MIME-Version: 1.0 X-Received: by 10.236.203.114 with SMTP id e78mr1101853yho.47.1416551566007; Thu, 20 Nov 2014 22:32:46 -0800 (PST) Sender: kmacybsd@gmail.com Received: by 10.170.82.197 with HTTP; Thu, 20 Nov 2014 22:32:45 -0800 (PST) In-Reply-To: References: Date: Thu, 20 Nov 2014 22:32:45 -0800 X-Google-Sender-Auth: cs18iFji-jZAQ270NKWQRtBzp8o Message-ID: Subject: Re: Debugging the ZDB debugger. From: "K. Macy" To: Zaphod Beeblebrox Content-Type: text/plain; charset=UTF-8 Cc: FreeBSD Hackers X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Nov 2014 06:32:47 -0000 Clang is very good at minimizing the live range of variables. As of that point in the function dl is no longer needed (by zdb), so if it is still available it will be in a non-callee save register. Whether or not it's still valid is more or less up to chance. You can often infer the value from disassembling and looking at the registers. However, you're not looking at some user's kernel core dump that you can't ask him to reproduce. You can ensure that every variable used, regardless of its liveness, is allocated a location on the stack by compiling with -O0. I believe -O2 is actually set somewhere in the .mk files, so naively you need to set CFLAGS=-O0 and add in explicitly whatever flags it's passed that it needs. I'd be surprised if there isn't a much cleaner way to do it but I'm not familiar with build magic. -K On Thu, Nov 20, 2014 at 10:25 PM, Zaphod Beeblebrox wrote: > Ok... that advice got me somewhere... now my stack is: > > (gdb) bt > #0 0x00000000004098a9 in dump_dir (os=0x80d302000) > at > /usr/src/cddl/usr.sbin/zdb/../../../cddl/contrib/opensolaris/cmd/zdb/zdb.c:1464 > #1 0x0000000000406222 in main (argc=0, argv=) > at > /usr/src/cddl/usr.sbin/zdb/../../../cddl/contrib/opensolaris/cmd/zdb/zdb.c:3604 > > and we got here on a segmentation fault. Now ... I'm a little confused: > > (gdb) frame 0 > #0 0x00000000004098a9 in dump_dir (os=0x80d302000) > at > /usr/src/cddl/usr.sbin/zdb/../../../cddl/contrib/opensolaris/cmd/zdb/zdb.c:1464 > 1464 zdb_nicenum(dl->dl_phys->dl_used, bytes); > (gdb) p dl > No symbol "dl" in current context. > (gdb) p *dl > No symbol "dl" in current context. > > I thought for a second that I was using gdb wrong (it's been awhile), but: > > (gdb) frame 1 > #1 0x0000000000406222 in main (argc=0, argv=) > at > /usr/src/cddl/usr.sbin/zdb/../../../cddl/contrib/opensolaris/cmd/zdb/zdb.c:3604 > 3604 dump_dir(os); > (gdb) p os > $3 = (objset_t *) 0x80d302000 > > ... my first thought was "is the stack trashed"? ... but shouldn't gdb know > what 'dl' is regardless of the process state? > > Then I realized that line 1464 isn't in dump_dir() ... it's in dump_dead() > > help? From owner-freebsd-hackers@FreeBSD.ORG Fri Nov 21 08:12:04 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id D5B15584 for ; Fri, 21 Nov 2014 08:12:04 +0000 (UTC) Received: from mailrelay8.public.one.com (mailrelay8.public.one.com [91.198.169.216]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 2097FA55 for ; Fri, 21 Nov 2014 08:12:03 +0000 (UTC) X-HalOne-Cookie: 477083b8965cf4f7fdcd4beac44cc5a430f087bd DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=cederstrand.dk; s=20140924; h=from:subject:date:message-id:to:cc:mime-version:content-type: content-transfer-encoding:in-reply-to:references; bh=6+SEgozgBROlDHTlOILIqgpwgZ8ByuXjD/blWnHBg7Q=; b=sT869UsLVMDICKgUPwIiNZaRc8JXnszU708jL72sULY2oqH/Iwz5CqDQ6piwe233Cz2YwDvju2mUX IAHkVjMogxcdTuDUmkKJujKsq8zFyY+Wyob9X/FayrRFOAVWJYpJlGAa5QDEl6EYGNnw46OKveOsq1 Itk7zwqoQA5ywI3s= Received: from [192.168.1.58] (unknown [217.157.7.221]) by smtpfilter4.public.one.com (Halon Mail Gateway) with ESMTPSA; Fri, 21 Nov 2014 08:08:04 +0000 (GMT) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 8.1 \(1993\)) Subject: Re: send-pr must live From: Erik Cederstrand In-Reply-To: Date: Fri, 21 Nov 2014 09:10:53 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <37F1EA3C-BAEC-4BC9-8EAD-8C5CC74295BA@cederstrand.dk> References: To: Chris H X-Mailer: Apple Mail (2.1993) Cc: freebsd-hackers@freebsd.org, FreeBSD STABLE , FreeBSD CURRENT X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Nov 2014 08:12:04 -0000 > Den 20/11/2014 kl. 18.07 skrev Chris H : >=20 > Greetings, > While I recognize that send-pr has pretty much > become useless, with the advent of bugzilla, being made > the new "official" FreeBSD bug reporting system. I really > miss send-pr, and was hoping I could revive it, eg; > integrate it with bugzilla. I had even contemplated adding > a feature that would allow it to also work with local > port/system building structures people often use to build, > and maintain FreeBSD. The original send-pr simply send an email to = freebsd-gnats-submit@freebsd.org. I wrote a script some years ago to = parse the contents of that email and import it into Bugzilla using the = Bugzilla XML-RPC API: https://github.com/ecederstrand/send-pr The advantage is that no changes are necessary to the original send-pr = because the script would run on a freebsd.org server. I haven't adapted = it to the Bugzilla that is running now, but it should be fairly easy. = Maybe this could be of use? Erik= From owner-freebsd-hackers@FreeBSD.ORG Fri Nov 21 15:27:40 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 05FB6DEB for ; Fri, 21 Nov 2014 15:27:40 +0000 (UTC) Received: from udns.ultimatedns.net (unknown [IPv6:2602:d1:b4d6:e600:4261:86ff:fef6:aa2a]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D106FE83 for ; Fri, 21 Nov 2014 15:27:39 +0000 (UTC) Received: from ultimatedns.net (localhost [127.0.0.1]) by udns.ultimatedns.net (8.14.9/8.14.9) with ESMTP id sALFSWYJ086881; Fri, 21 Nov 2014 07:28:33 -0800 (PST) (envelope-from bsd-lists@bsdforge.com) To: Erik Cederstrand In-Reply-To: <37F1EA3C-BAEC-4BC9-8EAD-8C5CC74295BA@cederstrand.dk> References: , <37F1EA3C-BAEC-4BC9-8EAD-8C5CC74295BA@cederstrand.dk> From: "Chris H" Subject: Re: send-pr must live Date: Fri, 21 Nov 2014 07:28:33 -0800 Content-Type: text/plain; charset=UTF-8; format=fixed MIME-Version: 1.0 Message-id: Content-Transfer-Encoding: 8bit Cc: freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Nov 2014 15:27:40 -0000 On Fri, 21 Nov 2014 09:10:53 +0100 Erik Cederstrand wrote > > Den 20/11/2014 kl. 18.07 skrev Chris H : > > > > Greetings, > > While I recognize that send-pr has pretty much > > become useless, with the advent of bugzilla, being made > > the new "official" FreeBSD bug reporting system. I really > > miss send-pr, and was hoping I could revive it, eg; > > integrate it with bugzilla. I had even contemplated adding > > a feature that would allow it to also work with local > > port/system building structures people often use to build, > > and maintain FreeBSD. > > The original send-pr simply send an email to > freebsd-gnats-submit@freebsd.org. I wrote a script some years ago to parse > the contents of that email and import it into Bugzilla using the Bugzilla > XML-RPC API: https://github.com/ecederstrand/send-pr > > The advantage is that no changes are necessary to the original send-pr > because the script would run on a freebsd.org server. I haven't adapted it to > the Bugzilla that is running now, but it should be fairly easy. Maybe this > could be of use? Thanks for the reply, Erik. Sounds promising. I'll have a look. --Chris > > Erik From owner-freebsd-hackers@FreeBSD.ORG Fri Nov 21 22:40:42 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 73597815 for ; Fri, 21 Nov 2014 22:40:42 +0000 (UTC) Received: from luigi.brtsvcs.net (luigi.brtsvcs.net [IPv6:2607:fc50:1000:1f00::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4D75F834 for ; Fri, 21 Nov 2014 22:40:42 +0000 (UTC) Received: from chombo.houseloki.net (c-71-59-211-166.hsd1.or.comcast.net [71.59.211.166]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by luigi.brtsvcs.net (Postfix) with ESMTPSA id DF88B2D4FB4; Fri, 21 Nov 2014 22:40:32 +0000 (UTC) Received: from [IPv6:2601:7:2580:674:baca:3aff:fe83:bd29] (ivy.libssl.so [IPv6:2601:7:2580:674:baca:3aff:fe83:bd29]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by chombo.houseloki.net (Postfix) with ESMTPSA id A2F99FDC; Fri, 21 Nov 2014 14:40:30 -0800 (PST) Message-ID: <546FBF60.70506@bluerosetech.com> Date: Fri, 21 Nov 2014 14:40:32 -0800 From: Darren Pilgrim Reply-To: freebsd-hackers@freebsd.org User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: Chris H Subject: Re: send-pr must live References: , <11d24756184c5b6f3339f6e645957f86@ultimatedns.net> In-Reply-To: <11d24756184c5b6f3339f6e645957f86@ultimatedns.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Nov 2014 22:40:42 -0000 On 11/20/2014 10:09 AM, Chris H wrote: > As to it having been shell based. While there's nothing wrong with > that at all, in fact it's advantageous in many respects. I was toying > with the idea of perhaps converting (augmenting) it to being Perl > based, by way of a statically linked mini-perl interpreter. I thought > it would better *empower* it, also providing for a more "user friendly" > dialog. But, like I said; just *toying* with the idea. :) You can use any language you like; but you'll need to use Bourne if you want it in base. From owner-freebsd-hackers@FreeBSD.ORG Fri Nov 21 22:44:34 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 2320DA14 for ; Fri, 21 Nov 2014 22:44:34 +0000 (UTC) Received: from mail-ig0-x22d.google.com (mail-ig0-x22d.google.com [IPv6:2607:f8b0:4001:c05::22d]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id DDBE286B for ; Fri, 21 Nov 2014 22:44:33 +0000 (UTC) Received: by mail-ig0-f173.google.com with SMTP id r2so415352igi.12 for ; Fri, 21 Nov 2014 14:44:33 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=QxErAV1MIoQLp2+hTzLmJvOAdM8ilxDprUIQBgGJ+6Y=; b=jz+269ZtWLp6MpZN5Wj3X4gvI0s0gUir+qMPkdJwUzhKfBXYBGFL5G4XldPQOOq4pc oR2kAasoT2nmBtbrfQiO416zC1bvxwM2ZuB7ojlFg5c/oj2uIyTelwr2VRMcn0yVmDl5 r6UGn8ASM/d2zGYA2HzeIpzmgZuh1kM1Vtxq2DpibpGwUMNQJkEr4nuVE5G5gT3QEmil Nd+gZB2DL9RWz9KyxWQL10KuqS5CGFEgNm9Jtnc7vfAB+DypoznffZKEbY8AMXoGboXQ ytwkr4N7BzDZQmxINOH5LcUXkOyVuoFDH8lvbSTBNRX49mRCFWJ8w+yOunT+fYNUKHxs B9sA== MIME-Version: 1.0 X-Received: by 10.107.8.102 with SMTP id 99mr5693054ioi.83.1416609873433; Fri, 21 Nov 2014 14:44:33 -0800 (PST) Received: by 10.50.42.162 with HTTP; Fri, 21 Nov 2014 14:44:33 -0800 (PST) In-Reply-To: <546FBF60.70506@bluerosetech.com> References: <11d24756184c5b6f3339f6e645957f86@ultimatedns.net> <546FBF60.70506@bluerosetech.com> Date: Fri, 21 Nov 2014 14:44:33 -0800 Message-ID: Subject: Re: send-pr must live From: NGie Cooper To: "freebsd-hackers@freebsd.org" Content-Type: text/plain; charset=UTF-8 Cc: Chris H X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Nov 2014 22:44:34 -0000 On Fri, Nov 21, 2014 at 2:40 PM, Darren Pilgrim wrote: > On 11/20/2014 10:09 AM, Chris H wrote: >> >> As to it having been shell based. While there's nothing wrong with >> that at all, in fact it's advantageous in many respects. I was toying >> with the idea of perhaps converting (augmenting) it to being Perl >> based, by way of a statically linked mini-perl interpreter. I thought >> it would better *empower* it, also providing for a more "user friendly" >> dialog. But, like I said; just *toying* with the idea. :) > > You can use any language you like; but you'll need to use Bourne if you want > it in base. ... or C/C++. From owner-freebsd-hackers@FreeBSD.ORG Fri Nov 21 22:50:58 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id CB02EB83 for ; Fri, 21 Nov 2014 22:50:58 +0000 (UTC) Received: from mo6-p00-ob.smtp.rzone.de (mo6-p00-ob.smtp.rzone.de [IPv6:2a01:238:20a:202:5300::8]) (using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.smtp.rzone.de", Issuer "TeleSec ServerPass DE-2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 639F491E for ; Fri, 21 Nov 2014 22:50:58 +0000 (UTC) X-RZG-AUTH: :JiIXek6mfvEEUpFQdo7Fj1/zg48CFjWjQv0cW+St/nW/auYssSp3lvHv2GCTMw== X-RZG-CLASS-ID: mo00 Received: from britannica.bec.de (ip-2-207-170-18.web.vodafone.de [2.207.170.18]) by smtp.strato.de (RZmta 35.13 DYNA|AUTH) with ESMTPSA id 505c00qALMoR7qZ (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) for ; Fri, 21 Nov 2014 23:50:27 +0100 (CET) Received: by britannica.bec.de (sSMTP sendmail emulation); Fri, 21 Nov 2014 23:50:26 +0100 Date: Fri, 21 Nov 2014 23:50:26 +0100 From: Joerg Sonnenberger To: freebsd-hackers@freebsd.org Subject: Re: send-pr must live Message-ID: <20141121225026.GA27717@britannica.bec.de> Mail-Followup-To: freebsd-hackers@freebsd.org References: <11d24756184c5b6f3339f6e645957f86@ultimatedns.net> <546FBF60.70506@bluerosetech.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Nov 2014 22:50:58 -0000 On Fri, Nov 21, 2014 at 02:44:33PM -0800, NGie Cooper wrote: > On Fri, Nov 21, 2014 at 2:40 PM, Darren Pilgrim > wrote: > > On 11/20/2014 10:09 AM, Chris H wrote: > >> > >> As to it having been shell based. While there's nothing wrong with > >> that at all, in fact it's advantageous in many respects. I was toying > >> with the idea of perhaps converting (augmenting) it to being Perl > >> based, by way of a statically linked mini-perl interpreter. I thought > >> it would better *empower* it, also providing for a more "user friendly" > >> dialog. But, like I said; just *toying* with the idea. :) > > > > You can use any language you like; but you'll need to use Bourne if you want > > it in base. > > ... or C/C++. awk? sed? Joerg From owner-freebsd-hackers@FreeBSD.ORG Fri Nov 21 22:58:09 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 06654F8F for ; Fri, 21 Nov 2014 22:58:09 +0000 (UTC) Received: from luigi.brtsvcs.net (luigi.brtsvcs.net [204.109.60.246]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D1BC2993 for ; Fri, 21 Nov 2014 22:58:08 +0000 (UTC) Received: from chombo.houseloki.net (c-71-59-211-166.hsd1.or.comcast.net [71.59.211.166]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by luigi.brtsvcs.net (Postfix) with ESMTPSA id 3EB962D4FB4; Fri, 21 Nov 2014 22:58:07 +0000 (UTC) Received: from [IPv6:2601:7:2580:674:baca:3aff:fe83:bd29] (ivy.libssl.so [IPv6:2601:7:2580:674:baca:3aff:fe83:bd29]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by chombo.houseloki.net (Postfix) with ESMTPSA id B586EFEB; Fri, 21 Nov 2014 14:58:05 -0800 (PST) Message-ID: <546FC37F.3000109@bluerosetech.com> Date: Fri, 21 Nov 2014 14:58:07 -0800 From: Darren Pilgrim Reply-To: "freebsd-hackers@freebsd.org" User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: NGie Cooper , "freebsd-hackers@freebsd.org" Subject: Re: send-pr must live References: <11d24756184c5b6f3339f6e645957f86@ultimatedns.net> <546FBF60.70506@bluerosetech.com> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Nov 2014 22:58:09 -0000 On 11/21/2014 2:44 PM, NGie Cooper wrote: > On Fri, Nov 21, 2014 at 2:40 PM, Darren Pilgrim > wrote: >> On 11/20/2014 10:09 AM, Chris H wrote: >>> >>> As to it having been shell based. While there's nothing wrong with >>> that at all, in fact it's advantageous in many respects. I was toying >>> with the idea of perhaps converting (augmenting) it to being Perl >>> based, by way of a statically linked mini-perl interpreter. I thought >>> it would better *empower* it, also providing for a more "user friendly" >>> dialog. But, like I said; just *toying* with the idea. :) >> >> You can use any language you like; but you'll need to use Bourne if you want >> it in base. > > ... or C/C++. That's given, but I thought we were talking about scripting languages. From owner-freebsd-hackers@FreeBSD.ORG Fri Nov 21 23:00:43 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 0621F138 for ; Fri, 21 Nov 2014 23:00:43 +0000 (UTC) Received: from udns.ultimatedns.net (unknown [IPv6:2602:d1:b4d6:e600:4261:86ff:fef6:aa2a]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D005FA35 for ; Fri, 21 Nov 2014 23:00:42 +0000 (UTC) Received: from ultimatedns.net (localhost [127.0.0.1]) by udns.ultimatedns.net (8.14.9/8.14.9) with ESMTP id sALN1f0A014108; Fri, 21 Nov 2014 15:01:41 -0800 (PST) (envelope-from bsd-lists@bsdforge.com) To: Darren Pilgrim In-Reply-To: <546FBF60.70506@bluerosetech.com> References: , <11d24756184c5b6f3339f6e645957f86@ultimatedns.net>, <546FBF60.70506@bluerosetech.com> From: "Chris H" Subject: Re: send-pr must live Date: Fri, 21 Nov 2014 15:01:41 -0800 Content-Type: text/plain; charset=UTF-8; format=fixed MIME-Version: 1.0 Message-id: Content-Transfer-Encoding: 8bit Cc: freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Nov 2014 23:00:43 -0000 On Fri, 21 Nov 2014 14:40:32 -0800 Darren Pilgrim wrote > On 11/20/2014 10:09 AM, Chris H wrote: > > As to it having been shell based. While there's nothing wrong with > > that at all, in fact it's advantageous in many respects. I was toying > > with the idea of perhaps converting (augmenting) it to being Perl > > based, by way of a statically linked mini-perl interpreter. I thought > > it would better *empower* it, also providing for a more "user friendly" > > dialog. But, like I said; just *toying* with the idea. :) > > You can use any language you like; but you'll need to use Bourne if you > want it in base. I'm *quite* happy with that. I have no reason to want to unnecessarily burden anyone on a freshish install, with *having* to have something other than that already provided in base. :) Thanks for the reply, Darren. I see no reason I shouldn't have something fit for review by the end of the weekend. --Chris From owner-freebsd-hackers@FreeBSD.ORG Fri Nov 21 23:04:33 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id D6CC546C for ; Fri, 21 Nov 2014 23:04:33 +0000 (UTC) Received: from udns.ultimatedns.net (unknown [IPv6:2602:d1:b4d6:e600:4261:86ff:fef6:aa2a]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 99F67A5E for ; Fri, 21 Nov 2014 23:04:33 +0000 (UTC) Received: from ultimatedns.net (localhost [127.0.0.1]) by udns.ultimatedns.net (8.14.9/8.14.9) with ESMTP id sALN5XZ4015280; Fri, 21 Nov 2014 15:05:33 -0800 (PST) (envelope-from bsd-lists@bsdforge.com) To: NGie Cooper , "freebsd-hackers@freebsd.org" , Darren Pilgrim In-Reply-To: <546FC37F.3000109@bluerosetech.com> References: <11d24756184c5b6f3339f6e645957f86@ultimatedns.net> <546FBF60.70506@bluerosetech.com> , <546FC37F.3000109@bluerosetech.com> From: "Chris H" Subject: Re: send-pr must live Date: Fri, 21 Nov 2014 15:05:33 -0800 Content-Type: text/plain; charset=UTF-8; format=fixed MIME-Version: 1.0 Message-id: Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Nov 2014 23:04:33 -0000 On Fri, 21 Nov 2014 14:58:07 -0800 Darren Pilgrim wrote > On 11/21/2014 2:44 PM, NGie Cooper wrote: > > On Fri, Nov 21, 2014 at 2:40 PM, Darren Pilgrim > > wrote: > >> On 11/20/2014 10:09 AM, Chris H wrote: > >>> > >>> As to it having been shell based. While there's nothing wrong with > >>> that at all, in fact it's advantageous in many respects. I was toying > >>> with the idea of perhaps converting (augmenting) it to being Perl > >>> based, by way of a statically linked mini-perl interpreter. I thought > >>> it would better *empower* it, also providing for a more "user friendly" > >>> dialog. But, like I said; just *toying* with the idea. :) > >> > >> You can use any language you like; but you'll need to use Bourne if you > >> want it in base. > > > > ... or C/C++. > > That's given, but I thought we were talking about scripting languages. So did I. In the end, I think it (scripting) is a great deal more flexible, and is far quicker to ferret issues out of. :) --Chris > > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" From owner-freebsd-hackers@FreeBSD.ORG Sat Nov 22 01:02:49 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4CEE42B0 for ; Sat, 22 Nov 2014 01:02:49 +0000 (UTC) Received: from mho-01-ewr.mailhop.org (mho-03-ewr.mailhop.org [204.13.248.66]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 216C977E for ; Sat, 22 Nov 2014 01:02:48 +0000 (UTC) Received: from [73.34.117.227] (helo=ilsoft.org) by mho-01-ewr.mailhop.org with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.72) (envelope-from ) id 1Xrz61-000MED-Vk; Sat, 22 Nov 2014 01:02:42 +0000 Received: from [172.22.42.240] (revolution.hippie.lan [172.22.42.240]) by ilsoft.org (8.14.9/8.14.9) with ESMTP id sAM12fuj004842; Fri, 21 Nov 2014 18:02:41 -0700 (MST) (envelope-from ian@FreeBSD.org) X-Mail-Handler: Dyn Standard SMTP by Dyn X-Originating-IP: 73.34.117.227 X-Report-Abuse-To: abuse@dyndns.com (see http://www.dyndns.com/services/sendlabs/outbound_abuse.html for abuse reporting information) X-MHO-User: U2FsdGVkX19V1RO7qYE1MQ85SBN876x8 X-Authentication-Warning: paranoia.hippie.lan: Host revolution.hippie.lan [172.22.42.240] claimed to be [172.22.42.240] Subject: Re: Running 8 building 10 gives "Out of file descriptors" ? From: Ian Lepore To: Dieter BSD In-Reply-To: References: Content-Type: text/plain; charset="us-ascii" Date: Fri, 21 Nov 2014 18:02:40 -0700 Message-ID: <1416618160.1147.318.camel@revolution.hippie.lan> Mime-Version: 1.0 X-Mailer: Evolution 2.32.1 FreeBSD GNOME Team Port Content-Transfer-Encoding: 7bit Cc: freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Nov 2014 01:02:49 -0000 On Tue, 2014-11-18 at 12:08 -0800, Dieter BSD wrote: > amd64 running 8.2 > Attempting to update to 10.1 > Need to build custom 10.1 kernel on machine running 8.2. > Installed binaries and src off to the side. > Attempts to compile kernel directly failed. > Attempts to build 10.1 "make" as 8.2 binary failed. > Chroot to 10.1 tree. > Attempt to build kernel (using stock GENERIC config file and stock sources > for now) failed: > > >>> stage 3.1: making dependencies > -------------------------------------------------------------- [...] > Out of file descriptors > *** Error code 2 I'm circling all the way back to the beginning on this problem. I was looking into whether we could easily fix /bin/sh or whether we should just warn that you can't bootstrap from systems earlier than 8.4. What I discovered along the way is that /bin/sh isn't a build tool and thus isn't a blocker to bootstrapping from 8.2. That is, the build system doesn't first build a newer sh, then use it for the rest of the build. You created the /bin/sh problem by running a 10.1 world in a chroot on an 8.2 kernel. I overlooked that fact when I first read this. So the real question would be why you failed to build a 10.1 kernel on an 8.2 machine, and there is no detail in your original report about how or why that happened. -- Ian From owner-freebsd-hackers@FreeBSD.ORG Sat Nov 22 02:11:00 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id DC25D65B; Sat, 22 Nov 2014 02:11:00 +0000 (UTC) Received: from mail-oi0-x234.google.com (mail-oi0-x234.google.com [IPv6:2607:f8b0:4003:c06::234]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B54ACD16; Sat, 22 Nov 2014 02:11:00 +0000 (UTC) Received: by mail-oi0-f52.google.com with SMTP id h136so4563189oig.11 for ; Fri, 21 Nov 2014 18:10:59 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:cc:content-type; bh=vThTqSN47ykrPKb8khy/DjC0qq8YXytQPZu+kTJJ4qA=; b=BvxZQ9E/N1MWL+10dtFSl/vn8yJ/I1S5jbURj+jdE4++PmxR3gJKfbrFka1Oc7OPHs GkTMjNhU9/ZbTZo4IyPT+y3xEWvow++Fl/53R5IOaGZRh6VHzsve/f+DBdNqZmj7w8Iz qVQkGRTmphSCvAA+bdd8/eXkNHxlaudqNtQs12G4QICIfqx5mOrQcflngGHb35kYs5xO gkOrNPKZMtqS6RQZjJw7Df7Az6gIDz4/nrL/dmV36Ku0iYXLIuS4cDIeBqvXSFsLXUh3 7PhTmikAQ6+2EHdpHpJaXMFE32SALoy9oR0yqxvrKK5HlzWGWFWNod9IV+p1r3QnvlYi 3XNQ== MIME-Version: 1.0 X-Received: by 10.60.94.167 with SMTP id dd7mr5109973oeb.35.1416622259824; Fri, 21 Nov 2014 18:10:59 -0800 (PST) Received: by 10.76.0.138 with HTTP; Fri, 21 Nov 2014 18:10:59 -0800 (PST) Date: Fri, 21 Nov 2014 21:10:59 -0500 Message-ID: Subject: Re: [patch] Debugging the ZDB debugger. From: Zaphod Beeblebrox To: "K. Macy" Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: FreeBSD Hackers X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Nov 2014 02:11:01 -0000 Obviously I don't know the ramifications here, but this patch fixes things. If you don't want to read it, the jist is that dl_phys is null and this function would like to dereference it. Now my next question is: how badly damaged is the zfs filesystem that causes this? From looking in from the outside, it works find save claming to have two files with errors. (in case everyone needs catching up, -dd works -ddd or -dddd crashes without this patch) Index: cddl/contrib/opensolaris/cmd/zdb/zdb.c =================================================================== --- cddl/contrib/opensolaris/cmd/zdb/zdb.c (revision 274527) +++ cddl/contrib/opensolaris/cmd/zdb/zdb.c (working copy) @@ -1461,11 +1461,15 @@ if (dump_opt['d'] < 3) return; - zdb_nicenum(dl->dl_phys->dl_used, bytes); - zdb_nicenum(dl->dl_phys->dl_comp, comp); - zdb_nicenum(dl->dl_phys->dl_uncomp, uncomp); - (void) printf("\n Deadlist: %s (%s/%s comp)\n", - bytes, comp, uncomp); + if(dl->dl_phys) { + zdb_nicenum(dl->dl_phys->dl_used, bytes); + zdb_nicenum(dl->dl_phys->dl_comp, comp); + zdb_nicenum(dl->dl_phys->dl_uncomp, uncomp); + (void) printf("\n Deadlist: %s (%s/%s comp)\n", + bytes, comp, uncomp); + } else { + (void) printf("\n Deadlist: __really_dead__\n"); + } if (dump_opt['d'] < 4) return; From owner-freebsd-hackers@FreeBSD.ORG Sat Nov 22 03:14:18 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 41D84173 for ; Sat, 22 Nov 2014 03:14:18 +0000 (UTC) Received: from mail-ie0-x232.google.com (mail-ie0-x232.google.com [IPv6:2607:f8b0:4001:c03::232]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0D4A63B1 for ; Sat, 22 Nov 2014 03:14:18 +0000 (UTC) Received: by mail-ie0-f178.google.com with SMTP id tp5so6165748ieb.37 for ; Fri, 21 Nov 2014 19:14:17 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=LKXlyKkYpskYV+1+vJ3gABuPo5IyhatrAyL+Ik/yq7g=; b=oyDYFuOGCGMRvjaAq/6cckaVk7jjspTjjZCXXwteSvSlImPPKXlbQOWnYakvYTww/C 83zpaDDq04lqxP0JKbM2PfcsE4c1SOytosuni+LVBQXQCLd7GgqOGJBbCHvhXAcPAuZN Tj9IddhLHy+E4uCgXeSk/bwPkFzWDdK4FSODfU6p9WueujyljDsYQMluYMGagybbov+Q AtxEhsCt09Ir7b1Sb5PfO47AkyukH8cXqtJ2rxYaappv5rzUe+J2cnxHCRuxiRLw4RkW pMnZYDnDQ83u7nB+RBmkZv6uBjAccj1XpiwgokoP+YcYnxcFKMwOaYrDEmOyXYeIr4s2 lG+Q== MIME-Version: 1.0 X-Received: by 10.43.66.9 with SMTP id xo9mr8568922icb.67.1416626057396; Fri, 21 Nov 2014 19:14:17 -0800 (PST) Received: by 10.64.147.164 with HTTP; Fri, 21 Nov 2014 19:14:17 -0800 (PST) Date: Fri, 21 Nov 2014 19:14:17 -0800 Message-ID: Subject: Re: Running 8 building 10 success (I think?) From: Dieter BSD To: freebsd-hackers@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Nov 2014 03:14:18 -0000 > I was looking into whether we could easily fix /bin/sh /bin/sh's error message is badly broken and needs to be fixed. I previously posted a short list of things that should be improved. A high school student that knows C should be able to do it. Since there is one brain-dead error message there are likely more, so bonus points for looking through the source and fixing those as well. The F_DUPFD_CLOEXEC problem is unfortunate, but it is already released. And there is an easy workaround: just mv /bin/sh /bin/sh_10.1 and then copy 8.2's /bin/sh to the chroot. > or whether we should > just warn that you can't bootstrap from systems earlier than 8.4. Looks like you can, actually. Make a chroot with 10.1 binaries and sources. Add /dev/null replace 10.1's /bin/sh with 8.2's /bin/sh Add /etc/make.conf containing WITHOUT_CTF=true edit GENERIC, commenting out "makeoptions WITH_CTF=1" chroot cd /usr/src make buildkernel KERNCONF=GENERIC I haven't testing doing these steps and nothing else, so the list might be missing something. From owner-freebsd-hackers@FreeBSD.ORG Sat Nov 22 03:28:41 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 00FF361F for ; Sat, 22 Nov 2014 03:28:40 +0000 (UTC) Received: from mho-01-ewr.mailhop.org (mho-03-ewr.mailhop.org [204.13.248.66]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id CA274698 for ; Sat, 22 Nov 2014 03:28:40 +0000 (UTC) Received: from [73.34.117.227] (helo=ilsoft.org) by mho-01-ewr.mailhop.org with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.72) (envelope-from ) id 1Xs1NH-0006IK-NH; Sat, 22 Nov 2014 03:28:39 +0000 Received: from [172.22.42.240] (revolution.hippie.lan [172.22.42.240]) by ilsoft.org (8.14.9/8.14.9) with ESMTP id sAM3ScFk005042; Fri, 21 Nov 2014 20:28:38 -0700 (MST) (envelope-from ian@FreeBSD.org) X-Mail-Handler: Dyn Standard SMTP by Dyn X-Originating-IP: 73.34.117.227 X-Report-Abuse-To: abuse@dyndns.com (see http://www.dyndns.com/services/sendlabs/outbound_abuse.html for abuse reporting information) X-MHO-User: U2FsdGVkX1/v5aYBgHe/kOOLOBdxjuBw X-Authentication-Warning: paranoia.hippie.lan: Host revolution.hippie.lan [172.22.42.240] claimed to be [172.22.42.240] Subject: Re: Running 8 building 10 success (I think?) From: Ian Lepore To: Dieter BSD In-Reply-To: References: Content-Type: text/plain; charset="us-ascii" Date: Fri, 21 Nov 2014 20:28:38 -0700 Message-ID: <1416626918.1147.327.camel@revolution.hippie.lan> Mime-Version: 1.0 X-Mailer: Evolution 2.32.1 FreeBSD GNOME Team Port Content-Transfer-Encoding: 7bit Cc: freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Nov 2014 03:28:41 -0000 On Fri, 2014-11-21 at 19:14 -0800, Dieter BSD wrote: > > I was looking into whether we could easily fix /bin/sh > > /bin/sh's error message is badly broken and needs to be fixed. > I previously posted a short list of things that should be > improved. A high school student that knows C should be able to do it. > Since there is one brain-dead error message there are likely more, > so bonus points for looking through the source and fixing those as well. > > The F_DUPFD_CLOEXEC problem is unfortunate, but it is already released. > And there is an easy workaround: just mv /bin/sh /bin/sh_10.1 and > then copy 8.2's /bin/sh to the chroot. > > > or whether we should > > just warn that you can't bootstrap from systems earlier than 8.4. > > Looks like you can, actually. > > Make a chroot with 10.1 binaries and sources. > Add /dev/null > replace 10.1's /bin/sh with 8.2's /bin/sh > Add /etc/make.conf containing WITHOUT_CTF=true > edit GENERIC, commenting out "makeoptions WITH_CTF=1" > chroot > cd /usr/src > make buildkernel KERNCONF=GENERIC > > I haven't testing doing these steps and nothing else, so the list > might be missing something. Well, since you've supplied plenty of sarcasm but once again no actual information about what problem you ran into trying to build from sources the right way, without crazy hackery like runing a 10.1 chroot on an 8.2 kernel, I guess I"m done with this. -- Ian From owner-freebsd-hackers@FreeBSD.ORG Sat Nov 22 07:30:03 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id EEF7A510 for ; Sat, 22 Nov 2014 07:30:03 +0000 (UTC) Received: from mail-ig0-x22a.google.com (mail-ig0-x22a.google.com [IPv6:2607:f8b0:4001:c05::22a]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id BA93DD70 for ; Sat, 22 Nov 2014 07:30:03 +0000 (UTC) Received: by mail-ig0-f170.google.com with SMTP id r2so2746592igi.5 for ; Fri, 21 Nov 2014 23:30:03 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=/+AfKNMd2/UZfuJRpXYxhNyScWrLhKkf907XG+BeDHs=; b=rEM0biRHjO5zYjliro3NwDJ7ZIpxVi65jK824KvVq2AOFkTZVIRdTQkgPGQ7iWUUa2 8HvWqxDFumxaxtvyPH2iCqi1Kcg8rYROhTro1SAjuCYkWuzT+icIkEBVghtKhJwKsFWK CWD88Y6zil7pIwBKG/AZZktRdgI1Nr/yjt1A4qQcVy2ZNhnULY68rGoAB93/9caAdtQC fj9eAhGhZKTXLzGhhUQ/TVn8ytpFlsuFIYsbWkwrhMAoXRqy+FBO0ghYisHK4oU1H/Yz yW/ChcCHXrHT2jYQ4C4M/L1BovyGdsNckcfYhfYTR8c5FnolrhAS/P86s7YZh8xUx6jq YtCA== MIME-Version: 1.0 X-Received: by 10.50.164.226 with SMTP id yt2mr2065258igb.22.1416641403037; Fri, 21 Nov 2014 23:30:03 -0800 (PST) Received: by 10.64.147.164 with HTTP; Fri, 21 Nov 2014 23:30:02 -0800 (PST) Date: Fri, 21 Nov 2014 23:30:02 -0800 Message-ID: Subject: Re: Running 8 building 10 success (I think?) From: Dieter BSD To: freebsd-hackers@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Nov 2014 07:30:04 -0000 > Well, since you've supplied plenty of sarcasm but once again no actual > information about what problem you ran into trying to build from sources > the right way, without crazy hackery like runing a 10.1 chroot on an 8.2 > kernel, I guess I"m done with this. Sorry, my sarcasm detector must be broken today. What do you consider the right way? I tried building a kernel without doing chroot, using 8.2's toolchain. 8.2's config failed. Built 10.1 config. CC='cc ' mkdep -f .depend -a -nostdinc -DAHC_REG_PRETTY_PRINT=1 -D_KERNEL -DKLD_MODULE -DHAVE_KERNEL_OPTION_HEADERS -I. -I@ -I@/contrib/altq -I/ro/freebsd_10.1/obj/ro/freebsd_10.1/usr/src/sys/GENERIC -std=iso9899:1999 aic7xxx_reg_print.c /ro/freebsd_10.1/usr/src/sys/modules/aic7xxx/ahc/../../../dev/aic7xxx/aic7xxx.c /ro/freebsd_10.1/usr/src/sys/modules/aic7xxx/ahc/../../../dev/aic7xxx/aic7xxx_93cx6.c /ro/freebsd_10.1/usr/src/sys/modules/aic7xxx/ahc/../../../dev/aic7xxx/aic7xxx_osm.c /ro/freebsd_10.1/usr/src/sys/modules/aic7xxx/ahc/../../../dev/aic7xxx/aic7770.c cc: aic7xxx_reg_print.c: No such file or directory mkdep: compile failed The file is there, no idea why cc couldn't find it. -rw-r--r-- 1 root wheel 10398 Nov 11 12:03 /ro/freebsd_10.1/usr/src/sys/modules/aic7xxx/ahc/../../../dev/aic7xxx/aic7770.c mkdep hasn't changed, except for comments (so it "can't" be mkdep's fault) Tried to build 10.1 make, but got tangled up in header file hell. Attempts to build the toolchain or kernel after running chroot both gave the incorrect "Out of file descriptors" error message. Is this the info you are looking for? Thank you again for finding that the error message was from sh, and also for the WITHOUT_CTF bit. Those two pieces of info were very helpful. From owner-freebsd-hackers@FreeBSD.ORG Sat Nov 22 22:15:46 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id C91A5626 for ; Sat, 22 Nov 2014 22:15:46 +0000 (UTC) Received: from ox.tedunangst.com (ox.tedunangst.com [208.82.130.146]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 65030B88 for ; Sat, 22 Nov 2014 22:15:45 +0000 (UTC) Received: from localhost.localdomain (localhost [127.0.0.1]); by ox.tedunangst.com (OpenSMTPD) with ESMTP id 5e290dae; for ; Sat, 22 Nov 2014 17:09:23 -0500 (EST) Date: Sat, 22 Nov 2014 17:09:04 -0500 From: Ted Unangst To: freebsd-hackers@freebsd.org Message-ID: <6a4308e3ce1d4835be5caef3f96b0c50@tedunangst.com> Subject: fix base64.c "overrun" Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Mailman-Approved-At: Sat, 22 Nov 2014 23:18:31 +0000 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Nov 2014 22:15:46 -0000 >From inspection, it appears FreeBSD's libc base64.c will sometimes erroneously fail to decode a base64 string into a precisely sized buffer. The overflow check is a little too greedy. The same bug was fixed in OpenBSD; it would be helpful if FreeBSD adopted the fix as well. :) http://cvsweb.openbsd.org/cgi-bin/cvsweb/src/lib/libc/net/base64.c.diff?r1=1.6&r2=1.7