From owner-freebsd-hackers@FreeBSD.ORG Mon Sep 2 08:49:39 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id D212FC1E; Mon, 2 Sep 2013 08:49:39 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-bk0-x22b.google.com (mail-bk0-x22b.google.com [IPv6:2a00:1450:4008:c01::22b]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id D14CA283A; Mon, 2 Sep 2013 08:49:38 +0000 (UTC) Received: by mail-bk0-f43.google.com with SMTP id mz13so1423112bkb.16 for ; Mon, 02 Sep 2013 01:49:37 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:message-id:date:from:user-agent:mime-version:to:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=2NdJTP8xy/tghqvhT0eqh0KJKUr9tGy7D+crGKM1GIY=; b=dKSlxcmStpiRbVyDOmmOlKsD6ruXFiUKuXOJqnBTxRrBK3pUDKyYHW0OncjxVyavQE ymt70Y5gpagtjMNX2k0bD8zdteYVASadji67T46/14NnA7LZjzBS1HJdWin8BKTnrZOv qANR7zVGc+q1uBxDGohlm5OAt2V5VMTuCEqZVuP5/CILpislCQwEvRmVT6ZwNsCbzgGh wSdA5WRfuSSVEJ+OL8DilROTVVxA9HZ8zqqrtGz74YoAx8d4Fo1U1WtUXPo3H6oi1dFP N7ImHW63gKhaOXr22ie4ttVcGxNDdNLhqO/aeHzbfss57P8SCzlU4IffaTOZjlEYaw7D eCtw== X-Received: by 10.204.199.132 with SMTP id es4mr623140bkb.28.1378111776996; Mon, 02 Sep 2013 01:49:36 -0700 (PDT) Received: from mavbook.mavhome.dp.ua ([37.229.21.195]) by mx.google.com with ESMTPSA id jt14sm1918024bkb.0.1969.12.31.16.00.00 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Mon, 02 Sep 2013 01:49:36 -0700 (PDT) Sender: Alexander Motin Message-ID: <5224511D.4090503@FreeBSD.org> Date: Mon, 02 Sep 2013 11:49:33 +0300 From: Alexander Motin User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130616 Thunderbird/17.0.6 MIME-Version: 1.0 To: FreeBSD SCSI , freebsd-hackers@FreeBSD.org, freebsd-geom@FreeBSD.org, "freebsd-current@freebsd.org" Subject: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking References: <520D4ADB.50209@FreeBSD.org> In-Reply-To: <520D4ADB.50209@FreeBSD.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 02 Sep 2013 08:49:39 -0000 Hi. I would like to invite more people to review and test my patches for improving CAM and GEOM scalability, that for last six months you could see developing in project/camlock SVN branch. Full diff of that branch against present head (r255131) can be found here: http://people.freebsd.org/~mav/camlock_patches/camlock_20130902.patch Heavy CAM changes there were focused on reducing scope of SIM lock to only protecting SIM internals, but not CAM core. That allows many times reduce lock congestion, especially on heavily parallel request submission with GEOM changes below. More detailed description of changes you could see here earlier: http://docs.freebsd.org/cgi/mid.cgi?520D4ADB.50209 GEOM changes were focused on avoiding switching to GEOM up/down threads in relatively simple setups where respective classes don't require it (and were explicitly marked so). That allows save on context switches and on systems with several HBAs and disks talk to them concurrently (that is where CAM locking changes are handy). Such classes were modified to support it: DEV, DISK, LABEL, MULTIPATH, NOP, PART, RAID (partially), STRIPE, ZERO, VFS, ZFS::VDEV, ZFS::ZVOL and some others. Requests to/from other classes will be queued to GEOM threads same as before. Together that allows to double block subsystem performance on high (at least 100-200K) IOPS benchmarks, allowing to reach up to a million total IOPS, while keeping full compatibility with all major ABIs/KBIs. Since we are already in 10.0 release process and changes are quite big, my plan is to wait and commit them to head branch after the freeze end, and then merge to stable/10. I hope the release process will go on schedule to not delay this work for another six months. This work is sponsored by iXsystems, Inc. -- Alexander Motin From owner-freebsd-hackers@FreeBSD.ORG Mon Sep 2 19:59:58 2013 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id E5C45DF3 for ; Mon, 2 Sep 2013 19:59:58 +0000 (UTC) (envelope-from yuri@rawbw.com) Received: from shell0.rawbw.com (shell0.rawbw.com [198.144.192.45]) by mx1.freebsd.org (Postfix) with ESMTP id B770F2ECB for ; Mon, 2 Sep 2013 19:59:58 +0000 (UTC) Received: from eagle.yuri.org (stunnel@localhost [127.0.0.1]) (authenticated bits=0) by shell0.rawbw.com (8.14.4/8.14.4) with ESMTP id r82Jxvad060297 for ; Mon, 2 Sep 2013 12:59:57 -0700 (PDT) (envelope-from yuri@rawbw.com) Message-ID: <5224EE3D.10303@rawbw.com> Date: Mon, 02 Sep 2013 12:59:57 -0700 From: Yuri User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130822 Thunderbird/17.0.8 MIME-Version: 1.0 To: FreeBSD Hackers Subject: kgdb 'next' command crashes kernel during inter-VM kernel debugging Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 02 Sep 2013 19:59:59 -0000 I am trying to debug kernel in one VBox VM from another VBox VM using this howto: http://census-labs.com/news/2009/01/19/freebsd-kernel-debugging with the exception that on the target VM hint.uart.0.flags="0x90" is set instead. It works, stops at breakpoints, etc. However, kgdb command "n" (next) causes target to reboot. Device /dev/cuau0 is used for the serial port. On the host it goes through the local socket /tmp/com_1 All with FreeBSD 10 (trunk) amd64, virtualbox 4.2.16 Yuri From owner-freebsd-hackers@FreeBSD.ORG Tue Sep 3 12:14:36 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 0985036C; Tue, 3 Sep 2013 12:14:36 +0000 (UTC) (envelope-from mailist@yandex.com) Received: from forward14.mail.yandex.net (forward14.mail.yandex.net [IPv6:2a02:6b8:0:801::4]) by mx1.freebsd.org (Postfix) with ESMTP id 8896A20BF; Tue, 3 Sep 2013 12:14:35 +0000 (UTC) Received: from web15j.yandex.ru (web15j.yandex.ru [5.45.198.56]) by forward14.mail.yandex.net (Yandex) with ESMTP id 47D781981EA5; Tue, 3 Sep 2013 16:14:23 +0400 (MSK) Received: from 127.0.0.1 (localhost [127.0.0.1]) by web15j.yandex.ru (Yandex) with ESMTP id E04FF1C41018; Tue, 3 Sep 2013 16:14:22 +0400 (MSK) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yandex.com; s=mail; t=1378210463; bh=2qMpzlU/lwTd4yCvkTjhW5BhLvp2sP/ax7ftOZVwg1U=; h=From:To:Subject:Date; b=gEFah+9MmPpNYfVX705WxVpiTFNMCBg6QmvZn+x3d/xtaiCUkXRrU3bsqlFGya4ws MgfpJIdrlFM8Xbow9ycVYSaHAjXlH9Y4Dx642y8YDqu5n9AWJVsEVWQG5BBZmn7YT4 dHWl1sICrWR19+DHsp6KrQX0KHpI0sMZ/xzAqkbE= Received: from 78.161.188.194.dynamic.ttnet.com.tr (78.161.188.194.dynamic.ttnet.com.tr [78.161.188.194]) by web15j.yandex.ru with HTTP; Tue, 03 Sep 2013 16:14:22 +0400 From: =?utf-8?B?RW1yZSDDh2FtYWxhbg==?= Envelope-From: mailist@yandex.com.tr To: freebsd-hackers@freebsd.org, FreeBSD quest Subject: Zfs encryption property for freebsd 8.3 MIME-Version: 1.0 Message-Id: <226721378210462@web15j.yandex.ru> X-Mailer: Yamail [ http://yandex.ru ] 5.0 Date: Tue, 03 Sep 2013 15:14:22 +0300 Content-Transfer-Encoding: 7bit Content-Type: text/plain X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Sep 2013 12:14:36 -0000 Hi, I want to encrypt some disk on my server with Zfs encryption property but it is not available. Are there anybody have got an experience about this? [url]http://docs.oracle.com/cd/E23824_01/html/821-1448/gkkih.html#scrolltoc[/url] [url]http://www.oracle.com/technetwork/articles/servers-storage-admin/manage-zfs-encryption-1715034.html[/url] These are good explanations but I got an error and output shows all property; ---------------------------------------------------- [root@HP ~]# zpool status pool: output state: ONLINE scan: none requested config: NAME STATE READ WRITE CKSUM output ONLINE 0 0 0 ad0s1e ONLINE 0 0 0 errors: No known data errors [root@HP ~]# zfs create -o encryption=on output/home cannot create 'output/home': invalid property 'encryption' [root@HP ~]# zfs get encryption bad property list: invalid property 'encryption' usage: get [-rHp] [-d max] [-o "all" | field[,...]] [-t type[,...]] [-s source[,...]] <"all" | property[,...]> [filesystem|volume|snapshot] ... The following properties are supported: PROPERTY EDIT INHERIT VALUES available NO NO clones NO NO [,...] compressratio NO NO <1.00x or higher if compressed> creation NO NO defer_destroy NO NO yes | no mounted NO NO yes | no origin NO NO refcompressratio NO NO <1.00x or higher if compressed> referenced NO NO type NO NO filesystem | volume | snapshot used NO NO usedbychildren NO NO usedbydataset NO NO usedbyrefreservation NO NO usedbysnapshots NO NO userrefs NO NO written NO NO aclinherit YES YES discard | noallow | restricted | passthrough | passthrough-x aclmode YES YES discard | groupmask | passthrough | restricted atime YES YES on | off canmount YES NO on | off | noauto casesensitivity NO YES sensitive | insensitive | mixed checksum YES YES on | off | fletcher2 | fletcher4 | sha256 compression YES YES on | off | lzjb | gzip | gzip-[1-9] | zle copies YES YES 1 | 2 | 3 dedup YES YES on | off | verify | sha256[,verify] devices YES YES on | off exec YES YES on | off jailed YES YES on | off logbias YES YES latency | throughput mlslabel YES YES mountpoint YES YES | legacy | none nbmand YES YES on | off normalization NO YES none | formC | formD | formKC | formKD primarycache YES YES all | none | metadata quota YES NO | none readonly YES YES on | off recordsize YES YES 512 to 128k, power of 2 refquota YES NO | none refreservation YES NO | none reservation YES NO | none secondarycache YES YES all | none | metadata setuid YES YES on | off sharenfs YES YES on | off | share(1M) options sharesmb YES YES on | off | sharemgr(1M) options snapdir YES YES hidden | visible sync YES YES standard | always | disabled utf8only NO YES on | off version YES NO 1 | 2 | 3 | 4 | 5 | current volblocksize NO YES 512 to 128k, power of 2 volsize YES NO vscan YES YES on | off xattr YES YES on | off userused@... NO NO groupused@... NO NO userquota@... YES NO | none groupquota@... YES NO | none written@ NO NO Sizes are specified in bytes with standard units such as K, M, G, etc. User-defined properties can be specified by using a name containing a colon (:). The {user|group}{used|quota}@ properties must be appended with a user or group specifier of one of these forms: POSIX name (eg: "matt") POSIX id (eg: "126829") SMB name@domain (eg: "matt@sun") SMB SID (eg: "S-1-234-567-89") [root@HP ~]# ----------------------------- How can I use or add encryption property to FreeBsd 8.3? From owner-freebsd-hackers@FreeBSD.ORG Tue Sep 3 12:19:19 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 3C08F5DF for ; Tue, 3 Sep 2013 12:19:19 +0000 (UTC) (envelope-from florent@peterschmitt.fr) Received: from peterschmitt.fr (peterschmitt.fr [5.135.177.31]) by mx1.freebsd.org (Postfix) with ESMTP id 046FE211D for ; Tue, 3 Sep 2013 12:19:18 +0000 (UTC) Received: from [172.29.180.39] (unknown [194.214.114.46]) by peterschmitt.fr (Postfix) with ESMTPSA id E09E36529 for ; Tue, 3 Sep 2013 14:19:09 +0200 (CEST) Message-ID: <5225D49B.2080807@peterschmitt.fr> Date: Tue, 03 Sep 2013 14:22:51 +0200 From: Florent Peterschmitt User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20130821 Icedove/17.0.8 MIME-Version: 1.0 To: freebsd-hackers@freebsd.org Subject: Re: Zfs encryption property for freebsd 8.3 References: <226721378210462@web15j.yandex.ru> In-Reply-To: <226721378210462@web15j.yandex.ru> X-Enigmail-Version: 1.5.1 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="----enig2SVKTDDPHMNMSIPXLDUGF" X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Sep 2013 12:19:19 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) ------enig2SVKTDDPHMNMSIPXLDUGF Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Le 03/09/2013 14:14, Emre =C7amalan a =E9crit : > Hi,=20 > I want to encrypt some disk on my server with Zfs encryption property b= ut it is not available. "That would require ZFS v30. As far as I am aware Oracle has not released the code under CDDL." =46rom http://forums.freebsd.org/showthread.php?t=3D30036 So you can use ZFS pools on GELI volumes, it can be a good start. I not play with it. --=20 Florent Peterschmitt | Please: florent@peterschmitt.fr | * Avoid HTML/RTF in E-mail. +33 (0)6 64 33 97 92 | * Send PDF for documents. http://florent.peterschmitt.fr | * Trim your quotations. Really. Proudly powered by Open Source | Thank you :) ------enig2SVKTDDPHMNMSIPXLDUGF Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.14 (GNU/Linux) Comment: Using GnuPG with Icedove - http://www.enigmail.net/ iQIcBAEBAgAGBQJSJdSbAAoJEFr01BkajbiBGh0P+gNQh57YtlLyAdo2qRNbtylm 8hxLZnqkBJLUX1gV9qd4440+L0wWbkSH5C0nMTLdZjqiJ83xIQJ4YtFs1pE4Qngz gwExMVyMuZ88GhEgeVOX6oC5NFTukuQh9Ec7zerMXSSfdaQyfZ9eD399p2K7qN7k CoXTfN30hNLqoykWJQhfCLCNYf+jZhrbVmFyNv7axrXKxTsLerQ0QyTzNVYZhixL YzrqB4Sz1FADZTDRBoID4UVWQbid/VFGxscsVVikKcfe0vgbu+l3om6QrYiwtCLu VweLSA/y7Y2d7a0vVFAaacTl+ashitpG7xPlhGAY7x80aPzTSeDyZbLP0GsgW4BQ ZuROXqRSjV0PGr6yU/vcvb56qocys4WT2Es6Lzr2XkCVk5xeSvAqJrsEPUymQ21t 4yXCYRzogItPg5k7JJ9/LvpHhBbwMCFSCAHiaHwsXIYtbKTTbD+KvppuX3hFIZ+x t508XyOkLxtCQG/OWtDdIk4Uw6SOaknDawRHSt9PL5LDuTgp6hB7ErLYuBz9w0gy 6w53S9EhB+7DNzJr7vD1SJaspKwGLbHz5QB/bqZJQtQmf8pzNbhVguMHnTzj5VfZ OyJz9Ej5nPl9rr6VksUmG9EaNrU4gbF5kIgwKTnje6+ioN6q83vaFLo0y8juNWTz VwRIcDP/SzBUVNzQupe0 =eV4B -----END PGP SIGNATURE----- ------enig2SVKTDDPHMNMSIPXLDUGF-- From owner-freebsd-hackers@FreeBSD.ORG Tue Sep 3 13:42:53 2013 Return-Path: Delivered-To: freebsd-hackers@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id A9170611; Tue, 3 Sep 2013 13:42:53 +0000 (UTC) (envelope-from jlh@FreeBSD.org) Received: from caravan.chchile.org (caravan.chchile.org [178.32.125.136]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 6EB032D3C; Tue, 3 Sep 2013 13:42:53 +0000 (UTC) Received: by caravan.chchile.org (Postfix, from userid 1000) id 75F99C0761; Tue, 3 Sep 2013 13:42:51 +0000 (UTC) Date: Tue, 3 Sep 2013 15:42:51 +0200 From: Jeremie Le Hen To: Alexander Motin Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking Message-ID: <20130903134251.GB43281@caravan.chchile.org> Mail-Followup-To: Alexander Motin , FreeBSD SCSI , freebsd-hackers@FreeBSD.org, freebsd-geom@FreeBSD.org, "freebsd-current@freebsd.org" References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <5224511D.4090503@FreeBSD.org> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: FreeBSD SCSI , freebsd-geom@FreeBSD.org, "freebsd-current@freebsd.org" , freebsd-hackers@FreeBSD.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Sep 2013 13:42:53 -0000 On Mon, Sep 02, 2013 at 11:49:33AM +0300, Alexander Motin wrote: > Hi. > > I would like to invite more people to review and test my patches for > improving CAM and GEOM scalability, that for last six months you could > see developing in project/camlock SVN branch. Full diff of that branch > against present head (r255131) can be found here: > http://people.freebsd.org/~mav/camlock_patches/camlock_20130902.patch I'm building my kernel right now. -- Jeremie Le Hen Scientists say the world is made up of Protons, Neutrons and Electrons. They forgot to mention Morons. From owner-freebsd-hackers@FreeBSD.ORG Tue Sep 3 14:53:34 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 24F52BD9 for ; Tue, 3 Sep 2013 14:53:34 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-qc0-x22b.google.com (mail-qc0-x22b.google.com [IPv6:2607:f8b0:400d:c01::22b]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id DA5122317 for ; Tue, 3 Sep 2013 14:53:33 +0000 (UTC) Received: by mail-qc0-f171.google.com with SMTP id n1so3107072qcw.2 for ; Tue, 03 Sep 2013 07:53:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type:content-transfer-encoding; bh=5GcDqogBsonxgUwPyzoQtV46rtdvrBz8mS3gFHYr8vI=; b=b2t2ShSKaG+yGGkGlnQwcKvuhPcoptzINlOovVOJtILaHk+2NSbx8LXlRLj3tyIAzt tszswJuEk+W0f08cJeEkP3DuD5uOokvdJWxU7Sw2iBazzMIaZXH9sW8SF389ym3y/nNG oTPtdd1V1SkVR+PC4we/pmPhq1wrIN1XFY7qTc7hLjF/OKRHJEm7QQD1NFKPzoj3mf8+ 1z4W7XYaJfml4XpVy9hbTWWrc3nhx+hRKAHSVYygqdRlm9PUxJHT55Il8hIWHH2sMgZF 3a0FVIV/5S6qZHn8bmCAGePUCK0is7xZuLRrjsG1czxBc8FvV+N3TsDjBHkZyUUKots7 URzA== MIME-Version: 1.0 X-Received: by 10.224.122.195 with SMTP id m3mr1364739qar.9.1378220012936; Tue, 03 Sep 2013 07:53:32 -0700 (PDT) Sender: asomers@gmail.com Received: by 10.49.39.101 with HTTP; Tue, 3 Sep 2013 07:53:32 -0700 (PDT) In-Reply-To: <5225D49B.2080807@peterschmitt.fr> References: <226721378210462@web15j.yandex.ru> <5225D49B.2080807@peterschmitt.fr> Date: Tue, 3 Sep 2013 08:53:32 -0600 X-Google-Sender-Auth: y92iJ1ToW6OAs5rXQu62t_nLHbM Message-ID: Subject: Re: Zfs encryption property for freebsd 8.3 From: Alan Somers To: Florent Peterschmitt Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Sep 2013 14:53:34 -0000 On Tue, Sep 3, 2013 at 6:22 AM, Florent Peterschmitt wrote: > Le 03/09/2013 14:14, Emre =C7amalan a =E9crit : >> Hi, >> I want to encrypt some disk on my server with Zfs encryption property bu= t it is not available. > > "That would require ZFS v30. As far as I am aware Oracle has not > released the code under CDDL." Oracle's ZFS encryption is crap anyway. It works at the filesystem level, not the pool level, so a lot of metadata is in plaintext; I don't remember how much exactly. It's also highly vulnerable to watermarking attacks. > > From http://forums.freebsd.org/showthread.php?t=3D30036 > > So you can use ZFS pools on GELI volumes, it can be a good start. I not > play with it. GELI is full-disk encryption. It's far superior to ZFS encryption. > > -- > Florent Peterschmitt | Please: > florent@peterschmitt.fr | * Avoid HTML/RTF in E-mail. > +33 (0)6 64 33 97 92 | * Send PDF for documents. > http://florent.peterschmitt.fr | * Trim your quotations. Really. > Proudly powered by Open Source | Thank you :) > From owner-freebsd-hackers@FreeBSD.ORG Tue Sep 3 14:58:17 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 404F4DE3 for ; Tue, 3 Sep 2013 14:58:17 +0000 (UTC) (envelope-from florent@peterschmitt.fr) Received: from peterschmitt.fr (peterschmitt.fr [5.135.177.31]) by mx1.freebsd.org (Postfix) with ESMTP id 069662358 for ; Tue, 3 Sep 2013 14:58:17 +0000 (UTC) Received: from [172.29.180.39] (unknown [194.214.114.46]) by peterschmitt.fr (Postfix) with ESMTPSA id C0D726736 for ; Tue, 3 Sep 2013 16:58:13 +0200 (CEST) Message-ID: <5225F9E3.4000101@peterschmitt.fr> Date: Tue, 03 Sep 2013 17:01:55 +0200 From: Florent Peterschmitt User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20130821 Icedove/17.0.8 MIME-Version: 1.0 To: freebsd-hackers@freebsd.org Subject: Re: Zfs encryption property for freebsd 8.3 References: <226721378210462@web15j.yandex.ru> <5225D49B.2080807@peterschmitt.fr> In-Reply-To: X-Enigmail-Version: 1.5.1 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="----enig2DRWFLJIARQSGUVEONUCK" X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Sep 2013 14:58:17 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) ------enig2DRWFLJIARQSGUVEONUCK Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Le 03/09/2013 16:53, Alan Somers a =E9crit : > GELI is full-disk encryption. It's far superior to ZFS encryption. Yup, but is there a possibility to encrypt a ZFS volume (not a whole pool) with a separate GELI partition? Also, in-ZFS encryption would be a nice thing if it could work like an LVM/LUKS where each logical LVM volume can be encrypted or not and have its own crypt key. I saw that Illumos has ZFS encrytion in the TODO list. --=20 Florent Peterschmitt | Please: florent@peterschmitt.fr | * Avoid HTML/RTF in E-mail. +33 (0)6 64 33 97 92 | * Send PDF for documents. http://florent.peterschmitt.fr | * Trim your quotations. Really. Proudly powered by Open Source | Thank you :) ------enig2DRWFLJIARQSGUVEONUCK Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.14 (GNU/Linux) Comment: Using GnuPG with Icedove - http://www.enigmail.net/ iQIbBAEBAgAGBQJSJfnjAAoJEFr01BkajbiBCvoP93U6FGySZEIZ9aUI1+903cUT /S7NeIwaCd+eoH2GxpX/niSF8BjiK4ToUrsmmeAOkj7Uu/AZHRxwT7iz+P6svEQQ Nqg3UVdb2Pj27Tu/O12IaTE21h0USA95/O7V4Tsy+4rpcxTkfQN+MArznrkGCsjq SXFeFBbiHzuus4Cpl0U3IbSuNqdBHhVategU/GHKfvkBGNboieMiARgNkU5ly5Z6 c/ZuOi3SLnVk8EH2mlHhcNFS7S6o6yRWARaz9HUrLnHXUWGvLnsmcs9B/zl8AcnM JhjCay9p9xbA1mbpScvCszaHx4Ngg3uXchdVWRvykRYyd8xRVIE0fDTn2mYrGd5n GAUcaZiq2+qk06ghWPm6foxNZzg0fUrQc1MwV0fCNEIaRP0m+TTZu715KUepux/E LNejAWIk+qD08oZ6033rrWuN+wNts0/2PrwdVkcGsJY7tfkri9gkOHen7E6scRcF OYA29K23H0x4JlB7efvKWVFQCVuS066Ci61uELF+8mxwiHhZII37hz1VWhS3Qc0y cb45N6bFJ1dKlEbmuYRSLgRomBWNGrFODFxabjEprMJ8ULP00iUUYFEARoSzlX1t NR4FeJtcoMNQ9tjvg0nxRr60jxUZAG4Q+qVz814sRc7r0ZaYVZqTidq/ViF01Bo5 zC2R5g8GS184ojHsXvE= =2raA -----END PGP SIGNATURE----- ------enig2DRWFLJIARQSGUVEONUCK-- From owner-freebsd-hackers@FreeBSD.ORG Tue Sep 3 16:20:06 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 24FD7C05 for ; Tue, 3 Sep 2013 16:20:06 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-qa0-x233.google.com (mail-qa0-x233.google.com [IPv6:2607:f8b0:400d:c00::233]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id DB9E328BD for ; Tue, 3 Sep 2013 16:20:05 +0000 (UTC) Received: by mail-qa0-f51.google.com with SMTP id bv4so1400498qab.3 for ; Tue, 03 Sep 2013 09:20:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type:content-transfer-encoding; bh=5YiBa43sincJofJb5i+QtekDEGxDN0la1ylhgm1V/xw=; b=CAhzfcxgJw8P0005YVs9ttmH7cbutPfY10XIGL0RfpEAi6qM/DdrPWw8dBNbEvGnGg ZSqhq7k32ukrVWUGe+uKftFxt8OFvxlNRKC4LhwPcmrghhg3qeoOz/IJsmHSns4QyBid +7ejZc0gbQky0TxVgafXrlSLypKpCU1JkaPsFx2mK7RJCKml6Dqs3N2lfBKGDpSFkRgY cg/nJbXRBmh1mwNbrxSXPZ48kTwcWqBQL5sNpbonBgMVO1EYzw9e3RtEz6fInAOfaRul uHA5G/2vnuhh1TRfHusi6Ngv8aJnt9EVG5zMCdgdwZvIUlK2VGFH2qDBnHmUqzm0Gs0H eRZA== MIME-Version: 1.0 X-Received: by 10.224.23.134 with SMTP id r6mr1833287qab.34.1378225205077; Tue, 03 Sep 2013 09:20:05 -0700 (PDT) Sender: asomers@gmail.com Received: by 10.49.39.101 with HTTP; Tue, 3 Sep 2013 09:20:05 -0700 (PDT) In-Reply-To: <5225F9E3.4000101@peterschmitt.fr> References: <226721378210462@web15j.yandex.ru> <5225D49B.2080807@peterschmitt.fr> <5225F9E3.4000101@peterschmitt.fr> Date: Tue, 3 Sep 2013 10:20:05 -0600 X-Google-Sender-Auth: wS-Wr16hxBKttJf-HQeCf4fgt-w Message-ID: Subject: Re: Zfs encryption property for freebsd 8.3 From: Alan Somers To: Florent Peterschmitt Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Sep 2013 16:20:06 -0000 On Tue, Sep 3, 2013 at 9:01 AM, Florent Peterschmitt wrote: > Le 03/09/2013 16:53, Alan Somers a =E9crit : >> GELI is full-disk encryption. It's far superior to ZFS encryption. > > Yup, but is there a possibility to encrypt a ZFS volume (not a whole > pool) with a separate GELI partition? You mean encrypt a zvol with GELI and put a file system on that? I suppose that would work, but I bet that it would be slow. > > Also, in-ZFS encryption would be a nice thing if it could work like an > LVM/LUKS where each logical LVM volume can be encrypted or not and have > its own crypt key. My understanding is that this is exactly how Oracle's ZFS encryption works. Each ZFS filesystem can have its own key, or be in plaintext. Every cryptosystem involves a tradeoff between security and convenience, and ZFS encryption goes fairly hard toward convenience. In particular, Oracle decided that encrypted files must be deduplicatable. A necessary result is that they are trivially vulnerable to watermarking attacks. https://blogs.oracle.com/darren/entry/zfs_encryption_what_is_on > > I saw that Illumos has ZFS encrytion in the TODO list. > > -- > Florent Peterschmitt | Please: > florent@peterschmitt.fr | * Avoid HTML/RTF in E-mail. > +33 (0)6 64 33 97 92 | * Send PDF for documents. > http://florent.peterschmitt.fr | * Trim your quotations. Really. > Proudly powered by Open Source | Thank you :) > From owner-freebsd-hackers@FreeBSD.ORG Tue Sep 3 18:10:34 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 86D92F92; Tue, 3 Sep 2013 18:10:34 +0000 (UTC) (envelope-from outbackdingo@gmail.com) Received: from mail-pa0-x22e.google.com (mail-pa0-x22e.google.com [IPv6:2607:f8b0:400e:c03::22e]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 4B33527EB; Tue, 3 Sep 2013 18:10:34 +0000 (UTC) Received: by mail-pa0-f46.google.com with SMTP id fa1so6747736pad.19 for ; Tue, 03 Sep 2013 11:10:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=U6aTzULoJOmotb6EDysMmZrEOn4yEnc/RZxCGfXH28Y=; b=EeqOVeGgn3Pye1lgfkID5C11E+cuH7lE6Qkben4dI6lros8b7PNodUfLnVLW8Sn7r/ j6JrNrE7i5WGzpCg5U/XT6lH4d6V3Dz3KQzjnOorjwqybRG7AF+FFnGiqxapJc/+vsZD fqx5WhzsYIluohp9r9EDVoaaiXnazTxdB9M9SaHdIVmklFFfWOKndwccxCn7km77HS1z dE6Nv6+v2HWKru+SiwPqLUiRHW4Rw52fkd6LSwq1mm14WJO0W4X65qupGSyTxBgx7FXB R8TDtPBlG0Ml/LH0d0kAEnImMzIYXoNnBaB558jbA8jYLefRSD5FkknLeljpdkld6ZY3 zTFg== MIME-Version: 1.0 X-Received: by 10.68.76.101 with SMTP id j5mr32863063pbw.67.1378231832471; Tue, 03 Sep 2013 11:10:32 -0700 (PDT) Received: by 10.66.126.141 with HTTP; Tue, 3 Sep 2013 11:10:32 -0700 (PDT) In-Reply-To: <20130903134251.GB43281@caravan.chchile.org> References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> Date: Tue, 3 Sep 2013 14:10:32 -0400 Message-ID: Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking From: Outback Dingo To: Alexander Motin , FreeBSD SCSI , freebsd-hackers@freebsd.org, freebsd-geom@freebsd.org, "freebsd-current@freebsd.org" Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.14 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Sep 2013 18:10:34 -0000 On Tue, Sep 3, 2013 at 9:42 AM, Jeremie Le Hen wrote: > On Mon, Sep 02, 2013 at 11:49:33AM +0300, Alexander Motin wrote: > > Hi. > > > > I would like to invite more people to review and test my patches for > > improving CAM and GEOM scalability, that for last six months you could > > see developing in project/camlock SVN branch. Full diff of that branch > > against present head (r255131) can be found here: > > http://people.freebsd.org/~mav/camlock_patches/camlock_20130902.patch > > I'm building my kernel right now. > > Can anyone confirm how well tested/stable this patch set might be?? if theres positive input i have a zoo of dev machines i could load it on, to help further it. Just checking to see how widely its been tested, > -- > Jeremie Le Hen > > Scientists say the world is made up of Protons, Neutrons and Electrons. > They forgot to mention Morons. > _______________________________________________ > freebsd-current@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" > From owner-freebsd-hackers@FreeBSD.ORG Tue Sep 3 19:08:37 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id A0604652; Tue, 3 Sep 2013 19:08:37 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from bigwig.baldwin.cx (bigwig.baldwin.cx [IPv6:2001:470:1f11:75::1]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 66DA42FC2; Tue, 3 Sep 2013 19:08:37 +0000 (UTC) Received: from jhbbsd.localnet (unknown [209.249.190.124]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id 21196B990; Tue, 3 Sep 2013 15:08:36 -0400 (EDT) From: John Baldwin To: freebsd-fs@freebsd.org Subject: Re: Call fo comments - raising vfs.ufs.dirhash_reclaimage? Date: Tue, 3 Sep 2013 15:07:32 -0400 User-Agent: KMail/1.13.5 (FreeBSD/8.2-CBSD-20110714-p28; KDE/4.5.5; amd64; ; ) References: <20130828181228.0d3618dd@ernst.home> In-Reply-To: MIME-Version: 1.0 Content-Type: Text/Plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Message-Id: <201309031507.33098.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Tue, 03 Sep 2013 15:08:36 -0400 (EDT) Cc: freebsd-hackers , Ivan Voras X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Sep 2013 19:08:37 -0000 On Wednesday, August 28, 2013 12:40:15 pm Ivan Voras wrote: > On 28 August 2013 18:12, Gary Jennejohn wrote: > > > So, if I understand this correctly, a normal desktop user won't > > notice any real change, except that buildworld might get faster, > > and big servers will benefit? > > Basically, yes, but read on... > > > But could this negatively impact small, embedded systems, which > > usually have only small memory footprints? Although I suppose > > one could argue that they usually don't have large numbers of > > files cached in memory at any given time. > > Unless I'm wrong, the only pathological case coming from this change > would be the following sequence of events: > > 1) Memory is scarce [*] > 2) There's a sudden surge of requests for a huge number of different directories > 3) There's an urgent lowmem event which is observed by dirhash, which > attempts to free memory but is prevented in doing so for the next 60 > seconds because all entries are young (the idea behind dirhash being > that if a directory is accessed, it will probably soon be accessed > again - think "ls" then "fopen", so we won't evict him until > reclaimage seconds) > 4) the kernel runs out of memory, game over. Just to play devil's advocate, the only way your change can benefit is if: 1) Memory is scarce thus triggering a lowmem event 2) There are requests for a huge number of directories that haven't been accessed in over 5 seconds. That is to say, what your change does is increase the relative importance of dirhash memory relative to other memory in the machine when the machine is under memory pressure. If the machine is not under memory pressure then the lowmem handler will not be triggered and your change will never matter. Keep in mind that if pagedaemon is able to keep up, the lowmem event handler will not be called. This handler only triggers when you are really low on memory and trying to allocate it faster than pagedaemon can reclaim free pages. In that sort of environment you generally want caches to return pages sooner rather than later. What would perhaps be better than a hardcoded reclaim age would be to use an LRU-type approach and perhaps set a target percent to reclaim. That is, suppose you were to reclaim the oldest 10% of hashes on each lowmem call (and make the '10%' the tunable value). Then you will always make some amount of progress in a low memory situation (and if the situation remains dire you will eventually empty the entire cache), but the effective maximum age will be more dynamic. Right now if you haven't touched UFS in 5 seconds it throws the entire thing out on the first lowmem event. The LRU-approach would only throw the oldest 10% out on the first call, but eventually throw it all out if the situation remains dire. -- John Baldwin From owner-freebsd-hackers@FreeBSD.ORG Tue Sep 3 20:23:26 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id DFA7A898; Tue, 3 Sep 2013 20:23:26 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from bigwig.baldwin.cx (bigwig.baldwin.cx [IPv6:2001:470:1f11:75::1]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id AD4CF26A3; Tue, 3 Sep 2013 20:23:26 +0000 (UTC) Received: from jhbbsd.localnet (unknown [209.249.190.124]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id 8B9DCB924; Tue, 3 Sep 2013 16:23:24 -0400 (EDT) From: John Baldwin To: freebsd-hackers@freebsd.org Subject: Re: About CPU cores numbering an processor affinity Date: Tue, 3 Sep 2013 15:24:18 -0400 User-Agent: KMail/1.13.5 (FreeBSD/8.2-CBSD-20110714-p28; KDE/4.5.5; amd64; ; ) References: <1D21F5BC-63CD-4B33-9286-6687E62FDB15@gmail.com> In-Reply-To: <1D21F5BC-63CD-4B33-9286-6687E62FDB15@gmail.com> MIME-Version: 1.0 Content-Type: Text/Plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Message-Id: <201309031524.18162.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Tue, 03 Sep 2013 16:23:24 -0400 (EDT) Cc: hackers@freebsd.org, Dmitry Sivachenko X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Sep 2013 20:23:26 -0000 On Friday, August 23, 2013 9:23:51 am Dmitry Sivachenko wrote: > Hello! > > I am using FreeBSD-9-STABLE on the following hardware: > > FreeBSD/SMP: Multiprocessor System Detected: 24 CPUs > FreeBSD/SMP: 2 package(s) x 6 core(s) x 2 SMT threads > > So I have 2 physical CPUs with 6 core each. > > # cpuset -g > pid -1 mask: 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23 > > > So each of 24 cores are numbered 0..23. > > 1) In what particular order are these cores numbered? Can I assume that 0..11 correspond to 1st physical CPU and 12..23 to second? How SMT threads are numbered within each core? Yes, the numbering is "grouped" so that you have each package as a contiguous block. Each core is a contiguous block as well, so SMT threads are adjacent to each other. > Should I use "-x" option of cpuset for that purpose (to bind irq 260 and 261 in my example)? Yes, cpuset -x. -- John Baldwin From owner-freebsd-hackers@FreeBSD.ORG Tue Sep 3 20:39:13 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 5C770F0D for ; Tue, 3 Sep 2013 20:39:13 +0000 (UTC) (envelope-from kim@westryn.net) Received: from mail3.westryn.net (mail3.westryn.net [72.28.112.3]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 3F07027C9 for ; Tue, 3 Sep 2013 20:39:12 +0000 (UTC) Received: from frost.westryn.net (204.16.225.169.westryn.net [204.16.225.169]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by mail3.westryn.net (Postfix) with ESMTPSA id 7628173A2D for ; Tue, 3 Sep 2013 15:29:08 -0500 (CDT) From: Kim Shrier Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Subject: booting FreeBSD on Apple Mac mini with GPT disk partition Message-Id: <1EB0CEFA-6A7E-4666-BCE3-4158AFEEA047@westryn.net> Date: Tue, 3 Sep 2013 14:29:04 -0600 To: FreeBSD Hackers Mime-Version: 1.0 (Mac OS X Mail 6.5 \(1508\)) X-Mailer: Apple Mail (2.1508) X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Sep 2013 20:39:13 -0000 Does anyone know if work on booting FreeBSD on modern Apple hardware was ever completed? I have looked on the wiki, forums, and email = archives but I don't see anything definitive. I would like to have a GPT partitioned disk with a freebsd-boot, = freebsd-swap, and multiple freebsd-ufs partitions on a new Mac mini. Any pointers = would be appreciated. Thanks, Kim -- Kim Shrier - kim@westryn.net Shrier and Deihl, Westryn Internet Services Internet Software Development and Hosting Remote Unix Admin, Security http://www.westryn.net/ From owner-freebsd-hackers@FreeBSD.ORG Tue Sep 3 21:31:50 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 4E646654; Tue, 3 Sep 2013 21:31:50 +0000 (UTC) (envelope-from jlh@FreeBSD.org) Received: from caravan.chchile.org (caravan.chchile.org [178.32.125.136]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 117E72BCE; Tue, 3 Sep 2013 21:31:50 +0000 (UTC) Received: by caravan.chchile.org (Postfix, from userid 1000) id DF286C0961; Tue, 3 Sep 2013 21:24:26 +0000 (UTC) Date: Tue, 3 Sep 2013 23:24:26 +0200 From: Jeremie Le Hen To: Outback Dingo Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking Message-ID: <20130903212426.GC43281@caravan.chchile.org> Mail-Followup-To: Outback Dingo , Alexander Motin , FreeBSD SCSI , freebsd-hackers@freebsd.org, freebsd-geom@freebsd.org, "freebsd-current@freebsd.org" References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) Cc: FreeBSD SCSI , Alexander Motin , freebsd-geom@freebsd.org, "freebsd-current@freebsd.org" , freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Sep 2013 21:31:50 -0000 On Tue, Sep 03, 2013 at 02:10:32PM -0400, Outback Dingo wrote: > On Tue, Sep 3, 2013 at 9:42 AM, Jeremie Le Hen wrote: > > > On Mon, Sep 02, 2013 at 11:49:33AM +0300, Alexander Motin wrote: > > > Hi. > > > > > > I would like to invite more people to review and test my patches for > > > improving CAM and GEOM scalability, that for last six months you could > > > see developing in project/camlock SVN branch. Full diff of that branch > > > against present head (r255131) can be found here: > > > http://people.freebsd.org/~mav/camlock_patches/camlock_20130902.patch > > > > I'm building my kernel right now. > > > > > Can anyone confirm how well tested/stable this patch set might be?? if > theres positive input i have a zoo of dev machines i could load it on, to > help further it. > Just checking to see how widely its been tested, Very stable so far. I'm doing a make -j 4 buildworld in parallel of a periodic security run. This has been running for hours without failure. -- Jeremie Le Hen Scientists say the world is made up of Protons, Neutrons and Electrons. They forgot to mention Morons. From owner-freebsd-hackers@FreeBSD.ORG Tue Sep 3 21:48:59 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id CF592D11; Tue, 3 Sep 2013 21:48:59 +0000 (UTC) (envelope-from cochard@gmail.com) Received: from mail-vc0-x22e.google.com (mail-vc0-x22e.google.com [IPv6:2607:f8b0:400c:c03::22e]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 429CF2CE8; Tue, 3 Sep 2013 21:48:59 +0000 (UTC) Received: by mail-vc0-f174.google.com with SMTP id gd11so4411172vcb.33 for ; Tue, 03 Sep 2013 14:48:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc:content-type:content-transfer-encoding; bh=CBjXK0KDjfW54LD0Yc8Pdr2jYxRu1lPETfc0cnr1Bmc=; b=FpG2g3+gqV/sAGRekCamqW+S4AgnWmAAHYsDfwV8PYuMp25Pc7l2Yj+j91pf0Su4uu IcIMAh5gvovMC46lw2aukJBCDj1MjgqvYC2GeSY6J41OtF+hYB7wkZSc8i9PDQsSNh6B fhRzJWFFp7LJnLLlPIinShJjc/G+61lF9CMUhK9JFnOuEhrFEL7SLmpWfV3yILsWC8JZ NwrbWss4RjzGjROVy8/XNbhPsnib7Omewe9X8HWyV4caAokWoo35QCqTo76g3swbhmxi 0lEMbkNMFQoiMzNlmN7qQdc9UFKTaDAe5CmeVHNtXsUpNP+dZKHzfhX9vZLFWJMHbGws Cp5Q== X-Received: by 10.220.199.5 with SMTP id eq5mr30028964vcb.16.1378244938366; Tue, 03 Sep 2013 14:48:58 -0700 (PDT) MIME-Version: 1.0 Sender: cochard@gmail.com Received: by 10.58.221.9 with HTTP; Tue, 3 Sep 2013 14:48:38 -0700 (PDT) In-Reply-To: References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> From: =?ISO-8859-1?Q?Olivier_Cochard=2DLabb=E9?= Date: Tue, 3 Sep 2013 23:48:38 +0200 X-Google-Sender-Auth: aEdoOoFc0E9sVrPag-3cJJNc85Q Message-ID: Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking To: Outback Dingo Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable Cc: FreeBSD SCSI , Alexander Motin , freebsd-geom@freebsd.org, "freebsd-current@freebsd.org" , freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Sep 2013 21:48:59 -0000 On Tue, Sep 3, 2013 at 8:10 PM, Outback Dingo wrot= e: > Can anyone confirm how well tested/stable this patch set might be?? if > theres positive input i have a zoo of dev machines i could load it on, to > help further it. > Just checking to see how widely its been tested, I've installed this patch on 3 differents machines there status after about 12hours: - SUN FIRE X4170 M2 (amd64: r255178) with 6 SAS harddrives in one big zraid (LSI MegaSAS Gen2 controller): Used for generating package with poudriere=85 no probleme since; - HAL/Fujitsu SPARC64-V (sparc64: r255178) with two SCSI-3 disks in gmirror: Used for generating package with poudriere too=85 no probleme since; - HP EliteBook 8460p (amd64: r255188) with DVD replaced by a second hardrive (where fbsd is installed): It crash just after the message "GEOM: new disk ada1" during boot screenshot of the crash screen: http://goo.gl/tW1VIx A little more information: addr2line -e /boot/kernel/kernel.symbols 0xffffffff8083abd3 /usr/src/sys/geom/geom_io.c:129 Regards, Olivier From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 4 00:31:57 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 8F70EAC0; Wed, 4 Sep 2013 00:31:57 +0000 (UTC) (envelope-from outbackdingo@gmail.com) Received: from mail-oa0-x235.google.com (mail-oa0-x235.google.com [IPv6:2607:f8b0:4003:c02::235]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 21888294D; Wed, 4 Sep 2013 00:31:57 +0000 (UTC) Received: by mail-oa0-f53.google.com with SMTP id k18so7551333oag.40 for ; Tue, 03 Sep 2013 17:31:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=TId/rHSlvsa6OMpmrl6Hypdr+azDGQF6VQU75p4pbAo=; b=N9O4AbJbWm2zaYqkUExEK3TP0U5H2bZNKkcXKTW8ovzbRua0M90ILPnYT2RXTRSSrP zgIeARpfG96nx5/c0ngFPNngf7WinJkrThKkPi8d58Wzs0x+jIdUBmxEQ4nrzeZrRvvf UKnXqv/PydLKWaj7jUNpIvwIBumxj05SixTVz4+0yfPVJvret7XoojZvWbTw5Fs5llVf d696ivBUI6xN4pUpTRbc0gZzMQV/iFFm2WA4RrG5A7hbJ1EnmcHd1xHpFAGnQtXm8OOR hvTefxsIdmH4X5TeIcsNFZFUWWJIhYxRrmIFF3HooL2uwbJKEVpzdtk1ShdE90zlWzI/ sNrA== MIME-Version: 1.0 X-Received: by 10.60.52.244 with SMTP id w20mr128413oeo.30.1378254716439; Tue, 03 Sep 2013 17:31:56 -0700 (PDT) Received: by 10.76.114.227 with HTTP; Tue, 3 Sep 2013 17:31:56 -0700 (PDT) In-Reply-To: References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> Date: Tue, 3 Sep 2013 20:31:56 -0400 Message-ID: Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking From: Outback Dingo To: =?ISO-8859-1?Q?Olivier_Cochard=2DLabb=E9?= Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.14 Cc: FreeBSD SCSI , Alexander Motin , freebsd-geom@freebsd.org, "freebsd-current@freebsd.org" , freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Sep 2013 00:31:57 -0000 On Tue, Sep 3, 2013 at 5:48 PM, Olivier Cochard-Labb=E9 wrote: > On Tue, Sep 3, 2013 at 8:10 PM, Outback Dingo > wrote: > > Can anyone confirm how well tested/stable this patch set might be?? if > > theres positive input i have a zoo of dev machines i could load it on, = to > > help further it. > > Just checking to see how widely its been tested, > > I've installed this patch on 3 differents machines there status after > about 12hours: > - SUN FIRE X4170 M2 (amd64: r255178) with 6 SAS harddrives in one big > zraid (LSI MegaSAS Gen2 controller): Used for generating package with > poudriere=85 no probleme since; > - HAL/Fujitsu SPARC64-V (sparc64: r255178) with two SCSI-3 disks in > gmirror: Used for generating package with poudriere too=85 no probleme > since; > - HP EliteBook 8460p (amd64: r255188) with DVD replaced by a second > hardrive (where fbsd is installed): It crash just after the message > "GEOM: new disk ada1" during boot > > screenshot of the crash screen: > http://goo.gl/tW1VIx > > A little more information: > addr2line -e /boot/kernel/kernel.symbols 0xffffffff8083abd3 > /usr/src/sys/geom/geom_io.c:129 > > Regards, > > Olivier > Be nice if it was backported to 9/stable..... not sure how feasible it is though... patch fails in a few places..... From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 4 05:24:49 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 0A1FEFC1; Wed, 4 Sep 2013 05:24:49 +0000 (UTC) (envelope-from jlh@FreeBSD.org) Received: from caravan.chchile.org (caravan.chchile.org [178.32.125.136]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id C33F32E6C; Wed, 4 Sep 2013 05:24:48 +0000 (UTC) Received: by caravan.chchile.org (Postfix, from userid 1000) id EAEB2C0A95; Wed, 4 Sep 2013 05:24:46 +0000 (UTC) Date: Wed, 4 Sep 2013 07:24:46 +0200 From: Jeremie Le Hen To: Outback Dingo , Alexander Motin , FreeBSD SCSI , freebsd-hackers@freebsd.org, freebsd-geom@freebsd.org, "freebsd-current@freebsd.org" Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking Message-ID: <20130904052446.GD43281@caravan.chchile.org> Mail-Followup-To: Outback Dingo , Alexander Motin , FreeBSD SCSI , freebsd-hackers@freebsd.org, freebsd-geom@freebsd.org, "freebsd-current@freebsd.org" References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> <20130903212426.GC43281@caravan.chchile.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20130903212426.GC43281@caravan.chchile.org> User-Agent: Mutt/1.5.21 (2010-09-15) X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Sep 2013 05:24:49 -0000 On Tue, Sep 03, 2013 at 11:24:26PM +0200, Jeremie Le Hen wrote: > On Tue, Sep 03, 2013 at 02:10:32PM -0400, Outback Dingo wrote: > > On Tue, Sep 3, 2013 at 9:42 AM, Jeremie Le Hen wrote: > > > > > On Mon, Sep 02, 2013 at 11:49:33AM +0300, Alexander Motin wrote: > > > > Hi. > > > > > > > > I would like to invite more people to review and test my patches for > > > > improving CAM and GEOM scalability, that for last six months you could > > > > see developing in project/camlock SVN branch. Full diff of that branch > > > > against present head (r255131) can be found here: > > > > http://people.freebsd.org/~mav/camlock_patches/camlock_20130902.patch > > > > > > I'm building my kernel right now. > > > > > > > > Can anyone confirm how well tested/stable this patch set might be?? if > > theres positive input i have a zoo of dev machines i could load it on, to > > help further it. > > Just checking to see how widely its been tested, > > Very stable so far. I'm doing a make -j 4 buildworld in parallel of a > periodic security run. This has been running for hours without failure. FWIW, I have 4 drives total, distributed in 2 zpool containing 2 mirrored zdev each. -- Jeremie Le Hen Scientists say the world is made up of Protons, Neutrons and Electrons. They forgot to mention Morons. From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 4 07:01:10 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 8FFDD7C1; Wed, 4 Sep 2013 07:01:10 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-wg0-x233.google.com (mail-wg0-x233.google.com [IPv6:2a00:1450:400c:c00::233]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 9DA8C28C1; Wed, 4 Sep 2013 07:01:09 +0000 (UTC) Received: by mail-wg0-f51.google.com with SMTP id a12so2264428wgh.18 for ; Wed, 04 Sep 2013 00:01:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=qQcQ3lQg5yW+MrAD8YAtILdaaJNlfmGx3bzF9F7m8w4=; b=q8BByWIwrdXM0K8ttL7/CYbzTbXgtwpUKxUd5p0FbZVX2X9XpDwckinfdQuHvyrBUY nRy6UzUA1z/Zcr4TamS6QIfLFesAEaP2U4PhFAXGEBSAZovv++c+xBCE9aXc/ItIjdcg /0vhg42kSaV0JcI7uY1boJ8qr0hL8jyc7+gn3J8SaLGwgzP70UagttzyHZ7iPe9EGmRi PHG8OioZTgzu7P/TZA4Y/yKO7AAtgZyGP9s9ZU4wOAmww5/6AD/twLjYA+Bb7TlMi4mk Qfg8zOuneoPIQrJQoT7BsOpaJ4h4zEdJCmGmbwTr+lHJF569lSfAvRBY36ifozGjD7zy h2nw== X-Received: by 10.180.75.16 with SMTP id y16mr767253wiv.59.1378278067954; Wed, 04 Sep 2013 00:01:07 -0700 (PDT) Received: from mavbook.mavhome.dp.ua ([37.229.21.195]) by mx.google.com with ESMTPSA id mw9sm1595508wic.4.1969.12.31.16.00.00 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Wed, 04 Sep 2013 00:01:06 -0700 (PDT) Sender: Alexander Motin Message-ID: <5226DAB0.1060303@FreeBSD.org> Date: Wed, 04 Sep 2013 10:01:04 +0300 From: Alexander Motin User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130616 Thunderbird/17.0.6 MIME-Version: 1.0 To: =?windows-1252?Q?Olivier_Cochard-Labb=E9?= Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 8bit Cc: Outback Dingo , freebsd-geom@freebsd.org, "freebsd-current@freebsd.org" , freebsd-hackers@freebsd.org, FreeBSD SCSI X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Sep 2013 07:01:10 -0000 On 04.09.2013 00:48, Olivier Cochard-Labbé wrote: > On Tue, Sep 3, 2013 at 8:10 PM, Outback Dingo wrote: >> Can anyone confirm how well tested/stable this patch set might be?? if >> theres positive input i have a zoo of dev machines i could load it on, to >> help further it. >> Just checking to see how widely its been tested, > > I've installed this patch on 3 differents machines there status after > about 12hours: > - SUN FIRE X4170 M2 (amd64: r255178) with 6 SAS harddrives in one big > zraid (LSI MegaSAS Gen2 controller): Used for generating package with > poudriere… no probleme since; > - HAL/Fujitsu SPARC64-V (sparc64: r255178) with two SCSI-3 disks in > gmirror: Used for generating package with poudriere too… no probleme > since; I've forgot to mention, but GEOM direct dispatch is now active only on x86 because GET_STACK_USAGE macro now defined only there and I wanted to stay on a safe side. On other archs GEOM works in old queued way. Somebody should port that small macro to other archs. But that is still interesting data point. Thanks. > - HP EliteBook 8460p (amd64: r255188) with DVD replaced by a second > hardrive (where fbsd is installed): It crash just after the message > "GEOM: new disk ada1" during boot > > screenshot of the crash screen: > http://goo.gl/tW1VIx > > A little more information: > addr2line -e /boot/kernel/kernel.symbols 0xffffffff8083abd3 > /usr/src/sys/geom/geom_io.c:129 Unfortunately I can't reproduce that and have not enough clues. It may be specific to some GEOM class. Could you describe/show all GEOM topology, file systems, etc. you have there? gpart show sysctl kern.geom.confxml ... Thank you! -- Alexander Motin From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 4 07:50:31 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 9347CCD8 for ; Wed, 4 Sep 2013 07:50:31 +0000 (UTC) (envelope-from benjamin.villain@gmail.com) Received: from mail-we0-x22b.google.com (mail-we0-x22b.google.com [IPv6:2a00:1450:400c:c03::22b]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 2AE9A2B22 for ; Wed, 4 Sep 2013 07:50:31 +0000 (UTC) Received: by mail-we0-f171.google.com with SMTP id p57so5637056wes.2 for ; Wed, 04 Sep 2013 00:50:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=IKyO2EqbSPO6N27reCgqkqiXp9zIyJILDQyHB4apH+w=; b=BTTsSCoHNy5Z52mVAtqBjLZB2PBQh+0SHkkcmVeq9+8PKi1v7GvLImGyysvjvd2Ob6 RHCtq8f7HeOqBHetJZ9oUkXfDtEJfOiS/aQ1GkQrfG17KRpQcwQfoUOayNLa2FpOkXKO TW3pJwMy/BDqzETLxE2EiLJpJqGDAGAFF1HZMKQthtiW/cLbnkx8NS9wfuaYYP2AKqNa x1UGxXAL4GzaN/qNXtOzu0yOmF0Vmuzm46OfOhXkDdONOyHmzxNIpGM/zTui5mZvFaSg 1Qh1TY3l9H/B1XC3I5KDFpklDlqzZlARIhqSj6FptRoY1KiD9U2kEnK0lNZVqSEJXO+F Zy5w== MIME-Version: 1.0 X-Received: by 10.180.188.202 with SMTP id gc10mr1044155wic.3.1378281029508; Wed, 04 Sep 2013 00:50:29 -0700 (PDT) Received: by 10.194.2.129 with HTTP; Wed, 4 Sep 2013 00:50:29 -0700 (PDT) In-Reply-To: <1EB0CEFA-6A7E-4666-BCE3-4158AFEEA047@westryn.net> References: <1EB0CEFA-6A7E-4666-BCE3-4158AFEEA047@westryn.net> Date: Wed, 4 Sep 2013 09:50:29 +0200 Message-ID: Subject: Re: booting FreeBSD on Apple Mac mini with GPT disk partition From: Benjamin VILLAIN To: Kim Shrier , freebsd-hackers@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.14 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Sep 2013 07:50:31 -0000 Hi Kim, I had some trouble bootin FreeBSD on my macbook pro last year. It seems that you have to boot FreeBSD in BIOS mode (UEFI bootloader is not available yet on amd64) and this can only be achieved on the SATA hard drive (not an external one). I don't know how are you trying to boot it but it should work (this link could help https://wiki.freebsd.org/AppleMacbook). Regards, -- Ben On Tue, Sep 3, 2013 at 10:29 PM, Kim Shrier wrote: > Does anyone know if work on booting FreeBSD on modern Apple hardware > was ever completed? I have looked on the wiki, forums, and email archives > but I don't see anything definitive. > > I would like to have a GPT partitioned disk with a freebsd-boot, > freebsd-swap, > and multiple freebsd-ufs partitions on a new Mac mini. Any pointers would > be > appreciated. > > Thanks, > Kim > -- > Kim Shrier - kim@westryn.net > Shrier and Deihl, Westryn Internet Services > Internet Software Development and Hosting > Remote Unix Admin, Security > http://www.westryn.net/ > > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" > From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 4 09:39:04 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 545D2522 for ; Wed, 4 Sep 2013 09:39:04 +0000 (UTC) (envelope-from vince@unsane.co.uk) Received: from unsane.co.uk (unsane-pt.tunnel.tserv5.lon1.ipv6.he.net [IPv6:2001:470:1f08:110::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id DECDB2322 for ; Wed, 4 Sep 2013 09:39:03 +0000 (UTC) Received: from vhoffman.lon.namesco.net (lon.namesco.net [195.7.254.102]) (authenticated bits=0) by unsane.co.uk (8.14.7/8.14.6) with ESMTP id r849cx8F046461 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Wed, 4 Sep 2013 10:39:01 +0100 (BST) (envelope-from vince@unsane.co.uk) Message-ID: <5226FFB3.3050407@unsane.co.uk> Date: Wed, 04 Sep 2013 10:38:59 +0100 From: Vincent Hoffman User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:17.0) Gecko/20130801 Thunderbird/17.0.8 MIME-Version: 1.0 To: Kim Shrier Subject: Re: booting FreeBSD on Apple Mac mini with GPT disk partition References: <1EB0CEFA-6A7E-4666-BCE3-4158AFEEA047@westryn.net> In-Reply-To: <1EB0CEFA-6A7E-4666-BCE3-4158AFEEA047@westryn.net> X-Enigmail-Version: 1.5.2 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: FreeBSD Hackers X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Sep 2013 09:39:04 -0000 On 03/09/2013 21:29, Kim Shrier wrote: > Does anyone know if work on booting FreeBSD on modern Apple hardware > was ever completed? I have looked on the wiki, forums, and email archives > but I don't see anything definitive. > > I would like to have a GPT partitioned disk with a freebsd-boot, freebsd-swap, > and multiple freebsd-ufs partitions on a new Mac mini. Any pointers would be > appreciated. I believe efi boot is almost done https://wiki.freebsd.org/UEFI I haven't tested yet although I may sometime soon as it would be nice to have my macbook dual boot without having to use bootcamp. Vince > > Thanks, > Kim > -- > Kim Shrier - kim@westryn.net > Shrier and Deihl, Westryn Internet Services > Internet Software Development and Hosting > Remote Unix Admin, Security > http://www.westryn.net/ > > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 4 12:45:46 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 9B0D06B2; Wed, 4 Sep 2013 12:45:46 +0000 (UTC) (envelope-from nwhitehorn@freebsd.org) Received: from smtpauth4.wiscmail.wisc.edu (wmauth4.doit.wisc.edu [144.92.197.145]) (using TLSv1 with cipher RC4-MD5 (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 6CD8D2023; Wed, 4 Sep 2013 12:45:46 +0000 (UTC) MIME-version: 1.0 Content-transfer-encoding: 8BIT Content-type: text/plain; charset=windows-1252; format=flowed Received: from avs-daemon.smtpauth4.wiscmail.wisc.edu by smtpauth4.wiscmail.wisc.edu (Oracle Communications Messaging Server 7u4-27.01(7.0.4.27.0) 64bit (built Aug 30 2012)) id <0MSL00100PMPTB00@smtpauth4.wiscmail.wisc.edu>; Wed, 04 Sep 2013 07:45:38 -0500 (CDT) X-Spam-PmxInfo: Server=avs-4, Version=6.0.3.2322014, Antispam-Engine: 2.7.2.2107409, Antispam-Data: 2013.9.4.123619, SenderIP=0.0.0.0 X-Spam-Report: AuthenticatedSender=yes, SenderIP=0.0.0.0 Received: from comporellon.tachypleus.net (adsl-76-208-67-185.dsl.mdsnwi.sbcglobal.net [76.208.67.185]) by smtpauth4.wiscmail.wisc.edu (Oracle Communications Messaging Server 7u4-27.01(7.0.4.27.0) 64bit (built Aug 30 2012)) with ESMTPSA id <0MSL0024HQ41OI20@smtpauth4.wiscmail.wisc.edu>; Wed, 04 Sep 2013 07:45:38 -0500 (CDT) Message-id: <52272B6F.9060308@freebsd.org> Date: Wed, 04 Sep 2013 07:45:35 -0500 From: Nathan Whitehorn User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130810 Thunderbird/17.0.8 To: Alexander Motin Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> <5226DAB0.1060303@FreeBSD.org> In-reply-to: <5226DAB0.1060303@FreeBSD.org> Cc: freebsd-geom@freebsd.org, freebsd-hackers@freebsd.org, "freebsd-current@freebsd.org" , FreeBSD SCSI , =?windows-1252?Q?Olivier_Cochard-Labb=E9?= , Outback Dingo X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Sep 2013 12:45:46 -0000 On 09/04/13 02:01, Alexander Motin wrote: > On 04.09.2013 00:48, Olivier Cochard-Labbé wrote: >> On Tue, Sep 3, 2013 at 8:10 PM, Outback Dingo >> wrote: >>> Can anyone confirm how well tested/stable this patch set might be?? if >>> theres positive input i have a zoo of dev machines i could load it >>> on, to >>> help further it. >>> Just checking to see how widely its been tested, >> >> I've installed this patch on 3 differents machines there status after >> about 12hours: >> - SUN FIRE X4170 M2 (amd64: r255178) with 6 SAS harddrives in one big >> zraid (LSI MegaSAS Gen2 controller): Used for generating package with >> poudriere… no probleme since; >> - HAL/Fujitsu SPARC64-V (sparc64: r255178) with two SCSI-3 disks in >> gmirror: Used for generating package with poudriere too… no probleme >> since; > > I've forgot to mention, but GEOM direct dispatch is now active only on > x86 because GET_STACK_USAGE macro now defined only there and I wanted > to stay on a safe side. On other archs GEOM works in old queued way. > Somebody should port that small macro to other archs. But that is > still interesting data point. Thanks. Could you describe what this macro is supposed to do so that we can do the porting work? -Nathan From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 4 13:20:43 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id DB979543; Wed, 4 Sep 2013 13:20:43 +0000 (UTC) (envelope-from rysto32@gmail.com) Received: from mail-oa0-x230.google.com (mail-oa0-x230.google.com [IPv6:2607:f8b0:4003:c02::230]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 63677232C; Wed, 4 Sep 2013 13:20:43 +0000 (UTC) Received: by mail-oa0-f48.google.com with SMTP id o17so336172oag.7 for ; Wed, 04 Sep 2013 06:20:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=uHQmwWU2MeBmE/1UIl47yFWFen4/AkTbDSQbsQhd/98=; b=enzMJG+Q9dZrdLHyb1h7LtN5bwcG03+y9VX9vqViqefI8Xfn4TWYmYwfAcF+qlPajc aRSfaiptbvyhvaBXy13j6fU3S8qgkA1ZiASZo8QW9xy1vfyntiguHgwsrg1rVQwoWZg0 jB94flQsMzViMSro/7HDhKwJZLEZvUQQfS/9sYmYkhxI5jZGBXOa4BQKDzWES1QGbwpf Oizz1P9WubWSrm92QtGsBkWB+HM2QdrYZQ75nCe/9u5j22q8bnkt57oAlQVtK5DjVh3h jOLiw/gTkx0IcWI8U/NIR79vbuBXa3nQiFrHMZU7uPRKg/gaSpIggGd7i6mi5HduGSY6 /2AQ== MIME-Version: 1.0 X-Received: by 10.182.73.136 with SMTP id l8mr2102864obv.53.1378300842725; Wed, 04 Sep 2013 06:20:42 -0700 (PDT) Received: by 10.76.68.38 with HTTP; Wed, 4 Sep 2013 06:20:42 -0700 (PDT) In-Reply-To: <52272B6F.9060308@freebsd.org> References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> <5226DAB0.1060303@FreeBSD.org> <52272B6F.9060308@freebsd.org> Date: Wed, 4 Sep 2013 09:20:42 -0400 Message-ID: Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking From: Ryan Stone To: Nathan Whitehorn Content-Type: text/plain; charset=ISO-8859-1 Cc: freebsd-geom@freebsd.org, "freebsd-hackers@freebsd.org" , Alexander Motin , "freebsd-current@freebsd.org" , Outback Dingo , =?ISO-8859-1?Q?Olivier_Cochard=2DLabb=E9?= , FreeBSD SCSI X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Sep 2013 13:20:44 -0000 On Wed, Sep 4, 2013 at 8:45 AM, Nathan Whitehorn wrote: > Could you describe what this macro is supposed to do so that we can do the > porting work? > -Nathan #define GET_STACK_USAGE(total, used) GET_STACK_USAGE sets the variable passed in total to the total amount of stack space available to the current thread. used is set to the amount of stack space currently used (this does not have to have byte-precision). Netgraph uses this to decide when to stop recursing and instead defer to a work queue (to prevent stack overflow). I presume that Alexander is using it in a similar way. It looks like the amd64 version could be ported to other architectures quite easily if you were to account for stacks that grow up and stacks that grow down: http://svnweb.freebsd.org/base/head/sys/amd64/include/proc.h?revision=233291&view=markup /* Get the current kernel thread stack usage. */ #define GET_STACK_USAGE(total, used) do { \ struct thread *td = curthread; \ (total) = td->td_kstack_pages * PAGE_SIZE; \ (used) = (char *)td->td_kstack + \ td->td_kstack_pages * PAGE_SIZE - \ (char *)&td; \ } while (0) From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 4 13:29:36 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 5C9FFA0B; Wed, 4 Sep 2013 13:29:36 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-bk0-x236.google.com (mail-bk0-x236.google.com [IPv6:2a00:1450:4008:c01::236]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 311752412; Wed, 4 Sep 2013 13:29:34 +0000 (UTC) Received: by mail-bk0-f54.google.com with SMTP id mz12so167341bkb.41 for ; Wed, 04 Sep 2013 06:29:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=KjWIzi+zzjy5EixOq84YnmeCwO5/zYJUl+xwaZAS7cg=; b=0wsCwn3GAC/ztaUAyTioLu8wt7jKdQkNpoOBKxI/fIxljCYeuc8fS7HSV/3AfYAiSJ nkcBy+X5TCHq8Qx4Vd8y2f/UGyUu5GXtOpu6H++c/hhoqnd3ulD1V0kyCFTFJu+o27mK CKfHvsuCNeUapbd/ry9rs829ItCJMdu3jUQrvq9dpbCZCfr79CRp+JXHrFM5Cz4TPYpI yqqtOFs51qPuwJ//NLlz8gF6D6xDhu6m1jeUfet2chJUAoTEUa7EZlfuL1zAmTTspHLo us5pLyZb6qWMBdEBR42rmbqV51Bw58/dJh40ko038vjbqhznKhY3yKY9pt2W9HRvmJJU 1Wqg== X-Received: by 10.205.22.71 with SMTP id qv7mr2518681bkb.20.1378301373128; Wed, 04 Sep 2013 06:29:33 -0700 (PDT) Received: from mavbook.mavhome.dp.ua ([37.229.21.195]) by mx.google.com with ESMTPSA id 14sm6560105bkl.17.1969.12.31.16.00.00 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Wed, 04 Sep 2013 06:29:32 -0700 (PDT) Sender: Alexander Motin Message-ID: <522735B9.1070403@FreeBSD.org> Date: Wed, 04 Sep 2013 16:29:29 +0300 From: Alexander Motin User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130616 Thunderbird/17.0.6 MIME-Version: 1.0 To: Nathan Whitehorn Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> <5226DAB0.1060303@FreeBSD.org> <52272B6F.9060308@freebsd.org> In-Reply-To: <52272B6F.9060308@freebsd.org> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 8bit Cc: freebsd-geom@freebsd.org, freebsd-hackers@freebsd.org, "freebsd-current@freebsd.org" , FreeBSD SCSI , =?windows-1252?Q?Olivier_Cochard-Labb=E9?= , Outback Dingo X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Sep 2013 13:29:36 -0000 On 04.09.2013 15:45, Nathan Whitehorn wrote: > On 09/04/13 02:01, Alexander Motin wrote: >> On 04.09.2013 00:48, Olivier Cochard-Labbé wrote: >>> On Tue, Sep 3, 2013 at 8:10 PM, Outback Dingo >>> wrote: >>>> Can anyone confirm how well tested/stable this patch set might be?? if >>>> theres positive input i have a zoo of dev machines i could load it >>>> on, to >>>> help further it. >>>> Just checking to see how widely its been tested, >>> >>> I've installed this patch on 3 differents machines there status after >>> about 12hours: >>> - SUN FIRE X4170 M2 (amd64: r255178) with 6 SAS harddrives in one big >>> zraid (LSI MegaSAS Gen2 controller): Used for generating package with >>> poudriere… no probleme since; >>> - HAL/Fujitsu SPARC64-V (sparc64: r255178) with two SCSI-3 disks in >>> gmirror: Used for generating package with poudriere too… no probleme >>> since; >> >> I've forgot to mention, but GEOM direct dispatch is now active only on >> x86 because GET_STACK_USAGE macro now defined only there and I wanted >> to stay on a safe side. On other archs GEOM works in old queued way. >> Somebody should port that small macro to other archs. But that is >> still interesting data point. Thanks. > > Could you describe what this macro is supposed to do so that we can do > the porting work? It supposed to report total and used stack sizes for current thread. I suppose that it will be equal for the most archs, but better somebody familiar with each one looked on it. The macro itself is not new. It is for years used in Netgraph for equivalent purpose. -- Alexander Motin From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 4 14:34:09 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 23331F09; Wed, 4 Sep 2013 14:34:09 +0000 (UTC) (envelope-from nwhitehorn@freebsd.org) Received: from mail.icecube.wisc.edu (trout.icecube.wisc.edu [128.104.255.119]) by mx1.freebsd.org (Postfix) with ESMTP id D9331284D; Wed, 4 Sep 2013 14:34:08 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by mail.icecube.wisc.edu (Postfix) with ESMTP id 50CBE5838C; Wed, 4 Sep 2013 09:11:29 -0500 (CDT) X-Virus-Scanned: amavisd-new at icecube.wisc.edu Received: from mail.icecube.wisc.edu ([127.0.0.1]) by localhost (trout.icecube.wisc.edu [127.0.0.1]) (amavisd-new, port 10030) with ESMTP id F6OyxvU8mfj5; Wed, 4 Sep 2013 09:11:29 -0500 (CDT) Received: from terminus.icecube.wisc.edu (terminus.icecube.wisc.edu [172.16.223.97]) by mail.icecube.wisc.edu (Postfix) with ESMTP id 3115758388; Wed, 4 Sep 2013 09:11:29 -0500 (CDT) Message-ID: <52273F90.7020303@freebsd.org> Date: Wed, 04 Sep 2013 09:11:28 -0500 From: Nathan Whitehorn User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130809 Thunderbird/17.0.8 MIME-Version: 1.0 To: Ryan Stone Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> <5226DAB0.1060303@FreeBSD.org> <52272B6F.9060308@freebsd.org> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-geom@freebsd.org, "freebsd-hackers@freebsd.org" , Alexander Motin , "freebsd-current@freebsd.org" , FreeBSD SCSI , =?ISO-8859-1?Q?Olivier_Cochard?= =?ISO-8859-1?Q?-Labb=E9?= , Outback Dingo X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Sep 2013 14:34:09 -0000 On 09/04/13 08:20, Ryan Stone wrote: > On Wed, Sep 4, 2013 at 8:45 AM, Nathan Whitehorn wrote: >> Could you describe what this macro is supposed to do so that we can do the >> porting work? >> -Nathan > #define GET_STACK_USAGE(total, used) > > GET_STACK_USAGE sets the variable passed in total to the total amount > of stack space available to the current thread. used is set to the > amount of stack space currently used (this does not have to have > byte-precision). Netgraph uses this to decide when to stop recursing > and instead defer to a work queue (to prevent stack overflow). I > presume that Alexander is using it in a similar way. It looks like > the amd64 version could be ported to other architectures quite easily > if you were to account for stacks that grow up and stacks that grow > down: > > http://svnweb.freebsd.org/base/head/sys/amd64/include/proc.h?revision=233291&view=markup > > /* Get the current kernel thread stack usage. */ > #define GET_STACK_USAGE(total, used) do { \ > struct thread *td = curthread; \ > (total) = td->td_kstack_pages * PAGE_SIZE; \ > (used) = (char *)td->td_kstack + \ > td->td_kstack_pages * PAGE_SIZE - \ > (char *)&td; \ > } while (0) > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" I think that should be MI for us anyway. I'm not aware of any architectures FreeBSD supports with stacks that grow up. I'll give it a test on PPC. -Nathan From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 4 16:07:51 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 2BC56248; Wed, 4 Sep 2013 16:07:51 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from bigwig.baldwin.cx (bigwig.baldwin.cx [IPv6:2001:470:1f11:75::1]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id EA3DA2E7C; Wed, 4 Sep 2013 16:07:50 +0000 (UTC) Received: from jhbbsd.localnet (unknown [209.249.190.124]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id 99108B941; Wed, 4 Sep 2013 12:07:49 -0400 (EDT) From: John Baldwin To: freebsd-current@freebsd.org Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking Date: Wed, 4 Sep 2013 12:00:55 -0400 User-Agent: KMail/1.13.5 (FreeBSD/8.2-CBSD-20110714-p28; KDE/4.5.5; amd64; ; ) References: <520D4ADB.50209@FreeBSD.org> <52273F90.7020303@freebsd.org> In-Reply-To: <52273F90.7020303@freebsd.org> MIME-Version: 1.0 Content-Type: Text/Plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Message-Id: <201309041200.56024.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Wed, 04 Sep 2013 12:07:49 -0400 (EDT) Cc: freebsd-geom@freebsd.org, "freebsd-hackers@freebsd.org" , Alexander Motin , Nathan Whitehorn , Outback Dingo , Olivier =?iso-8859-1?q?Cochard-Labb=E9?= , FreeBSD SCSI , Ryan Stone X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Sep 2013 16:07:51 -0000 On Wednesday, September 04, 2013 10:11:28 am Nathan Whitehorn wrote: > On 09/04/13 08:20, Ryan Stone wrote: > > On Wed, Sep 4, 2013 at 8:45 AM, Nathan Whitehorn wrote: > >> Could you describe what this macro is supposed to do so that we can do the > >> porting work? > >> -Nathan > > #define GET_STACK_USAGE(total, used) > > > > GET_STACK_USAGE sets the variable passed in total to the total amount > > of stack space available to the current thread. used is set to the > > amount of stack space currently used (this does not have to have > > byte-precision). Netgraph uses this to decide when to stop recursing > > and instead defer to a work queue (to prevent stack overflow). I > > presume that Alexander is using it in a similar way. It looks like > > the amd64 version could be ported to other architectures quite easily > > if you were to account for stacks that grow up and stacks that grow > > down: > > > > http://svnweb.freebsd.org/base/head/sys/amd64/include/proc.h?revision=233291&view=markup > > > > /* Get the current kernel thread stack usage. */ > > #define GET_STACK_USAGE(total, used) do { \ > > struct thread *td = curthread; \ > > (total) = td->td_kstack_pages * PAGE_SIZE; \ > > (used) = (char *)td->td_kstack + \ > > td->td_kstack_pages * PAGE_SIZE - \ > > (char *)&td; \ > > } while (0) > > _______________________________________________ > > freebsd-hackers@freebsd.org mailing list > > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" > > I think that should be MI for us anyway. I'm not aware of any > architectures FreeBSD supports with stacks that grow up. I'll give it a > test on PPC. ia64 has the double stack thingie where the register stack spills into a stack that grows up rather than down. Not sure how sparc64 window spills are handled either. -- John Baldwin From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 4 16:31:42 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 4A9B1A7D; Wed, 4 Sep 2013 16:31:42 +0000 (UTC) (envelope-from cochard@gmail.com) Received: from mail-ve0-x233.google.com (mail-ve0-x233.google.com [IPv6:2607:f8b0:400c:c01::233]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id C5B36208D; Wed, 4 Sep 2013 16:31:41 +0000 (UTC) Received: by mail-ve0-f179.google.com with SMTP id c13so355336vea.24 for ; Wed, 04 Sep 2013 09:31:41 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc:content-type; bh=XKa27OKDe9ewp7I9s+bvP097LtkA+VxHI3Fh9yDbWCk=; b=frtCXDU6t24rPHRkOrb2X2Aa1jhUxb6+6DY9/2xktyww57uJ0CqenvLPxKmQqKP61f bTFyYtzsLCOOVf2Z2HjuJBSFUn+9ShEL5zUGpFgNSztb5D2wxvG4JukPoSS6pAMTqo1I Zj5BM1KsLooN5a01V0pN/XHskzazNgIMaiM3PsKT0HEE0K4y4CsOC6MZMgLtozgQ3Hfy 8aoPvQpbmDV0R8W5V88Kw+IFErJObBeibb9NErqbpTsCwMDpxbGBDETduRyqlBZTlyF7 vxkpip8oeFjY3o/XugpsSg/tuMh0LAw7MepfePTD4QOSiDlZ72JhDo+kWSQKvpEWkrEG OomQ== X-Received: by 10.58.197.5 with SMTP id iq5mr849761vec.30.1378312300764; Wed, 04 Sep 2013 09:31:40 -0700 (PDT) MIME-Version: 1.0 Sender: cochard@gmail.com Received: by 10.58.221.9 with HTTP; Wed, 4 Sep 2013 09:31:20 -0700 (PDT) In-Reply-To: <5226DAB0.1060303@FreeBSD.org> References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> <5226DAB0.1060303@FreeBSD.org> From: =?ISO-8859-1?Q?Olivier_Cochard=2DLabb=E9?= Date: Wed, 4 Sep 2013 18:31:20 +0200 X-Google-Sender-Auth: JDxTeJui3sHLgm5FliEs0nhysPc Message-ID: Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking To: Alexander Motin Content-Type: text/plain; charset=ISO-8859-1 Cc: freebsd-hackers@freebsd.org, "freebsd-current@freebsd.org" , freebsd-geom@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Sep 2013 16:31:42 -0000 On Wed, Sep 4, 2013 at 9:01 AM, Alexander Motin wrote: > >> - HP EliteBook 8460p (amd64: r255188) with DVD replaced by a second >> hardrive (where fbsd is installed): It crash just after the message >> "GEOM: new disk ada1" during boot >> >> screenshot of the crash screen: >> http://goo.gl/tW1VIx >> >> A little more information: >> addr2line -e /boot/kernel/kernel.symbols 0xffffffff8083abd3 >> /usr/src/sys/geom/geom_io.c:129 > > > Unfortunately I can't reproduce that and have not enough clues. It may be > specific to some GEOM class. Could you describe/show all GEOM topology, file > systems, etc. you have there? > gpart show > sysctl kern.geom.confxml > ... Here are: - ada0: internal laptop hard-drive - ada1: the hard-drive that replace my DVD reader (partition 2: /boot in clear, partition 3: geli encrypted partition) => There is no special boot-loader, I manually select the hard-drive during Hardware: ahci0: port 0x4088-0x408f,0x4094-0x4097,0x4080-0x4087,0x4090-0x4093,0x4040-0x405f mem 0xd4827000-0xd48277ff irq 19 at device 31.2 on pci0 ahci0: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ada0 at ahcich0 bus 0 scbus0 target 0 lun 0 ada0: ATA-8 SATA 2.x device ada0: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes) ada0: Command Queueing enabled ada0: 305245MB (625142448 512 byte sectors: 16H 63S/T 16383C) ada0: Previously was known as ad4 ada1 at ahcich1 bus 0 scbus1 target 0 lun 0 ada1: ATA-8 SATA 2.x device ada1: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada1: Command Queueing enabled ada1: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C) ada1: quirks=0x1<4K> ada1: Previously was known as ad6 Regarding partition: root@laptop:/root # gpart show => 63 625142385 ada0 MBR (298G) 63 1985 - free - (992k) 2048 31457280 1 ntfs (15G) 31459328 4194304 2 ntfs [active] (2.0G) 35653632 589486768 3 ntfs (281G) 625140400 2048 - free - (1.0M) => 34 976773101 ada1 GPT (465G) 34 6 - free - (3.0k) 40 128 1 freebsd-boot (64k) 168 4194304 2 freebsd-ufs (2.0G) 4194472 972578656 3 freebsd-ufs (463G) 976773128 7 - free - (3.5k) And here is the long output of geom configuration: root@laptop:/root # sysctl kern.geom.confxml kern.geom.confxml: FD RAID DEV ada1p3.eli 4 r0w0e0 gpt/boot 4 r0w0e0 gptid/1c841adf-3cde-11e2-8cfc-a0b3cc295ab2 4 r0w0e0 ada1p3 3 r0w0e0 ada1p2 3 r0w0e0 ada1p1 3 r0w0e0 ntfs/System 4 r1w1e0 ntfs/BDEDrive 4 r0w0e0 ntfs/Recovery 4 r0w0e0 ada1 2 r0w0e0 ada0s3 3 r0w0e0 ada0s2 3 r0w0e0 ada0s1 3 r0w0e0 ada0 2 r0w0e0 ELI ada1p3.eli 3 928 928 BOOT 0 6 hardware 256 AES-XTS ACTIVE r1w1e1 r1w1e1 ada1p3.eli 497960271360 512 0 0 PART ada1 2 GPT 128 34 976773134 63 16 OK false r2w2e5 r1w1e1 ada1p3 497960271872 512 4096 0 4194472 976773127 3 freebsd-ufs 2147569664 497960271872 516e7cb6-6ecf-11d6-8ff8-00022d09712b c8e5c3ff-3cde-11e2-8cfc-a0b3cc295ab2 r1w1e2 ada1p2 2147483648 512 4096 0 168 4194471 2 freebsd-ufs 86016 2147483648 516e7cb6-6ecf-11d6-8ff8-00022d09712b 874bc9a6-3cde-11e2-8cfc-a0b3cc295ab2 r0w0e0 ada1p1 65536 512 4096 0 40 167 1 freebsd-boot 20480 65536 83bd6b9d-7f41-11dc-be0b-001560b84f0f 1c841adf-3cde-11e2-8cfc-a0b3cc295ab2 ada0 2 MBR 4 63 625142447 63 16 OK false r1w1e2 r1w1e1 ada0s3 301817225216 512 0 1074790400 35653632 625140399 3 ntfs 18254659584 301817225216 7 r0w0e0 ada0s2 2147483648 512 0 3222274048 31459328 35653631 2 ntfs 16107175936 2147483648 7 active r0w0e0 ada0s1 16106127360 512 0 1048576 2048 31459327 1 ntfs 1048576 16106127360 7 LABEL ada1p2 3 r1w1e2 r1w1e1 gpt/boot 2147483648 512 4096 0 0 2147483648 4194304 0 0 ada1p1 3 r0w0e0 r0w0e0 gptid/1c841adf-3cde-11e2-8cfc-a0b3cc295ab2 65536 512 4096 0 0 65536 128 0 0 ada0s3 3 r1w1e1 r1w1e0 ntfs/System 301817225216 512 0 1074790400 0 301817225216 589486768 0 0 ada0s2 3 r0w0e0 r0w0e0 ntfs/BDEDrive 2147483648 512 0 3222274048 0 2147483648 4194304 0 0 ada0s1 3 r0w0e0 r0w0e0 ntfs/Recovery 16106127360 512 0 1048576 0 16106127360 31457280 0 0 SWAP VFS ffs.gpt/boot 4 r1w1e1 ffs.ada1p3.eli 4 r1w1e1 MD DISK ada1 1 r2w2e5 ada1 500107862016 512 4096 0 16 63 WD-WX81A1179372 50014ee601049a6a WDC WD5000BPKT-00PK4T0 ada0 1 r1w1e2 ada0 320072933376 512 0 0 16 63 82JRT2VVT 5000039431d04c9c TOSHIBA MK3261GSYN From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 4 17:53:00 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 19F2CA49 for ; Wed, 4 Sep 2013 17:53:00 +0000 (UTC) (envelope-from kim@westryn.net) Received: from mail3.westryn.net (mail3.westryn.net [72.28.112.3]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id EE62E2792 for ; Wed, 4 Sep 2013 17:52:59 +0000 (UTC) Received: from frost.westryn.net (204.16.225.169.westryn.net [204.16.225.169]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by mail3.westryn.net (Postfix) with ESMTPSA id 49BC273A51; Wed, 4 Sep 2013 12:52:58 -0500 (CDT) Content-Type: text/plain; charset=iso-8859-1 Mime-Version: 1.0 (Mac OS X Mail 6.5 \(1508\)) Subject: Re: booting FreeBSD on Apple Mac mini with GPT disk partition From: Kim Shrier In-Reply-To: <5226FFB3.3050407@unsane.co.uk> Date: Wed, 4 Sep 2013 11:52:57 -0600 Content-Transfer-Encoding: quoted-printable Message-Id: References: <1EB0CEFA-6A7E-4666-BCE3-4158AFEEA047@westryn.net> <5226FFB3.3050407@unsane.co.uk> To: Vincent Hoffman X-Mailer: Apple Mail (2.1508) Cc: FreeBSD Hackers X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Sep 2013 17:53:00 -0000 On Sep 4, 2013, at 3:38 AM, Vincent Hoffman wrote: > On 03/09/2013 21:29, Kim Shrier wrote: >> Does anyone know if work on booting FreeBSD on modern Apple hardware >> was ever completed? I have looked on the wiki, forums, and email = archives >> but I don't see anything definitive. >>=20 >> I would like to have a GPT partitioned disk with a freebsd-boot, = freebsd-swap, >> and multiple freebsd-ufs partitions on a new Mac mini. Any pointers = would be >> appreciated. > I believe efi boot is almost done https://wiki.freebsd.org/UEFI >=20 > I haven't tested yet although I may sometime soon as it would be nice = to > have my macbook dual boot without having to use bootcamp. >=20 > Vince I seem to remember that the EFI code on a mac will only boot from an = HFS+ partition if the disk is partitioned using GPT. It will boot from a MBR = partitioned disk but only after waiting about 45 seconds before trying the MBR boot. = I would like to avoid this delay. Is this (still) true? Kim From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 4 21:30:01 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 6C004C61; Wed, 4 Sep 2013 21:30:01 +0000 (UTC) (envelope-from nwhitehorn@freebsd.org) Received: from mail.icecube.wisc.edu (trout.icecube.wisc.edu [128.104.255.119]) by mx1.freebsd.org (Postfix) with ESMTP id 304392742; Wed, 4 Sep 2013 21:30:00 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by mail.icecube.wisc.edu (Postfix) with ESMTP id D4DB958385; Wed, 4 Sep 2013 16:29:59 -0500 (CDT) X-Virus-Scanned: amavisd-new at icecube.wisc.edu Received: from mail.icecube.wisc.edu ([127.0.0.1]) by localhost (trout.icecube.wisc.edu [127.0.0.1]) (amavisd-new, port 10030) with ESMTP id C7+Tce5PvWx0; Wed, 4 Sep 2013 16:29:59 -0500 (CDT) Received: from terminus.icecube.wisc.edu (terminus.icecube.wisc.edu [172.16.223.97]) by mail.icecube.wisc.edu (Postfix) with ESMTP id A953E58384; Wed, 4 Sep 2013 16:29:59 -0500 (CDT) Message-ID: <5227A657.4010701@freebsd.org> Date: Wed, 04 Sep 2013 16:29:59 -0500 From: Nathan Whitehorn User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130809 Thunderbird/17.0.8 MIME-Version: 1.0 To: John Baldwin Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking References: <520D4ADB.50209@FreeBSD.org> <52273F90.7020303@freebsd.org> <201309041200.56024.jhb@freebsd.org> In-Reply-To: <201309041200.56024.jhb@freebsd.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-geom@freebsd.org, "freebsd-hackers@freebsd.org" , Alexander Motin , freebsd-current@freebsd.org, Outback Dingo , =?ISO-8859-1?Q?Olivier_Cochard-Labb=E9?= , FreeBSD SCSI , Ryan Stone X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Sep 2013 21:30:01 -0000 On 09/04/13 11:00, John Baldwin wrote: > On Wednesday, September 04, 2013 10:11:28 am Nathan Whitehorn wrote: >> On 09/04/13 08:20, Ryan Stone wrote: >>> On Wed, Sep 4, 2013 at 8:45 AM, Nathan Whitehorn > wrote: >>>> Could you describe what this macro is supposed to do so that we can do > the >>>> porting work? >>>> -Nathan >>> #define GET_STACK_USAGE(total, used) >>> >>> GET_STACK_USAGE sets the variable passed in total to the total amount >>> of stack space available to the current thread. used is set to the >>> amount of stack space currently used (this does not have to have >>> byte-precision). Netgraph uses this to decide when to stop recursing >>> and instead defer to a work queue (to prevent stack overflow). I >>> presume that Alexander is using it in a similar way. It looks like >>> the amd64 version could be ported to other architectures quite easily >>> if you were to account for stacks that grow up and stacks that grow >>> down: >>> >>> > http://svnweb.freebsd.org/base/head/sys/amd64/include/proc.h?revision=233291&view=markup >>> /* Get the current kernel thread stack usage. */ >>> #define GET_STACK_USAGE(total, used) do { \ >>> struct thread *td = curthread; \ >>> (total) = td->td_kstack_pages * PAGE_SIZE; \ >>> (used) = (char *)td->td_kstack + \ >>> td->td_kstack_pages * PAGE_SIZE - \ >>> (char *)&td; \ >>> } while (0) >>> _______________________________________________ >>> freebsd-hackers@freebsd.org mailing list >>> http://lists.freebsd.org/mailman/listinfo/freebsd-hackers >>> To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" >> I think that should be MI for us anyway. I'm not aware of any >> architectures FreeBSD supports with stacks that grow up. I'll give it a >> test on PPC. > ia64 has the double stack thingie where the register stack spills into a stack > that grows up rather than down. Not sure how sparc64 window spills are > handled either. > Ah, very well. That's weird. Should be fine for PPC, however. -Nathan From owner-freebsd-hackers@FreeBSD.ORG Thu Sep 5 12:40:52 2013 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 4A5114E1; Thu, 5 Sep 2013 12:40:52 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-bk0-x230.google.com (mail-bk0-x230.google.com [IPv6:2a00:1450:4008:c01::230]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id B12292B1C; Thu, 5 Sep 2013 12:40:51 +0000 (UTC) Received: by mail-bk0-f48.google.com with SMTP id my13so720689bkb.35 for ; Thu, 05 Sep 2013 05:40:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:message-id:date:from:user-agent:mime-version:to:subject :content-type:content-transfer-encoding; bh=8Z3kcvelwxokhY3nBr3uMzq9VZsLTGH5NrWXxMd5fKY=; b=jElfaW8h/9NoTien/GZ6ue1dgyR6DFdPuI4tloJZGHxYulkd4ooNwB8cCm5ZpyS/zC 041akRXQNjWEuXZTF8JqYQB7KHBAuWoZpZH5hfiSu/gDAZAjn35XjIGF4/6v/AI25JTz agoCIbVK6jk7wJxAwmD2jn+/D1XBsGYyJ43ctqBDsanjzBnIHQUSdNzNC24tBGGX7rXk YCVyBA6L5Cex9IVzvL341l+FNt4m0Xv1flLB6giZOW89mk+pMyjIhzUIzBCggNCHQ//1 ZlRlZPU56qRYcCsMk6QvqbfLMpBgBfz4EZDqpYX3G37nY5zW11/f4CfGDX2AQrDzy5r8 IoBg== X-Received: by 10.204.121.201 with SMTP id i9mr7215543bkr.13.1378384849200; Thu, 05 Sep 2013 05:40:49 -0700 (PDT) Received: from mavbook.mavhome.dp.ua ([37.229.21.195]) by mx.google.com with ESMTPSA id pn6sm7928380bkb.14.1969.12.31.16.00.00 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Thu, 05 Sep 2013 05:40:48 -0700 (PDT) Sender: Alexander Motin Message-ID: <52287BCD.4090507@FreeBSD.org> Date: Thu, 05 Sep 2013 15:40:45 +0300 From: Alexander Motin User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130616 Thunderbird/17.0.6 MIME-Version: 1.0 To: hackers@freebsd.org Subject: Again about pbuf_mtx Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Sep 2013 12:40:52 -0000 Hi. Some may remember that not so long ago I complained about high lock congestion on pbuf_mtx. At that time switching the mutex to padalign reduced the problem. But now after improving scalability in CAM and GEOM and doing more then half million IOPS on 32-core system I again heavily hit that problem -- hwpmc shows about 30% of CPU time spent on that mutex spinning and another 30% of time spent on attempt of threads to go to sleep on that mutex and getting more collisions there. Trying to mitigate that I've made a patch (http://people.freebsd.org/~mav/pcpu_pbuf.patch) to split single queue of pbufs into several. That definitely cost some amount of KVA and memory, but on my tests it fixes problem redically, removing any measurable congestion there. The patch is not complete and don't even boot on i386 now, but I would like to hear opinions about the approach, or may be some better propositions. Another patch I've made (http://people.freebsd.org/~mav/si_threadcount.patch) removes lock acquisition from dev_relthread() by using atomics for reference counting. That fixes another congestion I see. This patch looks fine to me and the only congestion I see after that is on HBA driver locks, but may be I am missing something? Thank you. -- Alexander Motin From owner-freebsd-hackers@FreeBSD.ORG Thu Sep 5 21:38:34 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 353CA329; Thu, 5 Sep 2013 21:38:34 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-ea0-x232.google.com (mail-ea0-x232.google.com [IPv6:2a00:1450:4013:c01::232]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 7485B222B; Thu, 5 Sep 2013 21:38:33 +0000 (UTC) Received: by mail-ea0-f178.google.com with SMTP id a15so1197367eae.9 for ; Thu, 05 Sep 2013 14:38:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=3Y3SU3hKjDRY9H37gbwWoI8b4zarwRXFW/n36mXoO7U=; b=W7K8LaPDCt9ZOe92QDuADwEsPQTebnHLgMx0eOUkD4V8aI0vvaCiA+nUaIyMIOeOIJ YHdmezZ7x8gIhI8nv3yuBEJDpsA3UXTMZry+1xrLitZP5Ij+7BU0QuoEgyE+6QdaELtc Q1Nx7sTyuYv0wEhv9V+Va/dpd/6OAqQ8mmj0wVGpSsaCMsF5a5ZGkKxoeLmEJ4oEaFlP Kc43YK2D+6EdKpQF66+/tWgczYtYXRSxoUHYwElxYydMc502+137x3HVDm4qtprwslnZ s5qRpmhLojmTUiumYHphkqb28j+zgqyF1i7Xzz0tPrFJso9L4S9wxrcJzrXpH6RYJCvT +I+g== X-Received: by 10.14.194.131 with SMTP id m3mr16631075een.45.1378417111929; Thu, 05 Sep 2013 14:38:31 -0700 (PDT) Received: from mavbook.mavhome.dp.ua ([37.229.21.195]) by mx.google.com with ESMTPSA id p5sm52041532eeg.5.1969.12.31.16.00.00 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Thu, 05 Sep 2013 14:38:31 -0700 (PDT) Sender: Alexander Motin Message-ID: <5228F9D4.3060008@FreeBSD.org> Date: Fri, 06 Sep 2013 00:38:28 +0300 From: Alexander Motin User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130616 Thunderbird/17.0.6 MIME-Version: 1.0 To: =?ISO-8859-1?Q?Olivier_Cochard-Labb=E9?= Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> <5226DAB0.1060303@FreeBSD.org> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit Cc: freebsd-hackers@freebsd.org, "freebsd-current@freebsd.org" , freebsd-geom@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Sep 2013 21:38:34 -0000 On 04.09.2013 19:31, Olivier Cochard-Labbé wrote: > On Wed, Sep 4, 2013 at 9:01 AM, Alexander Motin wrote: >> >>> - HP EliteBook 8460p (amd64: r255188) with DVD replaced by a second >>> hardrive (where fbsd is installed): It crash just after the message >>> "GEOM: new disk ada1" during boot >>> >>> screenshot of the crash screen: >>> http://goo.gl/tW1VIx >>> >>> A little more information: >>> addr2line -e /boot/kernel/kernel.symbols 0xffffffff8083abd3 >>> /usr/src/sys/geom/geom_io.c:129 >> >> >> Unfortunately I can't reproduce that and have not enough clues. It may be >> specific to some GEOM class. Could you describe/show all GEOM topology, file >> systems, etc. you have there? >> gpart show >> sysctl kern.geom.confxml I've found and fixed possible double request completion, that could cause such symptoms if happened. Updated patch located as usual: http://people.freebsd.org/~mav/camlock_patches/camlock_20130905.patch -- Alexander Motin From owner-freebsd-hackers@FreeBSD.ORG Thu Sep 5 22:46:48 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 855C3F7F; Thu, 5 Sep 2013 22:46:48 +0000 (UTC) (envelope-from cochard@gmail.com) Received: from mail-vb0-x22c.google.com (mail-vb0-x22c.google.com [IPv6:2607:f8b0:400c:c02::22c]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 0B40E25B5; Thu, 5 Sep 2013 22:46:47 +0000 (UTC) Received: by mail-vb0-f44.google.com with SMTP id e13so1681328vbg.3 for ; Thu, 05 Sep 2013 15:46:47 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc:content-type; bh=L2hqyhZpJ0JBn0q3kben8PMpNbwje0O2svVsBJ5vTpE=; b=nzK6rYk2L4RcR7ljW4QbvDcIgHfIkvHsxVkrEBmUPG7yI37hQWZuVK05BGyKeGBume 9oBL1UY4yJH1nOFaAZdOfgdDi6gOSoqMM1KeJa1mfK+Ry7SkH3LyZgfKu0C1yBwVpv0G D/8uJN8tYzRTIG/N6QsT7JNw0yfZ41IQKrEWY3vJ5OQB49ziJbjrNbPrEGLhwvGPiJg1 3hAO1ZkathFDFvBQJcKHmVFv58HIObDyUZUGJA+BWEqd14khc6VwOmuX1eZjT9y6TAd4 QKjjmmoJCRB1OenyIACt8uRD3yZGz2DeOmNuQP5s7UQbOszwGmxi1ngsqd0IRFfiwjVj wi1Q== X-Received: by 10.58.161.116 with SMTP id xr20mr10096802veb.2.1378421207130; Thu, 05 Sep 2013 15:46:47 -0700 (PDT) MIME-Version: 1.0 Sender: cochard@gmail.com Received: by 10.58.221.9 with HTTP; Thu, 5 Sep 2013 15:46:27 -0700 (PDT) In-Reply-To: <5228F9D4.3060008@FreeBSD.org> References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> <5226DAB0.1060303@FreeBSD.org> <5228F9D4.3060008@FreeBSD.org> From: =?ISO-8859-1?Q?Olivier_Cochard=2DLabb=E9?= Date: Fri, 6 Sep 2013 00:46:27 +0200 X-Google-Sender-Auth: rZXJ1jxqZ-x9zPiDTbRRsZzCApI Message-ID: Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking To: Alexander Motin Content-Type: text/plain; charset=ISO-8859-1 Cc: freebsd-hackers@freebsd.org, "freebsd-current@freebsd.org" , freebsd-geom@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Sep 2013 22:46:48 -0000 On Thu, Sep 5, 2013 at 11:38 PM, Alexander Motin wrote: > I've found and fixed possible double request completion, that could cause > such symptoms if happened. Updated patch located as usual: > http://people.freebsd.org/~mav/camlock_patches/camlock_20130905.patch > Good catch! this new patch (applied to r255188) fix the problem on my laptop. Thanks, Olivier From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 6 08:06:36 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 1080020C; Fri, 6 Sep 2013 08:06:36 +0000 (UTC) (envelope-from jlh@FreeBSD.org) Received: from caravan.chchile.org (caravan.chchile.org [178.32.125.136]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id C56A8248C; Fri, 6 Sep 2013 08:06:35 +0000 (UTC) Received: by caravan.chchile.org (Postfix, from userid 1000) id 35EF6C1B79; Fri, 6 Sep 2013 08:06:28 +0000 (UTC) Date: Fri, 6 Sep 2013 10:06:28 +0200 From: Jeremie Le Hen To: Olivier =?iso-8859-1?Q?Cochard-Labb=E9?= Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking Message-ID: <20130906080627.GH43281@caravan.chchile.org> Mail-Followup-To: Olivier =?iso-8859-1?Q?Cochard-Labb=E9?= , Alexander Motin , freebsd-hackers@freebsd.org, "freebsd-current@freebsd.org" , freebsd-geom@freebsd.org References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> <5226DAB0.1060303@FreeBSD.org> <5228F9D4.3060008@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-hackers@freebsd.org, Alexander Motin , "freebsd-current@freebsd.org" , freebsd-geom@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Sep 2013 08:06:36 -0000 On Fri, Sep 06, 2013 at 12:46:27AM +0200, Olivier Cochard-Labbé wrote: > On Thu, Sep 5, 2013 at 11:38 PM, Alexander Motin wrote: > > I've found and fixed possible double request completion, that could cause > > such symptoms if happened. Updated patch located as usual: > > http://people.freebsd.org/~mav/camlock_patches/camlock_20130905.patch > > > > Good catch! > this new patch (applied to r255188) fix the problem on my laptop. With this new one I cannot boot any more (I also updated the source tree). This is a hand transcripted version: Trying to mount root from zfs:zroot/root []... panic: Batch flag already set cpuid = 1 KDB: stack backtrace: db_trace_self_wrapper() kdb_backtrace() vpanic() kassert_panic() xpt_batch_start() ata_interrupt() softclock_call_cc() softclock() ithread_loop() fork_exit() fork_trampoline() -- Jeremie Le Hen Scientists say the world is made up of Protons, Neutrons and Electrons. They forgot to mention Morons. From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 6 08:11:25 2013 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id E3367533; Fri, 6 Sep 2013 08:11:24 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-ea0-x233.google.com (mail-ea0-x233.google.com [IPv6:2a00:1450:4013:c01::233]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 09FA1254D; Fri, 6 Sep 2013 08:11:23 +0000 (UTC) Received: by mail-ea0-f179.google.com with SMTP id b10so1403847eae.38 for ; Fri, 06 Sep 2013 01:11:22 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=MENZEmMr0sUVxdAq0usDknkzf7eJArKcNpbmmkCSdyk=; b=TC67HJEukz882fT6ifYtGLcpNr6Z6pFEvYsPUfmbffJ6SUJQdUL6DkHWyBYQvfnK25 S0xgvF10pZCHR9x+YQh3TxJZleGby8gr4rQk94lvdrD+E293WgMv1h/h22y5GV0K7/lG SAcabzqpCbHrAnU4ZiyyqTITN5ADVgYaIYg/4fYT3SjpDc7089ghUFoOtRFuyfJz6pKI Wg34jloD75h4r3jij0kcx2kaBUXI5jORvUUMvHRgvL3Wq5B0mC33lLaVOxwqpBYu6C7c euSRDrnQBmYTkG03Gmn9smo3hSaxbVdAfQtZnJxp/XMShgC80mNjRoC/Yg9N5SxDzXcl TiGg== X-Received: by 10.15.102.71 with SMTP id bq47mr1268106eeb.66.1378455082304; Fri, 06 Sep 2013 01:11:22 -0700 (PDT) Received: from mavbook.mavhome.dp.ua ([37.229.21.195]) by mx.google.com with ESMTPSA id z12sm2105616eev.6.1969.12.31.16.00.00 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 06 Sep 2013 01:11:21 -0700 (PDT) Sender: Alexander Motin Message-ID: <52298E27.60200@FreeBSD.org> Date: Fri, 06 Sep 2013 11:11:19 +0300 From: Alexander Motin User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130616 Thunderbird/17.0.6 MIME-Version: 1.0 To: hackers@freebsd.org Subject: Re: Again about pbuf_mtx References: <52287BCD.4090507@FreeBSD.org> In-Reply-To: <52287BCD.4090507@FreeBSD.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: Jeff Roberson , Andriy Gapon X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Sep 2013 08:11:25 -0000 On 05.09.2013 15:40, Alexander Motin wrote: > Some may remember that not so long ago I complained about high lock > congestion on pbuf_mtx. At that time switching the mutex to padalign > reduced the problem. But now after improving scalability in CAM and GEOM > and doing more then half million IOPS on 32-core system I again heavily > hit that problem -- hwpmc shows about 30% of CPU time spent on that > mutex spinning and another 30% of time spent on attempt of threads to go > to sleep on that mutex and getting more collisions there. > > Trying to mitigate that I've made a patch > (http://people.freebsd.org/~mav/pcpu_pbuf.patch) to split single queue > of pbufs into several. That definitely cost some amount of KVA and > memory, but on my tests it fixes problem redically, removing any > measurable congestion there. The patch is not complete and don't even > boot on i386 now, but I would like to hear opinions about the approach, > or may be some better propositions. On kib@ proposition I've tried to reimplement that patch using vmem(9). Code indeed looks much better (at least looked before workarounds): http://people.freebsd.org/~mav/pbuf_vmem.patch and it works fast, but I have found number of problems: - now we have only 256 (or even less) pbufs and UMA used by vmem for quick caches tend to allocate up to 256 items per CPU and never release them back. I've partially workarounded that by passing fake MAGIC_SIZE value to vmem and down to UMA as size to make initial bucket sizes smaller, but that is a hack and not always sufficient since size may grow on congestion and again never shrink back. - UMA panics with "uma_zalloc: Bucket pointer mangled." if I am giving vmem zero as valid pointer. I've workarounded that by adding an offset to the value, but I think that assertion in UMA should be removed if we are going to use it for abstract values now. > Another patch I've made > (http://people.freebsd.org/~mav/si_threadcount.patch) removes lock > acquisition from dev_relthread() by using atomics for reference > counting. That fixes another congestion I see. This patch looks fine to > me and the only congestion I see after that is on HBA driver locks, but > may be I am missing something? -- Alexander Motin From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 6 08:29:18 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 1F04722D; Fri, 6 Sep 2013 08:29:18 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-wi0-x233.google.com (mail-wi0-x233.google.com [IPv6:2a00:1450:400c:c05::233]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 3C2BC277F; Fri, 6 Sep 2013 08:29:17 +0000 (UTC) Received: by mail-wi0-f179.google.com with SMTP id hm2so548715wib.6 for ; Fri, 06 Sep 2013 01:29:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=cKvvmgI4MFZXDvTnnY59FeR0s1d1wz4lMm26SQGf0GA=; b=o5ccwrrEuDeiW02qIeTQ6XnFRpVWxSOvENLrYvAxtBCntauuGYvzJ5Kawq6Cip7cHj KTYEFxt21sjAI20m6psQjR/iAETpGKUHgUt6rHvq2i7Gf1Ktkb5vDH/Mdnvik6qzQetu zWxsoTzF47FlRRkv1QJPFKUgf+PjPbvI527zoNJ5Nim2nbRPRlkpbMiYu9cW8GZVrcly OWCvw/RKcHx2ZQjDE8gLIOGI3U2KvJAs0khy1ABKa1qtTb8nQXYLl1FjaJCm8T/So4+a eCLG/1gRFmJkyHF3WXMobqxVo+74DfeHBTuBFeey4wOYwV1YaaFAGkikPa3GrLaXH16j cTLA== X-Received: by 10.194.86.5 with SMTP id l5mr531403wjz.45.1378456155424; Fri, 06 Sep 2013 01:29:15 -0700 (PDT) Received: from mavbook.mavhome.dp.ua ([37.229.21.195]) by mx.google.com with ESMTPSA id e5sm4368184wiy.2.1969.12.31.16.00.00 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 06 Sep 2013 01:29:14 -0700 (PDT) Sender: Alexander Motin Message-ID: <52299257.10704@FreeBSD.org> Date: Fri, 06 Sep 2013 11:29:11 +0300 From: Alexander Motin User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130616 Thunderbird/17.0.6 MIME-Version: 1.0 To: Jeremie Le Hen Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> <5226DAB0.1060303@FreeBSD.org> <5228F9D4.3060008@FreeBSD.org> <20130906080627.GH43281@caravan.chchile.org> In-Reply-To: <20130906080627.GH43281@caravan.chchile.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit Cc: freebsd-hackers@freebsd.org, "freebsd-current@freebsd.org" , freebsd-geom@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Sep 2013 08:29:18 -0000 On 06.09.2013 11:06, Jeremie Le Hen wrote: > On Fri, Sep 06, 2013 at 12:46:27AM +0200, Olivier Cochard-Labbé wrote: >> On Thu, Sep 5, 2013 at 11:38 PM, Alexander Motin wrote: >>> I've found and fixed possible double request completion, that could cause >>> such symptoms if happened. Updated patch located as usual: >>> http://people.freebsd.org/~mav/camlock_patches/camlock_20130905.patch >>> > With this new one I cannot boot any more (I also updated the source > tree). This is a hand transcripted version: > > Trying to mount root from zfs:zroot/root []... > panic: Batch flag already set > cpuid = 1 > KDB: stack backtrace: > db_trace_self_wrapper() > kdb_backtrace() > vpanic() > kassert_panic() > xpt_batch_start() > ata_interrupt() > softclock_call_cc() > softclock() > ithread_loop() > fork_exit() > fork_trampoline() Thank you for the report. I see my fault. It is probably specific to ata(4) driver only. I've workarounded that in new patch version, but probably that area needs some rethinking. http://people.freebsd.org/~mav/camlock_patches/camlock_20130906.patch -- Alexander Motin From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 6 18:26:54 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 57A36CEE for ; Fri, 6 Sep 2013 18:26:54 +0000 (UTC) (envelope-from freebsd@dreamchaser.org) Received: from nightmare.dreamchaser.org (nightmare.dreamchaser.org [12.32.44.142]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 1E8FC2532 for ; Fri, 6 Sep 2013 18:26:53 +0000 (UTC) Received: from breakaway.dreamchaser.org (breakaway.dreamchaser.org. [12.32.36.73]) by nightmare.dreamchaser.org (8.13.6/8.13.6) with ESMTP id r86IQi6k045797 for ; Fri, 6 Sep 2013 12:26:44 -0600 (MDT) (envelope-from freebsd@dreamchaser.org) Message-ID: <522A1E64.3030907@dreamchaser.org> Date: Fri, 06 Sep 2013 12:26:44 -0600 From: Gary Aitken User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130730 Thunderbird/17.0.7 MIME-Version: 1.0 To: FreeBSD Mailing List Subject: need hint about build environment screwup Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-2.0.2 (nightmare.dreamchaser.org [12.32.36.65]); Fri, 06 Sep 2013 12:26:45 -0600 (MDT) X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list Reply-To: freebsd@dreamchaser.org List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Sep 2013 18:26:54 -0000 In trying to build /usr/ports/sysutils/lsof I get the following: In file included from /usr/include/_ctype.h:94, from /usr/include/ctype.h:46, from lsof.h:49, from dmnt.c:39: /usr/include/runetype.h:92: error: expected '=', ',', ';', 'asm' or '__attribute__' before 'const' /usr/include/runetype.h: In function '__getCurrentRuneLocale': /usr/include/runetype.h:96: error: '_ThreadRuneLocale' undeclared (first use in this function) /usr/include/runetype.h:96: error: (Each undeclared identifier is reported only once /usr/include/runetype.h:96: error: for each function it appears in.) I'm running 9.1 RELEASE on an amd64 with a recently updated ports tree, and recently upgraded to using pkgng /etc/make.conf contains WITH_PKGNG=yes I suspect something is wrong with the build environment, but haven't a clue. I'm trying to avoid rebuilding everything, and would like to find out what's screwed up. Since lsof basically doesn't depend on anything else, I'm baffled as to what got messed up. Can someone give me a hint? Thanks, Gary From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 6 23:02:38 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 981DB16B; Fri, 6 Sep 2013 23:02:38 +0000 (UTC) (envelope-from jlh@FreeBSD.org) Received: from caravan.chchile.org (caravan.chchile.org [178.32.125.136]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 5C51E2121; Fri, 6 Sep 2013 23:02:38 +0000 (UTC) Received: by caravan.chchile.org (Postfix, from userid 1000) id 38BB0C1EE3; Fri, 6 Sep 2013 23:02:36 +0000 (UTC) Date: Sat, 7 Sep 2013 01:02:36 +0200 From: Jeremie Le Hen To: Alexander Motin Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking Message-ID: <20130906230236.GI43281@caravan.chchile.org> Mail-Followup-To: Alexander Motin , freebsd-hackers@freebsd.org, "freebsd-current@freebsd.org" , freebsd-geom@freebsd.org References: <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> <5226DAB0.1060303@FreeBSD.org> <5228F9D4.3060008@FreeBSD.org> <20130906080627.GH43281@caravan.chchile.org> <52299257.10704@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <52299257.10704@FreeBSD.org> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-hackers@freebsd.org, "freebsd-current@freebsd.org" , freebsd-geom@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Sep 2013 23:02:38 -0000 On Fri, Sep 06, 2013 at 11:29:11AM +0300, Alexander Motin wrote: > On 06.09.2013 11:06, Jeremie Le Hen wrote: > > On Fri, Sep 06, 2013 at 12:46:27AM +0200, Olivier Cochard-Labbé wrote: > >> On Thu, Sep 5, 2013 at 11:38 PM, Alexander Motin wrote: > >>> I've found and fixed possible double request completion, that could cause > >>> such symptoms if happened. Updated patch located as usual: > >>> http://people.freebsd.org/~mav/camlock_patches/camlock_20130905.patch > >>> > > With this new one I cannot boot any more (I also updated the source > > tree). This is a hand transcripted version: > > > > Trying to mount root from zfs:zroot/root []... > > panic: Batch flag already set > > cpuid = 1 > > KDB: stack backtrace: > > db_trace_self_wrapper() > > kdb_backtrace() > > vpanic() > > kassert_panic() > > xpt_batch_start() > > ata_interrupt() > > softclock_call_cc() > > softclock() > > ithread_loop() > > fork_exit() > > fork_trampoline() > > Thank you for the report. I see my fault. It is probably specific to > ata(4) driver only. I've workarounded that in new patch version, but > probably that area needs some rethinking. > > http://people.freebsd.org/~mav/camlock_patches/camlock_20130906.patch I'm not sure you needed a confirmation, but it boots. Thanks :). I didn't quite understand the thread; is direct dispatch enabled for amd64? ISTR you said only i386 but someone else posted the macro for amd64. -- Jeremie Le Hen Scientists say the world is made up of Protons, Neutrons and Electrons. They forgot to mention Morons. From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 6 23:49:57 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 647BAD1; Fri, 6 Sep 2013 23:49:57 +0000 (UTC) (envelope-from shrikanth07@gmail.com) Received: from mail-vc0-x22c.google.com (mail-vc0-x22c.google.com [IPv6:2607:f8b0:400c:c03::22c]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 1808327E7; Fri, 6 Sep 2013 23:49:57 +0000 (UTC) Received: by mail-vc0-f172.google.com with SMTP id m17so2616780vca.17 for ; Fri, 06 Sep 2013 16:49:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=nx9j1tPvNPZKopY+Lr9A0v33BXahgpY9iygPVsigij0=; b=znnNyS1LzAP8pQfiPYrqbQRfsq/cnHAXzpjziqo3V5L4OFF2L+Iy+QYpi+pX+8gLQH sGWomN9OSaCSSxXOZ7BtrJd0BkPokXT+MrnavjYACAhdB/9/suyw0rzO1I3NXURxHdFL TJYeHn5BqdCK5K1WIw2W6KTdQZUhYmzPhCBsLKx3TZZzzq1y7rcZ2TM2hztTey4jkqJx Xl7RLerwkaUd8M/KgYBvVZnPdukcjquJ5gbWOV/IHSgeXWRm0Lgx0AW7gvcPiQhFSdQk poZdBwk82nk5EfdcQlcvTEceQnZJg4fFGFcWlit2P+izLD87F+nN+0FoiI5pMbBeztti PSng== MIME-Version: 1.0 X-Received: by 10.58.198.13 with SMTP id iy13mr4799048vec.11.1378511396144; Fri, 06 Sep 2013 16:49:56 -0700 (PDT) Received: by 10.59.1.70 with HTTP; Fri, 6 Sep 2013 16:49:56 -0700 (PDT) Date: Fri, 6 Sep 2013 16:49:56 -0700 Message-ID: Subject: Glitch in ctfconvert From: Shrikanth Kamath To: freebsd-hackers@freebsd.org, freebsd-dtrace@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Sep 2013 23:49:57 -0000 There is a glitch with ctfconvert builds the .SUNW_ctf section. It affects debugging the kernel modules with FBT provider of DTrace. I observe that the CTF sections built for the kernel modules have a problem if module symtab stripped or if the symbol table has symbols reordered. This messes up the FBT probes and shows wrong function name against a set of arguments. I presume the ctf mapping of a function to its arguments is done this way after looking at ctfdump code. func_name from symtab arguments dump from ctf_data_t ^ ^ |___symidx____ctfdump_____________| The detais are fetched from two different places. So when ctfconvert is run the function arguments are mapped with a particular symbol order. Post the linker stage the symbols may get reordered. Or if a strip utility is run the symtab may be removed completely. When first ctfconvert is run on module.kld symbol_X (idx 1) <-> [args set a in ctf_data_t] symbol_Y (idx 2) <-> [args set b in ctf_data_t] if symbols get re-arranged post the linker stage symbol_Y (idx 1) <-> [args set a in ctf_data_t] symbol_X (idx 2) <-> [args set b in ctf_data_t] which means symbol_Y now has args set of symbol_X Or if 'strip' is run it has totally junk shown against symbol_Y and symbol_X. Overall this affects when we do a Function Boundary Tracing on the functions to inspect arguments. From owner-freebsd-hackers@FreeBSD.ORG Sat Sep 7 06:32:52 2013 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id DE5F96B2; Sat, 7 Sep 2013 06:32:51 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-ee0-x22c.google.com (mail-ee0-x22c.google.com [IPv6:2a00:1450:4013:c00::22c]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 2B15D2DED; Sat, 7 Sep 2013 06:32:51 +0000 (UTC) Received: by mail-ee0-f44.google.com with SMTP id b47so2030518eek.3 for ; Fri, 06 Sep 2013 23:32:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:message-id:date:from:user-agent:mime-version:to:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=ilD9VCbquphj1dYzFxmCe9bvhxnFO5x39Z+sK2ZQYyc=; b=QG21UhYVc6fS3I1DtG2lispuOFkJAHmGsBe8l2vshkVr1YO4aWaD22pXiPLM0kCxZ7 8ANziza/TDXJyqWx1/AxUCzeGzvLcl//C04L0EdjqhbUE6MyOUjeCEQa56mFfYcVFGc+ hl/mUU1NklX3q0vTmgPv0FRd14FTrHEeDNSU0gjqkWUFPbIOJ8fzIMO3ya6DnJspUMXA mGEgOm3UEsx300oUisAtYb5kK3Xq+xHC5yOcupeulRa62VM+h/bJVYhOHjFnuXYpjYO4 lWHlGSXs3iftT5iIQEduNFp4xMDOn+FoV6ShN31B/CJoo6bP2z+WyUGGctmThFYA0+aL Wfag== X-Received: by 10.14.8.72 with SMTP id 48mr10508882eeq.25.1378535568549; Fri, 06 Sep 2013 23:32:48 -0700 (PDT) Received: from mavbook.mavhome.dp.ua ([37.229.21.195]) by mx.google.com with ESMTPSA id r48sm2188473eev.14.1969.12.31.16.00.00 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 06 Sep 2013 23:32:47 -0700 (PDT) Sender: Alexander Motin Message-ID: <522AC88D.4070005@FreeBSD.org> Date: Sat, 07 Sep 2013 09:32:45 +0300 From: Alexander Motin User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130616 Thunderbird/17.0.6 MIME-Version: 1.0 To: freebsd-hackers@freebsd.org, "freebsd-current@freebsd.org" , freebsd-geom@freebsd.org Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking References: <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> <5226DAB0.1060303@FreeBSD.org> <5228F9D4.3060008@FreeBSD.org> <20130906080627.GH43281@caravan.chchile.org> <52299257.10704@FreeBSD.org> <20130906230236.GI43281@caravan.chchile.org> In-Reply-To: <20130906230236.GI43281@caravan.chchile.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 07 Sep 2013 06:32:52 -0000 On 07.09.2013 02:02, Jeremie Le Hen wrote: > On Fri, Sep 06, 2013 at 11:29:11AM +0300, Alexander Motin wrote: >> On 06.09.2013 11:06, Jeremie Le Hen wrote: >>> On Fri, Sep 06, 2013 at 12:46:27AM +0200, Olivier Cochard-Labbé wrote: >>>> On Thu, Sep 5, 2013 at 11:38 PM, Alexander Motin wrote: >>>>> I've found and fixed possible double request completion, that could cause >>>>> such symptoms if happened. Updated patch located as usual: >>>>> http://people.freebsd.org/~mav/camlock_patches/camlock_20130905.patch >>>>> >>> With this new one I cannot boot any more (I also updated the source >>> tree). This is a hand transcripted version: >>> >>> Trying to mount root from zfs:zroot/root []... >>> panic: Batch flag already set >>> cpuid = 1 >>> KDB: stack backtrace: >>> db_trace_self_wrapper() >>> kdb_backtrace() >>> vpanic() >>> kassert_panic() >>> xpt_batch_start() >>> ata_interrupt() >>> softclock_call_cc() >>> softclock() >>> ithread_loop() >>> fork_exit() >>> fork_trampoline() >> >> Thank you for the report. I see my fault. It is probably specific to >> ata(4) driver only. I've workarounded that in new patch version, but >> probably that area needs some rethinking. >> >> http://people.freebsd.org/~mav/camlock_patches/camlock_20130906.patch > > I'm not sure you needed a confirmation, but it boots. Thanks :). > > I didn't quite understand the thread; is direct dispatch enabled for > amd64? ISTR you said only i386 but someone else posted the macro for > amd64. Yes, it is enabled for amd64. I've said x86, meaning both i386 and amd64. -- Alexander Motin