From owner-freebsd-stable@FreeBSD.ORG Sun Jul 1 07:30:41 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 5A96A16A468 for ; Sun, 1 Jul 2007 07:30:41 +0000 (UTC) (envelope-from kometen@gmail.com) Received: from wx-out-0506.google.com (wx-out-0506.google.com [66.249.82.230]) by mx1.freebsd.org (Postfix) with ESMTP id 1A35413C448 for ; Sun, 1 Jul 2007 07:30:41 +0000 (UTC) (envelope-from kometen@gmail.com) Received: by wx-out-0506.google.com with SMTP id i29so490493wxd for ; Sun, 01 Jul 2007 00:30:40 -0700 (PDT) DKIM-Signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=jZhn+2Ur4mB59YBAHkfL5f8HKxOASlxSyStKmSQ5KiX+uSDPYYIGy9iVSrWkpiu1vkPupn41zUvBriLE6802wCCN0XhznFXl5KfjGNSmyWz/Ux0mfTneutL9eIA0NnA5/scqE7C7oq4rUAUwhMrVc08u8DmuY0vcETUQkdndn1Y= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=UTL/DYtojSkzXyAprwsybg+S8RyWv2yxWlsMI30SBw9J0DpOdOjDm72YgYh3+T0+VP2V5SMHSNRLoUx4xXjLVqUDegaSJ4dPHr6+bNP4ra6u3uomV44eFQQYesT1XWi1Fy71EI/nk0+HlDz36ra0e15Zvfb1lCSoPhicOUca7L8= Received: by 10.70.52.1 with SMTP id z1mr367744wxz.1183275039984; Sun, 01 Jul 2007 00:30:39 -0700 (PDT) Received: by 10.70.72.6 with HTTP; Sun, 1 Jul 2007 00:30:39 -0700 (PDT) Message-ID: Date: Sun, 1 Jul 2007 09:30:39 +0200 From: "Claus Guttesen" To: "Nguyen Tam Chinh" In-Reply-To: <64b284310706270311j2a6af2f6i6766b483a4b66a5c@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <64b284310706270311j2a6af2f6i6766b483a4b66a5c@mail.gmail.com> Cc: freebsd-stable@freebsd.org, FreeBSD-Questions Subject: Re: UFS2 optimization for many small files X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 01 Jul 2007 07:30:41 -0000 > We're going to build a server with some 1Tb of over 500 million small > files with size from 0,5k to 4k. I'm wonder if the ufs2 can handle > this kind of system well. From newfs(8) the min block size is 4k. This > is not optimal in our case, a 1k or 0,5k block is more effective IMHO. > I'd be happy if anyone can suggest what does fragment (block/8) in the > ufs2 mean and how this parameter works. I know It's better to read the > full ufs2 specification, but hope that someone here can give a hint. > Please advice with optimizations or tricks. > Thank you very much. Try zfs on amd64 unless your app doesn't work well with zfs or your organization doesn't allow current. Current is remarkably stable taking into account zfs is fairly new and ported from solaris and running on current. I'm using it on a 8.2 TB nexsan storage and no crashes during testing and a limited time in production. Some years ago I used FreeBSD (5.2) as nfs-server (using ufs2) on approx. 15 partitions ranging from 400 GB to 2 TB in size. If the server for some reason had crashed the webservers were unable to access the nfs-mounted partitions during the period the server did a snapshot of a partition, in order to perform a background-fsck and thus our website was down. So ufs2 does not scale well. -- regards Claus When lenity and cruelty play for a kingdom, the gentlest gamester is the soonest winner. Shakespeare From owner-freebsd-stable@FreeBSD.ORG Sun Jul 1 09:26:40 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 679DB16A41F for ; Sun, 1 Jul 2007 09:26:40 +0000 (UTC) (envelope-from uspoerlein@gmail.com) Received: from ug-out-1314.google.com (ug-out-1314.google.com [66.249.92.170]) by mx1.freebsd.org (Postfix) with ESMTP id EA22A13C4B8 for ; Sun, 1 Jul 2007 09:26:39 +0000 (UTC) (envelope-from uspoerlein@gmail.com) Received: by ug-out-1314.google.com with SMTP id o4so680478uge for ; Sun, 01 Jul 2007 02:26:39 -0700 (PDT) DKIM-Signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:received:received:date:from:to:subject:message-id:mail-followup-to:references:mime-version:content-type:content-disposition:in-reply-to:user-agent; b=dlHpL+OS4PAxOGsYPaWoZRcTzqXoMSk+RD8qvjOtQqfiax44XWar85l61xy1mAIj61BBv/YBihf/wi7mhsoXZFi+NnGW+izjjBPbT+JbSNBaw29PwFiaEjzF8Wj1D8JwMRWsuM++XYWgv6lFaEBuz+z0MXLjqGmT1kja48/E23k= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:date:from:to:subject:message-id:mail-followup-to:references:mime-version:content-type:content-disposition:in-reply-to:user-agent; b=BCbOhQRGpRp5VKMKWxdw1qovSpbVOACPLVts1vj0Jvv8NB/yNEDDLUJDfLEbN1A8ypMfJSTzHK4/FNeLkWCqgecZd+sjrfelmogrfyWqwCF/blxJnXWqvvWcizC00p+ozPaGV7NOee+SIBLA9EKvd2AzzjdriQ3Z2ffBv1X9YrU= Received: by 10.66.236.13 with SMTP id j13mr2338651ugh.1183280511029; Sun, 01 Jul 2007 02:01:51 -0700 (PDT) Received: from roadrunner.q.local ( [85.180.134.200]) by mx.google.com with ESMTP id d13sm12813176fka.2007.07.01.02.01.49 (version=TLSv1/SSLv3 cipher=OTHER); Sun, 01 Jul 2007 02:01:50 -0700 (PDT) Received: from roadrunner.q.local (localhost [127.0.0.1]) by roadrunner.q.local (8.14.1/8.14.1) with ESMTP id l618J4wr002213; Sun, 1 Jul 2007 10:19:04 +0200 (CEST) (envelope-from uspoerlein@gmail.com) Received: (from q@localhost) by roadrunner.q.local (8.14.1/8.14.1/Submit) id l618J3Nf002212; Sun, 1 Jul 2007 10:19:03 +0200 (CEST) (envelope-from uspoerlein@gmail.com) Date: Sun, 1 Jul 2007 10:19:03 +0200 From: Ulrich Spoerlein To: Norberto Meijome , Yoshihiro Ota , freebsd-stable@freebsd.org Message-ID: <20070701081902.GB1797@roadrunner.q.local> Mail-Followup-To: Norberto Meijome , Yoshihiro Ota , freebsd-stable@freebsd.org References: <20070625174045.GA31486@slackbox.xs4all.nl> <20070625224507.da4e62c2.ota@j.email.ne.jp> <20070626060948.GA20203@slackbox.xs4all.nl> <20070627153221.1a2cce90@localhost> <20070627061206.GA58111@slackbox.xs4all.nl> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20070627061206.GA58111@slackbox.xs4all.nl> User-Agent: Mutt/1.5.15 (2007-04-06) Cc: Subject: Re: dumping large partition to USB drive fails X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 01 Jul 2007 09:26:40 -0000 On Wed, 27.06.2007 at 08:12:06 +0200, Roland Smith wrote: > Unfortunately I can't check the drives with smartctl; they produce an SCSI > error. I'll try 'camcontrol defects', and see if that turns up anything. Please try with atausb. Remove umass/da/scsi from your kernel and add atausb. Might be worth a try. Other than that, I wish FreeBSD could somehow translate those SMART commands, so it would work with USB/Firewire enclosures of all sorts. Cheers, Ulrich Spoerlein -- "The trouble with the dictionary is you have to know how the word is spelled before you can look it up to see how it is spelled." -- Will Cuppy From owner-freebsd-stable@FreeBSD.ORG Sun Jul 1 10:02:07 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 65BF616A46B for ; Sun, 1 Jul 2007 10:02:07 +0000 (UTC) (envelope-from rsmith@xs4all.nl) Received: from smtp-vbr1.xs4all.nl (smtp-vbr1.xs4all.nl [194.109.24.21]) by mx1.freebsd.org (Postfix) with ESMTP id 01EA413C45D for ; Sun, 1 Jul 2007 10:02:06 +0000 (UTC) (envelope-from rsmith@xs4all.nl) Received: from slackbox.xs4all.nl (slackbox.xs4all.nl [213.84.242.160]) by smtp-vbr1.xs4all.nl (8.13.8/8.13.8) with ESMTP id l61A25D0065663 for ; Sun, 1 Jul 2007 12:02:06 +0200 (CEST) (envelope-from rsmith@xs4all.nl) Received: by slackbox.xs4all.nl (Postfix, from userid 1001) id 35FBCB82A; Sun, 1 Jul 2007 12:02:05 +0200 (CEST) Date: Sun, 1 Jul 2007 12:02:05 +0200 From: Roland Smith To: freebsd-stable@freebsd.org Message-ID: <20070701100205.GA63587@slackbox.xs4all.nl> Mail-Followup-To: freebsd-stable@freebsd.org References: <20070625174045.GA31486@slackbox.xs4all.nl> <20070625224507.da4e62c2.ota@j.email.ne.jp> <20070626060948.GA20203@slackbox.xs4all.nl> <20070627153221.1a2cce90@localhost> <20070627061206.GA58111@slackbox.xs4all.nl> <20070701081902.GB1797@roadrunner.q.local> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="VbJkn9YxBvnuCH5J" Content-Disposition: inline In-Reply-To: <20070701081902.GB1797@roadrunner.q.local> X-GPG-Fingerprint: 1A2B 477F 9970 BA3C 2914 B7CE 1277 EFB0 C321 A725 X-GPG-Key: http://www.xs4all.nl/~rsmith/pubkey.txt X-GPG-Notice: If this message is not signed, don't assume I sent it! User-Agent: Mutt/1.5.15 (2007-04-06) X-Virus-Scanned: by XS4ALL Virus Scanner Subject: Re: dumping large partition to USB drive fails X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 01 Jul 2007 10:02:07 -0000 --VbJkn9YxBvnuCH5J Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sun, Jul 01, 2007 at 10:19:03AM +0200, Ulrich Spoerlein wrote: > On Wed, 27.06.2007 at 08:12:06 +0200, Roland Smith wrote: > > Unfortunately I can't check the drives with smartctl; they produce an S= CSI > > error. I'll try 'camcontrol defects', and see if that turns up anything. >=20 > Please try with atausb. Remove umass/da/scsi from your kernel and add > atausb. Might be worth a try. I tested the disk by putting it in another computer and running the manufacturer's diagnostic from the ultimate boot CD (www.ultimatebootcd.com) and it was fine. > Other than that, I wish FreeBSD could somehow translate those SMART > commands, so it would work with USB/Firewire enclosures of all sorts. It turned out that my enclosure used a USB/firewire chip with known problems, the Prolific PL3507 which has a problem with large transfers. I've ditched it. Roland --=20 R.F.Smith http://www.xs4all.nl/~rsmith/ [plain text _non-HTML_ PGP/GnuPG encrypted/signed email much appreciated] pgp: 1A2B 477F 9970 BA3C 2914 B7CE 1277 EFB0 C321 A725 (KeyID: C321A725) --VbJkn9YxBvnuCH5J Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4 (FreeBSD) iD8DBQFGh3ucEnfvsMMhpyURAks7AJwK/GGQ6KHXU4ls09KyNkqCSwTs8ACgpPLt HR9jnGGG9pAGcGYZx+xHxUk= =/gCx -----END PGP SIGNATURE----- --VbJkn9YxBvnuCH5J-- From owner-freebsd-stable@FreeBSD.ORG Sun Jul 1 10:35:48 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id C9D7716A400 for ; Sun, 1 Jul 2007 10:35:48 +0000 (UTC) (envelope-from junics-fbsdstable@atlantis.maniacs.se) Received: from mammoth.unixsh.net (mammoth.unixsh.net [195.35.83.67]) by mx1.freebsd.org (Postfix) with SMTP id 214B513C48A for ; Sun, 1 Jul 2007 10:35:47 +0000 (UTC) (envelope-from junics-fbsdstable@atlantis.maniacs.se) Received: (qmail 90463 invoked from network); 1 Jul 2007 10:09:05 -0000 Received: from localhost.maniacs.se (HELO ?192.168.0.34?) (127.0.0.1) by localhost.maniacs.se with SMTP; 1 Jul 2007 10:09:05 -0000 Message-ID: <46877D42.8010606@atlantis.maniacs.se> Date: Sun, 01 Jul 2007 12:09:06 +0200 From: Thomas Herrlin User-Agent: Thunderbird 1.5.0.9 (Windows/20061207) MIME-Version: 1.0 To: Nguyen Tam Chinh References: <64b284310706270311j2a6af2f6i6766b483a4b66a5c@mail.gmail.com> In-Reply-To: <64b284310706270311j2a6af2f6i6766b483a4b66a5c@mail.gmail.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-stable@freebsd.org Subject: Re: UFS2 optimization for many small files X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 01 Jul 2007 10:35:48 -0000 Nguyen Tam Chinh wrote: > Greetings, > > We're going to build a server with some 1Tb of over 500 million small > files with size from 0,5k to 4k. I'm wonder if the ufs2 can handle > this kind of system well. From newfs(8) the min block size is 4k. This > is not optimal in our case, a 1k or 0,5k block is more effective IMHO. > I'd be happy if anyone can suggest what does fragment (block/8) in the > ufs2 mean and how this parameter works. I know It's better to read the > full ufs2 specification, but hope that someone here can give a hint. > Please advice with optimizations or tricks. > Thank you very much. > If all else fails; try "divide and conquer" by having one filesystem per subdirectory. Unless you plan on having all files in a single dir?! Also look at how the squid proxy stores its files using a hashed dir structure. Another alternative is storing the data in a database if you don't need direct random RW file access.. From owner-freebsd-stable@FreeBSD.ORG Sun Jul 1 18:27:34 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 4B69116A421; Sun, 1 Jul 2007 18:27:34 +0000 (UTC) (envelope-from wojtek@wojtek.tensor.gdynia.pl) Received: from wojtek.tensor.gdynia.pl (chylonia.3miasto.net [83.12.228.78]) by mx1.freebsd.org (Postfix) with ESMTP id A732813C46C; Sun, 1 Jul 2007 18:27:33 +0000 (UTC) (envelope-from wojtek@wojtek.tensor.gdynia.pl) Received: from wojtek.tensor.gdynia.pl (localhost [IPv6:::1]) by wojtek.tensor.gdynia.pl (8.13.8/8.13.8) with ESMTP id l61IRRGZ064222; Sun, 1 Jul 2007 20:27:27 +0200 (CEST) (envelope-from wojtek@wojtek.tensor.gdynia.pl) Received: from localhost (wojtek@localhost) by wojtek.tensor.gdynia.pl (8.13.8/8.13.8/Submit) with ESMTP id l61IRR0E064219; Sun, 1 Jul 2007 20:27:27 +0200 (CEST) (envelope-from wojtek@wojtek.tensor.gdynia.pl) Date: Sun, 1 Jul 2007 20:27:27 +0200 (CEST) From: Wojciech Puchar To: Claus Guttesen In-Reply-To: Message-ID: <20070701202709.L64116@wojtek.tensor.gdynia.pl> References: <64b284310706270311j2a6af2f6i6766b483a4b66a5c@mail.gmail.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: Nguyen Tam Chinh , freebsd-stable@freebsd.org, FreeBSD-Questions Subject: Re: UFS2 optimization for many small files X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 01 Jul 2007 18:27:34 -0000 > approx. 15 partitions ranging from 400 GB to 2 TB in size. If the > server for some reason had crashed the webservers were unable to the question is about the reason it crashed... > access the nfs-mounted partitions during the period the server did a > snapshot of a partition, in order to perform a background-fsck and > thus our website was down. So ufs2 does not scale well. From owner-freebsd-stable@FreeBSD.ORG Sun Jul 1 18:29:41 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id B69E416A469; Sun, 1 Jul 2007 18:29:41 +0000 (UTC) (envelope-from wojtek@wojtek.tensor.gdynia.pl) Received: from wojtek.tensor.gdynia.pl (chylonia.3miasto.net [83.12.228.78]) by mx1.freebsd.org (Postfix) with ESMTP id 1D44613C4BF; Sun, 1 Jul 2007 18:29:40 +0000 (UTC) (envelope-from wojtek@wojtek.tensor.gdynia.pl) Received: from wojtek.tensor.gdynia.pl (localhost [IPv6:::1]) by wojtek.tensor.gdynia.pl (8.13.8/8.13.8) with ESMTP id l61ITV1c064256; Sun, 1 Jul 2007 20:29:32 +0200 (CEST) (envelope-from wojtek@wojtek.tensor.gdynia.pl) Received: from localhost (wojtek@localhost) by wojtek.tensor.gdynia.pl (8.13.8/8.13.8/Submit) with ESMTP id l61ITVfJ064253; Sun, 1 Jul 2007 20:29:31 +0200 (CEST) (envelope-from wojtek@wojtek.tensor.gdynia.pl) Date: Sun, 1 Jul 2007 20:29:31 +0200 (CEST) From: Wojciech Puchar To: Peter Jeremy In-Reply-To: <20070630235127.GX15680@turion.vk2pj.dyndns.org> Message-ID: <20070701202758.B64116@wojtek.tensor.gdynia.pl> References: <64b284310706270311j2a6af2f6i6766b483a4b66a5c@mail.gmail.com> <20070630235127.GX15680@turion.vk2pj.dyndns.org> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: Nguyen Tam Chinh , freebsd-stable@freebsd.org, FreeBSD-Questions Subject: Re: UFS2 optimization for many small files X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 01 Jul 2007 18:29:41 -0000 > I have tried using a 4K/0.5K UFS1 filesystem in the past and found the > performance was very poor. UFS2 was based on 16K/2K and I would expect > it to perform even worse with 4K/0.5K. I would suggest you try 8K/1K. > not for small files. you are light with large files but it's not THAT bad as you say. i reagularly use 4K/0.5 UFS but not for everything if i require good fast speed for big files. for really big files i make 32/4 filesystem with very little inodes From owner-freebsd-stable@FreeBSD.ORG Sun Jul 1 18:33:41 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id A3DD616A46B for ; Sun, 1 Jul 2007 18:33:41 +0000 (UTC) (envelope-from wojtek@wojtek.tensor.gdynia.pl) Received: from wojtek.tensor.gdynia.pl (chylonia.3miasto.net [83.12.228.78]) by mx1.freebsd.org (Postfix) with ESMTP id AF8BA13C484 for ; Sun, 1 Jul 2007 18:33:38 +0000 (UTC) (envelope-from wojtek@wojtek.tensor.gdynia.pl) Received: from wojtek.tensor.gdynia.pl (localhost [IPv6:::1]) by wojtek.tensor.gdynia.pl (8.13.8/8.13.8) with ESMTP id l61IDssg064189; Sun, 1 Jul 2007 20:13:54 +0200 (CEST) (envelope-from wojtek@wojtek.tensor.gdynia.pl) Received: from localhost (wojtek@localhost) by wojtek.tensor.gdynia.pl (8.13.8/8.13.8/Submit) with ESMTP id l61IDr6V064186; Sun, 1 Jul 2007 20:13:53 +0200 (CEST) (envelope-from wojtek@wojtek.tensor.gdynia.pl) Date: Sun, 1 Jul 2007 20:13:53 +0200 (CEST) From: Wojciech Puchar To: Nguyen Tam Chinh In-Reply-To: <64b284310706270311j2a6af2f6i6766b483a4b66a5c@mail.gmail.com> Message-ID: <20070701200639.N64116@wojtek.tensor.gdynia.pl> References: <64b284310706270311j2a6af2f6i6766b483a4b66a5c@mail.gmail.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: freebsd-stable@freebsd.org, FreeBSD-Questions Subject: Re: UFS2 optimization for many small files X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 01 Jul 2007 18:33:41 -0000 > > We're going to build a server with some 1Tb of over 500 million small > files with size from 0,5k to 4k. I'm wonder if the ufs2 can handle > this kind of system well. From newfs(8) the min block size is 4k. This > is not optimal in our case, a 1k or 0,5k block is more effective IMHO. > I'd be happy if anyone can suggest what does fragment (block/8) in the > ufs2 mean and how this parameter works. I know It's better to read the exactly as a block/cluster in windows. fragment is the smallest allocation block. "block" is a group of 8 fragments to make allocation faster and smarter. > full ufs2 specification, but hope that someone here can give a hint. > Please advice with optimizations or tricks. please DO NOT make single partition like that. try to divide it to 3-4 partitions. it will work on a single one but waiting for fsck will kill you ;) AFAIK fsck time grows nonlinearly with fs size to some extent.. options for newfs will be like that newfs -m -i -b 4096 -f 512 -U /dev/partition where A is space left. with mostly small files and huge partition don't worry to set it 1 or even 0. B - size of disk(bytes)/amount of inodes default is probably 2048, you may use 1024 or 4096 for your case - make rough estimate how much files will you have (you told between 4 and 0.5k, but what average?). making too much inodes=wasted space (128 bytes/inode), making too little=big problem :) another question - HOW do you plan to make backups of such data? with dump rsync tar etc. it's clearly "mission impossible". feel free to mail me i had such cases not 5E8 but over 1E8 files :) From owner-freebsd-stable@FreeBSD.ORG Sun Jul 1 18:35:35 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 9718B16A421; Sun, 1 Jul 2007 18:35:35 +0000 (UTC) (envelope-from wojtek@wojtek.tensor.gdynia.pl) Received: from wojtek.tensor.gdynia.pl (chylonia.3miasto.net [83.12.228.78]) by mx1.freebsd.org (Postfix) with ESMTP id E053613C4CB; Sun, 1 Jul 2007 18:35:34 +0000 (UTC) (envelope-from wojtek@wojtek.tensor.gdynia.pl) Received: from wojtek.tensor.gdynia.pl (localhost [IPv6:::1]) by wojtek.tensor.gdynia.pl (8.13.8/8.13.8) with ESMTP id l61IZSuo064382; Sun, 1 Jul 2007 20:35:28 +0200 (CEST) (envelope-from wojtek@wojtek.tensor.gdynia.pl) Received: from localhost (wojtek@localhost) by wojtek.tensor.gdynia.pl (8.13.8/8.13.8/Submit) with ESMTP id l61IZStb064379; Sun, 1 Jul 2007 20:35:28 +0200 (CEST) (envelope-from wojtek@wojtek.tensor.gdynia.pl) Date: Sun, 1 Jul 2007 20:35:28 +0200 (CEST) From: Wojciech Puchar To: Claus Guttesen In-Reply-To: Message-ID: <20070701203449.F64116@wojtek.tensor.gdynia.pl> References: <64b284310706270311j2a6af2f6i6766b483a4b66a5c@mail.gmail.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: Nguyen Tam Chinh , freebsd-stable@freebsd.org, FreeBSD-Questions Subject: Re: UFS2 optimization for many small files X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 01 Jul 2007 18:35:35 -0000 >> Thank you very much. > > Try zfs on amd64 unless your app doesn't work well with zfs or your does zfs have RELIABLE and USABLE software allowing to efficiently backup large filesystems to other media? (DVD's, tapes, other hard discs) From owner-freebsd-stable@FreeBSD.ORG Sun Jul 1 18:54:40 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 3107B16A41F for ; Sun, 1 Jul 2007 18:54:40 +0000 (UTC) (envelope-from kometen@gmail.com) Received: from wx-out-0506.google.com (wx-out-0506.google.com [66.249.82.236]) by mx1.freebsd.org (Postfix) with ESMTP id E2E4C13C44B for ; Sun, 1 Jul 2007 18:54:39 +0000 (UTC) (envelope-from kometen@gmail.com) Received: by wx-out-0506.google.com with SMTP id i29so557177wxd for ; Sun, 01 Jul 2007 11:54:39 -0700 (PDT) DKIM-Signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=dIu8UrQsHD0U4ceVwcLYqUa7Uf1wjlJQZ9DcEveGEuLIxlfvq5kxM6U4f8pH3PceoCGdg65+ivfC3MGkKI1kgIKvTaFkLL+qHDS2aeylYv22255A+xdeGB+L/5VBlr83BvNpttdcjplMbnmkhLXG2dUzEgJMVqgN/LIOkLy7N1g= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=r5OVzKpQjFk7xtDiqQNHujEbLLQYLD60JeLNVxGV05X43IwXnJFF06gFuLWVSv7NZ8AQizLfL+83zK26VscrVB0iEmr1vTKvyhdCit8kVsli5pRZzyeatEWhp7/lfuZypbFJAgSvjkHsn02LznxWWpoWj5RqQxC9Nb230Tku/E8= Received: by 10.70.80.14 with SMTP id d14mr6042529wxb.1183316079316; Sun, 01 Jul 2007 11:54:39 -0700 (PDT) Received: by 10.70.72.6 with HTTP; Sun, 1 Jul 2007 11:54:39 -0700 (PDT) Message-ID: Date: Sun, 1 Jul 2007 20:54:39 +0200 From: "Claus Guttesen" To: "Wojciech Puchar" In-Reply-To: <20070701202709.L64116@wojtek.tensor.gdynia.pl> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <64b284310706270311j2a6af2f6i6766b483a4b66a5c@mail.gmail.com> <20070701202709.L64116@wojtek.tensor.gdynia.pl> Cc: Nguyen Tam Chinh , freebsd-stable@freebsd.org, FreeBSD-Questions Subject: Re: UFS2 optimization for many small files X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 01 Jul 2007 18:54:40 -0000 > > approx. 15 partitions ranging from 400 GB to 2 TB in size. If the > > server for some reason had crashed the webservers were unable to > > the question is about the reason it crashed... > > > access the nfs-mounted partitions during the period the server did a > > snapshot of a partition, in order to perform a background-fsck and > > thus our website was down. So ufs2 does not scale well. Reasons not related to the nfs-server itself. FreeBSD itself was rock-solid. It was firmware-related on the storage-side. -- regards Claus When lenity and cruelty play for a kingdom, the gentlest gamester is the soonest winner. Shakespeare From owner-freebsd-stable@FreeBSD.ORG Sun Jul 1 18:57:43 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 2B59716A46C for ; Sun, 1 Jul 2007 18:57:43 +0000 (UTC) (envelope-from kometen@gmail.com) Received: from wx-out-0506.google.com (wx-out-0506.google.com [66.249.82.234]) by mx1.freebsd.org (Postfix) with ESMTP id CD8B113C44C for ; Sun, 1 Jul 2007 18:57:42 +0000 (UTC) (envelope-from kometen@gmail.com) Received: by wx-out-0506.google.com with SMTP id i29so557557wxd for ; Sun, 01 Jul 2007 11:57:42 -0700 (PDT) DKIM-Signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=q240AVBRd+buaW7zUh9w9hEEaXqApvbuXgzov8XhHwbojNw9GMNnJz+fmbKfJOK9h2cR+fY5Ke4qi4lPUKQmMEkvTXj91vvTxT6USWsm/GbVG7r2BfhrXVOrG7a9D+CfxtH5drjEnWbq5dNq+906osmIdTdXY9fxRH2LOlkvgo4= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=VJuvfIvRXI1z046AjolQHcaaYtB0t3mQDp/Z7s5mN+D2aF2ZiIPMeiFmUj6u2aIt4OB8f0eMrBt8w6BNk/hhyM/ySTOYnnY+MAMpiyg3VR+t/DARhBZKZrMTbK6SkR/IvcI3vYXWwH5KKsqLu9qkX/X6nHE3iMV2bmmRGpo/B7I= Received: by 10.70.29.7 with SMTP id c7mr5990241wxc.1183316262147; Sun, 01 Jul 2007 11:57:42 -0700 (PDT) Received: by 10.70.72.6 with HTTP; Sun, 1 Jul 2007 11:57:42 -0700 (PDT) Message-ID: Date: Sun, 1 Jul 2007 20:57:42 +0200 From: "Claus Guttesen" To: "Wojciech Puchar" In-Reply-To: <20070701203449.F64116@wojtek.tensor.gdynia.pl> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <64b284310706270311j2a6af2f6i6766b483a4b66a5c@mail.gmail.com> <20070701203449.F64116@wojtek.tensor.gdynia.pl> Cc: Nguyen Tam Chinh , freebsd-stable@freebsd.org, FreeBSD-Questions Subject: Re: UFS2 optimization for many small files X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 01 Jul 2007 18:57:43 -0000 > > Try zfs on amd64 unless your app doesn't work well with zfs or your > > does zfs have RELIABLE and USABLE software allowing to efficiently backup > large filesystems to other media? (DVD's, tapes, other hard discs) Zfs has send/receive where you can do snapshots and send them to a different host. This could be your backup-host. I'm considering this solution myself where FreeBSD and zfs is my primary host and my nightly backups will be send to my solaris-host. Solaris has the required lto-3-drivers. -- regards Claus When lenity and cruelty play for a kingdom, the gentlest gamester is the soonest winner. Shakespeare From owner-freebsd-stable@FreeBSD.ORG Sun Jul 1 19:00:06 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id DD4D216A46C; Sun, 1 Jul 2007 19:00:06 +0000 (UTC) (envelope-from wojtek@wojtek.tensor.gdynia.pl) Received: from wojtek.tensor.gdynia.pl (chylonia.3miasto.net [83.12.228.78]) by mx1.freebsd.org (Postfix) with ESMTP id 4BF2713C448; Sun, 1 Jul 2007 19:00:06 +0000 (UTC) (envelope-from wojtek@wojtek.tensor.gdynia.pl) Received: from wojtek.tensor.gdynia.pl (localhost [IPv6:::1]) by wojtek.tensor.gdynia.pl (8.13.8/8.13.8) with ESMTP id l61J00Bo064534; Sun, 1 Jul 2007 21:00:00 +0200 (CEST) (envelope-from wojtek@wojtek.tensor.gdynia.pl) Received: from localhost (wojtek@localhost) by wojtek.tensor.gdynia.pl (8.13.8/8.13.8/Submit) with ESMTP id l61J00lE064531; Sun, 1 Jul 2007 21:00:00 +0200 (CEST) (envelope-from wojtek@wojtek.tensor.gdynia.pl) Date: Sun, 1 Jul 2007 21:00:00 +0200 (CEST) From: Wojciech Puchar To: Claus Guttesen In-Reply-To: Message-ID: <20070701205906.G64506@wojtek.tensor.gdynia.pl> References: <64b284310706270311j2a6af2f6i6766b483a4b66a5c@mail.gmail.com> <20070701202709.L64116@wojtek.tensor.gdynia.pl> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: Nguyen Tam Chinh , freebsd-stable@freebsd.org, FreeBSD-Questions Subject: Re: UFS2 optimization for many small files X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 01 Jul 2007 19:00:07 -0000 >> > snapshot of a partition, in order to perform a background-fsck and >> > thus our website was down. So ufs2 does not scale well. > > Reasons not related to the nfs-server itself. FreeBSD itself was > rock-solid. It was firmware-related on the storage-side. > i always use software mirror concat or both in FreeBSD. always works, 10 times cheaper, fully portable and (yes true) comparable in speed. in some cases - faster. From owner-freebsd-stable@FreeBSD.ORG Sun Jul 1 19:51:24 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id B570C16A421 for ; Sun, 1 Jul 2007 19:51:24 +0000 (UTC) (envelope-from raaf@zen.mooo.com) Received: from smtp-2.orange.nl (smtp-2.orange.nl [193.252.22.242]) by mx1.freebsd.org (Postfix) with ESMTP id 752BC13C45A for ; Sun, 1 Jul 2007 19:51:24 +0000 (UTC) (envelope-from raaf@zen.mooo.com) Received: from smtp-2.orange.nl (mwinf6106 [172.22.153.34]) by mwinf6105.orange.nl (SMTP Server) with ESMTP id 6A9412000272 for ; Sun, 1 Jul 2007 21:24:41 +0200 (CEST) Received: from me-wanadoo.net (localhost [127.0.0.1]) by mwinf6106.orange.nl (SMTP Server) with ESMTP id 2FC3E7000089 for ; Sun, 1 Jul 2007 21:24:39 +0200 (CEST) Received: from zen.mooo.com (s559292f8.adsl.wanadoo.nl [85.146.146.248]) by mwinf6106.orange.nl (SMTP Server) with ESMTP id 152C77000084; Sun, 1 Jul 2007 21:24:38 +0200 (CEST) X-ME-UUID: 20070701192439868.152C77000084@mwinf6106.orange.nl Received: from zen.mooo.com (zen.mooo.com [127.0.0.1]) by zen.mooo.com (Postfix) with ESMTP id F211D21; Sun, 1 Jul 2007 21:24:37 +0200 (CEST) Message-ID: <4687FF75.3000108@zen.mooo.com> Date: Sun, 01 Jul 2007 21:24:37 +0200 From: Raaf User-Agent: Thunderbird 1.5.0.9 (X11/20070103) MIME-Version: 1.0 To: freebsd-stable@freebsd.org, freebsd-fs@freebsd.org Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: Subject: Cannot mount Sony Ericsson mobile phone, msdosfs too restrictive? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 01 Jul 2007 19:51:24 -0000 Hi, i got a Sony Ericsson mobile phone that came with a pre-formatted memory stick that i'm unable to mount in FreeBSD (it mounts fine in Linux). After investigating i found out that the FreeBSD msdsofs driver bails out on the following code (the pmp->pm_Heads being zero): ---------------------------------- if (!pmp->pm_BytesPerSec || !SecPerClust || !pmp->pm_Heads #ifdef PC98 || !pmp->pm_SecPerTrack || pmp->pm_SecPerTrack > 255) { #else || !pmp->pm_SecPerTrack || pmp->pm_SecPerTrack > 63) { #endif error = EINVAL; goto error_exit; } ---------------------------------- Removing the check for pmp->pm_Heads fixes it for me. Is the check for pmp->pm_Heads really necessary? Grepping through the msdosfs sources i can only see it being used for validation and not used in any calculation (the same applies for the pmp->pm_SecPerTrack value) --- sys/fs/msdosfs/msdosfs_vfsops.c.orig Sun Jul 1 20:42:14 2007 +++ sys/fs/msdosfs/msdosfs_vfsops.c Sun Jul 1 20:46:57 2007 @@ -483,7 +483,6 @@ /* XXX - We should probably check more values here */ if (!pmp->pm_BytesPerSec || !SecPerClust - || !pmp->pm_Heads #ifdef PC98 || !pmp->pm_SecPerTrack || pmp->pm_SecPerTrack > 255) { #else From owner-freebsd-stable@FreeBSD.ORG Sun Jul 1 20:05:07 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 7C10916A400 for ; Sun, 1 Jul 2007 20:05:07 +0000 (UTC) (envelope-from dennis.melentyev@gmail.com) Received: from wa-out-1112.google.com (wa-out-1112.google.com [209.85.146.177]) by mx1.freebsd.org (Postfix) with ESMTP id 5746B13C46A for ; Sun, 1 Jul 2007 20:05:07 +0000 (UTC) (envelope-from dennis.melentyev@gmail.com) Received: by wa-out-1112.google.com with SMTP id j37so2028048waf for ; Sun, 01 Jul 2007 13:05:07 -0700 (PDT) DKIM-Signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=pa42MFIQvTpt1gGtJS99CT0c+E+Qi/xTJirXaKUiBTUelm5NZtB87ppOM8ChN+Fv1V3gUaYm8kWmDLTDN4JSMXKB/QXZkb9Pwf7F9HYCcHLfFtJCZUzwNpyXzrZWvc1pHHHDHW4r4c7uW2U83VVAk10ZBDVG4HTb5WIC4lFLWKs= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=U30M+bjG8lk+3wbFR7TI9QwsY4mVZ71F2C3ikXewnkanz4D1xLOQHAxZc8VYGKu3NeDJnLoP1S20yAi4dFvBKj+C7+npkzY11uwVXkyaYbHh/jfAtsrbW9DyW62vpWc9XlkcoLt2rBrKxv2u2uV2RzwIlJvHPH+xaL4iQKEXx5g= Received: by 10.114.192.1 with SMTP id p1mr4492453waf.1183320307012; Sun, 01 Jul 2007 13:05:07 -0700 (PDT) Received: by 10.115.78.2 with HTTP; Sun, 1 Jul 2007 13:05:06 -0700 (PDT) Message-ID: Date: Sun, 1 Jul 2007 23:05:06 +0300 From: "Dennis Melentyev" To: Raaf In-Reply-To: <4687FF75.3000108@zen.mooo.com> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <4687FF75.3000108@zen.mooo.com> Cc: freebsd-fs@freebsd.org, freebsd-stable@freebsd.org Subject: Re: Cannot mount Sony Ericsson mobile phone, msdosfs too restrictive? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 01 Jul 2007 20:05:07 -0000 Well, had the same problem. For me, it looks like SE is using FAT12 (!!!Not 16!!!) on a devive larger than 32MB. Could have something slipped off my mind, but quite close. It is a BROKEN msdosfs on a stick. Just re-formated 1Gb flash with FAT32 using card reader and both K750i and FreeBSD are happy. 2007/7/1, Raaf : > Hi, i got a Sony Ericsson mobile phone that came with a pre-formatted > memory stick that i'm unable to mount in FreeBSD (it mounts fine in > Linux). > > After investigating i found out that the FreeBSD msdsofs driver bails > out on the following code (the pmp->pm_Heads being zero): > > ---------------------------------- > if (!pmp->pm_BytesPerSec || !SecPerClust > || !pmp->pm_Heads > #ifdef PC98 > || !pmp->pm_SecPerTrack || pmp->pm_SecPerTrack > 255) { > #else > || !pmp->pm_SecPerTrack || pmp->pm_SecPerTrack > 63) { > #endif > error = EINVAL; > goto error_exit; > } > ---------------------------------- > > Removing the check for pmp->pm_Heads fixes it for me. > > Is the check for pmp->pm_Heads really necessary? > > Grepping through the msdosfs sources i can only see it being used for > validation and not used in any calculation (the same applies for the > pmp->pm_SecPerTrack value) > > > --- sys/fs/msdosfs/msdosfs_vfsops.c.orig Sun Jul 1 20:42:14 2007 > +++ sys/fs/msdosfs/msdosfs_vfsops.c Sun Jul 1 20:46:57 2007 > @@ -483,7 +483,6 @@ > > /* XXX - We should probably check more values here */ > if (!pmp->pm_BytesPerSec || !SecPerClust > - || !pmp->pm_Heads > #ifdef PC98 > || !pmp->pm_SecPerTrack || pmp->pm_SecPerTrack > 255) { > #else > > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > -- Dennis Melentyev From owner-freebsd-stable@FreeBSD.ORG Sun Jul 1 21:52:24 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 8A81416A46D for ; Sun, 1 Jul 2007 21:52:24 +0000 (UTC) (envelope-from quetzal@zone3000.net) Received: from mx1.sitevalley.com (sitevalley.com [209.67.60.43]) by mx1.freebsd.org (Postfix) with SMTP id 38D4213C46C for ; Sun, 1 Jul 2007 21:52:24 +0000 (UTC) (envelope-from quetzal@zone3000.net) Received: from zone3000.kharkov.ua (HELO localhost) (217.144.69.37) by 0 with SMTP; 1 Jul 2007 21:52:21 -0000 Date: Mon, 2 Jul 2007 00:52:29 +0300 From: Nikolay Pavlov To: Nguyen Tam Chinh Message-ID: <20070701215229.GB10527@zone3000.net> Mail-Followup-To: Nikolay Pavlov , Nguyen Tam Chinh , FreeBSD-Questions , freebsd-stable@freebsd.org References: <64b284310706270311j2a6af2f6i6766b483a4b66a5c@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <64b284310706270311j2a6af2f6i6766b483a4b66a5c@mail.gmail.com> X-Operating-System: FreeBSD 6.2-RELEASE-p4 User-Agent: mutt-ng/devel-r804 (FreeBSD) Cc: freebsd-stable@freebsd.org, FreeBSD-Questions Subject: Re: UFS2 optimization for many small files X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 01 Jul 2007 21:52:24 -0000 On Wednesday, 27 June 2007 at 14:11:19 +0400, Nguyen Tam Chinh wrote: > Greetings, > > We're going to build a server with some 1Tb of over 500 million small > files with size from 0,5k to 4k. I'm wonder if the ufs2 can handle > this kind of system well. From newfs(8) the min block size is 4k. This > is not optimal in our case, a 1k or 0,5k block is more effective IMHO. > I'd be happy if anyone can suggest what does fragment (block/8) in the > ufs2 mean and how this parameter works. I know It's better to read the > full ufs2 specification, but hope that someone here can give a hint. > Please advice with optimizations or tricks. > Thank you very much. > > -- > With best regards, | The Power to Serve > Nguyen Tam Chinh | http://www.FreeBSD.org > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" I am not aware of any ZFS results on such tasks, may be you will be the one who share them ;) However RaiserFS whould be the best choise on such spesific case. It's not available on FreeBSD currently. I don't think UFS can handle a huge amount of small files effectively. Of course gjournal could be an option for fsck problems, but how do you plan to backup or sync this storage? -- ====================================================================== - Best regards, Nikolay Pavlov. <<<----------------------------------- ====================================================================== From owner-freebsd-stable@FreeBSD.ORG Sun Jul 1 22:07:40 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id E25B116A41F for ; Sun, 1 Jul 2007 22:07:40 +0000 (UTC) (envelope-from raaf@zen.mooo.com) Received: from smtp-4.orange.nl (smtp-4.orange.nl [193.252.22.249]) by mx1.freebsd.org (Postfix) with ESMTP id A1F1913C487 for ; Sun, 1 Jul 2007 22:07:40 +0000 (UTC) (envelope-from raaf@zen.mooo.com) Received: from me-wanadoo.net (localhost [127.0.0.1]) by mwinf6302.orange.nl (SMTP Server) with ESMTP id 1CD98700008E for ; Mon, 2 Jul 2007 00:07:39 +0200 (CEST) Received: from zen.mooo.com (s559292f8.adsl.wanadoo.nl [85.146.146.248]) by mwinf6302.orange.nl (SMTP Server) with ESMTP id 076D37000085; Mon, 2 Jul 2007 00:07:38 +0200 (CEST) X-ME-UUID: 20070701220739304.076D37000085@mwinf6302.orange.nl Received: from zen.mooo.com (zen.mooo.com [127.0.0.1]) by zen.mooo.com (Postfix) with ESMTP id 176616F; Mon, 2 Jul 2007 00:07:38 +0200 (CEST) Message-ID: <468825A9.80200@zen.mooo.com> Date: Mon, 02 Jul 2007 00:07:37 +0200 From: Raaf User-Agent: Thunderbird 1.5.0.9 (X11/20070103) MIME-Version: 1.0 To: Brian Chu References: <4687FF75.3000108@zen.mooo.com> <47a4f3080707011454m6e06c97bu4764b32a65160ad6@mail.gmail.com> In-Reply-To: <47a4f3080707011454m6e06c97bu4764b32a65160ad6@mail.gmail.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: Kostik Belousov , Dennis Melentyev , freebsd-stable@freebsd.org, freebsd-fs@freebsd.org Subject: Re: Cannot mount Sony Ericsson mobile phone, msdosfs too restrictive? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 01 Jul 2007 22:07:41 -0000 Brian Chu wrote: > Raaf, > > What's the size of the memory stick? Is it 32MB like Dennis has? > It's a 64MB memory stick using FAT12. > The check for the field that affected you isn't critical to msdosfs' > operation, but the field itself is specified to be non-zero. > Konstantin, is it alright to remove this field? > It seems there are more people having problems with the sanity checking code of msdosfs, see also this related pr: http://www.freebsd.org/cgi/query-pr.cgi?pr=93860 From owner-freebsd-stable@FreeBSD.ORG Sun Jul 1 22:19:32 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 78E5916A5A8 for ; Sun, 1 Jul 2007 22:19:32 +0000 (UTC) (envelope-from unixvn@gmail.com) Received: from py-out-1112.google.com (py-out-1112.google.com [64.233.166.178]) by mx1.freebsd.org (Postfix) with ESMTP id 2D67813C4C3 for ; Sun, 1 Jul 2007 22:19:32 +0000 (UTC) (envelope-from unixvn@gmail.com) Received: by py-out-1112.google.com with SMTP id u77so2697637pyb for ; Sun, 01 Jul 2007 15:19:31 -0700 (PDT) DKIM-Signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:to:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=a6pnhzdgFTy+9+1lepN+4ejUMtaG8LX9v2ZXGjl7p9HZj92yxQmhFcCumg/LjVdR8S+gLW024jWRYKCinYvZATf/Odf90OuO5kTtkopSO1NUNGJ9y0p9PM3pBuwZTBlrJs3G3LSSAVABfkSh88zczOKqHNLyTA1KugcBdUqPolw= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:to:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=hRnGRGLzwy4r+O3V10YSNKnfH8AYqIMpGIYYXJvkW0zRjPwgwDX6uJhTgP90PpnJNVaTWqKPnESvVLuM9EkDJYTadjo+AbyzfbYRKvw6kdgIW9UagoflrwYmxSnT3h+pdRi0eIt98ZGmGK8M6ERXCYD369ui8eIcoGYP60qtDHc= Received: by 10.65.186.18 with SMTP id n18mr8147218qbp.1183328371320; Sun, 01 Jul 2007 15:19:31 -0700 (PDT) Received: by 10.65.250.15 with HTTP; Sun, 1 Jul 2007 15:19:31 -0700 (PDT) Message-ID: <64b284310707011519k68ebc35p716cd900d9212234@mail.gmail.com> Date: Mon, 2 Jul 2007 02:19:31 +0400 From: "Nguyen Tam Chinh" To: "Nikolay Pavlov" , "Nguyen Tam Chinh" , FreeBSD-Questions , freebsd-stable@freebsd.org In-Reply-To: <20070701215229.GB10527@zone3000.net> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <64b284310706270311j2a6af2f6i6766b483a4b66a5c@mail.gmail.com> <20070701215229.GB10527@zone3000.net> Cc: Subject: Re: UFS2 optimization for many small files X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 01 Jul 2007 22:19:32 -0000 On 7/2/07, Nikolay Pavlov wrote: > On Wednesday, 27 June 2007 at 14:11:19 +0400, Nguyen Tam Chinh wrote: > > Greetings, > > > > We're going to build a server with some 1Tb of over 500 million small > > files with size from 0,5k to 4k. I'm wonder if the ufs2 can handle > > this kind of system well. From newfs(8) the min block size is 4k. This > > is not optimal in our case, a 1k or 0,5k block is more effective IMHO. > > I'd be happy if anyone can suggest what does fragment (block/8) in the > > ufs2 mean and how this parameter works. I know It's better to read the > > full ufs2 specification, but hope that someone here can give a hint. > > Please advice with optimizations or tricks. > > Thank you very much. > > > > -- > > With best regards, | The Power to Serve > > Nguyen Tam Chinh | http://www.FreeBSD.org > > _______________________________________________ > > freebsd-stable@freebsd.org mailing list > > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > > I am not aware of any ZFS results on such tasks, may be you will be the > one who share them ;) However RaiserFS whould be the best choise on such > spesific case. It's not available on FreeBSD currently. > I don't think UFS can handle a huge amount of small files effectively. > Of course gjournal could be an option for fsck problems, but how do you > plan to backup or sync this storage? > I'm aware of the fsck/backup problems. In our case there's no need for backup so i went with ufs2. The current configuration is 4x250Gb disks with bloc/frag ratio 4k/512b. We're generating files with the average size of 6k ('cause the compress procedure does not work as well as we estimated). After a week I think we could collect some statistics in production. Anyway, in this case a 8k/1k would be more effective for us. Hope that I can test this in the next server. -- With best regards, | The Power to Serve Nguyen Tam Chinh | http://www.FreeBSD.org From owner-freebsd-stable@FreeBSD.ORG Sun Jul 1 22:21:24 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id B2E4716A41F for ; Sun, 1 Jul 2007 22:21:24 +0000 (UTC) (envelope-from soc@hbar.us) Received: from ug-out-1314.google.com (ug-out-1314.google.com [66.249.92.172]) by mx1.freebsd.org (Postfix) with ESMTP id 3293F13C480 for ; Sun, 1 Jul 2007 22:21:23 +0000 (UTC) (envelope-from soc@hbar.us) Received: by ug-out-1314.google.com with SMTP id o4so773114uge for ; Sun, 01 Jul 2007 15:21:23 -0700 (PDT) Received: by 10.78.180.16 with SMTP id c16mr2658034huf.1183326898799; Sun, 01 Jul 2007 14:54:58 -0700 (PDT) Received: by 10.78.138.5 with HTTP; Sun, 1 Jul 2007 14:54:58 -0700 (PDT) Message-ID: <47a4f3080707011454m6e06c97bu4764b32a65160ad6@mail.gmail.com> Date: Sun, 1 Jul 2007 17:54:58 -0400 From: "Brian Chu" To: Raaf , "Kostik Belousov" In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <4687FF75.3000108@zen.mooo.com> Cc: freebsd-fs@freebsd.org, Dennis Melentyev , freebsd-stable@freebsd.org Subject: Re: Cannot mount Sony Ericsson mobile phone, msdosfs too restrictive? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 01 Jul 2007 22:21:24 -0000 Raaf, What's the size of the memory stick? Is it 32MB like Dennis has? The check for the field that affected you isn't critical to msdosfs' operation, but the field itself is specified to be non-zero. Konstantin, is it alright to remove this field? Brian On 7/1/07, Dennis Melentyev wrote: > Well, had the same problem. > For me, it looks like SE is using FAT12 (!!!Not 16!!!) on a devive > larger than 32MB. Could have something slipped off my mind, but quite > close. It is a BROKEN msdosfs on a stick. > > Just re-formated 1Gb flash with FAT32 using card reader and both K750i > and FreeBSD are happy. > > 2007/7/1, Raaf : > > Hi, i got a Sony Ericsson mobile phone that came with a pre-formatted > > memory stick that i'm unable to mount in FreeBSD (it mounts fine in > > Linux). > > > > After investigating i found out that the FreeBSD msdsofs driver bails > > out on the following code (the pmp->pm_Heads being zero): > > > > ---------------------------------- > > if (!pmp->pm_BytesPerSec || !SecPerClust > > || !pmp->pm_Heads > > #ifdef PC98 > > || !pmp->pm_SecPerTrack || pmp->pm_SecPerTrack > 255) { > > #else > > || !pmp->pm_SecPerTrack || pmp->pm_SecPerTrack > 63) { > > #endif > > error = EINVAL; > > goto error_exit; > > } > > ---------------------------------- > > > > Removing the check for pmp->pm_Heads fixes it for me. > > > > Is the check for pmp->pm_Heads really necessary? > > > > Grepping through the msdosfs sources i can only see it being used for > > validation and not used in any calculation (the same applies for the > > pmp->pm_SecPerTrack value) > > > > > > --- sys/fs/msdosfs/msdosfs_vfsops.c.orig Sun Jul 1 20:42:14 2007 > > +++ sys/fs/msdosfs/msdosfs_vfsops.c Sun Jul 1 20:46:57 2007 > > @@ -483,7 +483,6 @@ > > > > /* XXX - We should probably check more values here */ > > if (!pmp->pm_BytesPerSec || !SecPerClust > > - || !pmp->pm_Heads > > #ifdef PC98 > > || !pmp->pm_SecPerTrack || pmp->pm_SecPerTrack > 255) { > > #else > > > > > > _______________________________________________ > > freebsd-stable@freebsd.org mailing list > > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > > > > > -- > Dennis Melentyev > _______________________________________________ > freebsd-fs@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > From owner-freebsd-stable@FreeBSD.ORG Mon Jul 2 03:30:24 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 1413516A421; Mon, 2 Jul 2007 03:30:24 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from relay02.kiev.sovam.com (relay02.kiev.sovam.com [62.64.120.197]) by mx1.freebsd.org (Postfix) with ESMTP id 9A52D13C46E; Mon, 2 Jul 2007 03:30:23 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from [89.162.146.170] (helo=skuns.kiev.zoral.com.ua) by relay02.kiev.sovam.com with esmtps (TLSv1:AES256-SHA:256) (Exim 4.67) (envelope-from ) id 1I5CcF-0009Gr-4G; Mon, 02 Jul 2007 06:30:21 +0300 Received: from deviant.kiev.zoral.com.ua (root@deviant.kiev.zoral.com.ua [10.1.1.148]) by skuns.kiev.zoral.com.ua (8.14.1/8.14.1) with ESMTP id l623U20U083904 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Mon, 2 Jul 2007 06:30:02 +0300 (EEST) (envelope-from kostikbel@gmail.com) Received: from deviant.kiev.zoral.com.ua (kostik@localhost [127.0.0.1]) by deviant.kiev.zoral.com.ua (8.14.1/8.14.1) with ESMTP id l623U7V1015921; Mon, 2 Jul 2007 06:30:07 +0300 (EEST) (envelope-from kostikbel@gmail.com) Received: (from kostik@localhost) by deviant.kiev.zoral.com.ua (8.14.1/8.14.1/Submit) id l623U7Dn015920; Mon, 2 Jul 2007 06:30:07 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: deviant.kiev.zoral.com.ua: kostik set sender to kostikbel@gmail.com using -f Date: Mon, 2 Jul 2007 06:30:07 +0300 From: Kostik Belousov To: Brian Chu Message-ID: <20070702033007.GN2268@deviant.kiev.zoral.com.ua> References: <4687FF75.3000108@zen.mooo.com> <47a4f3080707011454m6e06c97bu4764b32a65160ad6@mail.gmail.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="i7uJIdOrCTgA6ZgY" Content-Disposition: inline In-Reply-To: <47a4f3080707011454m6e06c97bu4764b32a65160ad6@mail.gmail.com> User-Agent: Mutt/1.4.2.2i X-Virus-Scanned: ClamAV version 0.90.2, clamav-milter version 0.90.2 on skuns.kiev.zoral.com.ua X-Virus-Status: Clean X-Spam-Status: No, score=-1.4 required=5.0 tests=ALL_TRUSTED autolearn=failed version=3.1.8 X-Spam-Checker-Version: SpamAssassin 3.1.8 (2007-02-13) on skuns.kiev.zoral.com.ua X-Scanner-Signature: 6bd56f30920205a35a58b455a86ead09 X-DrWeb-checked: yes X-SpamTest-Envelope-From: kostikbel@gmail.com X-SpamTest-Group-ID: 00000000 X-SpamTest-Header: Not Detected X-SpamTest-Info: Profiles 1187 [June 28 2007] X-SpamTest-Info: helo_type=3 X-SpamTest-Method: none X-SpamTest-Rate: 0 X-SpamTest-Status: Not detected X-SpamTest-Status-Extended: not_detected X-SpamTest-Version: SMTP-Filter Version 3.0.0 [0255], KAS30/Release Cc: freebsd-fs@freebsd.org, Dennis Melentyev , Raaf , freebsd-stable@freebsd.org Subject: Re: Cannot mount Sony Ericsson mobile phone, msdosfs too restrictive? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 02 Jul 2007 03:30:24 -0000 --i7uJIdOrCTgA6ZgY Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sun, Jul 01, 2007 at 05:54:58PM -0400, Brian Chu wrote: > Raaf, >=20 > What's the size of the memory stick? Is it 32MB like Dennis has? >=20 > The check for the field that affected you isn't critical to msdosfs' > operation, but the field itself is specified to be non-zero. > Konstantin, is it alright to remove this field? >=20 Brian, I would expect to get the answer from you. In any case, you could do this on your branch and have tested it for some time. >=20 > On 7/1/07, Dennis Melentyev wrote: > >Well, had the same problem. > >For me, it looks like SE is using FAT12 (!!!Not 16!!!) on a devive > >larger than 32MB. Could have something slipped off my mind, but quite > >close. It is a BROKEN msdosfs on a stick. > > > >Just re-formated 1Gb flash with FAT32 using card reader and both K750i > >and FreeBSD are happy. > > > >2007/7/1, Raaf : > >> Hi, i got a Sony Ericsson mobile phone that came with a pre-formatted > >> memory stick that i'm unable to mount in FreeBSD (it mounts fine in > >> Linux). > >> > >> After investigating i found out that the FreeBSD msdsofs driver bails > >> out on the following code (the pmp->pm_Heads being zero): > >> > >> ---------------------------------- > >> if (!pmp->pm_BytesPerSec || !SecPerClust > >> || !pmp->pm_Heads > >> #ifdef PC98 > >> || !pmp->pm_SecPerTrack || pmp->pm_SecPerTrack > 255) { > >> #else > >> || !pmp->pm_SecPerTrack || pmp->pm_SecPerTrack > 63) { > >> #endif > >> error =3D EINVAL; > >> goto error_exit; > >> } > >> ---------------------------------- > >> > >> Removing the check for pmp->pm_Heads fixes it for me. > >> > >> Is the check for pmp->pm_Heads really necessary? > >> > >> Grepping through the msdosfs sources i can only see it being used for > >> validation and not used in any calculation (the same applies for the > >> pmp->pm_SecPerTrack value) > >> > >> > >> --- sys/fs/msdosfs/msdosfs_vfsops.c.orig Sun Jul 1 20:42:14 20= 07 > >> +++ sys/fs/msdosfs/msdosfs_vfsops.c Sun Jul 1 20:46:57 2007 > >> @@ -483,7 +483,6 @@ > >> > >> /* XXX - We should probably check more values here */ > >> if (!pmp->pm_BytesPerSec || !SecPerClust > >> - || !pmp->pm_Heads > >> #ifdef PC98 > >> || !pmp->pm_SecPerTrack || pmp->pm_SecPerTrack > 255) { > >> #else > >> > >> > >> _______________________________________________ > >> freebsd-stable@freebsd.org mailing list > >> http://lists.freebsd.org/mailman/listinfo/freebsd-stable > >> To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.o= rg" > >> > > > > > >-- > >Dennis Melentyev > >_______________________________________________ > >freebsd-fs@freebsd.org mailing list > >http://lists.freebsd.org/mailman/listinfo/freebsd-fs > >To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > > --i7uJIdOrCTgA6ZgY Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.7 (FreeBSD) iD8DBQFGiHE+C3+MBN1Mb4gRApbfAKCaA1pTDGVdHHE1CtrNwwwTwV8aBQCghmdz UcrUYg0NkjVUAKekgDV4ow0= =JLhH -----END PGP SIGNATURE----- --i7uJIdOrCTgA6ZgY-- From owner-freebsd-stable@FreeBSD.ORG Mon Jul 2 06:01:55 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 32E4F16A473 for ; Mon, 2 Jul 2007 06:01:55 +0000 (UTC) (envelope-from soc@hbar.us) Received: from ug-out-1314.google.com (ug-out-1314.google.com [66.249.92.175]) by mx1.freebsd.org (Postfix) with ESMTP id C5C1613C483 for ; Mon, 2 Jul 2007 06:01:54 +0000 (UTC) (envelope-from soc@hbar.us) Received: by ug-out-1314.google.com with SMTP id o4so819923uge for ; Sun, 01 Jul 2007 23:01:52 -0700 (PDT) Received: by 10.78.81.20 with SMTP id e20mr2714721hub.1183356111624; Sun, 01 Jul 2007 23:01:51 -0700 (PDT) Received: by 10.78.138.5 with HTTP; Sun, 1 Jul 2007 23:01:51 -0700 (PDT) Message-ID: <47a4f3080707012301q200c27efo8115f13ac1339d3@mail.gmail.com> Date: Mon, 2 Jul 2007 02:01:51 -0400 From: "Brian Chu" To: Raaf , "Dennis Melentyev" In-Reply-To: <468825A9.80200@zen.mooo.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <4687FF75.3000108@zen.mooo.com> <47a4f3080707011454m6e06c97bu4764b32a65160ad6@mail.gmail.com> <468825A9.80200@zen.mooo.com> Cc: freebsd-fs@freebsd.org, freebsd-stable@freebsd.org Subject: Re: Cannot mount Sony Ericsson mobile phone, msdosfs too restrictive? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 02 Jul 2007 06:01:55 -0000 Raaf, Dennis, I've taken pmp->pm_Heads out my branch, but it's not ready for a commit. Raaf, if you could give me a hexdump of the bootsector, I'd appreciate it. `hexdump -Cn1024 /dev/...` should do. Thanks, Brian On 7/1/07, Raaf wrote: > Brian Chu wrote: > > Raaf, > > > > What's the size of the memory stick? Is it 32MB like Dennis has? > > > > It's a 64MB memory stick using FAT12. > > > The check for the field that affected you isn't critical to msdosfs' > > operation, but the field itself is specified to be non-zero. > > Konstantin, is it alright to remove this field? > > > > It seems there are more people having problems with the sanity checking > code of msdosfs, see also this related pr: > > http://www.freebsd.org/cgi/query-pr.cgi?pr=93860 > > From owner-freebsd-stable@FreeBSD.ORG Mon Jul 2 11:27:28 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 6EC3116A4D1 for ; Mon, 2 Jul 2007 11:27:28 +0000 (UTC) (envelope-from rwatson@FreeBSD.org) Received: from cyrus.watson.org (cyrus.watson.org [209.31.154.42]) by mx1.freebsd.org (Postfix) with ESMTP id 3B2BE13C502 for ; Mon, 2 Jul 2007 11:27:21 +0000 (UTC) (envelope-from rwatson@FreeBSD.org) Received: from fledge.watson.org (fledge.watson.org [209.31.154.41]) by cyrus.watson.org (Postfix) with ESMTP id C4B3A47D39; Mon, 2 Jul 2007 07:27:17 -0400 (EDT) Date: Mon, 2 Jul 2007 12:27:17 +0100 (BST) From: Robert Watson X-X-Sender: robert@fledge.watson.org To: Brian Chu In-Reply-To: <47a4f3080707011454m6e06c97bu4764b32a65160ad6@mail.gmail.com> Message-ID: <20070702122548.K29272@fledge.watson.org> References: <4687FF75.3000108@zen.mooo.com> <47a4f3080707011454m6e06c97bu4764b32a65160ad6@mail.gmail.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: Kostik Belousov , freebsd-fs@freebsd.org, Raaf , freebsd-stable@freebsd.org, Dennis Melentyev Subject: Re: Cannot mount Sony Ericsson mobile phone, msdosfs too restrictive? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 02 Jul 2007 11:27:28 -0000 On Sun, 1 Jul 2007, Brian Chu wrote: > What's the size of the memory stick? Is it 32MB like Dennis has? > > The check for the field that affected you isn't critical to msdosfs' > operation, but the field itself is specified to be non-zero. Konstantin, is > it alright to remove this field? It turns out that quite a bit of our historical sanity checking on msdosfs is too conservative when applied to the highly diverse set of FAT file systems in the field. I think it would be useful for someone(tm) to compare the sanity checks in our version of msdosfs and the checks in the Darwin version and see what they've had to remove. Robert N M Watson Computer Laboratory University of Cambridge > > Brian > > On 7/1/07, Dennis Melentyev wrote: >> Well, had the same problem. >> For me, it looks like SE is using FAT12 (!!!Not 16!!!) on a devive >> larger than 32MB. Could have something slipped off my mind, but quite >> close. It is a BROKEN msdosfs on a stick. >> >> Just re-formated 1Gb flash with FAT32 using card reader and both K750i >> and FreeBSD are happy. >> >> 2007/7/1, Raaf : >> > Hi, i got a Sony Ericsson mobile phone that came with a pre-formatted >> > memory stick that i'm unable to mount in FreeBSD (it mounts fine in >> > Linux). >> > >> > After investigating i found out that the FreeBSD msdsofs driver bails >> > out on the following code (the pmp->pm_Heads being zero): >> > >> > ---------------------------------- >> > if (!pmp->pm_BytesPerSec || !SecPerClust >> > || !pmp->pm_Heads >> > #ifdef PC98 >> > || !pmp->pm_SecPerTrack || pmp->pm_SecPerTrack > 255) { >> > #else >> > || !pmp->pm_SecPerTrack || pmp->pm_SecPerTrack > 63) { >> > #endif >> > error = EINVAL; >> > goto error_exit; >> > } >> > ---------------------------------- >> > >> > Removing the check for pmp->pm_Heads fixes it for me. >> > >> > Is the check for pmp->pm_Heads really necessary? >> > >> > Grepping through the msdosfs sources i can only see it being used for >> > validation and not used in any calculation (the same applies for the >> > pmp->pm_SecPerTrack value) >> > >> > >> > --- sys/fs/msdosfs/msdosfs_vfsops.c.orig Sun Jul 1 20:42:14 2007 >> > +++ sys/fs/msdosfs/msdosfs_vfsops.c Sun Jul 1 20:46:57 2007 >> > @@ -483,7 +483,6 @@ >> > >> > /* XXX - We should probably check more values here */ >> > if (!pmp->pm_BytesPerSec || !SecPerClust >> > - || !pmp->pm_Heads >> > #ifdef PC98 >> > || !pmp->pm_SecPerTrack || pmp->pm_SecPerTrack > 255) { >> > #else >> > >> > >> > _______________________________________________ >> > freebsd-stable@freebsd.org mailing list >> > http://lists.freebsd.org/mailman/listinfo/freebsd-stable >> > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" >> > >> >> >> -- >> Dennis Melentyev >> _______________________________________________ >> freebsd-fs@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-fs >> To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" >> > _______________________________________________ > freebsd-fs@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > From owner-freebsd-stable@FreeBSD.ORG Mon Jul 2 16:33:42 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id DFD5C16A46E for ; Mon, 2 Jul 2007 16:33:42 +0000 (UTC) (envelope-from soc@hbar.us) Received: from ug-out-1314.google.com (ug-out-1314.google.com [66.249.92.172]) by mx1.freebsd.org (Postfix) with ESMTP id 7875B13C4B7 for ; Mon, 2 Jul 2007 16:33:42 +0000 (UTC) (envelope-from soc@hbar.us) Received: by ug-out-1314.google.com with SMTP id o4so933631uge for ; Mon, 02 Jul 2007 09:33:41 -0700 (PDT) Received: by 10.78.181.13 with SMTP id d13mr3036099huf.1183394020777; Mon, 02 Jul 2007 09:33:40 -0700 (PDT) Received: by 10.78.138.5 with HTTP; Mon, 2 Jul 2007 09:33:40 -0700 (PDT) Message-ID: <47a4f3080707020933v745a00c9s756f46e59fc2b947@mail.gmail.com> Date: Mon, 2 Jul 2007 12:33:40 -0400 From: "Brian Chu" To: "Robert Watson" In-Reply-To: <20070702122548.K29272@fledge.watson.org> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <4687FF75.3000108@zen.mooo.com> <47a4f3080707011454m6e06c97bu4764b32a65160ad6@mail.gmail.com> <20070702122548.K29272@fledge.watson.org> Cc: Kostik Belousov , freebsd-fs@freebsd.org, Raaf , freebsd-stable@freebsd.org, Dennis Melentyev Subject: Re: Cannot mount Sony Ericsson mobile phone, msdosfs too restrictive? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 02 Jul 2007 16:33:43 -0000 Robert, > the field. I think it would be useful for someone(tm) to compare the sanity > checks in our version of msdosfs and the checks in the Darwin version and see > what they've had to remove. Will do. Thanks, Brian From owner-freebsd-stable@FreeBSD.ORG Mon Jul 2 20:30:58 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id CBFAB16A41F for ; Mon, 2 Jul 2007 20:30:58 +0000 (UTC) (envelope-from dennis.melentyev@gmail.com) Received: from nz-out-0506.google.com (nz-out-0506.google.com [64.233.162.227]) by mx1.freebsd.org (Postfix) with ESMTP id 88D4E13C468 for ; Mon, 2 Jul 2007 20:30:58 +0000 (UTC) (envelope-from dennis.melentyev@gmail.com) Received: by nz-out-0506.google.com with SMTP id l8so851183nzf for ; Mon, 02 Jul 2007 13:30:58 -0700 (PDT) DKIM-Signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=Qe3H5MH5oDikfkYSkRpoccZCC1LyhGoWvWZl6uHUGYjTslX9bS1f2MqwDjXzegCRfJGaBClD3Fi0or8c5HRHNj5+/PGmOLADAJliLn3PXmcrD+5oEPahBGfmQ+XVBnT7/yHYKABQXMAtO6N8HJljGs5B2L0FX10ddBkUzrz3FOg= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=B39OU6H4NXG6GsLsJLOxHxQFbG+NYK/5gbSUJrnq0dfoXy4n+Ao+sQ8683wIOJQpXOBkaR695dul9YqEtdcSerTPF4W3pK2Ma2+lwd+lgrujbDBWQbjGo9cQuf+ER6Tpnur/lFw5mdYYmXkDBnyeoo7kW3EvA242L5EgbLLayK4= Received: by 10.114.92.2 with SMTP id p2mr5449197wab.1183408257653; Mon, 02 Jul 2007 13:30:57 -0700 (PDT) Received: by 10.115.78.2 with HTTP; Mon, 2 Jul 2007 13:30:57 -0700 (PDT) Message-ID: Date: Mon, 2 Jul 2007 23:30:57 +0300 From: "Dennis Melentyev" To: Raaf In-Reply-To: <468825A9.80200@zen.mooo.com> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <4687FF75.3000108@zen.mooo.com> <47a4f3080707011454m6e06c97bu4764b32a65160ad6@mail.gmail.com> <468825A9.80200@zen.mooo.com> Cc: Kostik Belousov , Brian Chu , freebsd-stable@freebsd.org, freebsd-fs@freebsd.org Subject: Re: Cannot mount Sony Ericsson mobile phone, msdosfs too restrictive? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 02 Jul 2007 20:30:58 -0000 Hi! 2007/7/2, Raaf : > Brian Chu wrote: > > Raaf, > > > > What's the size of the memory stick? Is it 32MB like Dennis has? It was 64MB card also. :) AFAIR, FAT12 is just not correct format for disks larger than 32Mb. It has to use clusters not handled by original MSDOS in this case. So, my answer is: SE just use wrong FAT. But, meanwile, it should be ok to allow this insanity be handled. Despite I'd rather use smaller clusters for such a tiny drive. > > > > It's a 64MB memory stick using FAT12. MSDOS 3.3 will go crazy with that :) > > > The check for the field that affected you isn't critical to msdosfs' > > operation, but the field itself is specified to be non-zero. > > Konstantin, is it alright to remove this field? > > > > It seems there are more people having problems with the sanity checking > code of msdosfs, see also this related pr: > > http://www.freebsd.org/cgi/query-pr.cgi?pr=93860 > > -- Dennis Melentyev From owner-freebsd-stable@FreeBSD.ORG Mon Jul 2 20:33:00 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 5A8A516A49A for ; Mon, 2 Jul 2007 20:33:00 +0000 (UTC) (envelope-from dennis.melentyev@gmail.com) Received: from wa-out-1112.google.com (wa-out-1112.google.com [209.85.146.183]) by mx1.freebsd.org (Postfix) with ESMTP id 2A0A913C4B0 for ; Mon, 2 Jul 2007 20:33:00 +0000 (UTC) (envelope-from dennis.melentyev@gmail.com) Received: by wa-out-1112.google.com with SMTP id j37so2454707waf for ; Mon, 02 Jul 2007 13:32:59 -0700 (PDT) DKIM-Signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=DTDYIfVq6CdTycv/0K/gCOIpSJGrtTIulwsI4vMPVrxiT1iOHu6efr6xOgl2GOe6x73TJbnOMkmySA4OTyfnAmTlQU7X+ffsLI5GdcFyuPn+1Uf29kRRnqPSEbplgXUDokadwXzl/FgfqAhICjIHTo6ie9x7dphk1iK5IUagzQQ= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=DLh8EYN0eFqMM2cqNy2NLDXxecOHmrKOWg0Vl0mSneUiIu+drh0cW8jVhpr+m3yXzPbUywlS9dXR7qHe7cv4U3p26TAhUv5jCtOtZc4vbvdI6xim4qWSRE1j/gFfctGH20yv2AllQHtPgxguBtZykHROvgK+2JfKSKl6ARf3O7w= Received: by 10.114.130.1 with SMTP id c1mr5477544wad.1183408379819; Mon, 02 Jul 2007 13:32:59 -0700 (PDT) Received: by 10.115.78.2 with HTTP; Mon, 2 Jul 2007 13:32:59 -0700 (PDT) Message-ID: Date: Mon, 2 Jul 2007 23:32:59 +0300 From: "Dennis Melentyev" To: Raaf In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <4687FF75.3000108@zen.mooo.com> <47a4f3080707011454m6e06c97bu4764b32a65160ad6@mail.gmail.com> <468825A9.80200@zen.mooo.com> Cc: Kostik Belousov , Brian Chu , freebsd-stable@freebsd.org, freebsd-fs@freebsd.org Subject: Re: Cannot mount Sony Ericsson mobile phone, msdosfs too restrictive? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 02 Jul 2007 20:33:00 -0000 Can't confirm, but it seems like formating card with phone will give you FAT12 even on 1Gb card. (Not volunteering to reformat my "player") :) 2007/7/2, Dennis Melentyev : > Hi! > > 2007/7/2, Raaf : > > Brian Chu wrote: > > > Raaf, > > > > > > What's the size of the memory stick? Is it 32MB like Dennis has? > It was 64MB card also. :) > AFAIR, FAT12 is just not correct format for disks larger than 32Mb. > It has to use clusters not handled by original MSDOS in this case. > > So, my answer is: SE just use wrong FAT. > > But, meanwile, it should be ok to allow this insanity be handled. > Despite I'd rather use smaller clusters for such a tiny drive. > > > > > > > > It's a 64MB memory stick using FAT12. > > MSDOS 3.3 will go crazy with that :) > > > > > > The check for the field that affected you isn't critical to msdosfs' > > > operation, but the field itself is specified to be non-zero. > > > Konstantin, is it alright to remove this field? > > > > > > > It seems there are more people having problems with the sanity checking > > code of msdosfs, see also this related pr: > > > > http://www.freebsd.org/cgi/query-pr.cgi?pr=93860 > > > > > > > -- > Dennis Melentyev > -- Dennis Melentyev From owner-freebsd-stable@FreeBSD.ORG Tue Jul 3 02:26:18 2007 Return-Path: X-Original-To: stable@FreeBSD.org Delivered-To: freebsd-stable@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id BA5B616A41F; Tue, 3 Jul 2007 02:26:18 +0000 (UTC) (envelope-from mi@aldan.algebra.com) Received: from aldan.algebra.com (aldan.algebra.com [216.254.65.224]) by mx1.freebsd.org (Postfix) with ESMTP id 4F62513C45B; Tue, 3 Jul 2007 02:26:18 +0000 (UTC) (envelope-from mi@aldan.algebra.com) Received: from aldan.algebra.com (localhost [127.0.0.1]) by aldan.algebra.com (8.14.1/8.14.1) with ESMTP id l6329Iux001109 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Mon, 2 Jul 2007 22:09:18 -0400 (EDT) (envelope-from mi@aldan.algebra.com) Received: (from mi@localhost) by aldan.algebra.com (8.14.1/8.14.1/Submit) id l6329I0u001108; Mon, 2 Jul 2007 22:09:18 -0400 (EDT) (envelope-from mi) From: "Mikhail T." Message-Id: <200707030209.l6329I0u001108@aldan.algebra.com> To: stable@FreeBSD.org, sos@FreeBSD.org Date: Mon, 2 Jul 2007 22:09:18 -0400 (EDT) X-Face: %UW#n0|w>ydeGt/b@1-.UFP=K^~-:0f#O:D7w hJ5G_<5143Bb3kOIs9XpX+"V+~$adGP:J|SLieM31VIhqXeLBli" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Jul 2007 02:26:18 -0000 I'm not 100% certain, this is a "legal" thing to do. But I think it is. I hooked up a brand new hard-drive (Seagate) to the free SATA port, and then connected the power cable. Before that I had just one SATA drive (ad8). The kernel crashed in ata_identify(). I'll keep the core around for some time -- let me know, if you need more investigation... The kernel is 6.2-STABLE #1: Thu Jun 7 22:11:33 EDT 2007 ... amd64 -mi Unread portion of the kernel message buffer: ad10: 715404MB at ata5-master SATA150 ad8: 476940MB at ata4-master SATA150 Fatal trap 12: page fault while in kernel mode cpuid = 0; apic id = 00 fault virtual address = 0x50 fault code = supervisor read data, page not present instruction pointer = 0x8:0xffffffff802cb59d stack pointer = 0x10:0xffffffffb1b0db00 frame pointer = 0x10:0xffffff004ed45100 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 8 (thread taskq) trap number = 12 panic: page fault cpuid = 0 Uptime: 17d10h1m11s Dumping 2047 MB (2 chunks) chunk 0: 1MB (156 pages) ... ok chunk 1: 2047MB (524016 pages) 2031 2015 1999 1983 1967 1951 1935 1919 1903 1887 1871 1855 1839 1823 1807 1791 1775 1759 1743 1727 1711 1695 1679 1663 1647 1631 1615 1599 1583 1567 1551 1535 1519 1503 1487 1471 1455 1439 1423 1407 1391 1375 1359 1343 1327 1311 1295 1279 1263 1247 1231 1215 1199 1183 1167 1151 1135 1119 1103 1087 1071 1055 1039 1023 1007 991 975 959 943 927 911 895 879 863 847 831 815 799 783 767 751 735 719 703 687 671 655 639 623 607 591 575 559 543 527 511 495 479 463 447 431 415 (CTRL-C to abort) (CTRL-C to abort) (CTRL-C to abort) 399 383 367 351 335 319 303 287 271 255 239 223 207 191 175 159 143 127 111 95 79 63 47 31 15 GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... (kgdb) #0 doadump () at pcpu.h:172 #1 0x0000000000000004 in ?? () #2 0xffffffff802b12b7 in boot (howto=260) at /var/src/sys/kern/kern_shutdown.c:409 #3 0xffffffff802b1951 in panic (fmt=0xffffff007b9e8720 "") at /var/src/sys/kern/kern_shutdown.c:565 #4 0xffffffff80410faf in trap_fatal (frame=0xffffff007b9e8720, eva=18446742976271941632) at /var/src/sys/amd64/amd64/trap.c:668 #5 0xffffffff8041132c in trap_pfault (frame=0xffffffffb1b0da50, usermode=0) at /var/src/sys/amd64/amd64/trap.c:580 #6 0xffffffff804115e3 in trap (frame= {tf_rdi = -1098189090560, tf_rsi = 4, tf_rdx = 0, tf_rcx = 1, tf_r8 = -2141067120, tf_r9 = -1097437640928, tf_rax = 2, tf_rbx = -1098189090560, tf_rbp = -1098189090560, tf_r10 = 72, tf_r11 = 1, tf_r12 = 0, tf_r13 = 0, tf_r14 = 4294967295, tf_r15 = 10, tf_trapno = 12, tf_addr = 80, tf_flags = 0, tf_err = 0, tf_rip = -2144553571, tf_cs = 8, tf_rflags = 66118, tf_rsp = -1313809648, tf_ss = 0}) at /var/src/sys/amd64/amd64/trap.c:353 #7 0xffffffff803f825b in calltrap () at /var/src/sys/amd64/amd64/exception.S:168 #8 0xffffffff802cb59d in device_attach (dev=0xffffff004ed45100) at /var/src/sys/kern/subr_bus.c:278 #9 0xffffffff802cc76f in bus_generic_attach (dev=0xffffff004ed45100) at /var/src/sys/kern/subr_bus.c:2883 #10 0xffffffff801b48cd in ata_identify (dev=0xffffff007b98eb00) at /var/src/sys/dev/ata/ata-all.c:718 #11 0xffffffff801b5891 in ata_sata_phy_event (context=0xffffff004ed45100, dummy=4) at /var/src/sys/dev/ata/ata-chipset.c:273 #12 0xffffffff802d8b35 in taskqueue_run (queue=0xffffff0000902d00) at /var/src/sys/kern/subr_taskqueue.c:257 #13 0xffffffff802d9885 in taskqueue_thread_loop (arg=0xffffff004ed45100) at /var/src/sys/kern/subr_taskqueue.c:376 #14 0xffffffff80296347 in fork_exit ( callout=0xffffffff802d9800 , arg=0xffffffff8062a0f0, frame=0xffffffffb1b0dc50) at /var/src/sys/kern/kern_fork.c:821 #15 0xffffffff803f85be in fork_trampoline () at /var/src/sys/amd64/amd64/exception.S:394 #16 0x0000000000000000 in ?? () #17 0x0000000000000000 in ?? () [...] #127 0x0000000000000000 in ?? () #128 0x0000000000000000 in ?? () (kgdb) #10 0xffffffff801b48cd in ata_identify (dev=0xffffff007b98eb00) at /var/src/sys/dev/ata/ata-all.c:718 718 bus_generic_attach(dev); (kgdb) $1 = {ops = 0xffffff0000907000, link = {tqe_next = 0x0, tqe_prev = 0xffffff007b98ec08}, devlink = {tqe_next = 0xffffff007b8fde00, tqe_prev = 0xffffff007b98ec18}, parent = 0xffffff007b8fd800, children = { tqh_first = 0xffffff0000e4db00, tqh_last = 0xffffff007b7e0308}, driver = 0xffffffff805c3e80, devclass = 0xffffff000095db80, unit = 5, nameunit = 0xffffff007b93c480 "ata5", desc = 0xffffff007b93c230 "ATA channel 3", busy = 0, state = DS_ATTACHED, devflags = 0, flags = 11, order = 0 '\0', pad = 0 '\0', ivars = 0x0, softc = 0xffffff007b71a800, sysctl_ctx = {tqh_first = 0xffffff007b91bc60, tqh_last = 0xffffff0000ac00c8}, sysctl_tree = 0xffffff0000abfb00} (kgdb) From owner-freebsd-stable@FreeBSD.ORG Tue Jul 3 03:17:49 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 3C6EA16A41F; Tue, 3 Jul 2007 03:17:49 +0000 (UTC) (envelope-from anderson@freebsd.org) Received: from ns.trinitel.com (186.161.36.72.static.reverse.layeredtech.com [72.36.161.186]) by mx1.freebsd.org (Postfix) with ESMTP id 071F713C489; Tue, 3 Jul 2007 03:17:48 +0000 (UTC) (envelope-from anderson@freebsd.org) Received: from proton.local (r74-193-81-203.pfvlcmta01.grtntx.tl.dh.suddenlink.net [74.193.81.203]) (authenticated bits=0) by ns.trinitel.com (8.14.1/8.14.1) with ESMTP id l6332tMY050472; Mon, 2 Jul 2007 22:02:57 -0500 (CDT) (envelope-from anderson@freebsd.org) Message-ID: <4689BC5C.90909@freebsd.org> Date: Mon, 02 Jul 2007 22:02:52 -0500 From: Eric Anderson User-Agent: Thunderbird 2.0.0.4 (Macintosh/20070604) MIME-Version: 1.0 To: Dennis Melentyev References: <4687FF75.3000108@zen.mooo.com> <47a4f3080707011454m6e06c97bu4764b32a65160ad6@mail.gmail.com> <468825A9.80200@zen.mooo.com> In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=ham version=3.1.8 X-Spam-Checker-Version: SpamAssassin 3.1.8 (2007-02-13) on ns.trinitel.com Cc: freebsd-fs@freebsd.org, Raaf , freebsd-stable@freebsd.org Subject: Re: Cannot mount Sony Ericsson mobile phone, msdosfs too restrictive? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Jul 2007 03:17:49 -0000 Dennis Melentyev wrote: > Can't confirm, but it seems like formating card with phone will give > you FAT12 even on 1Gb card. (Not volunteering to reformat my "player") > :) It would be useful to some people to have access to a FAT12 formatted file system that is >32MB. Can you (or someone else) dd the flash to a file (the 64MB file is file), and then gzip it? Preferably a freshly formatted fat12 would be best. Eric > 2007/7/2, Dennis Melentyev : >> Hi! >> >> 2007/7/2, Raaf : >> > Brian Chu wrote: >> > > Raaf, >> > > >> > > What's the size of the memory stick? Is it 32MB like Dennis has? >> It was 64MB card also. :) >> AFAIR, FAT12 is just not correct format for disks larger than 32Mb. >> It has to use clusters not handled by original MSDOS in this case. >> >> So, my answer is: SE just use wrong FAT. >> >> But, meanwile, it should be ok to allow this insanity be handled. >> Despite I'd rather use smaller clusters for such a tiny drive. >> >> > > >> > >> > It's a 64MB memory stick using FAT12. >> >> MSDOS 3.3 will go crazy with that :) >> >> > >> > > The check for the field that affected you isn't critical to msdosfs' >> > > operation, but the field itself is specified to be non-zero. >> > > Konstantin, is it alright to remove this field? >> > > >> > >> > It seems there are more people having problems with the sanity checking >> > code of msdosfs, see also this related pr: >> > >> > http://www.freebsd.org/cgi/query-pr.cgi?pr=93860 >> > >> > >> >> >> -- >> Dennis Melentyev >> > > From owner-freebsd-stable@FreeBSD.ORG Tue Jul 3 09:46:25 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 5502116A469 for ; Tue, 3 Jul 2007 09:46:25 +0000 (UTC) (envelope-from h.schmalzbauer@omnisec.de) Received: from host.omnisec.de (host.omnisec.de [62.245.232.135]) by mx1.freebsd.org (Postfix) with ESMTP id C231113C45B for ; Tue, 3 Jul 2007 09:46:24 +0000 (UTC) (envelope-from h.schmalzbauer@omnisec.de) Received: from tek.flintsbach.schmalzbauer.de (tek.flintsbach.schmalzbauer.de [172.21.2.3]) by host.omnisec.de (8.13.8/8.13.8) with ESMTP id l639R7g3060103 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Tue, 3 Jul 2007 11:27:12 +0200 (CEST) (envelope-from h.schmalzbauer@omnisec.de) Received: from titan.flintsbach.schmalzbauer.de (titan.flintsbach.schmalzbauer.de [IPv6:fec0::1:0:0:1:1]) by tek.flintsbach.schmalzbauer.de (8.13.8/8.13.8) with ESMTP id l639VdDq040045 for ; Tue, 3 Jul 2007 11:31:39 +0200 (CEST) (envelope-from h.schmalzbauer@omnisec.de) Received: from localhost (localhost [[UNIX: localhost]]) by titan.flintsbach.schmalzbauer.de (8.14.1/8.14.1/Submit) id l639R76V013751 for freebsd-stable@freebsd.org; Tue, 3 Jul 2007 11:27:07 +0200 (CEST) (envelope-from h.schmalzbauer@omnisec.de) From: Harald Schmalzbauer Organization: OmniSEC To: freebsd-stable@freebsd.org Date: Tue, 3 Jul 2007 11:27:07 +0200 User-Agent: KMail/1.9.6 MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200707031127.07413.h.schmalzbauer@omnisec.de> Subject: regular user can destroy disk label?!? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Jul 2007 09:46:25 -0000 Hello, accidentally I did 'bsdlabel -w ar0s2' as unprivileged user but it was successfull. Is this only possible because there was no mounted filesystem on it? But I can imagine having data on unmounted filesystems. Is it intended that regular useres can overwrite the label? That's a big fault in my opinion. Best regards, -Harry From owner-freebsd-stable@FreeBSD.ORG Tue Jul 3 09:46:26 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 8C15916A46B for ; Tue, 3 Jul 2007 09:46:26 +0000 (UTC) (envelope-from h.schmalzbauer@omnisec.de) Received: from host.omnisec.de (host.omnisec.de [62.245.232.135]) by mx1.freebsd.org (Postfix) with ESMTP id F32C313C465 for ; Tue, 3 Jul 2007 09:46:25 +0000 (UTC) (envelope-from h.schmalzbauer@omnisec.de) Received: from tek.flintsbach.schmalzbauer.de (tek.flintsbach.schmalzbauer.de [172.21.2.3]) by host.omnisec.de (8.13.8/8.13.8) with ESMTP id l639IuKH060005 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Tue, 3 Jul 2007 11:19:01 +0200 (CEST) (envelope-from h.schmalzbauer@omnisec.de) Received: from titan.flintsbach.schmalzbauer.de (titan.flintsbach.schmalzbauer.de [IPv6:fec0::1:0:0:1:1]) by tek.flintsbach.schmalzbauer.de (8.13.8/8.13.8) with ESMTP id l639NS3c039997 for ; Tue, 3 Jul 2007 11:23:28 +0200 (CEST) (envelope-from h.schmalzbauer@omnisec.de) Received: from localhost (localhost [[UNIX: localhost]]) by titan.flintsbach.schmalzbauer.de (8.14.1/8.14.1/Submit) id l639Iuqf013633 for freebsd-stable@freebsd.org; Tue, 3 Jul 2007 11:18:56 +0200 (CEST) (envelope-from h.schmalzbauer@omnisec.de) From: Harald Schmalzbauer Organization: OmniSEC To: freebsd-stable@freebsd.org Date: Tue, 3 Jul 2007 11:18:56 +0200 User-Agent: KMail/1.9.6 MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200707031118.56313.h.schmalzbauer@omnisec.de> Subject: atariad memory error, do I have to worry about? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Jul 2007 09:46:26 -0000 Hello, after I growfs'd my /usr label I had softupdates inconsistencies. I dumped /usr and newfs'd/restored it with the new (bigger) label to be on the safe side. While restoring I got this error: FAILURE - out of memory in ata_raid_init_request g_vfs_done():ar0s1e[WRITE(offset=3864918016, length=2048)]error = 5 What dows that mean? FreeBSD 6.2-RELEASE-p5 amd64 real memory = 2146304000 (2046 MB) FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-47 on motherboard atapci1: por... irq 19 at device 31.2 on pci0 ar0: 152627MB status: READY ar0: disk0 READY (master) using ad4 at ata2-master ar0: disk1 READY (mirror) using ad6 at ata3-master Thanks for any hints! -Harry From owner-freebsd-stable@FreeBSD.ORG Tue Jul 3 11:13:58 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id E29DC16A41F for ; Tue, 3 Jul 2007 11:13:58 +0000 (UTC) (envelope-from jhs@berklix.org) Received: from thin.berklix.org (thin.berklix.org [194.246.123.68]) by mx1.freebsd.org (Postfix) with ESMTP id 6FE7213C4AE for ; Tue, 3 Jul 2007 11:13:58 +0000 (UTC) (envelope-from jhs@berklix.org) Received: from js.berklix.net (p549A48BD.dip.t-dialin.net [84.154.72.189]) (authenticated bits=128) by thin.berklix.org (8.12.11/8.12.11) with ESMTP id l63BDhTw012045; Tue, 3 Jul 2007 13:13:44 +0200 (CEST) (envelope-from jhs@berklix.org) Received: from fire.js.berklix.net (fire.js.berklix.net [192.168.91.41]) by js.berklix.net (8.13.6/8.13.6) with ESMTP id l63BDclX019074; Tue, 3 Jul 2007 13:13:38 +0200 (CEST) (envelope-from jhs@berklix.org) Received: from fire.js.berklix.net (localhost.js.berklix.net [127.0.0.1]) by fire.js.berklix.net (8.13.8/8.13.8) with ESMTP id l63BDcZW036403; Tue, 3 Jul 2007 13:13:38 +0200 (CEST) (envelope-from jhs@fire.js.berklix.net) Message-Id: <200707031113.l63BDcZW036403@fire.js.berklix.net> To: Harald Schmalzbauer In-reply-to: <200707031127.07413.h.schmalzbauer@omnisec.de> References: <200707031127.07413.h.schmalzbauer@omnisec.de> Comments: In-reply-to Harald Schmalzbauer message dated "Tue, 03 Jul 2007 11:27:07 +0200." Date: Tue, 03 Jul 2007 13:13:38 +0200 From: "Julian H. Stacey" Cc: freebsd-stable@freebsd.org Subject: Re: regular user can destroy disk label?!? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Jul 2007 11:13:59 -0000 Harald Schmalzbauer wrote: > Hello, > > accidentally I did 'bsdlabel -w ar0s2' as unprivileged user but it was > successfull. Likely you have a permissions problems. Report result of cd /dev ; ls -l . ar0s2 ad0s2 /sbin/bsdlabel On my 6.2-RELEASE for example I have an unwriteable combo of: dr-xr-xr-x 5 root wheel 512 Jan 1 1970 ./ crw-r----- 1 root operator 0, 110 Jun 21 09:03 ad0s2 crw-r----- 1 root operator 0, 123 Jun 21 11:03 ad0s2a -r-xr-xr-x 2 root wheel 233768 Apr 11 19:43 /sbin/bsdlabel* Either: - You made a typo with ar0s2 & meant ad0s2, - Or you really mean "ar" - man 4 ar reports a comms card ! - /dev/ar0s2 may be some meaningless normal file, not a device, but in /dev/ , writeable by you, from a previous mistake you made as root ? > Is this only possible because there was no mounted filesystem on it? No. Regardless what the code of bsdlabel.c might try, if it doesnt have SUID or SGID bits & isnt run as root, kernel won't allow it to write what it doesnt have permission for. > But I can imagine having data on unmounted filesystems. Possible yes but see above. > Is it intended that regular useres can overwrite the label? No. > That's a big fault in my opinion. No such fault to fear :-) BTW all above is general Unix philospohy, applies equally to Linux, *BSD & commercial Unixes, ref. any book on Unix permissions etc :-) > Best regards, > > -Harry Julian -- Julian Stacey. Munich Computer Consultant, BSD Unix C Linux. http://berklix.com HTML mail unseen. Ihr Rauch=mein allergischer Kopfschmerz. Dump cigs 4 snuff. From owner-freebsd-stable@FreeBSD.ORG Tue Jul 3 16:03:27 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id EC45016A469 for ; Tue, 3 Jul 2007 16:03:27 +0000 (UTC) (envelope-from zkolic@sbb.co.yu) Received: from smtp3.sbb.co.yu (smtp3.sbb.co.yu [82.117.194.23]) by mx1.freebsd.org (Postfix) with ESMTP id 691F813C45A for ; Tue, 3 Jul 2007 16:03:27 +0000 (UTC) (envelope-from zkolic@sbb.co.yu) Received: from faust.net (cable-89-216-167-189.dynamic.sbb.co.yu [89.216.167.189]) by smtp3.sbb.co.yu (8.13.7/8.13.7) with ESMTP id l63FYH9B031262 for ; Tue, 3 Jul 2007 17:34:17 +0200 Received: by faust.net (Postfix, from userid 1001) id 37FC21CC58; Tue, 3 Jul 2007 17:34:11 +0200 (CEST) Date: Tue, 3 Jul 2007 17:34:11 +0200 From: Zoran Kolic To: freebsd-stable@freebsd.org Message-ID: <20070703153411.GA1132@faust.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-SMTP-Vilter-Version: 1.3.2 X-SBB-Virus-Status: clean X-SBB-Spam-Score: 2.8 X-SBB-Spam-Level: XXXXXX Subject: simh ethernet option on 6.2 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Jul 2007 16:03:28 -0000 Hi folks! I compiled simh on 6.2 amd64. It is emulator of older vax boxes. During that I chose the option to have ethernet connection for this guest system. Now I just cannot find where it is written. I had a feeling it was sysinstall taking this as an option. Am I right or I opened the door for something stupid? I looked at /boot, /etc, /usr/local/etc. It simply must be somewhere. Zoran From owner-freebsd-stable@FreeBSD.ORG Tue Jul 3 20:55:49 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 2EB1916A400 for ; Tue, 3 Jul 2007 20:55:49 +0000 (UTC) (envelope-from dominique.goncalves@gmail.com) Received: from py-out-1112.google.com (py-out-1112.google.com [64.233.166.177]) by mx1.freebsd.org (Postfix) with ESMTP id E0D5D13C4C3 for ; Tue, 3 Jul 2007 20:55:48 +0000 (UTC) (envelope-from dominique.goncalves@gmail.com) Received: by py-out-1112.google.com with SMTP id u77so3938891pyb for ; Tue, 03 Jul 2007 13:55:48 -0700 (PDT) DKIM-Signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=bA8XN5VNEvoMXyOugdENglg2lvaPaEwjTbu77qD7LZ3AWgIiwPUD4Vtjrm2/qihWzYzNBmQSWgHZgjK7nZoeB9nORAV8ec4UQq1tbqDCQBQ2kOBU8ybkFwuPdv8QZ++R8s++PZ9CYaWxHB6FMKogRfu5nhJYGP0jBLJv4vmPQSA= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=KMqi3bFl236eqGAsVqoTZNwrVt+h5vEBaxKuMNE53BxjkDgI5MmTyHIPmdnSkeh96XxFBrRmIuaG0+Nbx8fOB4rqb1W+DRKWTKlXvSQCJsjk3Xdprlcu53deoM9WdQ8NsUAnv6b0Gp+x/jR1qj4pz+nHPn2bL2oek3eb547XQTU= Received: by 10.35.106.15 with SMTP id i15mr8473987pym.1183496147943; Tue, 03 Jul 2007 13:55:47 -0700 (PDT) Received: by 10.35.17.15 with HTTP; Tue, 3 Jul 2007 13:55:47 -0700 (PDT) Message-ID: <7daacbbe0707031355x753d53a4u22453cf55501a3fa@mail.gmail.com> Date: Tue, 3 Jul 2007 22:55:47 +0200 From: "Dominique Goncalves" To: "Julian H. Stacey" In-Reply-To: <200706241516.l5OFGw9e024257@fire.js.berklix.net> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <7daacbbe0706230615p4ee58c71pb345f1036eb37810@mail.gmail.com> <200706241516.l5OFGw9e024257@fire.js.berklix.net> Cc: freebsd-stable@freebsd.org Subject: Re: Unable to use my USB MP4 player: FreeBSD hangs X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Jul 2007 20:55:49 -0000 Hi, On 6/24/07, Julian H. Stacey wrote: > "Dominique Goncalves" wrote: > > Hi, > > > > I'm trying to connect my USB MP4 player to transfer some video and > > music files, but when I plug the player FreeBSD hangs at this point: > > You don't say, if, so I'll reccomend: > Do turn on power before connectting to FreeBSD > Do not rely on player detecting power & turning on. > Why: > I used to have hell of a problem before with my Clipman mp3 player > Problem was devd or usbd created & destroying things while listening > to wire one end, & the Clipman mp3 listening to wire & also doing > things, eg powering off or destroying /dev entries etc. > http://berklix.com/~jhs/~jhs/txt/clipman/ > > -- > Julian Stacey. Munich Computer Consultant, BSD Unix C Linux. http://berklix.com > HTML mail unseen. Ihr Rauch=mein allergischer Kopfschmerz. Dump cigs 4 snuff. > I tried to connect my player powered before FreeBSD boots, it does not help unfortunately. Regards. -- There's this old saying: "Give a man a fish, feed him for a day. Teach a man to fish, feed him for life." From owner-freebsd-stable@FreeBSD.ORG Wed Jul 4 08:23:13 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id F082916A46C for ; Wed, 4 Jul 2007 08:23:13 +0000 (UTC) (envelope-from ronald-freebsd8@klop.yi.org) Received: from smtp-out3.tiscali.nl (smtp-out3.tiscali.nl [195.241.79.178]) by mx1.freebsd.org (Postfix) with ESMTP id 8DDB713C44C for ; Wed, 4 Jul 2007 08:23:13 +0000 (UTC) (envelope-from ronald-freebsd8@klop.yi.org) Received: from [82.171.39.195] (helo=guido.klop.ws) by smtp-out3.tiscali.nl with smtp (Tiscali http://www.tiscali.nl) id 1I608m-0001fu-6t for ; Wed, 04 Jul 2007 10:23:12 +0200 Received: (qmail 8755 invoked from network); 4 Jul 2007 08:23:04 -0000 Received: from localhost.thuis.klop.ws (HELO guido.klop.ws) (127.0.0.1) by localhost.thuis.klop.ws with SMTP; 4 Jul 2007 08:23:04 -0000 Date: Wed, 04 Jul 2007 10:23:04 +0200 To: freebsd-stable@freebsd.org From: "Ronald Klop" Content-Type: text/plain; format=flowed; delsp=yes; charset=us-ascii MIME-Version: 1.0 References: <7daacbbe0706230615p4ee58c71pb345f1036eb37810@mail.gmail.com> <200706241516.l5OFGw9e024257@fire.js.berklix.net> <7daacbbe0707031355x753d53a4u22453cf55501a3fa@mail.gmail.com> Content-Transfer-Encoding: Quoted-Printable Message-ID: In-Reply-To: <7daacbbe0707031355x753d53a4u22453cf55501a3fa@mail.gmail.com> User-Agent: Opera Mail/9.21 (FreeBSD) Subject: Re: Unable to use my USB MP4 player: FreeBSD hangs X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Jul 2007 08:23:14 -0000 On Tue, 03 Jul 2007 22:55:47 +0200, Dominique Goncalves = wrote: > Hi, > > On 6/24/07, Julian H. Stacey wrote: >> "Dominique Goncalves" wrote: >> > Hi, >> > >> > I'm trying to connect my USB MP4 player to transfer some video and >> > music files, but when I plug the player FreeBSD hangs at this point= : >> >> You don't say, if, so I'll reccomend: >> Do turn on power before connectting to FreeBSD >> Do not rely on player detecting power & turning on. >> Why: >> I used to have hell of a problem before with my Clipman mp3 player >> Problem was devd or usbd created & destroying things while listening >> to wire one end, & the Clipman mp3 listening to wire & also doing >> things, eg powering off or destroying /dev entries etc. >> http://berklix.com/~jhs/~jhs/txt/clipman/ >> >> -- >> Julian Stacey. Munich Computer Consultant, BSD Unix C Linux. = >> http://berklix.com >> HTML mail unseen. Ihr Rauch=3Dmein allergischer Kopfschmerz. Dump ci= gs 4 = >> snuff. >> > > I tried to connect my player powered before FreeBSD boots, it does not= > help unfortunately. I had problems with a usb harddisk, which only worked if plugged in afte= r = FreeBSD booted. The computer hang if I plugged it in before or while = FreeBSD was booting. After I disabled USB in the BIOS, FreeBSD still fou= nd = the usb devices, but the computer doesn't hang anymore. So I think I had= a = conflict between my BIOS and FreeBSD both doing things with usb (or the = = irq of usb, I don't know). BTW: this only happens with my us harddisk. M= y = usb bluetooth device doesn't have this. You could try this also, but no garanties. Ronald. -- = Ronald Klop Amsterdam, The Netherlands From owner-freebsd-stable@FreeBSD.ORG Wed Jul 4 08:51:18 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id F0BAB16A46C for ; Wed, 4 Jul 2007 08:51:18 +0000 (UTC) (envelope-from tom.hurst@clara.net) Received: from spork.qfe3.net (spork.qfe3.net [212.13.207.101]) by mx1.freebsd.org (Postfix) with ESMTP id B41A513C46A for ; Wed, 4 Jul 2007 08:51:18 +0000 (UTC) (envelope-from tom.hurst@clara.net) Received: from [81.104.144.87] (helo=voi.aagh.net) by spork.qfe3.net with esmtp (Exim 4.66 (FreeBSD)) (envelope-from ) id 1I60Hu-000CQN-RQ; Wed, 04 Jul 2007 09:32:38 +0100 Received: from freaky by voi.aagh.net with local (Exim 4.67 (FreeBSD)) (envelope-from ) id 1I60Hu-000Lm6-Mh; Wed, 04 Jul 2007 09:32:38 +0100 Date: Wed, 4 Jul 2007 09:32:38 +0100 From: Thomas Hurst To: "Julian H. Stacey" Message-ID: <20070704083238.GA80543@voi.aagh.net> Mail-Followup-To: "Julian H. Stacey" , Harald Schmalzbauer , freebsd-stable@freebsd.org References: <200707031127.07413.h.schmalzbauer@omnisec.de> <200707031113.l63BDcZW036403@fire.js.berklix.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <200707031113.l63BDcZW036403@fire.js.berklix.net> Organization: Not much. User-Agent: Mutt/1.5.15 (2007-04-06) Sender: Thomas Hurst Cc: freebsd-stable@freebsd.org, Harald Schmalzbauer Subject: Re: regular user can destroy disk label?!? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Jul 2007 08:51:19 -0000 * Julian H. Stacey (jhs@berklix.org) wrote: > Either: > - You made a typo with ar0s2 & meant ad0s2, > - Or you really mean "ar" - man 4 ar reports a comms card ! ataraid(4) exposes ATA RAID devices as ar%d: -% man 4 ataraid |grep /dev /dev/ar* ATA RAID device nodes -- Thomas 'Freaky' Hurst http://hur.st/ From owner-freebsd-stable@FreeBSD.ORG Wed Jul 4 13:00:33 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 9EF8116A46B for ; Wed, 4 Jul 2007 13:00:33 +0000 (UTC) (envelope-from jhs@berklix.org) Received: from thin.berklix.org (thin.berklix.org [194.246.123.68]) by mx1.freebsd.org (Postfix) with ESMTP id 2BAA413C459 for ; Wed, 4 Jul 2007 13:00:32 +0000 (UTC) (envelope-from jhs@berklix.org) Received: from js.berklix.net (p549A6DC6.dip.t-dialin.net [84.154.109.198]) (authenticated bits=128) by thin.berklix.org (8.12.11/8.12.11) with ESMTP id l64D0E9u002271; Wed, 4 Jul 2007 15:00:20 +0200 (CEST) (envelope-from jhs@berklix.org) Received: from fire.js.berklix.net (fire.js.berklix.net [192.168.91.41]) by js.berklix.net (8.13.6/8.13.6) with ESMTP id l64D08RP026284; Wed, 4 Jul 2007 15:00:08 +0200 (CEST) (envelope-from jhs@berklix.org) Received: from fire.js.berklix.net (localhost.js.berklix.net [127.0.0.1]) by fire.js.berklix.net (8.13.8/8.13.8) with ESMTP id l64D08og087278; Wed, 4 Jul 2007 15:00:08 +0200 (CEST) (envelope-from jhs@fire.js.berklix.net) Message-Id: <200707041300.l64D08og087278@fire.js.berklix.net> To: Harald Schmalzbauer , freebsd-stable@freebsd.org In-reply-to: <20070704083238.GA80543@voi.aagh.net> References: <200707031127.07413.h.schmalzbauer@omnisec.de> <200707031113.l63BDcZW036403@fire.js.berklix.net> <20070704083238.GA80543@voi.aagh.net> Comments: In-reply-to Thomas Hurst message dated "Wed, 04 Jul 2007 09:32:38 +0100." Date: Wed, 04 Jul 2007 15:00:08 +0200 From: "Julian H. Stacey" Cc: Subject: Re: regular user can destroy disk label?!? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Jul 2007 13:00:33 -0000 Thomas Hurst wrote: > * Julian H. Stacey (jhs@berklix.org) wrote: > > > Either: > > - You made a typo with ar0s2 & meant ad0s2, > > - Or you really mean "ar" - man 4 ar reports a comms card ! > > ataraid(4) exposes ATA RAID devices as ar%d: > > -% man 4 ataraid |grep /dev > /dev/ar* ATA RAID device nodes Thanks Thomas, that explains name then. It doesnt affect thoughts on permissions though, unless driver very strange. Harald, - If your shell or xterm scroll etc supports logging & you still have it, you might check if you really were unprivileged ? - What's result of your cd /dev ; ls -l . ar0s2 /sbin/bsdlabel -- Julian Stacey. Munich Computer Consultant, BSD Unix C Linux. http://berklix.com HTML mail unseen. Ihr Rauch=mein allergischer Kopfschmerz. Dump cigs 4 snuff. From owner-freebsd-stable@FreeBSD.ORG Wed Jul 4 14:12:42 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id C9DB016A46B for ; Wed, 4 Jul 2007 14:12:42 +0000 (UTC) (envelope-from bms@FreeBSD.org) Received: from out1.smtp.messagingengine.com (out1.smtp.messagingengine.com [66.111.4.25]) by mx1.freebsd.org (Postfix) with ESMTP id A3B0E13C46A for ; Wed, 4 Jul 2007 14:12:42 +0000 (UTC) (envelope-from bms@FreeBSD.org) Received: from compute1.internal (compute1.internal [10.202.2.41]) by out1.messagingengine.com (Postfix) with ESMTP id 0DB9E137F for ; Wed, 4 Jul 2007 10:12:42 -0400 (EDT) Received: from heartbeat2.messagingengine.com ([10.202.2.161]) by compute1.internal (MEProxy); Wed, 04 Jul 2007 10:12:42 -0400 X-Sasl-enc: wyDaK7eFAq1tOA7Q0ESnnTwur2AIwoxejGsxSg3vT5qq 1183558361 Received: from empiric.lon.incunabulum.net (82-35-112-254.cable.ubr07.dals.blueyonder.co.uk [82.35.112.254]) by mail.messagingengine.com (Postfix) with ESMTP id ABE6717ABE for ; Wed, 4 Jul 2007 10:12:41 -0400 (EDT) Message-ID: <468BAAD8.904@FreeBSD.org> Date: Wed, 04 Jul 2007 15:12:40 +0100 From: "Bruce M. Simpson" User-Agent: Thunderbird 2.0.0.4 (X11/20070630) MIME-Version: 1.0 To: FreeBSD stable References: <4670311A.3000200@incunabulum.net> In-Reply-To: <4670311A.3000200@incunabulum.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Subject: Re: FYI: ULi/ALi SATA fix committed on HEAD X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Jul 2007 14:12:42 -0000 This change has now been MFCed. cheers, BMS Bruce M Simpson wrote: > I have just committed a change (with soren's blessing) for the > upcoming 7.0 branch which resolves the regression with ALI/ULI sata > controllers introduced in 6.2-RELEASE. > > This affected a number of systems in particular the ASUS Vintage > series of barebones boxes. Some folks on stable were affected too. From owner-freebsd-stable@FreeBSD.ORG Wed Jul 4 14:59:45 2007 Return-Path: X-Original-To: stable@freebsd.org Delivered-To: freebsd-stable@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 441A216A468 for ; Wed, 4 Jul 2007 14:59:45 +0000 (UTC) (envelope-from petefrench@ticketswitch.com) Received: from mail.ticketswitch.com (mail.ticketswitch.com [194.200.93.188]) by mx1.freebsd.org (Postfix) with ESMTP id 070B813C458 for ; Wed, 4 Jul 2007 14:59:44 +0000 (UTC) (envelope-from petefrench@ticketswitch.com) Received: from dilbert.rattatosk ([10.50.50.6] helo=dilbert.ticketswitch.com) by mail.ticketswitch.com with esmtp (Exim 4.67 (FreeBSD)) (envelope-from ) id 1I665O-000D5t-47 for stable@freebsd.org; Wed, 04 Jul 2007 15:44:06 +0100 Received: from petefrench by dilbert.ticketswitch.com with local (Exim 4.67 (FreeBSD)) (envelope-from ) id 1I665O-0005gC-3r for stable@freebsd.org; Wed, 04 Jul 2007 15:44:06 +0100 To: stable@freebsd.org Message-Id: From: Pete French Date: Wed, 04 Jul 2007 15:44:06 +0100 Cc: Subject: should if_lagg balance outbound traffic on an lacp connection ? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Jul 2007 14:59:45 -0000 Having recently discovered if_lagg in stable I have spent the last couple of days experimentsin with this and using it to aggregate connections between a pair of servers and a pair of Cisco switches. It all appears to be functioning, but looking at the stats I see this: Name Mtu Network Address Ipkts Ierrs Opkts Oerrs Coll bce0 1500 00:19:bb:33:00:de 7545268 0 9303330 0 0 bce1 1500 00:19:bb:33:00:de 7099168 0 126 0 0 lo0 16384 15377 0 15376 0 0 lo0 16384 fe80:3::1 fe80:3::1 0 - 0 - - lo0 16384 localhost ::1 60 - 60 - - lo0 16384 your-net localhost 14222 - 14221 - - lagg0 1500 00:19:bb:33:00:de 7545187 0 9303208 58 0 lagg0 1500 10.17.16/20 turpentine 7539218 - 9305974 - - Note that whilst I am getting evenly split traffic comming in from the switch, outgoing traffic is all heading out on bce0. The ifconfig output looks like this: options=3b ether 00:19:bb:33:00:de media: Ethernet autoselect (1000baseTX ) status: active lagg: laggdev lagg0 bce1: flags=8843 mtu 1500 options=3b ether 00:19:bb:33:00:de media: Ethernet autoselect (1000baseTX ) status: active lagg: laggdev lagg0 lo0: flags=8049 mtu 16384 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet6 ::1 prefixlen 128 inet 127.0.0.1 netmask 0xff000000 lagg0: flags=8843 mtu 1500 inet 10.17.19.0 netmask 0xfffff000 broadcast 10.17.31.255 ether 00:19:bb:33:00:de media: Ethernet autoselect status: active lagg: laggproto lacp laggport bce1 =18 laggport bce0 =1c On the switch both ports are configured in LACP 'active' mode. Is this expected behaviour, or have I done something wrong ? My rc.conf file looks like this: cloned_interfaces="lagg0" network_interfaces="lo0 bce0 bce1 lagg0" ifconfig_bce0="up" ifconfig_bce1="up" ifconfig_lagg0="laggproto lacp laggport bce0 laggport bce1" ipv4_addrs_lagg0="10.17.19.0/20" Any advice ? Or that simply the expected behaviour ? (I dont actuall mind if it is - I am aiming for fault tolerance not performance on this connection, but I am curious for future reference) cheers, -pcf. From owner-freebsd-stable@FreeBSD.ORG Wed Jul 4 15:14:46 2007 Return-Path: X-Original-To: freebsd-stable@FreeBSD.ORG Delivered-To: freebsd-stable@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 8962816A468 for ; Wed, 4 Jul 2007 15:14:46 +0000 (UTC) (envelope-from petefrench@ticketswitch.com) Received: from mail.ticketswitch.com (mail.ticketswitch.com [194.200.93.188]) by mx1.freebsd.org (Postfix) with ESMTP id 26B1A13C459 for ; Wed, 4 Jul 2007 15:14:45 +0000 (UTC) (envelope-from petefrench@ticketswitch.com) Received: from dilbert.rattatosk ([10.50.50.6] helo=dilbert.ticketswitch.com) by mail.ticketswitch.com with esmtp (Exim 4.67 (FreeBSD)) (envelope-from ) id 1I66Gc-000DLm-3Q for freebsd-stable@FreeBSD.ORG; Wed, 04 Jul 2007 15:55:42 +0100 Received: from petefrench by dilbert.ticketswitch.com with local (Exim 4.67 (FreeBSD)) (envelope-from ) id 1I66Gc-0005hG-1Z for freebsd-stable@FreeBSD.ORG; Wed, 04 Jul 2007 15:55:42 +0100 To: freebsd-stable@FreeBSD.ORG Message-Id: From: Pete French Date: Wed, 04 Jul 2007 15:55:42 +0100 Cc: Subject: should if_lagg balance outbound traffic on an lacp connection ? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Jul 2007 15:14:46 -0000 Having recently discovered if_lagg in stable I have spent the last couple of days experimentsin with this and using it to aggregate connections between a pair of servers and a pair of Cisco switches. It all appears to be functioning, but looking at the stats I see this: Name Mtu Network Address Ipkts Ierrs Opkts Oerrs Coll bce0 1500 00:19:bb:33:00:de 7545268 0 9303330 0 0 bce1 1500 00:19:bb:33:00:de 7099168 0 126 0 0 lo0 16384 15377 0 15376 0 0 lo0 16384 fe80:3::1 fe80:3::1 0 - 0 - - lo0 16384 localhost ::1 60 - 60 - - lo0 16384 your-net localhost 14222 - 14221 - - lagg0 1500 00:19:bb:33:00:de 7545187 0 9303208 58 0 lagg0 1500 10.17.16/20 turpentine 7539218 - 9305974 - - Note that whilst I am getting evenly split traffic comming in from the switch, outgoing traffic is all heading out on bce0. The ifconfig output looks like this: options=3b ether 00:19:bb:33:00:de media: Ethernet autoselect (1000baseTX ) status: active lagg: laggdev lagg0 bce1: flags=8843 mtu 1500 options=3b ether 00:19:bb:33:00:de media: Ethernet autoselect (1000baseTX ) status: active lagg: laggdev lagg0 lo0: flags=8049 mtu 16384 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet6 ::1 prefixlen 128 inet 127.0.0.1 netmask 0xff000000 lagg0: flags=8843 mtu 1500 inet 10.17.19.0 netmask 0xfffff000 broadcast 10.17.31.255 ether 00:19:bb:33:00:de media: Ethernet autoselect status: active lagg: laggproto lacp laggport bce1 =18 laggport bce0 =1c On the switch both ports are configured in LACP 'active' mode. Is this expected behaviour, or have I done something wrong ? My rc.conf file looks like this: cloned_interfaces="lagg0" network_interfaces="lo0 bce0 bce1 lagg0" ifconfig_bce0="up" ifconfig_bce1="up" ifconfig_lagg0="laggproto lacp laggport bce0 laggport bce1" ipv4_addrs_lagg0="10.17.19.0/20" Any advice ? Or that simply the expected behaviour ? (I dont actuall mind if it is - I am aiming for fault tolerance not performance on this connection, but I am curious for future reference) cheers, -pcf. From owner-freebsd-stable@FreeBSD.ORG Wed Jul 4 18:31:31 2007 Return-Path: X-Original-To: stable@freebsd.org Delivered-To: freebsd-stable@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 85FE716A400 for ; Wed, 4 Jul 2007 18:31:31 +0000 (UTC) (envelope-from thompsa@FreeBSD.org) Received: from heff.fud.org.nz (203-109-251-39.static.bliink.ihug.co.nz [203.109.251.39]) by mx1.freebsd.org (Postfix) with ESMTP id AC48713C468 for ; Wed, 4 Jul 2007 18:31:30 +0000 (UTC) (envelope-from thompsa@FreeBSD.org) Received: by heff.fud.org.nz (Postfix, from userid 1001) id E6A531CC58; Thu, 5 Jul 2007 06:19:03 +1200 (NZST) Date: Thu, 5 Jul 2007 06:19:03 +1200 From: Andrew Thompson To: Pete French Message-ID: <20070704181903.GA26719@heff.fud.org.nz> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.13 (2006-08-11) Cc: stable@freebsd.org Subject: Re: should if_lagg balance outbound traffic on an lacp connection ? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Jul 2007 18:31:31 -0000 On Wed, Jul 04, 2007 at 03:44:06PM +0100, Pete French wrote: > Having recently discovered if_lagg in stable I have spent the last couple > of days experimentsin with this and using it to aggregate connections between > a pair of servers and a pair of Cisco switches. It all appears to be > functioning, but looking at the stats I see this: > > Name Mtu Network Address Ipkts Ierrs Opkts Oerrs Coll > bce0 1500 00:19:bb:33:00:de 7545268 0 9303330 0 0 > bce1 1500 00:19:bb:33:00:de 7099168 0 126 0 0 > lo0 16384 15377 0 15376 0 0 > lo0 16384 fe80:3::1 fe80:3::1 0 - 0 - - > lo0 16384 localhost ::1 60 - 60 - - > lo0 16384 your-net localhost 14222 - 14221 - - > lagg0 1500 00:19:bb:33:00:de 7545187 0 9303208 58 0 > lagg0 1500 10.17.16/20 turpentine 7539218 - 9305974 - - > > Note that whilst I am getting evenly split traffic comming in from the switch, > outgoing traffic is all heading out on bce0. The ifconfig output looks > like this: > > options=3b > ether 00:19:bb:33:00:de > media: Ethernet autoselect (1000baseTX ) > status: active > lagg: laggdev lagg0 > bce1: flags=8843 mtu 1500 > options=3b > ether 00:19:bb:33:00:de > media: Ethernet autoselect (1000baseTX ) > status: active > lagg: laggdev lagg0 > lo0: flags=8049 mtu 16384 > inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 > inet6 ::1 prefixlen 128 > inet 127.0.0.1 netmask 0xff000000 > lagg0: flags=8843 mtu 1500 > inet 10.17.19.0 netmask 0xfffff000 broadcast 10.17.31.255 > ether 00:19:bb:33:00:de > media: Ethernet autoselect > status: active > lagg: laggproto lacp > laggport bce1 =18 > laggport bce0 =1c > bce1 is a concern here as it is not in the ACTIVE state. On your switch have a look at the lacp stats, here is an example from mine with a 4 port aggregation. c2950#sh lacp neighbor Flags: S - Device is requesting Slow LACPDUs F - Device is requesting Fast LACPDUs A - Device is in Active mode P - Device is in Passive mode Channel group 1 neighbors Partner's information: LACP port Oper Port Port Port Flags Priority Dev ID Age Key Number State Fa0/11 SA 32768 0005.5d71.8db8 4s 0xE6 0x1 0x3D Fa0/12 SA 32768 0005.5d71.8db8 5s 0xE6 0x2 0x3D Fa0/13 SA 32768 0005.5d71.8db8 4s 0xE6 0x3 0x3D Fa0/14 SA 32768 0005.5d71.8db8 3s 0xE6 0x4 0x3D c2950#sh lacp internal Flags: S - Device is requesting Slow LACPDUs F - Device is requesting Fast LACPDUs A - Device is in Active mode P - Device is in Passive mode Channel group 1 LACP port Admin Oper Port Port Port Flags State Priority Key Key Number State Fa0/11 SA bndl 32768 0x1 0x1 0xB 0x3D Fa0/12 SA bndl 32768 0x1 0x1 0xC 0x3D Fa0/13 SA bndl 32768 0x1 0x1 0xD 0x3D Fa0/14 SA bndl 32768 0x1 0x1 0xE 0x3D As you can see all ports are in 'bndl' state which means they have been negoiated. lagg0: flags=8843 metric 0 mtu 1500 ether 00:05:5d:71:8d:b8 media: Ethernet autoselect status: active lagg: laggproto lacp laggport ste3 =1c laggport ste2 =1c laggport ste1 =1c laggport ste0 =1c And all ports here are ACTIVE. I have been meaning to add IOCTLS to display more lacp stats to help debug this sort of thing. Andrew From owner-freebsd-stable@FreeBSD.ORG Thu Jul 5 08:04:28 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 45D7B16A469 for ; Thu, 5 Jul 2007 08:04:28 +0000 (UTC) (envelope-from kim.attree@za.verizonbusiness.com) Received: from mx01.uunet.co.za (mx01.uunet.co.za [196.7.142.153]) by mx1.freebsd.org (Postfix) with ESMTP id D2C9913C44B for ; Thu, 5 Jul 2007 08:04:27 +0000 (UTC) (envelope-from kim.attree@za.verizonbusiness.com) Received: from [196.30.158.7] (helo=pixproxy.so.jnb6.za.uu.net) by mx01.uunet.co.za with esmtp (Exim 4.63 (FreeBSD)) (envelope-from ) id 1I6MK9-0000Vl-E6 for freebsd-stable@freebsd.org; Thu, 05 Jul 2007 10:04:25 +0200 Received: from [196.22.64.216] (chickenboo.ops.uunet.co.za [196.22.64.216]) by pixproxy.so.jnb6.za.uu.net (Postfix) with ESMTP id 5958D102CFC for ; Thu, 5 Jul 2007 10:04:25 +0200 (SAST) Message-ID: <468CA6BE.1000300@za.verizonbusiness.com> Date: Thu, 05 Jul 2007 10:07:26 +0200 From: Kim Attree Organization: Verizon Business User-Agent: Thunderbird 1.5.0.9 (X11/20070208) MIME-Version: 1.0 To: freebsd-stable@freebsd.org X-Enigmail-Version: 0.94.0.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Subject: Problem with KDM not passing to Xorg/KDE after login X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: kim.attree@za.verizonbusiness.com List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jul 2007 08:04:28 -0000 Hey Guys, hoping you can help. I Have a FREEBSD 6.2-STABLE recently supped and compiled, which is a diskless environment. The workstation I'm testing on is working fine, Xorg 7.2 is running perfectly as is KDE (I start it up with startx from a user login). However, when I run KDM as root, and try to login as the same user, KDM sits for about a minute, and then just returns to the KDM login screen. I've gotten rid of the critical error messages I've found in kdm-bin.log, and Xorg.log.0, but still KDM will not pass to KDE/X. Here are the excerpts from the logs (These log entries are only during the login procedure, from when I press enter with a correct user/pass until it returns to KDM). (II) I810(0): [drm] removed 1 reserved context for kernel (II) I810(0): [drm] unmapping 8192 bytes of SAREA 0xc43e7000 at 0x28584000 (WW) I810(0): Successfully set original devices (WW) I810(0): Setting the original video mode instead of restoring the saved state (WW) I810(0): Extended BIOS function 0x5f05 failed. (II) I810(0): BIOS call 0x5f05 not supported, setting refresh with VBE 3 method. (II) I810(0): xf86UnbindGARTMemory: unbind key 18 (II) I810(0): xf86UnbindGARTMemory: unbind key 10 (II) I810(0): xf86UnbindGARTMemory: unbind key 11 (II) I810(0): xf86UnbindGARTMemory: unbind key 13 (II) I810(0): xf86UnbindGARTMemory: unbind key 12 (II) I810(0): xf86UnbindGARTMemory: unbind key 14 (II) I810(0): xf86UnbindGARTMemory: unbind key 15 (II) I810(0): xf86UnbindGARTMemory: unbind key 16 (II) I810(0): xf86UnbindGARTMemory: unbind key 17 (WW) I810(0): Successfully set original devices (2) FreeFontPath: FPE "/usr/local/lib/X11/fonts/misc/" refcount is 2, should be 1; fixing. X Window System Version 7.2.0 Release Date: 22 January 2007 X Protocol Version 11, Revision 0, Release 7.2 Build Operating System: FreeBSD 6.2-STABLE i386 Current Operating System: FreeBSD csc01.csc.jnb6.za.uu.net 6.2-STABLE FreeBSD 6.2-STABLE #8: Tue Apr 3 14:39:35 SAST 2007 root@diskless02 .csc.jnb6.za.uu.net:/usr/obj/usr/src/sys/GENERIC i386 Build Date: 11 June 2007 Before reporting problems, check http://wiki.x.org to make sure that you have the latest version. Module Loader present Markers: (--) probed, (**) from config file, (==) default setting, (++) from command line, (!!) notice, (II) informational, (WW) warning, (EE) error, (NI) not implemented, (??) unknown. (==) Log file: "/var/log/Xorg.0.log", Time: Wed Jul 4 15:14:21 2007 (==) Using config file: "/etc/X11/xorg.conf" /usr/local/share/config/kdm/Xservers: No such file or directory FreeFontPath: FPE "/usr/local/lib/X11/fonts/misc/" refcount is 2, should be 1; fixing. And the directory/FS Structure: / = NFS Mount to /diskless_root /usr = NFS Mount to /usr /home = NFS Read/Write mount to /home /var = Memory filesystem populated at boot /etc = Memory filesystem populated at boot /tmp = NFS Read/Write mount to /netswap Thanks in advance, Kim Attree UNIX Sysadmin From owner-freebsd-stable@FreeBSD.ORG Thu Jul 5 08:59:22 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 9B35116A400 for ; Thu, 5 Jul 2007 08:59:22 +0000 (UTC) (envelope-from kim.attree@za.verizonbusiness.com) Received: from mx01.uunet.co.za (mx01.uunet.co.za [196.7.142.153]) by mx1.freebsd.org (Postfix) with ESMTP id D96D313C457 for ; Thu, 5 Jul 2007 08:59:21 +0000 (UTC) (envelope-from kim.attree@za.verizonbusiness.com) Received: from [196.30.158.7] (helo=pixproxy.so.jnb6.za.uu.net) by mx01.uunet.co.za with esmtp (Exim 4.63 (FreeBSD)) (envelope-from ) id 1I6NBF-00024T-BZ; Thu, 05 Jul 2007 10:59:17 +0200 Received: from [196.22.64.216] (chickenboo.ops.uunet.co.za [196.22.64.216]) by pixproxy.so.jnb6.za.uu.net (Postfix) with ESMTP id 247C2102E11; Thu, 5 Jul 2007 10:59:17 +0200 (SAST) Message-ID: <468CB399.6060600@za.verizonbusiness.com> Date: Thu, 05 Jul 2007 11:02:17 +0200 From: Kim Attree Organization: Verizon Business User-Agent: Thunderbird 1.5.0.9 (X11/20070208) MIME-Version: 1.0 To: ait , freebsd-stable@freebsd.org References: <468CA6BE.1000300@za.verizonbusiness.com> <7011c4710707050156m54a62123kd32aa931fc9201d6@mail.gmail.com> In-Reply-To: <7011c4710707050156m54a62123kd32aa931fc9201d6@mail.gmail.com> X-Enigmail-Version: 0.94.0.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: Subject: Re: Problem with KDM not passing to Xorg/KDE after login X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: kim.attree@za.verizonbusiness.com List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jul 2007 08:59:22 -0000 Ait, I use a normal user to login into KDM, it's just run as root, well because you can't run KDM as a normal user....I've disabled the ability to login as root on KDM as well.... Thanks Kim ait wrote: > I'm not an expert but it seems to me that KDM system won't let you > login as root ;) It's a security measure. Have you tried to login as > ordinary user? > > > > 2007/7/5, Kim Attree >: > > Hey Guys, hoping you can help. > > I Have a FREEBSD 6.2-STABLE recently supped and compiled, which is a > diskless environment. The workstation I'm testing on is working fine, > Xorg 7.2 is running perfectly as is KDE (I start it up with startx > from > a user login). > > However, when I run KDM as root, and try to login as the same > user, KDM > sits for about a minute, and then just returns to the KDM login > screen. > I've gotten rid of the critical error messages I've found in > kdm-bin.log, and Xorg.log.0, but still KDM will not pass to KDE/X. > > Here are the excerpts from the logs (These log entries are only during > the login procedure, from when I press enter with a correct user/pass > until it returns to KDM). > > > (II) I810(0): [drm] removed 1 reserved context for kernel > (II) I810(0): [drm] unmapping 8192 bytes of SAREA 0xc43e7000 at > 0x28584000 > (WW) I810(0): Successfully set original devices > (WW) I810(0): Setting the original video mode instead of restoring > the saved state > (WW) I810(0): Extended BIOS function 0x5f05 failed. > (II) I810(0): BIOS call 0x5f05 not supported, setting refresh with > VBE 3 > method. > (II) I810(0): xf86UnbindGARTMemory: unbind key 18 > (II) I810(0): xf86UnbindGARTMemory: unbind key 10 > (II) I810(0): xf86UnbindGARTMemory: unbind key 11 > (II) I810(0): xf86UnbindGARTMemory: unbind key 13 > (II) I810(0): xf86UnbindGARTMemory: unbind key 12 > (II) I810(0): xf86UnbindGARTMemory: unbind key 14 > (II) I810(0): xf86UnbindGARTMemory: unbind key 15 > (II) I810(0): xf86UnbindGARTMemory: unbind key 16 > (II) I810(0): xf86UnbindGARTMemory: unbind key 17 > (WW) I810(0): Successfully set original devices (2) > FreeFontPath: FPE "/usr/local/lib/X11/fonts/misc/" refcount is 2, > should > be 1; fixing. > > > > X Window System Version 7.2.0 > Release Date: 22 January 2007 > X Protocol Version 11, Revision 0, Release 7.2 > Build Operating System: FreeBSD 6.2-STABLE i386 > Current Operating System: FreeBSD csc01.csc.jnb6.za.uu.net > 6.2-STABLE > FreeBSD 6.2-STABLE #8: Tue Apr 3 14:39:35 SAST 2007 > root@diskless02 > .csc.jnb6.za.uu.net:/usr/obj/usr/src/sys/GENERIC i386 > Build Date: 11 June 2007 > Before reporting problems, check http://wiki.x.org > to make sure that you have the latest version. > Module Loader present > Markers: (--) probed, (**) from config file, (==) default setting, > (++) from command line, (!!) notice, (II) informational, > (WW) warning, (EE) error, (NI) not implemented, (??) unknown. > (==) Log file: "/var/log/Xorg.0.log", Time: Wed Jul 4 15:14:21 2007 > (==) Using config file: "/etc/X11/xorg.conf" > /usr/local/share/config/kdm/Xservers: No such file or directory > FreeFontPath: FPE "/usr/local/lib/X11/fonts/misc/" refcount is 2, > should > be 1; fixing. > > > And the directory/FS Structure: > > / = NFS Mount to /diskless_root > /usr = NFS Mount to /usr > /home = NFS Read/Write mount to /home > /var = Memory filesystem populated at boot > /etc = Memory filesystem populated at boot > /tmp = NFS Read/Write mount to /netswap > > Thanks in advance, > > Kim Attree > UNIX Sysadmin > _______________________________________________ > freebsd-stable@freebsd.org > mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to " > freebsd-stable-unsubscribe@freebsd.org > " > > From owner-freebsd-stable@FreeBSD.ORG Thu Jul 5 09:03:23 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 3B75E16A46C for ; Thu, 5 Jul 2007 09:03:23 +0000 (UTC) (envelope-from kim.attree@za.verizonbusiness.com) Received: from mx01.uunet.co.za (mx01.uunet.co.za [196.7.142.153]) by mx1.freebsd.org (Postfix) with ESMTP id C7EC313C4C5 for ; Thu, 5 Jul 2007 09:03:22 +0000 (UTC) (envelope-from kim.attree@za.verizonbusiness.com) Received: from [196.30.158.7] (helo=pixproxy.so.jnb6.za.uu.net) by mx01.uunet.co.za with esmtp (Exim 4.63 (FreeBSD)) (envelope-from ) id 1I6NFA-0002Cv-Vw; Thu, 05 Jul 2007 11:03:21 +0200 Received: from [196.22.64.216] (chickenboo.ops.uunet.co.za [196.22.64.216]) by pixproxy.so.jnb6.za.uu.net (Postfix) with ESMTP id D4060103009; Thu, 5 Jul 2007 11:03:20 +0200 (SAST) Message-ID: <468CB48D.4050208@za.verizonbusiness.com> Date: Thu, 05 Jul 2007 11:06:21 +0200 From: Kim Attree Organization: Verizon Business User-Agent: Thunderbird 1.5.0.9 (X11/20070208) MIME-Version: 1.0 To: Danny Braniss , freebsd-stable@freebsd.org References: In-Reply-To: X-Enigmail-Version: 0.94.0.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: Subject: Re: Problem with KDM not passing to Xorg/KDE after login X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: kim.attree@za.verizonbusiness.com List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jul 2007 09:03:23 -0000 Danny, thought of that already, /root/.kde is symbolically linked to /var/.kde, which has the contents of /root/.kde and is populated at boot. That /var/.kde is root writable too... Thanks Kim Attree Danny Braniss wrote: > don't know if this is the problem, but usualy, in a diskless env. / is > mountted read-only, and so ~(root) is /root which could be read-only, > and so manythings break when trying to write,eg ~/.kde > > my 5c > danny > > From owner-freebsd-stable@FreeBSD.ORG Thu Jul 5 11:44:55 2007 Return-Path: X-Original-To: stable@freebsd.org Delivered-To: freebsd-stable@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 828C516A421 for ; Thu, 5 Jul 2007 11:44:55 +0000 (UTC) (envelope-from petefrench@ticketswitch.com) Received: from mail.ticketswitch.com (mail.ticketswitch.com [194.200.93.188]) by mx1.freebsd.org (Postfix) with ESMTP id 43E3413C4BA for ; Thu, 5 Jul 2007 11:44:55 +0000 (UTC) (envelope-from petefrench@ticketswitch.com) Received: from dilbert.rattatosk ([10.50.50.6] helo=dilbert.ticketswitch.com) by mail.ticketswitch.com with esmtp (Exim 4.67 (FreeBSD)) (envelope-from ) id 1I6PlV-000P0u-St; Thu, 05 Jul 2007 12:44:53 +0100 Received: from petefrench by dilbert.ticketswitch.com with local (Exim 4.67 (FreeBSD)) (envelope-from ) id 1I6PlV-0007W1-Rl; Thu, 05 Jul 2007 12:44:53 +0100 To: thompsa@FreeBSD.org In-Reply-To: <20070704181903.GA26719@heff.fud.org.nz> Message-Id: From: Pete French Date: Thu, 05 Jul 2007 12:44:53 +0100 Cc: stable@freebsd.org Subject: Re: should if_lagg balance outbound traffic on an lacp connection ? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jul 2007 11:44:55 -0000 > bce1 is a concern here as it is not in the ACTIVE state. On your switch > have a look at the lacp stats, here is an example from mine with a 4 > port aggregation. I have to admit that I did not setup the switch and have never looked into this part of the network before. So it's been 24 hours of 'teach yourself cisco'. But whilst researching the lagg stuff on the net I came across an OpenBSD thread which says that you can only use lagg's LACP implementation to aggregate ports connected to the same physical switch. In this case the networking company who installed the switches have installed a pair, and each machine has one port connected to each switch. The pair of switches is allegedly configured to act as a single switch, so I should just be able to aggregate ports between them. Indeed we have one solitary windows box connected the same whayy which does this quite happily. But I do not know if this is possible under FreeBSD > c2950#sh lacp neighbor .... > Port Flags State Priority Key Key Number State > Fa0/11 SA bndl 32768 0x1 0x1 0xB 0x3D > > As you can see all ports are in 'bndl' state which means they have been negoiated. O.K., trying this on each switch I get the following: Port Flags Priority Dev ID Age Key Number State Gi0/2 SA 32768 0019.bb24.0422 25s 0x90 0x1 0x3D and Port Flags Priority Dev ID Age Key Number State Gi0/2 SA 32768 0019.bb24.0422 23s 0x90 0x2 0x3D So I dont have your first 'State' column in the output! But I do have the final one (is the first one simply an english readable alterantive to the hex?). So my ports are in 0x3D as are yours. > And all ports here are ACTIVE. I have been meaning to add IOCTLS to > display more lacp stats to help debug this sort of thing. I still only have one ACTIVE port. I am going to try using 'failover' mode on lagg instead, but it is a shame :-( Do you think this has anything to do with this being two switches ? Thanks for the help, -pcf. From owner-freebsd-stable@FreeBSD.ORG Thu Jul 5 17:06:28 2007 Return-Path: X-Original-To: stable@FreeBSD.org Delivered-To: freebsd-stable@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 00D6116A41F for ; Thu, 5 Jul 2007 17:06:28 +0000 (UTC) (envelope-from quetzal@zone3000.net) Received: from mx1.sitevalley.com (sitevalley.com [209.67.60.43]) by mx1.freebsd.org (Postfix) with SMTP id B8F9313C487 for ; Thu, 5 Jul 2007 17:06:27 +0000 (UTC) (envelope-from quetzal@zone3000.net) Received: from zone3000.kharkov.ua (HELO localhost) (217.144.69.37) by 0 with SMTP; 5 Jul 2007 16:39:45 -0000 Date: Thu, 5 Jul 2007 19:39:45 +0300 From: Nikolay Pavlov To: Pete French Message-ID: <20070705163945.GA38421@zone3000.net> References: <20070704181903.GA26719@heff.fud.org.nz> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Operating-System: FreeBSD 6.2-RELEASE-p4 User-Agent: mutt-ng/devel-r804 (FreeBSD) Cc: stable@FreeBSD.org, thompsa@FreeBSD.org Subject: Re: should if_lagg balance outbound traffic on an lacp connection ? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jul 2007 17:06:28 -0000 On Thursday, 5 July 2007 at 12:44:53 +0100, Pete French wrote: > > bce1 is a concern here as it is not in the ACTIVE state. On your switch > > have a look at the lacp stats, here is an example from mine with a 4 > > port aggregation. > > I have to admit that I did not setup the switch and have never looked into > this part of the network before. So it's been 24 hours of 'teach yourself > cisco'. But whilst researching the lagg stuff on the net I came across > an OpenBSD thread which says that you can only use lagg's LACP implementation > to aggregate ports connected to the same physical switch. In this case the > networking company who installed the switches have installed a pair, and > each machine has one port connected to each switch. The pair of switches > is allegedly configured to act as a single switch, so I should > just be able to aggregate ports between them. Indeed we have one solitary > windows box connected the same whayy which does this quite happily. But I > do not know if this is possible under FreeBSD > > > c2950#sh lacp neighbor > .... > > Port Flags State Priority Key Key Number State > > Fa0/11 SA bndl 32768 0x1 0x1 0xB 0x3D > > > > As you can see all ports are in 'bndl' state which means they have been negoiated. > > O.K., trying this on each switch I get the following: > > Port Flags Priority Dev ID Age Key Number State > Gi0/2 SA 32768 0019.bb24.0422 25s 0x90 0x1 0x3D > > and > > Port Flags Priority Dev ID Age Key Number State > Gi0/2 SA 32768 0019.bb24.0422 23s 0x90 0x2 0x3D > > So I dont have your first 'State' column in the output! But I do have the > final one (is the first one simply an english readable alterantive to > the hex?). So my ports are in 0x3D as are yours. > > > And all ports here are ACTIVE. I have been meaning to add IOCTLS to > > display more lacp stats to help debug this sort of thing. > > I still only have one ACTIVE port. I am going to try using 'failover' > mode on lagg instead, but it is a shame :-( Do you think this has anything > to do with this being two switches ? > > Thanks for the help, > > -pcf. Try to use fec mode and EtherChannel(on Cisco side) because there is no any special protocol requirments like it is for lacp case. Here is an example on Cisco side: interface GigabitEthernet2/3 description Goes to 2/7 of ServerIron 400 switchport access vlan 55 switchport mode access logging event link-status load-interval 30 speed 1000 no qos channel-group 1 mode on ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ! interface GigabitEthernet2/4 description Goes to 2/8 of ServerIron 400 switchport access vlan 55 switchport mode access logging event link-status load-interval 30 speed 1000 no qos channel-group 1 mode on ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ -- ====================================================================== - Best regards, Nikolay Pavlov. <<<----------------------------------- ====================================================================== From owner-freebsd-stable@FreeBSD.ORG Thu Jul 5 18:40:31 2007 Return-Path: X-Original-To: freebsd-stable@FreeBSD.org Delivered-To: freebsd-stable@FreeBSD.org Received: from misaki (localhost [127.0.0.1]) by hub.freebsd.org (Postfix) with SMTP id 8031216A400; Thu, 5 Jul 2007 18:40:30 +0000 (UTC) (envelope-from ariff@FreeBSD.org) Date: Fri, 6 Jul 2007 02:40:26 +0800 From: Ariff Abdullah To: "TooMany Secrets" Message-Id: <20070706024026.3f7ec656.ariff@FreeBSD.org> In-Reply-To: References: Organization: FreeBSD X-Mailer: /usr/local/lib/ruby/1.8/net/smtp.rb Mime-Version: 1.0 Content-Type: multipart/signed; protocol="application/pgp-signature"; micalg="PGP-SHA1"; boundary="Signature=_Fri__6_Jul_2007_02_40_27_+0800_uAga2kqZ+k/u=OCO" Cc: freebsd-multimedia@freebsd.org, freebsd-stable@FreeBSD.org Subject: Re: Problems with snd_via8233 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jul 2007 18:40:31 -0000 --Signature=_Fri__6_Jul_2007_02_40_27_+0800_uAga2kqZ+k/u=OCO Content-Type: text/plain; charset=US-ASCII Content-Disposition: inline Content-Transfer-Encoding: quoted-printable [CC: -stable, as this doesn't seems like sound specific issues, or so I thought.] On Thu, 5 Jul 2007 19:51:58 +0200 "TooMany Secrets" wrote: > Hello. >=20 > First, please, excuse me my bad english. >=20 > I've got a laptop with FreeBSD 6.2-STABLE. The upgrade from RELEASE > to STABLE was made this monday 2 (aprox.). > Before the upgrade, sound work correctly, without any problem. But > after compile the system (buildworld...) I don't have sound in the > laptop. >=20 > Here is some information: >=20 > dmesg: > pcm0: port 0x1000-0x10ff irq 22 at device 17.5 on pci0 > pcm0: primary codec not ready (cnt =3D 0x7d0) > device_attach: pcm0 attach returned 6 >=20 This is indeed troublesome, since I couldn't recall any major changes to this driver (snd_via8233) for RELENG_6. What release was that, 6.2 or 6.1? What kind of hardware is this, a laptop? Could it be because of ACPI or APIC (try booting by disabling either both). > pciconf -lv: > pcm0@pci0:17:5: class=3D0x040100 card=3D0x2032161f chip=3D0x30591106 > rev=3D0x50 hdr=3D0x00 > vendor =3D 'VIA Technologies Inc' > device =3D 'VT8233/33A/8235/8237 AC97 Enhanced Audio > Controller' class =3D multimedia > subclass =3D audio >=20 > cat /dev/sndstat: > FreeBSD Audio Driver (newpcm) > Installed devices: >=20 > sysctl -w hw.snd.verbose=3D2 > hw.snd.verbose: 2 -> 2 >=20 > sysctl -a hw.snd > hw.snd.report_soft_formats: 1 > hw.snd.targetirqrate: 32 > hw.snd.verbose: 2 > hw.snd.maxautovchans: 4 > hw.snd.unit: 0 >=20 > uname -a > FreeBSD leonsio.toomany.net 6.2-STABLE FreeBSD 6.2-STABLE #1: Mon > Jul 2 20:29:31 CEST 2007 > root@leonsio.toomany.net:/usr/obj/usr/src/sys/LEONSIO i386 >=20 > And attached to this mail here it is the complet kernel config. >=20 > Please, anybody could help me? >=20 -- Ariff Abdullah FreeBSD ... Recording in stereo is obviously too advanced and confusing for us idiot ***** users :P ........ --Signature=_Fri__6_Jul_2007_02_40_27_+0800_uAga2kqZ+k/u=OCO Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.7 (FreeBSD) iD8DBQFGjTsblr+deMUwTNoRAkwSAJ9a0jdACV6h1b4U461LtnnmGZRGbQCg0IL6 uGeXf1QH7RJirV0kYM9CeWY= =TBF0 -----END PGP SIGNATURE----- --Signature=_Fri__6_Jul_2007_02_40_27_+0800_uAga2kqZ+k/u=OCO-- From owner-freebsd-stable@FreeBSD.ORG Thu Jul 5 18:52:06 2007 Return-Path: X-Original-To: stable@freebsd.org Delivered-To: freebsd-stable@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 39A1A16A41F for ; Thu, 5 Jul 2007 18:52:06 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from server.baldwin.cx (66-23-211-162.clients.speedfactory.net [66.23.211.162]) by mx1.freebsd.org (Postfix) with ESMTP id E3DEA13C4C4 for ; Thu, 5 Jul 2007 18:52:05 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from localhost.corp.yahoo.com (john@localhost [127.0.0.1]) (authenticated bits=0) by server.baldwin.cx (8.13.8/8.13.8) with ESMTP id l65ITs0e026471; Thu, 5 Jul 2007 14:29:55 -0400 (EDT) (envelope-from jhb@freebsd.org) From: John Baldwin To: stable@freebsd.org Date: Thu, 5 Jul 2007 14:28:22 -0400 User-Agent: KMail/1.9.6 MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200707051428.22766.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH authentication, not delayed by milter-greylist-2.0.2 (server.baldwin.cx [127.0.0.1]); Thu, 05 Jul 2007 14:29:55 -0400 (EDT) X-Virus-Scanned: ClamAV 0.88.3/3605/Thu Jul 5 12:18:28 2007 on server.baldwin.cx X-Virus-Status: Clean X-Spam-Status: No, score=-4.4 required=4.2 tests=ALL_TRUSTED,AWL,BAYES_00 autolearn=ham version=3.1.3 X-Spam-Checker-Version: SpamAssassin 3.1.3 (2006-06-01) on server.baldwin.cx Cc: current@freebsd.org Subject: Future of the ie(4) driver X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jul 2007 18:52:06 -0000 The ie(4) driver in 7.x has several issues. First of all, it has several compiler warnings that haven't been successfully fixed in several years and are currently just ignored. More importantly, it hasn't been updated to use more modern FreeBSD APIs like bus_space (still uses inb/outb) and SMPng locking. If someone is using this driver and is willing to test fixes for it, then it can be updated. If there isn't anyone who is using this driver and willing to test fixes, then it will be removed from the tree at some point in the future (say a month or two). -- John Baldwin From owner-freebsd-stable@FreeBSD.ORG Fri Jul 6 13:34:25 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id D5EFD16A400 for ; Fri, 6 Jul 2007 13:34:25 +0000 (UTC) (envelope-from rwatson@FreeBSD.org) Received: from cyrus.watson.org (cyrus.watson.org [209.31.154.42]) by mx1.freebsd.org (Postfix) with ESMTP id AEE9A13C43E for ; Fri, 6 Jul 2007 13:34:25 +0000 (UTC) (envelope-from rwatson@FreeBSD.org) Received: from fledge.watson.org (fledge.watson.org [209.31.154.41]) by cyrus.watson.org (Postfix) with ESMTP id 286FB48318; Fri, 6 Jul 2007 09:34:25 -0400 (EDT) Date: Fri, 6 Jul 2007 14:34:25 +0100 (BST) From: Robert Watson X-X-Sender: robert@fledge.watson.org To: "Julian H. Stacey" In-Reply-To: <200707041300.l64D08og087278@fire.js.berklix.net> Message-ID: <20070706143347.S18110@fledge.watson.org> References: <200707031127.07413.h.schmalzbauer@omnisec.de> <200707031113.l63BDcZW036403@fire.js.berklix.net> <20070704083238.GA80543@voi.aagh.net> <200707041300.l64D08og087278@fire.js.berklix.net> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: freebsd-stable@freebsd.org, Harald Schmalzbauer Subject: Re: regular user can destroy disk label?!? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Jul 2007 13:34:25 -0000 On Wed, 4 Jul 2007, Julian H. Stacey wrote: > Thomas Hurst wrote: >> * Julian H. Stacey (jhs@berklix.org) wrote: >> >>> Either: >>> - You made a typo with ar0s2 & meant ad0s2, >>> - Or you really mean "ar" - man 4 ar reports a comms card ! >> >> ataraid(4) exposes ATA RAID devices as ar%d: >> >> -% man 4 ataraid |grep /dev >> /dev/ar* ATA RAID device nodes > > Thanks Thomas, that explains name then. > > It doesnt affect thoughts on permissions though, unless driver very strange. Something people occasional get surprised by is the fact that members of the operator group are given significant access to local disks, etc. Could user account in question have been in the operator group? Robert N M Watson Computer Laboratory University of Cambridge From owner-freebsd-stable@FreeBSD.ORG Fri Jul 6 14:55:38 2007 Return-Path: X-Original-To: stable@freebsd.org Delivered-To: freebsd-stable@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id AA7BC16A41F; Fri, 6 Jul 2007 14:55:38 +0000 (UTC) (envelope-from imb@protected-networks.net) Received: from aaron.protected-networks.net (aaron.protected-networks.net [202.12.127.66]) by mx1.freebsd.org (Postfix) with ESMTP id 472BE13C455; Fri, 6 Jul 2007 14:55:38 +0000 (UTC) (envelope-from imb@protected-networks.net) Received: from localhost (localhost [127.0.0.1]) by aaron.protected-networks.net (Postfix) with ESMTP id 576C8C551; Fri, 6 Jul 2007 10:55:37 -0400 (EDT) Received: from toshi.auburn.protected-networks.net (toshi.auburn.protected-networks.net [202.12.127.84]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "Iain Michael Butler", Issuer "Protected Networks Certificate Authority" (verified OK)) (Authenticated sender: imb@protected-networks.net) by aaron.protected-networks.net (Postfix) with ESMTP id 5E314C448; Fri, 6 Jul 2007 10:55:23 -0400 (EDT) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=protected-networks.net; s=200705; t=1183733723; bh=VhAdHb6NsdowRc LmUZkxD82nyLNae+d1mqmKULLRxnw=; h=DomainKey-Signature:Message-ID: Date:From:User-Agent:MIME-Version:To:CC:Subject:References: In-Reply-To:X-Enigmail-Version:OpenPGP:Content-Type: Content-Transfer-Encoding; b=IFm9WJhvr85n57idgoHqzyoxUGqhKURRCUXf8 OpJ0HQvKRsrTIELMV1OmyjLucAGg4Aj7n8MeP2yi+t3sgwgyPWi3Apj2W7Um5AusmDv VKFjtdzqFv1NjEy/B4AJIcNF DomainKey-Signature: a=rsa-sha1; s=200509; d=protected-networks.net; c=nofws; q=dns; h=message-id:date:from:user-agent:mime-version:to:cc:subject: references:in-reply-to:x-enigmail-version:openpgp:content-type:content-transfer-encoding; b=A1aKh/SCl17q3d4rcTnBe4IuqFx1e4sdNU9kI2r2JcTjIUcUO5+Xcoh6cC/H5wSio Rl+/k+wSDTYWWMFrhWoS4HoY0yB5eHhNtookgDPx1hPRChCAPXC+Gr+YNfZkdxE Message-ID: <468E57D9.20406@protected-networks.net> Date: Fri, 06 Jul 2007 10:55:21 -0400 From: Michael Butler User-Agent: Thunderbird 2.0.0.4 (X11/20070615) MIME-Version: 1.0 To: Kostik Belousov References: <468DC8BB.307@micom.mng.net> <20070706095113.GD2200@deviant.kiev.zoral.com.ua> In-Reply-To: <20070706095113.GD2200@deviant.kiev.zoral.com.ua> X-Enigmail-Version: 0.95.2 OpenPGP: id=0442D492 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: stable@freebsd.org, freebsd-current@freebsd.org, x11@freebsd.org Subject: Re: xorg 7.2 locks system in current X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Jul 2007 14:55:38 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Kostik Belousov wrote: > [Redirecting to x11@ as more appropriate] > > Man page states explicitely that bus_dma_tag_create() (as well as > bus_dmamem_alloc()) shall not be called with non-sleepable lock held. > I am not completely sure, but it seems to be safe to drop the drm > lock around drm_pci_alloc() when the later moved to the start of the > i915_initialize(). > > Could you, please, test the patch below ? This appears to be equally applicable to 6-stable. I've had random lock-ups with an i945GM and which, on initial and brief testing, appear to be gone using this patch, Michael > diff --git a/sys/dev/drm/i915_dma.c b/sys/dev/drm/i915_dma.c > index 1d1877b..118d160 100644 > --- a/sys/dev/drm/i915_dma.c > +++ b/sys/dev/drm/i915_dma.c > @@ -122,7 +122,22 @@ static int i915_initialize(drm_device_t * dev, > drm_i915_private_t * dev_priv, > drm_i915_init_t * init) > { > + drm_dma_handle_t *dmah; > + > + DRM_UNLOCK(); > + dmah = drm_pci_alloc(dev, PAGE_SIZE, PAGE_SIZE, > + 0xffffffff); > + if (!dmah) { > + dev->dev_private = (void *)dev_priv; > + i915_dma_cleanup(dev); > + DRM_ERROR("Can not allocate hardware status page\n"); > + DRM_LOCK(); > + return DRM_ERR(ENOMEM); > + } > + DRM_LOCK(); > + > memset(dev_priv, 0, sizeof(drm_i915_private_t)); > + dev_priv->status_page_dmah = dmah; > > DRM_GETSAREA(); > if (!dev_priv->sarea) { > @@ -181,15 +196,6 @@ static int i915_initialize(drm_device_t * dev, > dev_priv->allow_batchbuffer = 1; > > /* Program Hardware Status Page */ > - dev_priv->status_page_dmah = drm_pci_alloc(dev, PAGE_SIZE, PAGE_SIZE, > - 0xffffffff); > - > - if (!dev_priv->status_page_dmah) { > - dev->dev_private = (void *)dev_priv; > - i915_dma_cleanup(dev); > - DRM_ERROR("Can not allocate hardware status page\n"); > - return DRM_ERR(ENOMEM); > - } > dev_priv->hw_status_page = dev_priv->status_page_dmah->vaddr; > dev_priv->dma_status_page = dev_priv->status_page_dmah->busaddr; > -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.7 (FreeBSD) iD4DBQFGjlfZQv9rrgRC1JIRAnKKAJjho4IxKKbkckbFHJWXkU0eXB48AJ9pcxI/ fCAdV0vMyddsC2WfFKN9Vg== =5hrb -----END PGP SIGNATURE----- From owner-freebsd-stable@FreeBSD.ORG Fri Jul 6 16:05:55 2007 Return-Path: X-Original-To: stable@freebsd.org Delivered-To: freebsd-stable@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 17F3716A46B for ; Fri, 6 Jul 2007 16:05:55 +0000 (UTC) (envelope-from davemac11@yahoo.com) Received: from web32811.mail.mud.yahoo.com (web32811.mail.mud.yahoo.com [68.142.206.41]) by mx1.freebsd.org (Postfix) with SMTP id B9BAC13C46E for ; Fri, 6 Jul 2007 16:05:54 +0000 (UTC) (envelope-from davemac11@yahoo.com) Received: (qmail 93810 invoked by uid 60001); 6 Jul 2007 15:39:13 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:MIME-Version:Content-Type:Message-ID; b=bVU06mP1JL+hEvDU/x311Z7oUfkfWUHga56rUMnlzDVJmx97BSc9g+5cd6sEfdI+0wHdhVv63tg+IvOUbDYFAaTMESy7qX+BiZjTL9g/1KNWnwNbUPW/k0XZWhfwIIT5NZ3Jni7d57LwuDTNokckei034CAHfuiWbKMNnt5z3e4=; X-YMail-OSG: 1QsGtNsVM1lqClfFnf2a7XYga7bpOwK8xfbKQJliusvjzVnKK0WW_QqtoijlPpF3h5o.am_u0pGvczfc9V1bAVJzIRaCyjrtpkIcVhkaPFH784QmSTw- Received: from [157.91.16.21] by web32811.mail.mud.yahoo.com via HTTP; Fri, 06 Jul 2007 08:39:13 PDT X-Mailer: YahooMailRC/651.41 YahooMailWebService/0.7.41.16 Date: Fri, 6 Jul 2007 08:39:13 -0700 (PDT) From: Dave McCammon To: stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ascii Message-ID: <868934.77972.qm@web32811.mail.mud.yahoo.com> Cc: Subject: ipfw with if_bridge oddity X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Jul 2007 16:05:55 -0000 I got nothing from questions@ so I'm posting here. I can't seem to grasp why this is working differently. FreeBSD 6.2 using ipfw + if_bridge LAN -- em1(if_bridge + ipfw)em0 -- internet I am at xx.xx.16.6 and try to ping say www.yahoo.com in ruleset: 1100 allow icmp from any to xx.xx.16.0/27{1-10,13,14,19,22,23} icmptypes 0,3,11,12,13,14 2100 allow ip from xx.xx.16.0/27 to any in via em1 gets dropped by following rule as shown in logs: 4700 deny log ip from any to any Log entry: ipfw: 4700 Deny ICMP:8.0 xx.xx.16.6 69.147.114.210 out via em0 If I add this rule all works great: 2101 allow icmp from xx.xx.16.0/27 to any recv em1 Why would the "recv em1" work and the "in via em1" get blocked? I just changed from using bridge(4) to if_bridge using the same ruleset. The rest of my ruleset seems to be working fine but this problem is causing me a little paranoia about the effectiveness of the firewall. Also, should I still be seeing "deny (snip) in via bridge0" messages in by logs if I have this set "net.link.bridge.pfil_bridge: 0"? Thanks for your help. dave ____________________________________________________________________________________ Looking for a deal? Find great prices on flights and hotels with Yahoo! FareChase. http://farechase.yahoo.com/ From owner-freebsd-stable@FreeBSD.ORG Sat Jul 7 08:39:28 2007 Return-Path: X-Original-To: stable@freebsd.org Delivered-To: freebsd-stable@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 1930F16A46C for ; Sat, 7 Jul 2007 08:39:28 +0000 (UTC) (envelope-from smithi@nimnet.asn.au) Received: from gaia.nimnet.asn.au (nimbin.lnk.telstra.net [139.130.45.143]) by mx1.freebsd.org (Postfix) with ESMTP id AB18B13C45E for ; Sat, 7 Jul 2007 08:39:26 +0000 (UTC) (envelope-from smithi@nimnet.asn.au) Received: from localhost (smithi@localhost) by gaia.nimnet.asn.au (8.8.8/8.8.8R1.5) with SMTP id SAA09531; Sat, 7 Jul 2007 18:25:52 +1000 (EST) (envelope-from smithi@nimnet.asn.au) Date: Sat, 7 Jul 2007 18:25:51 +1000 (EST) From: Ian Smith To: Dave McCammon In-Reply-To: <868934.77972.qm@web32811.mail.mud.yahoo.com> Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Cc: stable@freebsd.org Subject: Re: ipfw with if_bridge oddity X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 07 Jul 2007 08:39:28 -0000 On Fri, 6 Jul 2007, Dave McCammon wrote: > I can't seem to grasp why this is working differently. > FreeBSD 6.2 using ipfw + if_bridge > > LAN -- em1(if_bridge + ipfw)em0 -- internet > > I am at xx.xx.16.6 and try to ping say www.yahoo.com > > in ruleset: > 1100 allow icmp from any to xx.xx.16.0/27{1-10,13,14,19,22,23} icmptypes 0,3,11,12,13,14 > 2100 allow ip from xx.xx.16.0/27 to any in via em1 Seeing noone more knowledgeable has had a go, and with the caveat that I've never setup an if_bridge(4) but still maintain a bridge(4)+ipfw .. Rule 2100 lets your ping in, and 1100 allows the response (in and out) > gets dropped by following rule as shown in logs: > > 4700 deny log ip from any to any > > Log entry: ipfw: 4700 Deny ICMP:8.0 xx.xx.16.6 69.147.114.210 out via em0 Denied because you have no rule letting it go out, it seems. > If I add this rule all works great: > > 2101 allow icmp from xx.xx.16.0/27 to any recv em1 Which allows it both in and out (neither specified) > Why would the "recv em1" work and the "in via em1" get blocked? > > I just changed from using bridge(4) to if_bridge using the same ruleset. Only inbound bridged packets are passed to ipfw from bridge(4) .. once allowed in, they go out. My reading of if_bridge(4) suggests that ipfw (etc) may also be examining outbound bridged packets, depending on the sysctls. How have you got the sysctls mentioned in if_bridge(4) set? > The rest of my ruleset seems to be working fine but this problem is causing me a little paranoia > about the effectiveness of the firewall. > > Also, should I still be seeing "deny (snip) in via bridge0" messages in by logs > if I have this set "net.link.bridge.pfil_bridge: 0"? Dunno. Cheers, Ian From owner-freebsd-stable@FreeBSD.ORG Sat Jul 7 22:36:45 2007 Return-Path: X-Original-To: freebsd-stable@FreeBSD.org Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 38D8316A41F; Sat, 7 Jul 2007 22:36:45 +0000 (UTC) (envelope-from jhs@berklix.org) Received: from thin.berklix.org (thin.berklix.org [194.246.123.68]) by mx1.freebsd.org (Postfix) with ESMTP id BE4BB13C489; Sat, 7 Jul 2007 22:36:44 +0000 (UTC) (envelope-from jhs@berklix.org) Received: from js.berklix.net (p549A6C0B.dip.t-dialin.net [84.154.108.11]) (authenticated bits=128) by thin.berklix.org (8.12.11/8.12.11) with ESMTP id l67MaQWK022795; Sun, 8 Jul 2007 00:36:27 +0200 (CEST) (envelope-from jhs@berklix.org) Received: from fire.js.berklix.net (fire.js.berklix.net [192.168.91.41]) by js.berklix.net (8.13.6/8.13.6) with ESMTP id l67MaI7X043600; Sun, 8 Jul 2007 00:36:19 +0200 (CEST) (envelope-from jhs@berklix.org) Received: from fire.js.berklix.net (localhost.js.berklix.net [127.0.0.1]) by fire.js.berklix.net (8.13.8/8.13.8) with ESMTP id l67MaI7C073631; Sun, 8 Jul 2007 00:36:18 +0200 (CEST) (envelope-from jhs@fire.js.berklix.net) Message-Id: <200707072236.l67MaI7C073631@fire.js.berklix.net> To: Robert Watson In-reply-to: <20070706143347.S18110@fledge.watson.org> References: <200707031127.07413.h.schmalzbauer@omnisec.de> <200707031113.l63BDcZW036403@fire.js.berklix.net> <20070704083238.GA80543@voi.aagh.net> <200707041300.l64D08og087278@fire.js.berklix.net> <20070706143347.S18110@fledge.watson.org> Comments: In-reply-to Robert Watson message dated "Fri, 06 Jul 2007 14:34:25 +0100." Date: Sun, 08 Jul 2007 00:36:18 +0200 From: "Julian H. Stacey" Cc: freebsd-stable@FreeBSD.org, Harald Schmalzbauer Subject: Re: regular user can destroy disk label?!? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 07 Jul 2007 22:36:45 -0000 Robert Watson wrote: > On Wed, 4 Jul 2007, Julian H. Stacey wrote: > > > Thomas Hurst wrote: > >> * Julian H. Stacey (jhs@berklix.org) wrote: > >> > >>> Either: > >>> - You made a typo with ar0s2 & meant ad0s2, > >>> - Or you really mean "ar" - man 4 ar reports a comms card ! > >> > >> ataraid(4) exposes ATA RAID devices as ar%d: > >> > >> -% man 4 ataraid |grep /dev > >> /dev/ar* ATA RAID device nodes > > > > Thanks Thomas, that explains name then. > > > > It doesnt affect thoughts on permissions though, unless driver very strange. > > Something people occasional get surprised by is the fact that members of the > operator group are given significant access to local disks, etc. Could user > account in question have been in the operator group? > > Robert N M Watson Good guess; No response seen though from questioner Harald S., (though my mail filter was in heavy change this week). BTW Harald S., Ian Smith wrote add -d: cd /dev ; ls -l -d . ar0s2 -- Julian Stacey. Munich Computer Consultant, BSD Unix C Linux. http://berklix.com HTML mail unseen. Ihr Rauch=mein allergischer Kopfschmerz. Dump cigs 4 snuff.