From owner-freebsd-cluster@FreeBSD.ORG Thu Jun 5 05:43:23 2003 Return-Path: Delivered-To: freebsd-cluster@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E84CF37B401 for ; Thu, 5 Jun 2003 05:43:23 -0700 (PDT) Received: from mail005.syd.optusnet.com.au (mail005.syd.optusnet.com.au [210.49.20.136]) by mx1.FreeBSD.org (Postfix) with ESMTP id A2FDE43F93 for ; Thu, 5 Jun 2003 05:43:20 -0700 (PDT) (envelope-from Peter.Ross@alumni.tu-berlin.de) Received: from purzelina.optusnet.com.au (melax2-202.dialup.optusnet.com.au [210.49.64.202])h55ChHo25140; Thu, 5 Jun 2003 22:43:17 +1000 Received: from localhost (petros@localhost)h55Cetm01463; Thu, 5 Jun 2003 22:40:55 +1000 X-Authentication-Warning: purzelina.optusnet.com.au: petros owned process doing -bs Date: Thu, 5 Jun 2003 22:40:55 +1000 (EST) From: Peter Ross X-X-Sender: petros@purzelina.optusnet.com.au To: Kip Macy In-Reply-To: Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII cc: freebsd-cluster@freebsd.org Subject: Re: iSCSI and clustering with FreeBSD X-BeenThere: freebsd-cluster@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Clustering FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jun 2003 12:43:25 -0000 On Sun, 20 Apr 2003, Kip Macy wrote: > .. I > see a number of things that FreeBSD really needs to be on equal footing > that I would like to see get going and would like to contribute towards, > but realize that I don't have the time to do it myself and still pay my > mortgage. I'm wondering if people are interested in getting together, or > are simply too busy to do anything but bemoan their absence. I was fired weeks ago so I have some time left;-) And I am a little bit tired of systems administration. After years of reading kernel code (last year especially Linux NFS :-( it would be my first kernel coding. I can imagine to do some work related to FreeBSD clustering. Especially no. 1 sounds interesting. > 1) Shared storage: iscsi initiator > A while back, I signed up to write an iscsi initiator. After having > written an iscsi target, I now realize that I don't have the time to > write an initiator by myself (at least not unpaid). > Time required for development: 3 man months I found: Nate Lawson on freebsd-scsi ( Fri, 28 Mar 2003) > .. Since there is no public iSCSI implementation for FreeBSD, I > have to assume you are using the wrong mailing list. I assume you have more information? What's already done? Is someone else working on it? Regards Peter From owner-freebsd-cluster@FreeBSD.ORG Thu Jun 5 06:48:37 2003 Return-Path: Delivered-To: freebsd-cluster@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8027C37B41C for ; Thu, 5 Jun 2003 06:48:36 -0700 (PDT) Received: from moutng.kundenserver.de (moutng.kundenserver.de [212.227.126.185]) by mx1.FreeBSD.org (Postfix) with ESMTP id E1DCA43FB1 for ; Thu, 5 Jun 2003 06:48:34 -0700 (PDT) (envelope-from sporner@nentec.de) Received: from [212.227.126.155] (helo=mrelayng.kundenserver.de) by moutng.kundenserver.de with esmtp (Exim 3.35 #1) id 19Nv6F-0003AN-00; Thu, 05 Jun 2003 15:48:15 +0200 Received: from [80.131.140.135] (helo=gate.nentec.de) (TLSv1:EDH-RSA-DES-CBC3-SHA:168) (Exim 3.35 #1) id 19Nv6F-00054W-00; Thu, 05 Jun 2003 15:48:15 +0200 Received: from nenny.nentec.de (nenny.nentec.de [153.92.64.1]) by gate.nentec.de (8.11.3/) with ESMTP id h55DmCi27586; Thu, 5 Jun 2003 15:48:12 +0200 Received: from nentec.de (andromeda.nentec.de [153.92.64.34]) by nenny.nentec.de (8.11.3/8.11.3) with ESMTP id h55Dm9009851; Thu, 5 Jun 2003 15:48:09 +0200 Message-ID: <3EDF4A18.9060404@nentec.de> Date: Thu, 05 Jun 2003 15:48:08 +0200 From: Andy Sporner User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2a) Gecko/20020910 X-Accept-Language: en-us, en MIME-Version: 1.0 To: Peter Ross References: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: by AMaViS-perl11-milter (http://amavis.org/) cc: freebsd-cluster@freebsd.org Subject: Re: iSCSI and clustering with FreeBSD X-BeenThere: freebsd-cluster@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Clustering FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jun 2003 13:48:38 -0000 Hi It's about time for me to get back in the fray here. As far as I know there is no work being done on I-scsi. It would be a *VERY* welcome work. If you have kernel questions--ask!! I have bandwidth for questions--just not the whole project. I am well versed with drivers in FreeBSD. I am (finally!!!) finishing the failover effort for FreeBSD. It is sort of like what Sequent had in their clusters (minus lock manager). I think wish to tackle process migration. I have a good idea what has to be done and I don't think 2 year is the target. Once I can start it could be 2-3 months. (I know I said that back in January--but then again how many times has 5.0 release been delayed ;-)) Andy Peter Ross wrote: >On Sun, 20 Apr 2003, Kip Macy wrote: > > > >>.. I >>see a number of things that FreeBSD really needs to be on equal footing >>that I would like to see get going and would like to contribute towards, >>but realize that I don't have the time to do it myself and still pay my >>mortgage. I'm wondering if people are interested in getting together, or >>are simply too busy to do anything but bemoan their absence. >> >> > >I was fired weeks ago so I have some time left;-) > >And I am a little bit tired of systems administration. After years of >reading kernel code (last year especially Linux NFS :-( it would be my >first kernel coding. > >I can imagine to do some work related to FreeBSD clustering. Especially >no. 1 sounds interesting. > > > >>1) Shared storage: iscsi initiator >>A while back, I signed up to write an iscsi initiator. After having >>written an iscsi target, I now realize that I don't have the time to >>write an initiator by myself (at least not unpaid). >>Time required for development: 3 man months >> >> > >I found: > >Nate Lawson on freebsd-scsi ( Fri, 28 Mar 2003) > > > >>.. Since there is no public iSCSI implementation for FreeBSD, I >>have to assume you are using the wrong mailing list. >> >> > >I assume you have more information? What's already done? Is someone else >working on it? > >Regards >Peter > >_______________________________________________ >freebsd-cluster@freebsd.org mailing list >http://lists.freebsd.org/mailman/listinfo/freebsd-cluster >To unsubscribe, send any mail to "freebsd-cluster-unsubscribe@freebsd.org" > > > > From owner-freebsd-cluster@FreeBSD.ORG Thu Jun 5 09:01:09 2003 Return-Path: Delivered-To: freebsd-cluster@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3146637B404 for ; Thu, 5 Jun 2003 09:01:09 -0700 (PDT) Received: from iota.root-servers.ch (iota.root-servers.ch [193.41.193.195]) by mx1.FreeBSD.org (Postfix) with SMTP id 58A9943FE9 for ; Thu, 5 Jun 2003 09:01:07 -0700 (PDT) (envelope-from gabriel_ambuehl@buz.ch) Received: (qmail 92197 invoked from network); 5 Jun 2003 16:01:05 -0000 Received: from dclient217-162-135-22.hispeed.ch (HELO gaxp1800.root.li) (217.162.135.22) by 0 with SMTP; 5 Jun 2003 16:01:05 -0000 Date: Thu, 5 Jun 2003 18:03:50 +0200 From: Gabriel Ambuehl X-Mailer: The Bat! (v1.62i) Educational Organization: BUZ Internet Services X-Priority: 3 (Normal) Message-ID: <1711762515.20030605180350@buz.ch> To: Andy Sporner In-Reply-To: <3EDF4A18.9060404@nentec.de> References: <3EDF4A18.9060404@nentec.de> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit cc: freebsd-cluster@freebsd.org Subject: Re[2]: iSCSI and clustering with FreeBSD X-BeenThere: freebsd-cluster@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: gabriel_ambuehl@buz.ch List-Id: Clustering FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jun 2003 16:01:09 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hello Andy, Thursday, June 5, 2003, 3:48:08 PM, you wrote: > sort of like what Sequent had in their clusters (minus lock manager). > I think wish to tackle process migration. I have a good idea what has If you're going to do process migration, any chance to get MOSIX like functionality, too? Best regards, Gabriel -----BEGIN PGP SIGNATURE----- Version: PGP 6.0.2i iQEVAwUBPt9b2sZa2WpymlDxAQEjawf/RlwG5GPECuF31RU13Ngv3Lr9ZG29DrLf cRjjJylyB4BnirRus+kHeYb2y2UbDrEq4uggYSOvv9Koq5aRvr+bPgihovAusZn6 zpF4IfYK0xS5Vdx8u487xg8lZaLbJ2FWilHOiWGGO74ccmdyCVc7jldMaOj3zVf+ 40eyqZfPungou4bosYWtZf8c0Rgk1JaVtrtOYL9PC7WTDbU89N6EnabV8qMrdU5G GI4BRVG9sfS+psaWqRE/BFa73G1Y4tqfaIzf/CBo9iX9cPFXBdC+8x64pZlRoDys U0dceTDGP94VSLh1tWqJlIlr6U38nYYpWeL6wEzK8FzFg8KQ9UKJJQ== =Inr5 -----END PGP SIGNATURE----- From owner-freebsd-cluster@FreeBSD.ORG Thu Jun 5 09:25:51 2003 Return-Path: Delivered-To: freebsd-cluster@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B59EC37B401 for ; Thu, 5 Jun 2003 09:25:51 -0700 (PDT) Received: from moutng.kundenserver.de (moutng.kundenserver.de [212.227.126.186]) by mx1.FreeBSD.org (Postfix) with ESMTP id CF99043F93 for ; Thu, 5 Jun 2003 09:25:50 -0700 (PDT) (envelope-from sporner@nentec.de) Received: from [212.227.126.162] (helo=mrelayng.kundenserver.de) by moutng.kundenserver.de with esmtp (Exim 3.35 #1) id 19NxYi-00056A-00; Thu, 05 Jun 2003 18:25:48 +0200 Received: from [80.131.140.135] (helo=gate.nentec.de) (TLSv1:EDH-RSA-DES-CBC3-SHA:168) (Exim 3.35 #1) id 19NxYi-0007Cl-00; Thu, 05 Jun 2003 18:25:48 +0200 Received: from nenny.nentec.de (nenny.nentec.de [153.92.64.1]) by gate.nentec.de (8.11.3/) with ESMTP id h55GPki22875; Thu, 5 Jun 2003 18:25:46 +0200 Received: from nentec.de (andromeda.nentec.de [153.92.64.34]) by nenny.nentec.de (8.11.3/8.11.3) with ESMTP id h55GPg022691; Thu, 5 Jun 2003 18:25:42 +0200 Message-ID: <3EDF6F06.4050902@nentec.de> Date: Thu, 05 Jun 2003 18:25:42 +0200 From: Andy Sporner User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2a) Gecko/20020910 X-Accept-Language: en-us, en MIME-Version: 1.0 To: gabriel_ambuehl@buz.ch References: <3EDF4A18.9060404@nentec.de> <1711762515.20030605180350@buz.ch> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: by AMaViS-perl11-milter (http://amavis.org/) cc: freebsd-cluster@freebsd.org Subject: Re: iSCSI and clustering with FreeBSD X-BeenThere: freebsd-cluster@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Clustering FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jun 2003 16:25:52 -0000 Gabriel Ambuehl wrote: >-----BEGIN PGP SIGNED MESSAGE----- > >Hello Andy, > >Thursday, June 5, 2003, 3:48:08 PM, you wrote: > > >>sort of like what Sequent had in their clusters (minus lock >> >> >manager). > > >>I think wish to tackle process migration. I have a good idea what >> >> >has > >If you're going to do process migration, any chance to get MOSIX like >functionality, too? > > I am not completely up on the current Mosix. I read the paper a few years ago when it could only do 32 nodes without specific modifications. What I would like to reach is VMS like process migration. For all I know it could be the same thing. I wish I had to time search this. But suffice that I saw VaxClusters as a very beautiful thing and that was where I started from. That should give some clues. I have started a document detailing it, but I can't reach it now otherwise I would post it here. I will post this in the next days ahead of the release of the new software. The software took longer because I moved to the final phase and it meant some big changes about configuration (for instance there is no GUI in the moment--OK some people please don't get sick trying to control your enthusiasm here ;-) Later it may come back. More will come in about a week, but the short answer to the question is YES. Andy From owner-freebsd-cluster@FreeBSD.ORG Thu Jun 5 09:48:07 2003 Return-Path: Delivered-To: freebsd-cluster@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 660E037B401 for ; Thu, 5 Jun 2003 09:48:07 -0700 (PDT) Received: from walnut.he.net (walnut.he.net [64.71.137.114]) by mx1.FreeBSD.org (Postfix) with ESMTP id A2EB643F3F for ; Thu, 5 Jun 2003 09:48:06 -0700 (PDT) (envelope-from kmacy@fsmware.com) Received: from localhost (kmacy@localhost) by walnut.he.net (8.8.6p2003-03-31/8.8.2) with ESMTP id JAA19500; Thu, 5 Jun 2003 09:47:55 -0700 Date: Thu, 5 Jun 2003 09:47:55 -0700 (PDT) From: Kip Macy X-Sender: kmacy@walnut.he.net To: Andy Sporner In-Reply-To: <3EDF4A18.9060404@nentec.de> Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII cc: freebsd-cluster@freebsd.org Subject: Re: iSCSI and clustering with FreeBSD X-BeenThere: freebsd-cluster@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Clustering FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jun 2003 16:48:07 -0000 > > I am (finally!!!) finishing the failover effort for FreeBSD. It is > sort of like what Sequent had in their clusters (minus lock manager). > I think wish to tackle process migration. I have a good idea what has > to be done and I don't think 2 year is the target. Once I can start > it could be 2-3 months. (I know I said that back in January--but > then again how many times has 5.0 release been delayed ;-)) That would be excellent. If you have any design information, I'm sure there are people other than myself who would be interested in seeing it. -Kip From owner-freebsd-cluster@FreeBSD.ORG Thu Jun 5 10:12:38 2003 Return-Path: Delivered-To: freebsd-cluster@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B49F037B401 for ; Thu, 5 Jun 2003 10:12:38 -0700 (PDT) Received: from iota.root-servers.ch (iota.root-servers.ch [193.41.193.195]) by mx1.FreeBSD.org (Postfix) with SMTP id 4B35B43F85 for ; Thu, 5 Jun 2003 10:12:37 -0700 (PDT) (envelope-from gabriel_ambuehl@buz.ch) Received: (qmail 95527 invoked from network); 5 Jun 2003 17:12:34 -0000 Received: from dclient217-162-135-22.hispeed.ch (HELO gaxp1800.root.li) (217.162.135.22) by 0 with SMTP; 5 Jun 2003 17:12:34 -0000 Date: Thu, 5 Jun 2003 19:15:24 +0200 From: Gabriel Ambuehl X-Mailer: The Bat! (v1.62i) Educational Organization: BUZ Internet Services X-Priority: 3 (Normal) Message-ID: <1386056109.20030605191524@buz.ch> To: Andy Sporner In-Reply-To: <3EDF6F06.4050902@nentec.de> References: <3EDF4A18.9060404@nentec.de> <1711762515.20030605180350@buz.ch> <3EDF6F06.4050902@nentec.de> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit cc: freebsd-cluster@freebsd.org Subject: Re[2]: iSCSI and clustering with FreeBSD X-BeenThere: freebsd-cluster@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: gabriel_ambuehl@buz.ch List-Id: Clustering FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jun 2003 17:12:39 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hello Andy, Thursday, June 5, 2003, 6:25:42 PM, you wrote: > I am not completely up on the current Mosix. I read the paper a few > years ago when it > could only do 32 nodes without specific modifications. I think it's mostly process migration combined with a scheduler. It still doesn't support threads of one process on different machines IIRC. Then again, the performance to sync such would be prohibitively anyway. > What I would like to reach is VMS like process migration. For all I > know it could be > the same thing. I wish I had to time search this. But suffice that I > saw VaxClusters > as a very beautiful thing and that was where I started from. Never used VMS. I hear it's (was?) a good OS and in many ways superior to UNIX but very expensive. Best regards, Gabriel -----BEGIN PGP SIGNATURE----- Version: PGP 6.0.2i iQEUAwUBPt9soMZa2WpymlDxAQGa6Af2PaPe4ticr3UcJP1aOcQ6PZ8T/fOzq+U9 ua0WJYn2RtwMGbvwGwlY19H0SsRtd+qQzq37DtmheQHcVYR+fDQy7D+5Wao4m00U 4raq08H9fT6I+DEsnLvdIuyhgoqoNz3ZMrV0aXK3zUNJ45e6C9oPrAfkaihKVEiX iA6Gjachf1/JgQF4tWw1tykEPzlFzwZDNhgmF3s9gd8rIgw/etyLJUS9HPFbvOXh GpahOwzZBADjutEjKniae4uzAseWJzzBI9nLFiY5U0Y1x09FTELyfTzD8b+gEIDx vgiXsBHthf2trI1Yja4x6lb6x9jSwj6y7yQnMgKB4tKcmgH33EYW =2naE -----END PGP SIGNATURE----- From owner-freebsd-cluster@FreeBSD.ORG Thu Jun 5 10:18:28 2003 Return-Path: Delivered-To: freebsd-cluster@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 62E8837B401 for ; Thu, 5 Jun 2003 10:18:28 -0700 (PDT) Received: from walnut.he.net (walnut.he.net [64.71.137.114]) by mx1.FreeBSD.org (Postfix) with ESMTP id EAC0343F93 for ; Thu, 5 Jun 2003 10:18:27 -0700 (PDT) (envelope-from kmacy@fsmware.com) Received: from localhost (kmacy@localhost) by walnut.he.net (8.8.6p2003-03-31/8.8.2) with ESMTP id KAA01446; Thu, 5 Jun 2003 10:18:27 -0700 Date: Thu, 5 Jun 2003 10:18:27 -0700 (PDT) From: Kip Macy X-Sender: kmacy@walnut.he.net To: Gabriel Ambuehl In-Reply-To: <1386056109.20030605191524@buz.ch> Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII cc: freebsd-cluster@freebsd.org Subject: Re: Re[2]: iSCSI and clustering with FreeBSD X-BeenThere: freebsd-cluster@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Clustering FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jun 2003 17:18:28 -0000 > > I think it's mostly process migration combined with a scheduler. It > still doesn't support threads of one process on different machines > IIRC. Then again, the performance to sync such would be prohibitively > anyway. It has a number of extensions for improving performance, including a clustered file system. The unpatched version (which itself is a _large_ patch), cannot migrate rfork style threaded programs. The problem is linux views (or, at least pre-nptl, viewed) threads as separate processes, so only migrating one process would be extremely expensive. -Kip