From owner-freebsd-cluster Sun Nov 28 7:20:29 1999 Delivered-To: freebsd-cluster@freebsd.org Received: from ns1.yes.no (ns1.yes.no [195.204.136.10]) by hub.freebsd.org (Postfix) with ESMTP id 520A414CCB for ; Sun, 28 Nov 1999 07:20:08 -0800 (PST) (envelope-from eivind@bitbox.follo.net) Received: from bitbox.follo.net (bitbox.follo.net [195.204.143.218]) by ns1.yes.no (8.9.3/8.9.3) with ESMTP id QAA23370; Sun, 28 Nov 1999 16:20:03 +0100 (CET) Received: (from eivind@localhost) by bitbox.follo.net (8.8.8/8.8.6) id QAA57643; Sun, 28 Nov 1999 16:20:02 +0100 (MET) Date: Sun, 28 Nov 1999 16:20:02 +0100 From: Eivind Eklund To: Jeroen Ruigrok/Asmodai Cc: cluster@FreeBSD.ORG Subject: Re: Homepage Message-ID: <19991128162002.F53832@bitbox.follo.net> References: <19991126225814.I35499@daemon.ninth-circle.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Mailer: Mutt 1.0i In-Reply-To: <19991126225814.I35499@daemon.ninth-circle.org>; from asmodai@wxs.nl on Fri, Nov 26, 1999 at 10:58:14PM +0100 Sender: owner-freebsd-cluster@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.ORG On Fri, Nov 26, 1999 at 10:58:14PM +0100, Jeroen Ruigrok/Asmodai wrote: > Hi, > > just a few people on the list yet, but I just wanted to ask for material > to put on the project's webpages which I am going to maintain. > > I cc:'d two of my co-workers, feel free to drop them from future > replies. Patrick and Guillaume, the list is freebsd-cluster, > subscribable through majordomo@freebsd.org. > > The current URL is: http://lucifer.bart.nl/~asmodai/projects/Hydra > > Current project name has been set to Hydra - The *BSD Cluster Project > I hope you guys like the subtitle which you can see on the page. ;) I am of two minds about it - one way, I think it is extremely cool. In another way, I think it doesn't really represent most of what we'll do. Another possibility (inspired by yours): We restart processes faster than you can kill hardware! > So basically this is a call for papers/submissions and to slowly start > the gruntwork of defining things we want and not want in this project. > Some things might end up being defined as a sub-project or a totally > different project. It is in the best interest that after the gruntwork > is done that we gather as much interest from able persons as possible, > e.g. mail -net, -arch about it. -net is probably not too relevant. -hackers is relevant, and -arch is relevant, at least. > And possibly ask -security about safe ways to ensure spoofing or > other attacks can be kept to a minimum. I don't think security is a large part of this. When you are building a cluster, you usually include a so called System Area Network (SAN) that run only inside your cluster. This is assumed to be secure (just as your SCSI buses and memory bus are assumed to be secure). We might want to go beyond that to support different distributed systems models, but I don't think it needs to be a priority. > Thoughts and/or opinions thus far? We need to define the way we think we can walk. I see a number of things we will want to do (this text is intended to be in such a form that you can just snarf it, do slight polish, and use it on the web pages): 1. Give FreeBSD support for process migration. I think the way to do this is to integrate the MOSIX patches, and then go from there. As we have the BSD/OS patches, I think this should be rather simple - it will require some work, but not really large amounts. Guess: About three days to get the patches ported over, and quite a bit more (couple of weeks, or so) to get the stuff up and running. This assumes that the userland side proves easy. 2. Integrate base technology other people have already used for clustering. This includes (at least) a DLM, the v9fs of Ron Minnich, and probably one of the shared distributed memory packages out there. It'd be nice to get the SCI drivers, too. 3. Set up a system for maintaining heartbeats throughout the cluster. This is something that use as close as possible to all available links between the nodes in order to track which part of a cluster is dead when something goes wrong. We should look at available implementations, and see what we can do from there. A heartbeat system normally also provide some way of sending messages to the nodes that are alive, but with little guarantee about bandwidth (one of the links one use is commonly a serial line). 4. Add support for re-writing ARP addresses. This allow instant failover when a machine dies. 5. Add one or more file systems that can be shared between machines - this can be replicated filesystems, or shared access filesystems (like HAS-FS). 6. Design a system for tracking services, including what resources they need and how they are supposed to fail over. Some of the requirements for such a system to be used as the startup system for FreeBSD is available at http://www.freebsd.org/~eivind/newrc.html. Another good resource is the TruCluster documentation, as TruCluster has a very simple implementation of services. This shows the minimum we need to support in order to get it up and working in practice. The third thing we're farily certain we should look at is the implementation of service groups in IBM's RS/6000 Cluster support ("Phoenix"). 7. Implement any other technology necessary to make it easy to create clusters; this will probably involve defining as we go, and looking a lot at what other people have done. I believe the parts mentioned above are mostly mandatory, at least. Eivind. To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-cluster" in the body of the message From owner-freebsd-cluster Mon Nov 29 9:41:39 1999 Delivered-To: freebsd-cluster@freebsd.org Received: from acl.lanl.gov (acl.lanl.gov [128.165.147.1]) by hub.freebsd.org (Postfix) with ESMTP id 5CD7C15097 for ; Mon, 29 Nov 1999 09:41:37 -0800 (PST) (envelope-from rminnich@lanl.gov) Received: from mini.acl.lanl.gov (root@mini.acl.lanl.gov [128.165.147.34]) by acl.lanl.gov (8.8.8/8.8.5) with ESMTP id KAA457976 for ; Mon, 29 Nov 1999 10:41:36 -0700 (MST) Received: from localhost (rminnich@localhost) by mini.acl.lanl.gov (8.9.3/8.8.8) with ESMTP id KAA26146 for ; Mon, 29 Nov 1999 10:41:36 -0700 X-Authentication-Warning: mini.acl.lanl.gov: rminnich owned process doing -bs Date: Mon, 29 Nov 1999 10:41:36 -0700 (MST) From: "Ronald G. Minnich" X-Sender: rminnich@mini.acl.lanl.gov To: cluster@freebsd.org Subject: subscribe Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-freebsd-cluster@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.ORG subscribe rminnich@acl.lanl.gov To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-cluster" in the body of the message From owner-freebsd-cluster Wed Dec 1 13:41:40 1999 Delivered-To: freebsd-cluster@freebsd.org Received: from smtp02.wxs.nl (smtp02.wxs.nl [195.121.6.60]) by hub.freebsd.org (Postfix) with ESMTP id DECB714F94 for ; Wed, 1 Dec 1999 13:41:36 -0800 (PST) (envelope-from asmodai@wxs.nl) Received: from daemon.ninth-circle.org ([195.121.196.98]) by smtp02.wxs.nl (Netscape Messaging Server 3.61) with ESMTP id AAA58AF for ; Wed, 1 Dec 1999 22:39:23 +0100 Received: (from asmodai@localhost) by daemon.ninth-circle.org (8.9.3/8.9.3) id WAA10565 for cluster@freebsd.org; Wed, 1 Dec 1999 22:39:02 +0100 (CET) (envelope-from asmodai) Date: Wed, 1 Dec 1999 22:39:02 +0100 From: Jeroen Ruigrok/Asmodai To: cluster@freebsd.org Subject: Homepage, take two. Message-ID: <19991201223902.E89541@daemon.ninth-circle.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Mailer: Mutt 1.0i Organisation: Ninth-Circle Enterprises Sender: owner-freebsd-cluster@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.ORG Hi you cluster fans. ;) I added some more stuff to the homepage for the cluster project at http://lucifer.bart.nl/~asmodai/projects/Hydra and I welcome feedback. I still have an 100 odd URL's to review which Eivind dumped on me, so expect to see the references page being extended slowly and steadily. Does anyone know of an online dictionary like the OED or some other English dictionary in which I can look up some definitions of words? Also, suggestions about the goals are also welcome so that we can clearly define what falls within and outside the scope of the project at hands. We can also hint at making the things which fall outside the scope interesting to-do projects for others. =) I already added two goals which need some review. Furthermore, what do we need to talk over and agree upon before we can unleash the hordes unto the project? Eivind and me agreed that we need to have a least a decent foundation which cannot be argued about (except by very cluefull people) so that we can skip the long-winded discussion part and go straight on to the more interesting parts. It's late now and if I forgot important things I welcome people to address these things. Kind regards, -- Jeroen Ruigrok van der Werven/Asmodai asmodai(at)wxs.nl The BSD Programmer's Documentation Project Network/Security Specialist BSD: Technical excellence at its best Learn e-mail netiquette: http://www.lemis.com/email.html Forgive us our trespasses, as we forgive those that trespass against us. To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-cluster" in the body of the message From owner-freebsd-cluster Thu Dec 2 3:14:20 1999 Delivered-To: freebsd-cluster@freebsd.org Received: from mimer.webgiro.com (mimer.webgiro.com [212.209.29.5]) by hub.freebsd.org (Postfix) with ESMTP id 879E914D8B for ; Thu, 2 Dec 1999 03:14:13 -0800 (PST) (envelope-from abial@webgiro.com) Received: by mimer.webgiro.com (Postfix, from userid 66) id 632DF2DC05; Thu, 2 Dec 1999 12:14:51 +0100 (CET) Received: by mx.webgiro.com (Postfix, from userid 1001) id BE33F7810; Thu, 2 Dec 1999 12:13:32 +0100 (CET) Received: from localhost (localhost [127.0.0.1]) by mx.webgiro.com (Postfix) with ESMTP id ADF1110E10; Thu, 2 Dec 1999 12:13:32 +0100 (CET) Date: Thu, 2 Dec 1999 12:13:32 +0100 (CET) From: Andrzej Bialecki To: Jeroen Ruigrok/Asmodai Cc: cluster@freebsd.org Subject: Re: Homepage, take two. In-Reply-To: <19991201223902.E89541@daemon.ninth-circle.org> Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-freebsd-cluster@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.ORG On Wed, 1 Dec 1999, Jeroen Ruigrok/Asmodai wrote: > Hi you cluster fans. ;) > > I added some more stuff to the homepage for the cluster project at > http://lucifer.bart.nl/~asmodai/projects/Hydra and I welcome feedback. > I still have an 100 odd URL's to review which Eivind dumped on me, so > expect to see the references page being extended slowly and steadily. If you don't have it yet, Bill Paul's code to set MAC address on some NICs should be of interest (MAC takeover). I really really wonder why it's not yet in the tree.. :-( It Just Works, period. http://www.freebsd.org/~wpaul/mac.tar.gz Andrzej Bialecki // WebGiro AB, Sweden (http://www.webgiro.com) // ------------------------------------------------------------------- // ------ FreeBSD: The Power to Serve. http://www.freebsd.org -------- // --- Small & Embedded FreeBSD: http://www.freebsd.org/~picobsd/ ---- To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-cluster" in the body of the message From owner-freebsd-cluster Thu Dec 2 4: 1:40 1999 Delivered-To: freebsd-cluster@freebsd.org Received: from lucifer.bart.nl (lucifer.bart.nl [194.158.168.74]) by hub.freebsd.org (Postfix) with ESMTP id 6594B14F44 for ; Thu, 2 Dec 1999 04:01:37 -0800 (PST) (envelope-from asmodai@lucifer.bart.nl) Received: (from asmodai@localhost) by lucifer.bart.nl (8.9.3/8.9.3) id NAA18795; Thu, 2 Dec 1999 13:01:34 +0100 (CET) (envelope-from asmodai) Date: Thu, 2 Dec 1999 13:01:34 +0100 From: Jeroen Ruigrok van der Werven To: Andrzej Bialecki Cc: Jeroen Ruigrok/Asmodai , cluster@FreeBSD.ORG Subject: Re: Homepage, take two. Message-ID: <19991202130134.E18029@lucifer.bart.nl> References: <19991201223902.E89541@daemon.ninth-circle.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Mailer: Mutt 1.0i In-Reply-To: ; from abial@webgiro.com on Thu, Dec 02, 1999 at 12:13:32PM +0100 Organisation: bART Internet Services B.V. Sender: owner-freebsd-cluster@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.ORG -On [19991202 12:15], Andrzej Bialecki (abial@webgiro.com) wrote: >If you don't have it yet, Bill Paul's code to set MAC address on some NICs >should be of interest (MAC takeover). I really really wonder why it's not >yet in the tree.. :-( It Just Works, period. > > http://www.freebsd.org/~wpaul/mac.tar.gz Added under references. Slowly adding Eivind's URLs which would be relevant for the project. -- Jeroen Ruigrok van der Werven Network- and systemadministrator bART Internet Services / Tel: +31 - (0) 10 - 240 39 70 VIA NET.WORKS Netherlands To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-cluster" in the body of the message From owner-freebsd-cluster Sat Dec 4 6:55: 6 1999 Delivered-To: freebsd-cluster@freebsd.org Received: from smtp02.wxs.nl (smtp02.wxs.nl [195.121.6.60]) by hub.freebsd.org (Postfix) with ESMTP id 67A4F14FBE for ; Sat, 4 Dec 1999 06:54:53 -0800 (PST) (envelope-from asmodai@wxs.nl) Received: from daemon.ninth-circle.org ([195.121.197.22]) by smtp02.wxs.nl (Netscape Messaging Server 3.61) with ESMTP id AAA29A1 for ; Sat, 4 Dec 1999 15:54:46 +0100 Received: (from asmodai@localhost) by daemon.ninth-circle.org (8.9.3/8.9.3) id PAA03812 for cluster@freebsd.org; Sat, 4 Dec 1999 15:54:42 +0100 (CET) (envelope-from asmodai) Date: Sat, 4 Dec 1999 15:54:42 +0100 From: Jeroen Ruigrok/Asmodai To: cluster@freebsd.org Subject: FW: found load balancing cluster for fbsd! Message-ID: <19991204155442.D3330@daemon.ninth-circle.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Mailer: Mutt 1.0i Organisation: Ninth-Circle Enterprises Sender: owner-freebsd-cluster@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.ORG For those not on -hackers. They have a 2.x and 3.x tarball. ----- Forwarded message from Matt ----- From: "Matt" To: Cc: Subject: found load balancing cluster for fbsd! Date: Fri, 3 Dec 1999 12:10:12 -0800 go to ftp.xgforce.com/pub/eCluster/2X4 I downloaded a copy. It's free for commercial use. there's a linux port for kernel 2.2.5, and a port for sun sparc solaris 2.6/2.7 The following is its intro.txt file in the distribution that i cut off and paste here: The eCluster(tm) Server provides Network Traffic Distribution, Network Failsafe, and Large Network Management features for both Internet and Intranet environment, where one could distribute network traffic among a large number of networked servers and workstations. eCluster(tm) is a highly scalable load-balance cluster system, which can be scaled up to 8X1024, which means that there are 8 cluster groups and each group contains 1024 nodes. Network Traffic Distribution speeds up Internet services. Web Servers and FTP Servers will have distributed traffic. Network traffic will only be routed to the server/workstation that is up, with non-busy and non-crashed corresponding service(port), and with most available resources. Otherwise, an email alert will be sent to a prespecified email address where administrators can be notified. It provides better performance and faster response to net users with fail safe assurance. The eCluster(tm) Failsafe capability allows non-interruptible Internet services and Intranet services. Administrators may take systems down temporarily for server and/or Internet service maintenance without interrupting Internet or Intranet users. It is a true High Availability System providing large scale of redundancy. Large Network Management helps administrators to view and monitor the whole network at their finger tip. Once the network is eClustered, statistics of each server and workstation can be seen from a single console. Alert messages will inform administrators any resource shortages, such as memory shortage, hard drive space shortage, etc. Administrators will be alerted periodically if the shortage condition or failure event is not fixed. The server or workstation that is short in resource will be taken off-line automatically by Clmd and connection request will be directed to the server/workstation with most available resource. Administrators can be notified by pager if you have email capable pagers, such as Skytel. ----- End forwarded message ----- -- Jeroen Ruigrok van der Werven/Asmodai asmodai(at)wxs.nl The BSD Programmer's Documentation Project Network/Security Specialist BSD: Technical excellence at its best Learn e-mail netiquette: http://www.lemis.com/email.html ...fools rush in where Daemons fear to tread. To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-cluster" in the body of the message