Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 9 Nov 2005 14:37:31 +0200
From:      Aggelis Aggelis <aggelis@gmail.com>
To:        Nick I <clusterbuilder@gmail.com>
Cc:        freebsd-cluster@freebsd.org
Subject:   Re: backbone of a large-file streaming system
Message-ID:  <f8ec3c030511090437n6888460cuf3bba1d6e10a3b9e@mail.gmail.com>
In-Reply-To: <e073f9120511080921x50d603el9689567c43e582c7@mail.gmail.com>
References:  <e073f9120511080921x50d603el9689567c43e582c7@mail.gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help
On 11/8/05, Nick I <clusterbuilder@gmail.com> wrote:
> Hi,
> I help maintain a Web site at
> www.clusterbuilder.org<http://www.clusterbuilder.org/>.
> You might have seen before that I have a section called Ask the Cluster
> Expert, where I am building a knowledgebase of cluster and grid informati=
on.
> When someone asks a question I am researching the answer to build this
> knowledgebase out. I received the following question:
>
> *"I am looking for a variety of solutions to be a backbone of a large-fil=
e
> streaming system providing thousands of concurrent download streams.
> Preferably commodity hardware and Linux, though I'm open to commercial
> solutions."*
>
> I am wondering if anyone here has suggestions of what applications will w=
ork
> best for this type of setup. You can respond to the question at
> www.clusterbuilder.org/FAQ
> <http://www.clusterbuilder.org/FAQ>or respond in email.
>
> Thanks,
> Nick
> _______________________________________________
> freebsd-cluster@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-cluster
> To unsubscribe, send any mail to "freebsd-cluster-unsubscribe@freebsd.org=
"
>
it all depends on job. This is the moto of clustering.
>From what i have read the solution is load balancing/redundancy  cluster.
Probably something like what is described in the article  at

http://www.countersiege.com/doc/pfsync-carp/

at the section "Something Bigger"

"This larger configuration is in place at a large educational
institution, providing load balancing and redundancy for a cluster of
web servers:"

As far  as the hardware , that depends on the kind and magnitude of
load that you expect.

there are also devices like eg this
http://www.coyotepoint.com/extreme.htm

Also read the pdf for what these devices are offering
http://www.coyotepoint.com/pdfs/extreme_05.pdf.

Anyway the key point here is on load balancing  and redundancy


      client
        |
        |
    internet
        |
 Load Balancer/Firewall
    |          |             . ..........  |
    |          |                           |
    |          |                           |
  server1 server2                  serverN



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?f8ec3c030511090437n6888460cuf3bba1d6e10a3b9e>