From owner-freebsd-questions Thu Jan 16 6:36:53 2003 Delivered-To: freebsd-questions@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 13E0637B401 for ; Thu, 16 Jan 2003 06:36:52 -0800 (PST) Received: from cactus.fi.uba.ar (cactus.fi.uba.ar [157.92.49.108]) by mx1.FreeBSD.org (Postfix) with ESMTP id 0837543F1E for ; Thu, 16 Jan 2003 06:36:51 -0800 (PST) (envelope-from fgleiser@cactus.fi.uba.ar) Received: from cactus.fi.uba.ar (cactus.fi.uba.ar [157.92.49.108]) by cactus.fi.uba.ar (8.12.3/8.12.3) with ESMTP id h0GEXLu6008127; Thu, 16 Jan 2003 11:33:23 -0300 (ART) (envelope-from fgleiser@cactus.fi.uba.ar) Date: Thu, 16 Jan 2003 11:33:20 -0300 (ART) From: Fernando Gleiser To: Alex.Wilkinson@dsto.defence.gov.au Cc: freebsd-questions@FreeBSD.ORG Subject: Re: entropy In-Reply-To: <441y3ehwpb.fsf@be-well.ilk.org> Message-ID: <20030116112515.C8104-100000@cactus.fi.uba.ar> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII X-Spam-Status: No, hits=-103.4 required=5.0 tests=IN_REP_TO,USER_IN_WHITELIST version=2.31 Sender: owner-freebsd-questions@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.ORG On 15 Jan 2003, Lowell Gilbert wrote: > "Wilkinson,Alex" writes: > > > Can someone recommend to me where I can read up on > > entropy. > > > > ie what it is ? Why we have it ? etc etc > > The term "entropy" is often used (in rough analogy to its technical > meaning in thermodynamics) in computer systems to describe the > "amount" of "randomness" available to random-number functionality. The entropy is the mean information per symbol. The higher the entropy, the more random the language is. It can be shown that the entropy is maximum when all the symbols in the alphabet have the same probability 1/n, where n is the number of symbols in the alphabet. In that case, the entropy has a value of -n*log2(n). Also, in that case the alphabet is trully random. > > What to read depends on why you need to know about it, but you could > always refer to some manual pages, particularly rndcontrol(8). If you want a more solid background, get an introductory book in information/coding theory. But don't try it if you don't know calculus, probability and algebra. Fer To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-questions" in the body of the message