Skip site navigation (1)Skip section navigation (2)
Date:      Fri, 7 Apr 2017 14:06:29 -0700
From:      Karl Young <karly@kipshouse.org>
To:        Tomasz Rola <rtomek@ceti.pl>
Cc:        freebsd-questions@freebsd.org, Ernie Luzar <luzar722@gmail.com>
Subject:   Re: Is there a database built into the base system
Message-ID:  <20170407210629.GR2787@mailboy.kipshouse.net>
In-Reply-To: <20170407001101.GA5885@tau1.ceti.pl>
References:  <58E696BD.6050503@gmail.com> <69607026-F68C-4D9D-A826-3EFE9ECE12AB@mac.com> <58E69E59.6020108@gmail.com> <20170406210516.c63644064eb99f7b60dbd8f4@sohara.org> <58E6AFC0.2080404@gmail.com> <20170407001101.GA5885@tau1.ceti.pl>

next in thread | previous in thread | raw e-mail | index | archive | help
Tomasz Rola(rtomek@ceti.pl)@2017.04.07 02:11:01 +0200:
> On Thu, Apr 06, 2017 at 05:14:40PM -0400, Ernie Luzar wrote:
> [...]
> > inbound source ip address hits my front door. Have 3 flat text files
> > containing about 2000 ip address having a record size of 30 bytes.
> > I am afraid I may be approaching the max file size that csh can handle.
> > Thinking of simple db where the 3 files are indexed and can be
> > read/written with out sequentially process all the records. At the
> > proof of concept stage.
> 
> If I had problem processing 2000 records (or 60 kilobytes) on a
> machine less than 20 years old, I would definitely rethink my
> strategy/algorithm.
> 
> > I have programmed in pear script before where I can open a file and
> > process a record sequentially where only the next record is
> > buffered. csh does not have that kind of file handling that I know
> > of.
> > 
> > You have any suggestions?
> 
> I understand you need to run this under base system (because you want
> no ports). I guess you need to do "man awk" - it seems to be the only
> language capable enough in such environment. Albeit if you are
> masochist, you can stay with csh or learn sh (and sort, cut and few
> other things).
> 

Ah, I thought there was perl and python in base system.  If not, then I
second the awk recommendation.  Awk is powerful enough, and should be
fast enough for what OP has described.

But I wouldn't suggest to learn awk from man page.  "The Awk Programming
Language", written by the inventors of Awk, is a lovely book and even has
a whole chapter on databases.

And, it's available for free.

https://archive.org/stream/pdfy-MgN0H1joIoDVoIC7/The_AWK_Programming_Language_djvu.txt

Enjoy

-karl

> -- 
> Regards,
> Tomasz Rola
> 
> --
> ** A C programmer asked whether computer had Buddha's nature.      **
> ** As the answer, master did "rm -rif" on the programmer's home    **
> ** directory. And then the C programmer became enlightened...      **
> **                                                                 **
> ** Tomasz Rola          mailto:tomasz_rola@bigfoot.com             **
> _______________________________________________
> freebsd-questions@freebsd.org mailing list
> https://lists.freebsd.org/mailman/listinfo/freebsd-questions
> To unsubscribe, send any mail to "freebsd-questions-unsubscribe@freebsd.org"



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20170407210629.GR2787>