[Israel.pm] Memory problem - Loading big files

Pinkhas Nisanov pinkhas at nisanov.com
Fri Jun 20 01:29:29 PDT 2008


On Tue, Jun 17, 2008 at 2:35 AM, Assaf Gordon <gordon at cshl.edu> wrote:
> My data file is a big (~250MB) text file, with eight tab-separated
> fields. I want to load the entire file into a list.

I had same problem, so I stored entire line unparsed and split it everytime
I need it as array. It take much more CPU but cut memory usage
by 2-3 times, e.g.: ( CPU vs memory again )


thanks
Pinkhas Nisanov



More information about the Perl mailing list