[Israel.pm] Handling huge data-structures?

Zachary Kessin zkessin at cs.brandeis.edu
Mon Aug 30 05:06:52 PDT 2004


you can always mmap the file, or just make sure you do have enough swap to
grab it. I would recomend more ram if you can.

--Zach

--
Zachary Kessin zkessin at cs.brandeis.edu +972 51 809 717 (Cell)
Custom Internet application development
IM: ZachKessin


On Sun, 29 Aug 2004, Yuval Yaari wrote:

> I'm asking about this just for reading/editing files (and I know the
> classic Tie::File).
> I would like to know how to keep and manipulate huge data-structures, as
> if they're in the memory.
>
> It might be impossible... But then again, what is?
>
>   --Yuval
>
> Offer Kaye said:
> > On Sun, 29 Aug 2004 17:32:33 +0300 (IDT), Yuval Yaari wrote:
> >>
> >> I have a <1GB file that I want to keep in a hash, and work with that
> >> hash like a normal hash, just keep it out of my memory (on the HDD,
> >> probably).
> >>
> >> What solutions exist (except for buying more RAM) and what are their
> >> limitations?
> >>
> >>   Thanks,
> >>   --Yuval
> >>
> >
> > Array based rather than hash based solution, but good for large data
> > sets and works pretty much as you described above:
> > Tie::File
> >
> > --
> > Offer Kaye
> > _______________________________________________
> > Perl mailing list
> > Perl at perl.org.il
> > http://perl.org.il/mailman/listinfo/perl
>
>
>
> _______________________________________________
> Perl mailing list
> Perl at perl.org.il
> http://perl.org.il/mailman/listinfo/perl
>



More information about the Perl mailing list