[Israel.pm] Handling huge data-structures?

Itamar Elem elem at compugen.co.il
Tue Aug 31 04:46:58 PDT 2004


hi worked with 
1. hash with  10,000 entries  each entry   0.5 mb
2.hash with 5000,000 entries   each entry about 1kb

in each case the memory size of the process was  o(entry size + some constant size)

itamar

-----Original Message-----
From: Yuval Yaari [mailto:yuval at windax.com]
Sent: Tuesday, August 31, 2004 2:35 PM
To: perl at perl.org.il
Subject: RE: [Israel.pm] Handling huge data-structures?


May I ask how big were the data-structures you worked with?

  --Yuval


Itamar Elem said:
> hi
> from my experience no
> itamar
>
> -----Original Message-----
> From: Yuval Yaari [mailto:yuval at windax.com]
> Sent: Tuesday, August 31, 2004 11:16 AM
> To: perl at perl.org.il
> Subject: RE: [Israel.pm] Handling huge data-structures?
>
>
> Could anyone tell me if BerkeleyDB::Hash also loads all the data to the
> memory?
> Otherwise -- this is the best solution so far :)
>
>   --Yuval
>
>
> Itamar Elem said:
>> hi
>> you can try use BerkeleyDB module
>> its the interface for the new version of use BerkeleyDB (3.* and
>> above) and its have hash interface
>>
>>          use BerkeleyDB;
>>
>>          $db  = tie %hash, 'BerkeleyDB::Hash', [OPTIONS] ;
>>          $db  = new BerkeleyDB::Hash [OPTIONS] ;
>>
>>          $db  = tie %hash, 'BerkeleyDB::Btree', [OPTIONS] ;
>>          $db  = new BerkeleyDB::Btree [OPTIONS] ;
>>
>>
>> and more
>>
>> itamar
>
>
> _______________________________________________
> Perl mailing list
> Perl at perl.org.il
> http://perl.org.il/mailman/listinfo/perl
>
> _______________________________________________
> Perl mailing list
> Perl at perl.org.il
> http://perl.org.il/mailman/listinfo/perl



_______________________________________________
Perl mailing list
Perl at perl.org.il
http://perl.org.il/mailman/listinfo/perl




More information about the Perl mailing list