«

I have a situation to load large amount of data multi-million of data to
memory for processing.
It's memory intensive application. Analysis.

I have found that Hash is too slow, then I try Array but it's overhead
of 20 or 40 byte make me run out of memory.

I try to find how to define a pointer to block of memory or create array
which less overhead.

Is that possible in ruby ?
--
Posted via http://www.ruby-forum.com/.

Pinit Asavanuchit wrote:
> I have a situation to load large amount of data multi-million of data to
> memory for processing.
> It's memory intensive application. Analysis.
>
> I have found that Hash is too slow, then I try Array but it's overhead
> of 20 or 40 byte make me run out of memory.
>
> I try to find how to define a pointer to block of memory or create array
> which less overhead.
>
> Is that possible in ruby ?

What kind of data is it?

Check out mmap:
http://rubyforge.org/projects/mmap/

Also the narray gem and A. Howard's combination of the two:
http://blade.nagaokaut.ac.jp/cgi-bin...by-talk/162769