[Beowulf] Pretty Big Data
Lux, Jim (337C)
james.p.lux at jpl.nasa.gov
Sat Jan 23 07:14:35 PST 2016
Very much so.
Dumb sequential search in ram is probably faster than a fancy indexing scheme on disk.
And if your data set fits in RAM, why not.
From: Beowulf <beowulf-bounces at beowulf.org<mailto:beowulf-bounces at beowulf.org>> on behalf of John Hearns <hearnsj at googlemail.com<mailto:hearnsj at googlemail.com>>
Date: Friday, January 22, 2016 at 5:33 AM
To: "beowulf at beowulf.org<mailto:beowulf at beowulf.org>" <beowulf at beowulf.org<mailto:beowulf at beowulf.org>>
Subject: [Beowulf] Pretty Big Data
Cubedrone has it today:
A very perceptive cartoon!
And lets just think - with non-volatile RAM why don't we keep everything in RAM.
Also look at this article by Nicole Hemsoth:
Burst buffer style storage on all your notes, writing down to a cheap, slow layer.
the traditional parallel filesystem may have its days numbered.
And I think this could happen faster than you think.
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the Beowulf