[Beowulf] Pretty Big Data

[Lux, Jim (337C)]

Very much so.
Dumb sequential search in ram is probably faster than a fancy indexing scheme on disk.
And if your data set fits in RAM, why not.


From: Beowulf <beowulf-bounces at beowulf.org<mailto:beowulf-bounces at beowulf.org>> on behalf of John Hearns <hearnsj at googlemail.com<mailto:hearnsj at googlemail.com>>
Date: Friday, January 22, 2016 at 5:33 AM
To: "beowulf at beowulf.org<mailto:beowulf at beowulf.org>" <beowulf at beowulf.org<mailto:beowulf at beowulf.org>>
Subject: [Beowulf] Pretty Big Data

Cubedrone has it today:

http://cubedrone.com/

A very perceptive cartoon!
And lets just think - with non-volatile RAM why don't we keep everything in RAM.

Also look at this article by Nicole Hemsoth:

http://www.nextplatform.com/2016/01/12/the-slow-death-of-the-parallel-file-system/

Burst buffer style storage on all your notes, writing down to a cheap, slow layer.
the traditional parallel filesystem may have its days numbered.
And I think this could happen faster than you think.

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.beowulf.org/pipermail/beowulf/attachments/20160123/17322ead/attachment.html>