[Beowulf] Spark, Julia, OpenMPI etc. - all in one place

[Oddo Da]

On Tue, Oct 13, 2020 at 9:55 AM Douglas Eadline <deadline at eadline.org>
wrote:

>
> Spark is a completely separate code base that has its own Map Reduce
> engine. It can work stand-alone, with the YARN scheduler, or with
> other schedulers. It can also take advantage of HDFS.
>

Doug, this is correct. I think for all practical purposes Hadoop and Spark
get lumped into the same bag because the underlying ideas are coming from
the same place. A lot of people saw Spark (esp. at the beginning) as a much
faster, in-memory Hadoop.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://beowulf.org/pipermail/beowulf/attachments/20201013/2e0b7527/attachment.html>