[Beowulf] [External] Spark, Julia, OpenMPI etc. - all in one place
Oddo Da
oddodaoddo at gmail.com
Thu Oct 15 04:22:30 PDT 2020
On Tue, Oct 13, 2020 at 8:25 AM Benson Muite <benson_muite at emailplus.org>
wrote:
> A typical university cluster can run a data science workload with Spark,
> Hadoop etc., just requires Admins to make this possible. Systems like
> Comet are made for this kind of work:
> https://portal.xsede.org/sdsc-comet
Thank you, I was unaware of this.
Once jobs start using tens to hundreds of thousands of cores hours,
> taxpayer money (probably also the environment) is saved by writing in a
> low level language.
>
That's an interesting thought, thanks.
A small number of countries design entirely new systems and train their
> students write/port software for them - much as happened with bleeding
> edge systems 20 years ago:)
>
Can you provide some examples? I am curious about this. Thanks!
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://beowulf.org/pipermail/beowulf/attachments/20201015/59c53b44/attachment.html>
More information about the Beowulf
mailing list