From ericmars at oarc.rutgers.edu  Wed Sep 16 06:09:21 2020
From: ericmars at oarc.rutgers.edu (Eric Marshall)
Date: Wed, 16 Sep 2020 13:09:21 +0000
Subject: [Beowulf] Rutgers University is looking for someone to join our HPC
	team!
Message-ID: <7F48C82B-E5BC-4F5B-B573-1F91BD0DDE25@oarc.rutgers.edu>

We looking for folks with a background in HPC as a sysadmin or systems programmer who wants to join our team at Rutgers University, the State University of New Jersey. Our HPC clusters help us support research all across the state of New Jersey!

We include parents of small kids, so we know how important it is to be flexible about time and about the life/work balance. We have a team of facilitators who support our users directly, so the systems folks can do systems work.

Ideally, you are sharp, curious and like to get things done. If you are curious about this job, please take a look at https://jobs.rutgers.edu/postings/119645 and please apply! If you have questions, you can reach me at (848) 445-5261 or at eric.marshall at rutgers.edu<mailto:eric.marshall at rutgers.edu>


Thanks,
  Eric

Eric W. Marshall
Director of Advanced Computing Infrastructure
Office of Advanced Research Computing, Rutgers, The State University of New Jersey
Busch Campus, CoRE Building, 96 Frelinghuysen Road, Room 710, Piscataway, NJ 08854
848.445.5261 eric.marshall at rutgers.edu<mailto:eric.marshall at rutgers.edu>  http://oarc.rutgers.edu








-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://beowulf.org/pipermail/beowulf/attachments/20200916/c7448c99/attachment.html>

From tba at kb.dk  Thu Sep 24 01:17:54 2020
From: tba at kb.dk (Tony Brian Albers)
Date: Thu, 24 Sep 2020 08:17:54 +0000
Subject: [Beowulf] Does anyone know if Apache Ambari has been abandoned?
Message-ID: <500dd966-ebd5-6c32-7e2f-d8a31c580061@kb.dk>

Hi guys,

Sorry for the inconvenience.

I'm looking into using Ambari on a new cluster, but as far as I can 
tell, there's no releases after 2.7.5 which came in December '19.

However, the documentation at 
https://cwiki.apache.org/confluence/display/AMBARI/Releasing+Ambari 
states that 2.7.x is deprecated and gives instructions on how to build 
2.8.x.

But I can't find 2.8.x anywhere..

Any ideas/suggestions? I'm puzzled.

TIA

/tony


-- 
Tony Albers - Systems Architect - IT Development Royal Danish Library, 
Victor Albecks Vej 1, 8000 Aarhus C, Denmark
Tel: +45 2566 2383 - CVR/SE: 2898 8842 - EAN: 5798000792142

From sassy-work at sassy.formativ.net  Sun Sep 27 15:27:18 2020
From: sassy-work at sassy.formativ.net (=?ISO-8859-1?Q?J=F6rg_Sa=DFmannshausen?=)
Date: Sun, 27 Sep 2020 23:27:18 +0100
Subject: [Beowulf] Tech talk: Yes! You Can Run Your Software on Arm.
Message-ID: <3578488.giHp7AXMqt@deepblue>

Dear all,

it gives me great pleasure to announce the upcoming tech-talk:
"Yes! You Can Run Your Software on Arm."
given by Chris Edsall (University of Bristol, UK) on Wednesday, 30th of 
September. It is free and no registration is required. 

More information can be found here:

https://github.com/easybuilders/easybuild/wiki/EasyBuild-Tech-Talks-II:-Arm

I hope I will find this talk interesting and exciting. 
Please feel free to distribute it further. 

All the best

Jörg




From darren at wisecorp.co.uk  Sun Sep 27 16:36:29 2020
From: darren at wisecorp.co.uk (Darren Wise)
Date: Mon, 28 Sep 2020 00:36:29 +0100
Subject: [Beowulf] Tech talk: Yes! You Can Run Your Software on Arm.
In-Reply-To: <3578488.giHp7AXMqt@deepblue>
References: <3578488.giHp7AXMqt@deepblue>
Message-ID: <97EC3114-7CF4-46A0-BF92-D66ACFF04AF1@wisecorp.co.uk>

I've shared it via LinkedIn for you too Jörg as I've a few connections that might take the opportunity too :)

Kind regards,
Darren Wise
wisecorp.co.uk

On 27 September 2020 23:27:18 BST, "Jörg Saßmannshausen" <sassy-work at sassy.formativ.net> wrote:
>Dear all,
>
>it gives me great pleasure to announce the upcoming tech-talk:
>"Yes! You Can Run Your Software on Arm."
>given by Chris Edsall (University of Bristol, UK) on Wednesday, 30th of
>
>September. It is free and no registration is required. 
>
>More information can be found here:
>
>https://github.com/easybuilders/easybuild/wiki/EasyBuild-Tech-Talks-II:-Arm
>
>I hope I will find this talk interesting and exciting. 
>Please feel free to distribute it further. 
>
>All the best
>
>Jörg
>
>
>
>_______________________________________________
>Beowulf mailing list, Beowulf at beowulf.org sponsored by Penguin
>Computing
>To change your subscription (digest mode or unsubscribe) visit
>https://beowulf.org/cgi-bin/mailman/listinfo/beowulf
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://beowulf.org/pipermail/beowulf/attachments/20200928/7283993e/attachment.html>

From sassy-work at sassy.formativ.net  Mon Sep 28 00:12:15 2020
From: sassy-work at sassy.formativ.net (=?ISO-8859-1?Q?J=F6rg_Sa=DFmannshausen?=)
Date: Mon, 28 Sep 2020 08:12:15 +0100
Subject: [Beowulf] Tech talk: Yes! You Can Run Your Software on Arm.
In-Reply-To: <97EC3114-7CF4-46A0-BF92-D66ACFF04AF1@wisecorp.co.uk>
References: <3578488.giHp7AXMqt@deepblue>
 <97EC3114-7CF4-46A0-BF92-D66ACFF04AF1@wisecorp.co.uk>
Message-ID: <1705955.n5Uy6IGncr@deepblue>

Hi Darren,

many thanks for doing this!

The tech-talks are really good as they are from the experts for the experts, 
which makes them different to the usual sales-type talk. 
I had a sneak preview and I found it very interesting to be honest. 

All the best from London

Jörg

Am Montag, 28. September 2020, 00:36:29 BST schrieb Darren Wise:
> I've shared it via LinkedIn for you too Jörg as I've a few connections that
> might take the opportunity too :)
> 
> Kind regards,
> Darren Wise
> wisecorp.co.uk
> 
> On 27 September 2020 23:27:18 BST, "Jörg Saßmannshausen" <sassy-
work at sassy.formativ.net> wrote:
> >Dear all,
> >
> >it gives me great pleasure to announce the upcoming tech-talk:
> >"Yes! You Can Run Your Software on Arm."
> >given by Chris Edsall (University of Bristol, UK) on Wednesday, 30th of
> >
> >September. It is free and no registration is required.
> >
> >More information can be found here:
> >
> >https://github.com/easybuilders/easybuild/wiki/EasyBuild-Tech-Talks-II:-Arm
> >
> >I hope I will find this talk interesting and exciting.
> >Please feel free to distribute it further.
> >
> >All the best
> >
> >Jörg
> >
> >
> >
> >_______________________________________________
> >Beowulf mailing list, Beowulf at beowulf.org sponsored by Penguin
> >Computing
> >To change your subscription (digest mode or unsubscribe) visit
> >https://beowulf.org/cgi-bin/mailman/listinfo/beowulf




From darren at wisecorp.co.uk  Mon Sep 28 07:42:18 2020
From: darren at wisecorp.co.uk (Darren Wise)
Date: Mon, 28 Sep 2020 15:42:18 +0100
Subject: [Beowulf] Tech talk: Yes! You Can Run Your Software on Arm.
In-Reply-To: <1705955.n5Uy6IGncr@deepblue>
References: <3578488.giHp7AXMqt@deepblue>
 <97EC3114-7CF4-46A0-BF92-D66ACFF04AF1@wisecorp.co.uk>
 <1705955.n5Uy6IGncr@deepblue>
Message-ID: <527EFA0F-A497-425E-A10A-3F3F40999029@wisecorp.co.uk>

You're welcome Jörg, I'll definitely chime in too.

On another note as I've worked in northern europe during my life and jörg feels like George but not northern european to a degree with an umlaut, my best guess is german and I hope not offend you with my assumptions. Just curious.

Kind regards,
Darren Wise

On 28 September 2020 08:12:15 BST, "Jörg Saßmannshausen" <sassy-work at sassy.formativ.net> wrote:
>Hi Darren,
>
>many thanks for doing this!
>
>The tech-talks are really good as they are from the experts for the
>experts, 
>which makes them different to the usual sales-type talk. 
>I had a sneak preview and I found it very interesting to be honest. 
>
>All the best from London
>
>Jörg
>
>Am Montag, 28. September 2020, 00:36:29 BST schrieb Darren Wise:
>> I've shared it via LinkedIn for you too Jörg as I've a few
>connections that
>> might take the opportunity too :)
>> 
>> Kind regards,
>> Darren Wise
>> wisecorp.co.uk
>> 
>> On 27 September 2020 23:27:18 BST, "Jörg Saßmannshausen" <sassy-
>work at sassy.formativ.net> wrote:
>> >Dear all,
>> >
>> >it gives me great pleasure to announce the upcoming tech-talk:
>> >"Yes! You Can Run Your Software on Arm."
>> >given by Chris Edsall (University of Bristol, UK) on Wednesday, 30th
>of
>> >
>> >September. It is free and no registration is required.
>> >
>> >More information can be found here:
>> >
>>
>>https://github.com/easybuilders/easybuild/wiki/EasyBuild-Tech-Talks-II:-Arm
>> >
>> >I hope I will find this talk interesting and exciting.
>> >Please feel free to distribute it further.
>> >
>> >All the best
>> >
>> >Jörg
>> >
>> >
>> >
>> >_______________________________________________
>> >Beowulf mailing list, Beowulf at beowulf.org sponsored by Penguin
>> >Computing
>> >To change your subscription (digest mode or unsubscribe) visit
>> >https://beowulf.org/cgi-bin/mailman/listinfo/beowulf
>
>
>
>_______________________________________________
>Beowulf mailing list, Beowulf at beowulf.org sponsored by Penguin
>Computing
>To change your subscription (digest mode or unsubscribe) visit
>https://beowulf.org/cgi-bin/mailman/listinfo/beowulf
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://beowulf.org/pipermail/beowulf/attachments/20200928/0c3e72f6/attachment.html>

From deadline at eadline.org  Tue Sep 29 10:29:08 2020
From: deadline at eadline.org (Douglas Eadline)
Date: Tue, 29 Sep 2020 13:29:08 -0400
Subject: [Beowulf] Does anyone know if Apache Ambari has been abandoned?
In-Reply-To: <500dd966-ebd5-6c32-7e2f-d8a31c580061@kb.dk>
References: <500dd966-ebd5-6c32-7e2f-d8a31c580061@kb.dk>
Message-ID: <fc78fa09547b2393322b51512f180902.squirrel@mail.eadline.org>



The short answer is probably.

The long answer is as follows. Hortonworks (company spun out
of Yahoo for Hadoop development and support) provided
a Hadoop "distro" called HDP (kind of like Red Hat).

They put a lot of effort (paid programmers) into the HDP
(and variants) and Ambari as way to install and manage HDP.

So the bill comes due on Hadoop and both Hortonworks and
the other "big"  Hadoop company, Cloudera combine and
re-design the whole lot for on-prem/cloud seamless (fill in
marketing buzzwords here). Seems the Hadoop peak on the
Gartner Hype curve was a bit too high. The Hadoop
ecosystem is still viable and good tech, just got
over sold to the VC's (Intel invested $742 million
in Cloudera!)

In any case, they discontinued and basically "closed sourced" HDP
after version 3.1.4 and Ambari 2.7.4. You can ask for a pass code
to download new versions but I'm not sure what it will cost
(maybe just a call from a salesperson)

So yes, "He's dead Jim" unless some community members
jump in. And Ambari pretty much only worked turn-key
with HDP versions.

Hadoop (and friends) sources are still available from the Apache
site. I use them quite a bit for rolling my own
Hadoop/Spark/Hive/Kafka ... VMs. I use the last open
version of HDP and Ambari on our Limulus personal
clusters, but at some point may move to a more
Apache based home grown install.

IMO, Ambari is nice, very slick and a bit over complicated
which is basically a true statement for the whole
Hadoop Big Data ecosystem.

--
Doug





> Hi guys,
>
> Sorry for the inconvenience.
>
> I'm looking into using Ambari on a new cluster, but as far as I can
> tell, there's no releases after 2.7.5 which came in December '19.
>
> However, the documentation at
> https://cwiki.apache.org/confluence/display/AMBARI/Releasing+Ambari
> states that 2.7.x is deprecated and gives instructions on how to build
> 2.8.x.
>
> But I can't find 2.8.x anywhere..
>
> Any ideas/suggestions? I'm puzzled.
>
> TIA
>
> /tony
>
>
> --
> Tony Albers - Systems Architect - IT Development Royal Danish Library,
> Victor Albecks Vej 1, 8000 Aarhus C, Denmark
> Tel: +45 2566 2383 - CVR/SE: 2898 8842 - EAN: 5798000792142
> _______________________________________________
> Beowulf mailing list, Beowulf at beowulf.org sponsored by Penguin Computing
> To change your subscription (digest mode or unsubscribe) visit
> https://beowulf.org/cgi-bin/mailman/listinfo/beowulf
>


--
Doug


From tba at kb.dk  Tue Sep 29 22:22:37 2020
From: tba at kb.dk (Tony Brian Albers)
Date: Wed, 30 Sep 2020 05:22:37 +0000
Subject: [Beowulf] Does anyone know if Apache Ambari has been abandoned?
In-Reply-To: <fc78fa09547b2393322b51512f180902.squirrel@mail.eadline.org>
References: <500dd966-ebd5-6c32-7e2f-d8a31c580061@kb.dk>
 <fc78fa09547b2393322b51512f180902.squirrel@mail.eadline.org>
Message-ID: <c7a3f62d-6f4d-4d45-cf05-5c3448efae6a@kb.dk>

Hi Doug,

I think you're right. I've made pretty much the same conclusions as you, 
and your input is highly appreciated.

We've actually considered using ansible for deploying the hadoop 
components and their configs. So far this seems to be working.



What did you have in mind when you mentioned "..but at some point may 
move to a more Apache based home grown install."? I'd like to know more 
about that possibility.



Thanks again,

/tony


Douglas Eadline wrote:
> 
> 
> The short answer is probably.
> 
> The long answer is as follows. Hortonworks (company spun out
> of Yahoo for Hadoop development and support) provided
> a Hadoop "distro" called HDP (kind of like Red Hat).
> 
> They put a lot of effort (paid programmers) into the HDP
> (and variants) and Ambari as way to install and manage HDP.
> 
> So the bill comes due on Hadoop and both Hortonworks and
> the other "big"  Hadoop company, Cloudera combine and
> re-design the whole lot for on-prem/cloud seamless (fill in
> marketing buzzwords here). Seems the Hadoop peak on the
> Gartner Hype curve was a bit too high. The Hadoop
> ecosystem is still viable and good tech, just got
> over sold to the VC's (Intel invested $742 million
> in Cloudera!)
> 
> In any case, they discontinued and basically "closed sourced" HDP
> after version 3.1.4 and Ambari 2.7.4. You can ask for a pass code
> to download new versions but I'm not sure what it will cost
> (maybe just a call from a salesperson)
> 
> So yes, "He's dead Jim" unless some community members
> jump in. And Ambari pretty much only worked turn-key
> with HDP versions.
> 
> Hadoop (and friends) sources are still available from the Apache
> site. I use them quite a bit for rolling my own
> Hadoop/Spark/Hive/Kafka ... VMs. I use the last open
> version of HDP and Ambari on our Limulus personal
> clusters, but at some point may move to a more
> Apache based home grown install.
> 
> IMO, Ambari is nice, very slick and a bit over complicated
> which is basically a true statement for the whole
> Hadoop Big Data ecosystem.
> 
> --
> Doug
> 
> 
> 
> 
> 
>> Hi guys,
>>
>> Sorry for the inconvenience.
>>
>> I'm looking into using Ambari on a new cluster, but as far as I can
>> tell, there's no releases after 2.7.5 which came in December '19.
>>
>> However, the documentation at
>> https://cwiki.apache.org/confluence/display/AMBARI/Releasing+Ambari
>> states that 2.7.x is deprecated and gives instructions on how to build
>> 2.8.x.
>>
>> But I can't find 2.8.x anywhere..
>>
>> Any ideas/suggestions? I'm puzzled.
>>
>> TIA
>>
>> /tony
>>
>>
>> --
>> Tony Albers - Systems Architect - IT Development Royal Danish Library,
>> Victor Albecks Vej 1, 8000 Aarhus C, Denmark
>> Tel: +45 2566 2383 - CVR/SE: 2898 8842 - EAN: 5798000792142
>> _______________________________________________
>> Beowulf mailing list, Beowulf at beowulf.org sponsored by Penguin Computing
>> To change your subscription (digest mode or unsubscribe) visit
>> https://beowulf.org/cgi-bin/mailman/listinfo/beowulf
>>
> 
> 
> --
> Doug
> 


-- 
Tony Albers - Systems Architect - IT Development Royal Danish Library, 
Victor Albecks Vej 1, 8000 Aarhus C, Denmark
Tel: +45 2566 2383 - CVR/SE: 2898 8842 - EAN: 5798000792142