[Beowulf] bring back 2012?
sdm900 at gmail.com
Fri Aug 19 07:59:57 PDT 2016
Prentice, have you actually run any of these solutions? Or are you just a
back seat pundit?
Immersion cooling is practical, efficient, easy and has a ton of side
* cheap cooling (can run evaporative rather than compressors)
* nodes use 20% less energy due to removing fans
* node have less failures
* system is more robust against cooling failures (ie. if you lose cooling,
tanks can take a long time to heat up to a point where you would turn nodes
off - we have ridden out 20mins cooling outages)
* more reliable run times - cause cpu's never heat up and change their
* fluid has a high fire and flash point - so you can get permits to hold it
* fluid is readily available and cheap
* fluid is safe (I've ingested and swam in it with no adverse effects -
* quiet - no 1" screaming fans
I looked at all the other solutions and they scare the hell out of me. Try
putting all those pipes into a 2RU node with 8 phi's... it just won't
On Fri, Aug 19, 2016 at 10:25 PM, Prentice Bisbal <pbisbal at pppl.gov> wrote:
> On 08/19/2016 10:02 AM, Michael Di Domenico wrote:
> On Fri, Aug 19, 2016 at 9:32 AM, Stu Midgley <sdm900 at gmail.com> wrote:
>> thanks for the links....
>> are you guys using oil immersed cooling? i've been tracking it for
>> years, but it still seems like it would make a big mess
> I've ranted on the impracticalities of immersion cooling in mineral oil on
> here many times in the past, so I won't rehash those arguments again today.
> Suffice it to say I'm pretty sure the guys at Green Revolution Cooling hate
> seeing me at SC.
> I think direct contact liquid cooling (DCLC)solutions from Asetek and
> CoolIT are much more practical, as are immersion cooling systems using 3M
> Novec engineered fluid. Novec is really appealing because of the heat
> transfer efficiency of the change of state. I believe it was originally
> designed as an electronic parts cleaner, too. It evaporates at room temp
> like other electronic cleaners, so when you pull hardware out the liquid,
> it's dry in a matter of seconds, and very clean, too! Much more practical
> than mineral oil in that regard. 3M claims it has a very low global warming
> factor, too.
> Personally, I think DCLC since any leaks in the data center should be
> smaller than if a tank-like chassis springs a leak, and there one is scared
> of the environmental impact of water, even when antifreeze and other water
> treatment chemicals are added to it, as would be needed in this use case.
> Beowulf mailing list, Beowulf at beowulf.org sponsored by Penguin Computing
> To change your subscription (digest mode or unsubscribe) visit
Dr Stuart Midgley
sdm900 at sdm900.com
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the Beowulf