[Beowulf] Power per area

[Scott Atchley]

Summit uses both cold plates and rear-door heat exchangers. Frontier will
use Cray's Shasta cabinet which is all water cooled (no fans at all) and is
very high density. I am thinking of the systems after Frontier. Can we
continue to use cold plates or at some point does immersion become the only
alternative? I am not familiar enough with today's immersion, but I am not
sure that it is any more dense or efficient than Summit is. I look at
pictures of cyber-currency facilities with immersion tanks that are 3-4
feet high and I see a lot of empty space above them which could be holding
more compute.

On Tue, Mar 10, 2020 at 7:01 PM Jörg Saßmannshausen <
sassy-work at sassy.formativ.net> wrote:

> Dear all,
>
> yes, there is a max load of the floor and you really should stick to that,
> even though that might open a hole, pardon, a door for a new data centre.
> :-)
>
> There are various way of getting more cooling done. You can use doors
> which
> are cooled, the already described plates on the CPU, you can basically use
> a
> large trough and put your nodes in there (the trough is filled with oil,
> heat
> it up enough and you can fry your chips (not)), you can do that smaller as
> Iceotop demonstrated:
> https://www.iceotope.com/
>
> I guess there are a number of ways you can address the problem. Multi-core
> CPUs, like the new AMD ones, might also be a solution as you can get more
> cores per area.
>
> I hope that helps a bit.
>
> Jörg
>
> Am Dienstag, 10. März 2020, 20:26:18 GMT schrieb David Mathog:
> > On Tue, 10 Mar 2020 15:36:42 -0400 Scott Atchley wrote:
> > > To make the exercise even more fun, what is the weight per square foot
> > > for
> > > immersion systems? Our data centers have a limit of 250 or 500 pounds
> > > per
> > > square foot.
> >
> > I am not an architect but...
> >
> > Aren't there two load values for a floor?  The one I think you are
> > citing is the amount of weight which can safely be placed in a "small"
> > floor area without punching through or causing other localized damage,
> > the other is the total weight that can be placed on that floor without
> > the building collapsing.  If the whole data center is on the ground
> > floor sitting right on a concrete slab with no voids beneath it I would
> > expect the latter value to be huge and not a real concern, but it might
> > be less than (500 pounds per square foot) X (total area) on the 2nd or
> > higher floors.
> >
> > Regards,
> >
> > David Mathog
> > mathog at caltech.edu
> > Manager, Sequence Analysis Facility, Biology Division, Caltech
> > _______________________________________________
> > Beowulf mailing list, Beowulf at beowulf.org sponsored by Penguin Computing
> > To change your subscription (digest mode or unsubscribe) visit
> > https://beowulf.org/cgi-bin/mailman/listinfo/beowulf
>
>
>
> _______________________________________________
> Beowulf mailing list, Beowulf at beowulf.org sponsored by Penguin Computing
> To change your subscription (digest mode or unsubscribe) visit
> https://beowulf.org/cgi-bin/mailman/listinfo/beowulf
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://beowulf.org/pipermail/beowulf/attachments/20200310/11f05246/attachment.html>