[Beowulf] Power draw of cluster nodes under heavy load

[Prentice Bisbal]

On 07/28/2014 01:29 PM, Jeff White wrote:
> Power draw will vary greatly depending on many factors.  Where I am at 
> we currently have 16 racks of HPC equipment (compute nodes, storage, 
> network gear, etc.) using about 140kVA but can use up to 160 kVA.  A 
> single rack with 26 compute nodes each with 64 cores worth of AMD 6276 
> (Supermicro boxes) is using about 18 kW across the PDUs, 3 phase at 
> 240 volts, with most of the nodes at 100% CPU usage.

Agreed there's a lot of variability. Since I don't exactly what's going 
in my new space yet, I'm looking for everyone's input to come up with an 
average, or ballpark amount. the 5 - 10 kW one vendor specified seems 
waaaay too low for a rack of high-density HPC nodes running at or near 
100% utilization.
>
> Jeff White - GNU+Linux Systems Administrator
> University of Pittsburgh - CSSD
>
> On 07/28/2014 10:51 AM, Prentice Bisbal wrote:
>> Beowulfers,
>>
>> Are any of you monitoring the power draw on your clusters? If so, can
>> any of you provide me with some statistics on your power draw under
>> heavy load? Ideally, I'm looking for the power load for a worst-case
>> scenario, such as running HPL, on a per-rack basis. If you can provide
>> me with the power draw and a description of the hardware, that would be
>> great.
>>
>> I have some numbers from a friend who lurks on this list, but the more
>> data points I have, the better I can justify my power requirements for a
>> new cluster purchase I'm working on.
>>
> _______________________________________________
> Beowulf mailing list, Beowulf at beowulf.org sponsored by Penguin Computing
> To change your subscription (digest mode or unsubscribe) visit 
> http://www.beowulf.org/mailman/listinfo/beowulf