<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html><head><title>Re[2]: [Beowulf] recommendations for cluster upgrades</title>
<META http-equiv=Content-Type content="text/html; charset=iso-8859-1">
<meta http-equiv="Content-Style-Type" content="text/css">
<style type="text/css"><!--
body {
margin: 5px 5px 5px 5px;
background-color: #ffffff;
}
/* ========== Text Styles ========== */
hr { color: #000000}
body, table /* Normal text */
{
font-size: 9pt;
font-family: 'Courier New';
font-style: normal;
font-weight: normal;
color: #000000;
text-decoration: none;
}
span.rvts1 /* Heading */
{
font-size: 10pt;
font-family: 'Arial';
font-weight: bold;
color: #0000ff;
}
span.rvts2 /* Subheading */
{
font-size: 10pt;
font-family: 'Arial';
font-weight: bold;
color: #000080;
}
span.rvts3 /* Keywords */
{
font-size: 10pt;
font-family: 'Arial';
font-style: italic;
color: #800000;
}
a.rvts4, span.rvts4 /* Jump 1 */
{
font-size: 10pt;
font-family: 'Arial';
color: #008000;
text-decoration: underline;
}
a.rvts5, span.rvts5 /* Jump 2 */
{
font-size: 10pt;
font-family: 'Arial';
color: #008000;
text-decoration: underline;
}
span.rvts6
{
font-weight: bold;
color: #800080;
}
span.rvts7
{
font-weight: bold;
color: #800000;
}
a.rvts8, span.rvts8
{
color: #0000ff;
text-decoration: underline;
}
span.rvts9
{
font-weight: bold;
color: #800000;
}
/* ========== Para Styles ========== */
p,ul,ol /* Paragraph Style */
{
text-align: left;
text-indent: 0px;
padding: 0px 0px 0px 0px;
margin: 0px 0px 0px 0px;
}
.rvps1 /* Centered */
{
text-align: center;
}
--></style>
</head>
<body>
<p>Hallo Mark,</p>
<p><br></p>
<p>Mittwoch, 13. Mai 2009, meintest Du:</p>
<p><br></p>
<p><span class=rvts6>>> I'm currently shopping around for a cluster-expansion and was shopping</span></p>
<p><span class=rvts6>>> for options. Anybody out here who's bought new hardware in the recent</span></p>
<p><span class=rvts6>>> past? Any suggestions? Any horror stories?</span></p>
<p><br></p>
<p><span class=rvts7>MH> I think the answer depends on time-frame. if you're bw-sensitive,</span></p>
<p><span class=rvts7>MH> you go nehalem for the time being. </span></p>
<p><span class=rvts7><br></span></p>
<p>I'm really surprised that everyone just screams "Nehalem" - of course the platorm is the fastest that you can buy for money at the moment. It is the youngest design so that is not suprising. </p>
<p><br></p>
<p>But clustering is always about price/performance. And AMD doesn't look so bad there. Shanghai-pricing was lowered in February and another pricedrop is expected when Istanbul is launched. So Nehalem is faster but more expensive. For some Applications it is "more expensive" than it is "faster".</p>
<p><br></p>
<p>Memory, CPUs and Chipsets for Intel are expensive - what you can buy from AMD is "old" hardware that is in the market now for quite some time. It is simply cheaper. </p>
<p><br></p>
<p>The 2.4..2.6 GHz Shangais are interesting. </p>
<p><br></p>
<p><span class=rvts7>MH> for the near future, I'm interested to see how AMD's next-gen "istanbul" works out. </span></p>
<p><span class=rvts7><br></span></p>
<p>It seems to be very interesting. </p>
<p><br></p>
<p>When Clovertown/Harpertown was launched by INtel it seemed like they designed the CPU just for getting to the top500. High HPL-scores but other applications did not always perform good. Istanbul seems to be the perfect top500-CPU. You reach a high Number of cores in a small power footprint. HPL-efficiency is very good. Let's see how real applications behave ... what i've seen so far was looking interesting enough!</p>
<p><br></p>
<p><span class=rvts7>MH> AMD obviously needs </span></p>
<p><span class=rvts7>MH> to break out past ddr2/800 - it would be kind of surprising if they </span></p>
<p><br></p>
<p>They will ... but having a stable platform was also important. And AMD kept the socket-F now for quite some time.</p>
<p><br></p>
<p><span class=rvts7>MH> went 6c/socket without some improvement. AMD has made a big deal </span></p>
<p><span class=rvts7>MH> about the cache snooping, but I'm not sure how much it matters for </span></p>
<p><span class=rvts7>MH> the main market (2-socket). </span></p>
<p><span class=rvts7><br></span></p>
<p>You have two things: </p>
<p><br></p>
<p>HyperTransport3 - some Shanghai have it (the really fast ones with the odd product numbers). And of course all Istanbuls. It enables them to handle a lot more coherency-trafic. But in a 2-way mainboard it is not a big performance impact.</p>
<p>HT-Assist - some kinde of snoop filter for Istanbul. Without this Istanbul probably wouldn't scale to 6cores at all. But real world performance seem to be interesting... so HT-Assist seem to make a difference.</p>
<p><br></p>
<p><span class=rvts7>MH> if you're considering 4-socket, I'd </span></p>
<p><span class=rvts7>MH> certainly think about whether to wait for istanbul.</span></p>
<p><br></p>
<p>Istanbul or at least Shanghais with HyperTransport3 - it makes a much bigger difference there...</p>
<p><br></p>
<p><span class=rvts6>>> We've been using Dell SC1435's with Quad-Core AMD 2354 Opterons @</span></p>
<p><span class=rvts6>>> 2.2GHz. 16 Gig RAM.</span></p>
<p><br></p>
<p><span class=rvts7>MH> 2G/core seems to be fairly safe. although it's overkill for a lot of </span></p>
<p><span class=rvts7>MH> users, ram is also pretty cheap - 6x 4G dimms for dual-i7 is probably</span></p>
<p><span class=rvts7>MH> pretty sensible.</span></p>
<p><br></p>
<p>12 x 2 for E-Series Xeons or 6 x 4 for X-Series Xeons.... but that is another thing with Nehalem: you have to buy 50% more RAM (if you are just looking for 2GB/Core) to get good performance. Same is true for Istanbul... the metrics are changeing ;-)</p>
<p><br></p>
<p>Jan</p>
</body></html>