<html xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Aptos;
panose-1:2 11 0 4 2 2 2 2 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:12.0pt;
font-family:"Aptos",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
p.m1520445824058576200msolistparagraph, li.m1520445824058576200msolistparagraph, div.m1520445824058576200msolistparagraph
{mso-style-name:m_1520445824058576200msolistparagraph;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Aptos",sans-serif;}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:"Aptos",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;
mso-ligatures:none;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:355426233;
mso-list-template-ids:460247848;}
@list l0:level1
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:.5in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level2
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:1.0in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level3
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:1.5in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level4
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:2.0in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level5
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:2.5in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level6
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:3.0in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level7
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:3.5in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level8
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:4.0in;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level9
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:4.5in;
mso-level-number-position:left;
text-indent:-.25in;}
ol
{margin-bottom:0in;}
ul
{margin-bottom:0in;}
--></style>
</head>
<body lang="EN-US" link="blue" vlink="purple" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt">No big dollar demand, I suspect. Existing off the shelf optical stuff at 10G satisfies most needs. And practically speaking, for cluster interconnects (relevant to here) – you also want low latency, good
bisection bandwidth, and a bunch of other stuff. I can see a “city to city” optical link wanting 100G or more (although the actual fiber is awfully cheap, why not just run N slower fibers).<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-family:"Calibri",sans-serif;color:black">From:
</span></b><span style="font-family:"Calibri",sans-serif;color:black">Scott Atchley <e.scott.atchley@gmail.com><br>
<b>Date: </b>Thursday, January 18, 2024 at 12:01 PM<br>
<b>To: </b>Jim Lux <james.p.lux@jpl.nasa.gov><br>
<b>Cc: </b>"beowulf@beowulf.org" <beowulf@beowulf.org><br>
<b>Subject: </b>Re: [Beowulf] [EXTERNAL] Re: anyone have modern interconnect metrics?<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">There is a lot of interest in lower-cost optics, but manufacturing costs for the alternatives to today's active optical cables have not provided the promised cost savings. Silicon photonics seems to be just a few years away just as fusion
is just a decade away.<o:p></o:p></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal">On Wed, Jan 17, 2024 at 6:16<span style="font-family:"Arial",sans-serif"> </span>PM Lux, Jim (US 3370) via Beowulf <<a href="mailto:beowulf@beowulf.org">beowulf@beowulf.org</a>> wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">To a certain extent, faster Ethernet is more likely to be a commodity – and at rates above 1 Gbps, there’s substantial “art” in making a PHY that works reliably. At the 10G speed,
there’s things like RapidIO and SRIO, but they <o:p></o:p></p>
<ol start="1" type="a">
<li class="m1520445824058576200msolistparagraph" style="mso-list:l0 level1 lfo1">
Only work for short distances (<<1 meter)<o:p></o:p></li><li class="m1520445824058576200msolistparagraph" style="mso-list:l0 level1 lfo1">
Are *<b>very</b>* board layout and other implementation sensitive. Fine for getting in and out of a package, but not great for running any distance.<o:p></o:p></li></ol>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Then there’s XAUI (pronounced Zowie!) which is a multiwire wire interface between logic and 10G (or whatever) PHY. But it’s got the same problems as SRIO/RapidIO (or for that
matter, the venerable (now) TLK2711 SERDES). <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">10G and 40G Ethernet do actually work over distances of meters, and over some moderate range of temperatures, and are likely to meet EMI/EMC requirements.
<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">It is interesting that there doesn’t seem to be the same commercial pressure for optical versions. They all exist, but typically as modules you’d slide into your switch, not components
you’d solder to a board. And there are plenty of XAUI->optical kinds of interfaces. And optical cables are cheap and relatively rugged.
<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b>From:</b> Beowulf <<a href="mailto:beowulf-bounces@beowulf.org" target="_blank">beowulf-bounces@beowulf.org</a>>
<b>On Behalf Of </b>Scott Atchley<br>
<b>Sent:</b> Wednesday, January 17, 2024 7:18 AM<br>
<b>To:</b> Larry Stewart <<a href="mailto:stewart@serissa.com" target="_blank">stewart@serissa.com</a>><br>
<b>Cc:</b> Mark Hahn <<a href="mailto:hahn@mcmaster.ca" target="_blank">hahn@mcmaster.ca</a>>;
<a href="mailto:beowulf@beowulf.org" target="_blank">beowulf@beowulf.org</a><br>
<b>Subject:</b> [EXTERNAL] Re: [Beowulf] anyone have modern interconnect metrics?<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">While I was at Myricom, the founder, Chuck Seitz, used to say that there was Ethernet and Ethernot. He tied Myricom's fate to Ethernet's 10G PHYs.<o:p></o:p></p>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">On Wed, Jan 17, 2024 at 9:08<span style="font-family:"Arial",sans-serif"> </span>AM Larry Stewart <<a href="mailto:stewart@serissa.com" target="_blank">stewart@serissa.com</a>>
wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid windowtext 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt;border-color:currentcolor currentcolor currentcolor rgb(204,204,204)">
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt">I don't know what the networking technology of the future will be like, but it will be called Ethernet.<br>
- unknown (to me)<o:p></o:p></p>
</blockquote>
</div>
</div>
</div>
<p class="MsoNormal">_______________________________________________<br>
Beowulf mailing list, <a href="mailto:Beowulf@beowulf.org" target="_blank">Beowulf@beowulf.org</a> sponsored by Penguin Computing<br>
To change your subscription (digest mode or unsubscribe) visit <a href="https://urldefense.us/v3/__https:/beowulf.org/cgi-bin/mailman/listinfo/beowulf__;!!PvBDto6Hs4WbVuu7!Ixq5D_bsl4Xvg1t1VWaYCWDx6D996js8p3ZYzDukhOAjJ13TNcEsw9PTrxQIVTKHI5LTjDrXMd4eCrVz-w_P3G62jVN8nSYT8Q$" target="_blank">
https://beowulf.org/cgi-bin/mailman/listinfo/beowulf</a><o:p></o:p></p>
</div>
</blockquote>
</div>
</div>
</body>
</html>