[Beowulf] What is rdma, ofed, verbs, psm etc?

[Alex Chekholko]

I don't know about RoCE but here is plain 10G ICMP ECHO round trip:

# ping n0030
PING n0030.localdomain (192.168.0.204) 56(84) bytes of data.
64 bytes from n0030.localdomain (192.168.0.204): icmp_seq=1 ttl=64
time=0.141 ms
64 bytes from n0030.localdomain (192.168.0.204): icmp_seq=2 ttl=64
time=0.139 ms
64 bytes from n0030.localdomain (192.168.0.204): icmp_seq=3 ttl=64
time=0.117 ms
64 bytes from n0030.localdomain (192.168.0.204): icmp_seq=4 ttl=64
time=0.115 ms
64 bytes from n0030.localdomain (192.168.0.204): icmp_seq=5 ttl=64
time=0.115 ms
64 bytes from n0030.localdomain (192.168.0.204): icmp_seq=6 ttl=64
time=0.107 ms
64 bytes from n0030.localdomain (192.168.0.204): icmp_seq=7 ttl=64
time=0.142 ms
^C
--- n0030.localdomain ping statistics ---
7 packets transmitted, 7 received, 0% packet loss, time 6000ms
rtt min/avg/max/mdev = 0.107/0.125/0.142/0.015 ms

YMMV

On Thu, Sep 21, 2017 at 9:10 AM Jon Tegner <tegner at renget.se> wrote:

> What kind of latency can one expect using RoCE/10G?
>
> On 09/21/2017 05:28 PM, Douglas Eadline wrote:
> > I think the main reason it stopped was that IB is the
> > choice of most clusters and most 10G nics provide
> > low latency with default tcp/ip (less than 10us in most cases).
>
> _______________________________________________
> Beowulf mailing list, Beowulf at beowulf.org sponsored by Penguin Computing
> To change your subscription (digest mode or unsubscribe) visit
> http://www.beowulf.org/mailman/listinfo/beowulf
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.beowulf.org/pipermail/beowulf/attachments/20170921/570dc56a/attachment.html>