[Beowulf] NFS over RDMA performance confusion
diep at xs4all.nl
Thu Sep 13 05:17:28 PDT 2012
I'm not a database expert,
but are you sure you are using RDMA?
AFAIK mysql just uses TCP/IP which is a lot slower.
On Sep 13, 2012, at 1:52 PM, holway at th.physik.uni-frankfurt.de wrote:
> I am a bit confused.
> I have 4 top notch dual socket machines with 128GB ram each. I also
> have a
> Nexenta box which is my NFS / ZFS server. Everything is connected
> with QDR infiniband.
> I want to use this for setup for mysql databases so I am testing
> for 16K
> random and stride performance.
> If I set up a single machine to hammer the fileserver with IOzone I
> something like 50,000 IOPS but if all four machines are hammering the
> filesystem concurrently we got it up to 180,000 IOPS.
> Can anyone tell me what might be the bottleneck on the single
> Why can I not get 180,000 IOPS when running on a single machine.
> If I test using IPoIB in connected mode I see this: http://
> Some kind of buffer problem?
> Beowulf mailing list, Beowulf at beowulf.org sponsored by Penguin
> To change your subscription (digest mode or unsubscribe) visit
More information about the Beowulf