[Beowulf] posting bonnie++ stats from our cluster: any comments about my I/O performance stats?

[Rahul Nabar]

On Thu, Sep 24, 2009 at 9:06 PM, Joe Landman
<landman at scalableinformatics.com> wrote:
> I've found fio (http://freshmeat.net/projects/fio/) to be an excellent
> testing tool for disk systems.  To use it, compile it (requires libaio), and
> then run it as
>
>        fio input.fio
>
> For a nice simple IOP test, try this:
>
> [random]
> rw=randread
> size=4g
> directory=/data
> iodepth=32
> blocksize=8k
> numjobs=16
> nrfiles=1
> group_reporting
> ioengine=sync
> loops=1
>
>
> We use this to model bonnie++ and other types of workloads.  It provides a
> great deal of useful information.


Thanks for this "fio" lead Joe. The test seems to run great. I tried
this exact same input suite from one of my NFS clients. Detailed
results below but I think it reports a IOPS of around 600 (if I read
it correctly!) Not bad huh? This is  a 5 disk RAID5. 10k RPM 300 GB
SAS drives.

I'm about to kill the test prematurely , though, since it seems to
indicate that it wants to run for 6 more hours! :) I hope this still
gave me a good benchmark, though, since I have already run it for
about 20 minutes.

One mysterios aspect: Is it really showing a 4.6 Gbits/sec throughput.
That'd be way too high, I'd have thought! I'm going to do another
similar run from the NFS server to isolate out the effect of the disk
versus network. I'll post those soon in case it interests any other
users.

####################################################################
random: (g=0): rw=randread, bs=8K-8K/8K-8K, ioengine=sync, iodepth=32
...
random: (g=0): rw=randread, bs=8K-8K/8K-8K, ioengine=sync, iodepth=32
Starting 16 processes
random: Laying out IO file(s) (1 file(s) / 4096MiB)
random: Laying out IO file(s) (1 file(s) / 4096MiB)
random: Laying out IO file(s) (1 file(s) / 4096MiB)
random: Laying out IO file(s) (1 file(s) / 4096MiB)
random: Laying out IO file(s) (1 file(s) / 4096MiB)
random: Laying out IO file(s) (1 file(s) / 4096MiB)
random: Laying out IO file(s) (1 file(s) / 4096MiB)
random: Laying out IO file(s) (1 file(s) / 4096MiB)
random: Laying out IO file(s) (1 file(s) / 4096MiB)
random: Laying out IO file(s) (1 file(s) / 4096MiB)
random: Laying out IO file(s) (1 file(s) / 4096MiB)
random: Laying out IO file(s) (1 file(s) / 4096MiB)
random: Laying out IO file(s) (1 file(s) / 4096MiB)
random: Laying out IO file(s) (1 file(s) / 4096MiB)
random: Laying out IO file(s) (1 file(s) / 4096MiB)
random: Laying out IO file(s) (1 file(s) / 4096MiB)
Jobs: 16 (f=16): [rrrrrrrrrrrrrrrr] [1.4% done] [4,647K/0K /s] [567/0
iops] [eta 06h:23m:08s]
###########################################################################

-- 
Rahul