[Beowulf] since we are talking about file systems ...

Joe Landman landman at scalableinformatics.com
Tue Jan 17 12:40:23 PST 2006

Methinks I lost lots of folks with my points ...

Major thesis is that on well designed hardware/software/filesystems, 
50000 files is not a problem for accesses (though from a management 
point of view it is a nightmare).  For poorly designed/implemented file 
systems it is a nightmare.

Way back when in the glory days of SGI, I seem to remember xfs being 
tested with millions of files per directory (though don't hold me to 
that old memory).  Call this hearsay at this moment.

A well designed and implemented file system shouldn't bog you down as 
you scale out in size, even if you shouldn't.  Its sort of like your 
car.  If you go beyond 70 MPH somewhere in the US that supports such 
speeds, your transmission shouldn't just drop out because you hit 71 MPH.

Graceful degradation is a good thing.


Joseph Landman, Ph.D
Founder and CEO
Scalable Informatics LLC,
email: landman at scalableinformatics.com
web  : http://www.scalableinformatics.com
phone: +1 734 786 8423
fax  : +1 734 786 8452
cell : +1 734 612 4615

More information about the Beowulf mailing list