[Beowulf] GPFS question

[Jörg Saßmannshausen]

Hi Lance,

thanks for the feedback. I guess it also depends how much meta-data you have 
and whether or not you have zillions of small or larger files. 
At least I got an idea how long it might take.

All the best

Jörg

Am Dienstag, 30. April 2019, 07:59:06 BST schrieb Lance Wilson:
> Hi Jörg,
> Our 1Pb array took up to 3 days when we did this. It might be faster for
> you but it took a very long time with little to no indication of how long
> it would take. Just a word of caution though, we didn’t do an offline scan
> once too long and that scan took much longer than previously. Good luck!
> 
> Lance
> 
> On Tue, 30 Apr 2019 at 7:34 am, Jörg Saßmannshausen <
> 
> sassy-work at sassy.formativ.net> wrote:
> > Dear all,
> > 
> > just a quick question regarding GPFS:
> > we are running a 9 PB GPFS storage space at work of which around 6 -7 PB
> > are
> > used. It is a single file system but with different file-sets installed on
> > it.
> > During our routine checks we found that:
> > $ mmhealth node show -n all
> > reports this problem:
> > 
> > fserrinvalid(FOO)
> > 
> > (where FOO is being the file system).
> > 
> > Our vendor suggested to do an online check:
> > 
> > $ mmfsck FOO -o -y
> > 
> > which is still running.
> > Today the vendor suggested to take the GPFS file system offline and run
> > the above
> > command without the -o option, which would lead to an outage.
> > 
> > So my simply question is: has anybody ever done that on such a large file
> > set
> > and how long roughly would that take? Every time I am asking this question
> > I
> > get told: a long time!
> > Our vendor told us we could use for example
> > --threads 128
> > as oppose to the normally used 16 threads, so I am aware my mileage will
> > vary
> > here a bit, but I would just like a guestimate of the time.
> > 
> > Many thanks for your help here!
> > 
> > All the best from London
> > 
> > Jörg
> > 
> > _______________________________________________
> > Beowulf mailing list, Beowulf at beowulf.org sponsored by Penguin Computing
> > To change your subscription (digest mode or unsubscribe) visit
> > https://beowulf.org/cgi-bin/mailman/listinfo/beowulf