[Beowulf] (no subject)

Peter St. John peter.st.john at gmail.com
Fri Feb 16 13:22:59 PST 2007


Nathan,
You might experiment with the flags to cp; e.g. I might try
cp -i -v
The -i will prompt you when it wants to overwrite an existing file (maybe at
142MB in you are getting a permissions error) and -v is verbose (so maybe it
will stop failing silently).

You also might want to specify stderr at the command line; you may not be
seeing the window that the error messages are in, depending on how your
windows are set up. This happens in the NT environment all the time,
GUI errors go to a DOS prompt that blinks and vanishes :-)

I use UGU.com to find man pages for arbitrary flavors of unix.
Peter


On 2/16/07, Nathan Moore <ntmoore at gmail.com> wrote:
>
> Hello all,
>
> I have a small beowulf cluster of Scientific Linux 4.4 machines with
> common NIS logins and NFS shared home directories.  In the short
> term, I'd rather not buy a tape drive for backups.  Instead, I've got
> a jury-rigged backup scheme.  The node that serves the home
> directories via NFS runs a nightly tar job (through cron),
>
>        root at server> tar cf home_backup.tar ./home
>        root at server> mv home_backup.tar /data/backups/
>
> where /data/backups is a folder that's shared (via NFS) across the
> cluster.  The actual backup then occurs when the other machines in
> the cluster (via cron) copy home_backup.tar to a private (root-access-
> only) local directory.
>
>        root at client> cp /mnt/server-data/backups/home_backup.tar
> /private_data/
>
> where "/mnt/server-data/backups/" is where the server's "/data/
> backups/" is mounted, and where /private_data/ is a folder on
> client's local disk.
>
> Here's the problem I'm seeing with this scheme.  users on my cluster
> have quite a bit of stuff stored in their home directories, and
> home_backup.tar is large (~4GB).  When I try the cp command on
> client, only 142MB of the 4.2GB is copied over (this is repeatable -
> not a random error, and always about 142MB).  The cp command doesn't
> fail, rather, it quits quietly.  Why would only some of the file be
> copied over?  Is there a limit on the size of files which can be
> transferred via NFS?  There's certainly sufficient space on disk for
> the backups (both client's and server's disks are 300GB SATA drives,
> formatted to ext3)
>
> I'm using the standard NFS that's available in SL43, config is
> basically default.
> regards,
>
> Nathan Moore
>
>
> - - - - - - - - - - - - - - - - - - - - - - -
> Nathan Moore
> Physics, Pasteur 152
> Winona State University
> nmoore at winona.edu
> AIM:nmoorewsu
> - - - - - - - - - - - - - - - - - - - - - - -
>
>
> _______________________________________________
> Beowulf mailing list, Beowulf at beowulf.org
> To change your subscription (digest mode or unsubscribe) visit
> http://www.beowulf.org/mailman/listinfo/beowulf
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://www.scyld.com/pipermail/beowulf/attachments/20070216/c4bf178c/attachment.html


More information about the Beowulf mailing list