[Beowulf] Large backups

Orion Poplawski orion at cora.nwra.com
Fri Apr 10 15:25:12 PDT 2009

Joshua Baker-LePain wrote:
> I currently backup a bit more than 16TB to an LTO3 library and don't 
> find it that painful.  I use AMANDA and break the data down into 
> bite-size chunks.  AMANDA handles spreading these chunks out over the 
> whole backup cycle, so that each night's backup is about the same size 
> (and so takes about the same amount of time).  Each "chunk" gets a full 
> dump once per cycle and incrementals in between.  Yes, there is some 
> bookkeeping to be done when the "chunks" change drastically in size.  
> But it really does mostly run itself.  A full restore would indeed take 
> some time, but this is academia.  We have time.

Amanda is great at handling this.  I backup to disk though rather than 
tape.  A daily set goes to volumes on another (non-raid) disk server.  A 
weekly set goes to a removable disk that goes off-site.

Orion Poplawski
Technical Manager                     303-415-9701 x222
NWRA/CoRA Division                    FAX: 303-415-9702
3380 Mitchell Lane                  orion at cora.nwra.com
Boulder, CO 80301              http://www.cora.nwra.com

More information about the Beowulf mailing list