Backup: Difference between revisions

From T2B Wiki
Jump to navigation Jump to search
m (Created page with " === Backup === The information below is outdated: you cannot access the backups anymore. Send a mail to grid_admin AT listserv.vub.ac.be with the path of the files you wan...")
 
Line 1: Line 1:


=== Backup ===
=== Backup of /user & /localgrid ===


The information below is outdated: you cannot access the backups anymore. Send a mail to grid_admin AT listserv.vub.ac.be with the path of the files you want and the date.
We are thinking of changes to this backup access, and will update the twiki accordingly (06 June 2015).


==== User accessible backups ==== ==> NOT UP-TO-DATE
There is no way for users to access the backups. Just send a mail to '''grid_admin@listserv.vub.iihe.ac.be''' specifying the file(s)/folder(s) you want, and the date you want it from.


The new file server allows us to make snapshots that are accessible for all the users to read. They are located at:
Our zfs server allows us to do regular snapshots:
* There is one done everyday at midnight, we keep the last seven of those (so a complete week).
* We also have one snapshot per week, and keep the last 4 of them (so a month).


<pre>
Additionnaly, the /user is backed up every day to a secondary machine, in case our main fileserver goes down.
/user/.zfs/snapshot/
</pre>
These snapshots contain all your files that have been modified or deleted since the day the snapshot was taken. <br>
 
Under this directory you will find a number of sub-directories, ending in @weekly.<nr> and @daily.<nr>. Daily snapshots are taken on all days except Sunday. 0 is the latest one (the previous day). Weekly backups are taken on Sunday and the numbering convention is the same as for the daily ones.<br>
All these directories are directly browsable and you can copy you old files back to you home directory. Remark that the snapshots are read only, so you should not attempt to modify anything in it.<br>
<br>
In addition, the localgrid area also has a daily snapshot. No weekly snapshots are provided here, only 7 daily snapshots as this is only meant to run on the cluster. The snapshots are to be found at:
 
<pre>
/localgrid/.zfs/snapshot/
</pre>
 
 
<br>
<br>
We however encourage you to commit your code to the CERN cvs every night, to minimize the possible losses.
==== Non accessible backups ====
 
Additionally to this, weekly on Tuesday, a full backup to a different machine is taken in case a serious hardware problem would occur on our system. This backup is made every Tuesday.
 
==== IMPORTANT: /localgrid ====
 
For people relying heavily on their work on /localgrid (for local submission), it is important to notice that the files under /localgrid are not backed up at all.<br>
Therefore, we encourage you to take the necessary steps if you need so. The best thing is to back everything up on the /user disk. What follows set this up in an automated fashion so that backup is done automatically.<br>
Make a directory that will hold the backup on /user and make the initial backup:
<pre>
mkdir /user/odevroed/LocalgridBackup
rsync -a /localgrid/Odevroed /user/odevroed/LocalgridBackup
</pre>
 
Next, set up a cron job that will do this automatically every day:
 
<pre>
crontab -e
</pre>
This opens a vi editor. Type i to insert text and insert:
 
<pre>
00 00 * * * rsync -a --delete /localgrid/odevroed /user/odevroed/LocalgridBackup
</pre>
 
The --delete is necessary, as files you deleted on /localgrid need to be deleted in the backup too. If you do not do this, the backup will continue to grow and you will reach the limit of your quota.<br>
The crontab can only be done on M3. In this way, we can make a backup of the necessary files that cron uses.
 
 
 
 
 
 
{{TracNotice|{{PAGENAME}}}}

Revision as of 10:23, 4 November 2015

Backup of /user & /localgrid

There is no way for users to access the backups. Just send a mail to grid_admin@listserv.vub.iihe.ac.be specifying the file(s)/folder(s) you want, and the date you want it from.

Our zfs server allows us to do regular snapshots:

  • There is one done everyday at midnight, we keep the last seven of those (so a complete week).
  • We also have one snapshot per week, and keep the last 4 of them (so a month).

Additionnaly, the /user is backed up every day to a secondary machine, in case our main fileserver goes down.