StorageConsistency

The instructions in this wiki page are based on the info found at: https://github.com/dmwm/DMWMMON/tree/master/SiteInfoProviders/DCache

To do the storage consistency check:
go to maite

rpm -ivh /root/Olivier/pnfs-dump-1.0.24-1.i386.rpm

then run the tool:

/opt/pnfs/tools/pnfsDump -o syncat /var/pnfsDump_T2_BE_IIHE_18_12_12 -s -k -c

Transfer this file to your laptop as we need to do some memory intensive operations on it.
First, we will transform the file so that it contains one line per file on /pnfs. The original contains only one line with the complete xml.

sed 's_</entry>_</entry>\n_g' < pnfsDump_T2_BE_IIHE_04_03_14 > onePerLine

The mail you received will contain a set of directories that need to be scanned. The last mail received said:

/store/mc
/store/data
/store/generator
/store/results
/store/hidata
/store/himc
/store/lumi
/store/relval

We will grep for these and put everything in a result file. The easiest way is to put all the patterns in a file named 'patterns' and issue:

grep -f patterns testFile > outFile

Lastly, we will convert the pfn's into lfn's by stripping the site specific part of the file's name.

sed s_"/root/fs/usr/cms/ph/sc4_"_ < outFile > result_IIHE_2014_03_19

Bzip this file, put it somewhere on afs and update the ticket to tell the people where it can be found.