CRAB3testingwithWMAgent

From T2B Wiki
Jump to navigation Jump to search

CRAB3 testing with WMAgent

Bookmarks

Recipe for submitting jobs with CRAB3 client

  • Login to lxplus, since the crabserver port is not open on the CERN firewall
ssh -X jmmaes@lxplus.cern.ch

cd public/CRAB3client/CMSSW_4_1_5/src/
source /afs/cern.ch/cms/sw/cmsset_default.sh
source /afs/cern.ch/cms/LCG/LCG-2/UI/cms_ui_env.sh
cmsenv 
. /afs/cern.ch/user/g/grandi/public/CRAB3/client/CRABClient/crab.sh


  • Snippet from Claudio's email
- start from a CMSSW project working with CRAB2 *at CERN* (the crabserver port on vocms104 is not open on the CERN firewall)
- define the CRAB environment with:
  . /afs/cern.ch/user/g/grandi/public/CRAB3/client/CRABClient/crab.sh
- create a crab configuration file named crabConfig.py using as example the one that you can find in /afs/cern.ch/user/g/grandi/public/CRAB3/client/tests/crabConfig.py. Change the parameters you need in order to run your workflow but do not change the crabserver URL: 
  config.General.server_url    = 'vocms104.cern.ch:8880'
- submit the task with 
  crab submit
- monitor the task using the wmagent page:
  http://vocms104.cern.ch:8687/reqmgr/RequestOverview/
  If you are outside CERN you need to create an ssh tunnel to access all the monitoring pages:
  ssh -L48687:vocms104.cern.ch:8687 -L49996:vocms104.cern.ch:9996 -L49997:vocms104.cern.ch:9997 lxplus.cern.ch
  and change the urls accordingly (or better: use something like FoxyProxy).
- crab status -t <taskname> reports the status through the client

Installation of a CRAB3 client at the IIHE

- At CERN the version of voms is not compatible with our SE.
- I'll try to install a client at the IIHE
- Instructions are here https://twiki.cern.ch/twiki/bin/view/CMS/WMAgentRunAnalysis#How_to_deploy_the_Client
- Recipe:
cd CRAB3Client/
cd /user/jmmaes/CMSSW_test/CMSSW_4_1_5/src
cmsenv
cd -
wget https://twiki.cern.ch/twiki/pub/CMS/WMAgentRunAnalysis/LightDeployCrabClient.sh
chmod u+x LightDeployCrabClient.sh
./LightDeployCrabClient.sh 3.0.4a 0.8.11a jmmaes
- REMARK: needed subversion ~1.6.x
- Once the crab executable is available, set the crab software
export TopDir=/user/jmmaes/CRAB3Client/CRABClient
. /user/jmmaes/CRAB3Client/CRABClient/crab.sh

Testing

cd /user/jmmaes/CMSSW_test/CMSSW_4_1_5/src
cmsenv
export TopDir=/user/jmmaes/CRAB3Client/CRABClient
. /user/jmmaes/CRAB3Client/CRABClient/crab.sh

Current instructions to install a CRAB3 server

Obsolete instructions






Template:TracNotice