CRAB3testingwithWMAgent
Jump to navigation
Jump to search
CRAB3 testing with WMAgent
Bookmarks
- https://twiki.cern.ch/twiki/bin/viewauth/CMS/T1OperationsWithWMAgent
- https://twiki.cern.ch/twiki/bin/viewauth/CMS/WMAgentDeployment
- https://svnweb.cern.ch/trac/CMSDMWM/wiki/WMDeployment
Recipe for submitting jobs with CRAB3 client
- Login to lxplus, since the crabserver port is not open on the CERN firewall
ssh -X jmmaes@lxplus.cern.ch cd public/CRAB3client/CMSSW_4_1_5/src/ source /afs/cern.ch/cms/sw/cmsset_default.sh source /afs/cern.ch/cms/LCG/LCG-2/UI/cms_ui_env.sh cmsenv . /afs/cern.ch/user/g/grandi/public/CRAB3/client/CRABClient/crab.sh
- Snippet from Claudio's email
- start from a CMSSW project working with CRAB2 *at CERN* (the crabserver port on vocms104 is not open on the CERN firewall) - define the CRAB environment with: . /afs/cern.ch/user/g/grandi/public/CRAB3/client/CRABClient/crab.sh - create a crab configuration file named crabConfig.py using as example the one that you can find in /afs/cern.ch/user/g/grandi/public/CRAB3/client/tests/crabConfig.py. Change the parameters you need in order to run your workflow but do not change the crabserver URL: config.General.server_url = 'vocms104.cern.ch:8880' - submit the task with crab submit - monitor the task using the wmagent page: http://vocms104.cern.ch:8687/reqmgr/RequestOverview/ If you are outside CERN you need to create an ssh tunnel to access all the monitoring pages: ssh -L48687:vocms104.cern.ch:8687 -L49996:vocms104.cern.ch:9996 -L49997:vocms104.cern.ch:9997 lxplus.cern.ch and change the urls accordingly (or better: use something like FoxyProxy). - crab status -t <taskname> reports the status through the client
Installation of a CRAB3 client at the IIHE
- At CERN the version of voms is not compatible with our SE. - I'll try to install a client at the IIHE - Instructions are here https://twiki.cern.ch/twiki/bin/view/CMS/WMAgentRunAnalysis#How_to_deploy_the_Client - Recipe:
cd CRAB3Client/ cd /user/jmmaes/CMSSW_test/CMSSW_4_1_5/src cmsenv cd - wget https://twiki.cern.ch/twiki/pub/CMS/WMAgentRunAnalysis/LightDeployCrabClient.sh chmod u+x LightDeployCrabClient.sh ./LightDeployCrabClient.sh 3.0.4a 0.8.11a jmmaes
- REMARK: needed subversion ~1.6.x - Once the crab executable is available, set the crab software
export TopDir=/user/jmmaes/CRAB3Client/CRABClient . /user/jmmaes/CRAB3Client/CRABClient/crab.sh
Testing
cd /user/jmmaes/CMSSW_test/CMSSW_4_1_5/src cmsenv export TopDir=/user/jmmaes/CRAB3Client/CRABClient . /user/jmmaes/CRAB3Client/CRABClient/crab.sh
Current instructions to install a CRAB3 server
- Go to following page https://twiki.cern.ch/twiki/bin/viewauth/CMS/DFSIntegrationCRAB3ServerCurrentDetails303
Obsolete instructions
- Instructions with AGENT_VERSION="0.7.12" SERVER_VERSION="3.0.1a"
- Instructions with AGENT_VERSION="0.7.8a" SERVER_VERSION="3.0.1"
- Instructions with AGENT_VERSION="0.7.9a" SERVER_VERSION="3.0.0"