ObsoleteInstructions2

From T2B Wiki
Revision as of 12:28, 26 August 2015 by Maintenance script (talk | contribs) (Created page with " <pre> AGENT_VERSION="0.7.8a" SERVER_VERSION="3.0.1" </pre> *login to vocms104 and go to the working directory <pre> ssh -X jmmaes@lxplus.cern.ch ssh crab@vocms104 ...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search 


AGENT_VERSION="0.7.8a"
SERVER_VERSION="3.0.1"
  • login to vocms104 and go to the working directory
ssh -X jmmaes@lxplus.cern.ch
ssh crab@vocms104
cd /data/wmagent/CRAB3_server

svn co svn+ssh://jmmaes@svn.cern.ch/reps/CMSDMWM/Infrastructure/trunk/Deployment
  • Follow instructions under section CRABServer specifications here
vi Deployment/wmagent/deploy # set AGENT_VERSION="0.7.8a"
vi Deployment/crabserver/deploy # set SERVER_VERSION="3.0.1"

cd Deployment/
./Deploy  -s prep -t v300 $PWD/.. crabserver
./Deploy  -s sw -t v300 $PWD/.. crabserver
./Deploy  -s post -t v300 $PWD/.. crabserver

cd ..
./setenv.sh
  • Temporary fix: in "config/crabserver/manage" file switch this line :cp $ROOT_DIR/apps/crab-server3/configuration/Example.py $CONFIG_CS/config-template.py with the following one: cp $ROOT_DIR/apps/wmcore/etc/CrabServerConfig.py $CONFIG_CS/config-template.py
  • Temporary fix in this file: sw/slc5_amd64_gcc434/cms/wmcore/0.7.8a/lib/python2.6/site-packages/WMCore/BossAir/Plugins/gLitePlugin.py
1333c1333
<             return getProxy(userdn)
---
>             return self.getProxy(userdn)
  • Fire up the server
cd current
./config/crabserver/manage activate-crabserver
./config/crabserver/manage start-services # check if file is there ls /data/wmagent/CRAB3_server/v300/install/mysql/logs/mysql.sock
./config/crabserver/manage init-crabserver
  • According tot the trac twiki about crabservermanagement some configuration settings need to be adapted:
in config/crabserver/config.py 
- config.CRABInterface.configCacheCouchURL = 'http://joriswmagent:****@vocms104.cern.ch:5984' ##according to gwave
- config.CRABInterface.views.active.crab.model.couchUrl = 'http://joriswmagent:****@vocms104.cern.ch:5984'
- config.reqmgr.views.active.create.requestor = 'Analysis'
- config.CRABInterface.admin = 'Joris.Maes@cern.ch'
- config.CRABInterface.views.active.crab.jsmCacheCouchURL = 'http://joriswmagent:****@vocms104.cern.ch:5984'
- config.CRABInterface.views.active.crab.model.workloadCouchDB = 'reqmgrdb'
- config.CRABInterface.views.active.crab.jsmCacheCouchDB = 'wmagent_jobdump'
- config.CRABInterface.agentDN = '/DC=ch/DC=cern/OU=computers/CN=vocms104.cern.ch'

in config/workqueue/config.py
- config.Agent.teamName = 'Analysis'
- config.Agent.contact = 'joris.maes@cern.ch'
- config.WorkQueueManager.reqMgrConfig = {'endpoint': 'http://vocms104.cern.ch:8687/reqmgr/reqMgr/', 'teamName': 'Analysis'}
- config.WorkQueueService.admin = 'Joris.Maes@cern.ch'

in config/reqmgr/config.py
- config.Agent.teamName = 'Analysis'

in config/wmagent/config.py
- config.Agent.teamName = 'team1,team2,cmsdataops,Analysis'
- config.WorkQueueManager.queueParams = {'QueueURL': 'http://vocms104.cern.ch:9997/workqueueservice/workqueue', 'FullReportInterval': 300, 'Teams': 'team1,team2,cmsdataops,Analysis', 'CacheDir': '/data/wmagent/CRAB3_server/v300/install/wmagent/WorkQueueManager/wf', 'PopulateFilesets': True, 'ParentQueue': 'http://vocm104.cern.ch:9996/workqueueservice/workqueue'}
- config.WorkQueueService.views.active.workqueue.queueParams = {'QueueURL': 'http://vocms104.cern.ch:9997/workqueueservice/workqueue', 'FullReportInterval': 300, 'Teams': 'team1,team2,cmsdataops,Analysis', 'CacheDir': '/data/wmagent/CRAB3_server/v300/install/wmagent/WorkQueueManager/wf', 'PopulateFilesets': True, 'ParentQueue': 'http://vocm104.cern.ch:9996/workqueueservice/workqueue'}
- config.Agent.agentName = 'integration'
- config.BossAir.gLitePrefixEnv = "/lib64/"
  • Make the changes for the BossAir plugin explained here here.
vi config/wmagent/config.py
config.BossAir.pluginNames = ['gLitePlugin']
config.BossAir.gLiteProcesses = 4
config.BossAir.gliteConf   = '/data/wmagent/CRAB3_server/control/glite_wms_CERN.conf'
config.BossAir.UISetupScript = '/afs/cern.ch/cms/LCG/LCG-2/UI/cms_ui_env.sh'
config.BossAir.credentialDir  = '/data/wmagent/CRAB3_server/credentials/'
config.Agent.serverDN = '/DC=ch/DC=cern/OU=computers/CN=vocms104.cern.ch'
  • Fix a bug in the glite plugin
/data/wmagent/CRAB3_server/v300/sw/slc5_amd64_gcc434/cms/wmcore/0.7.8a/lib/python2.6/site-packages/WMCore/BossAir/Plugins/gLitePlugin.py
replace all:
except multiprocessing.Queue.Empty
with:
except Queue.Empty
And add queue to the imported package also Queue, changing:
import multiprocessing
with:
import multiprocessing, Queue
  • Start services
./config/crabserver/manage start-services
./config/crabserver/manage start-crabserver
  • Add resources
./config/crabserver/manage execute-agent wmagent-resource-control --plugin=gLitePlugin --site-name=T2_IT_Legnaro --site-slots=20 --se-name=t2-srm-02.lnl.infn.it --ce-name=t2-ce-02.lnl.infn.it
./config/crabserver/manage execute-agent wmagent-resource-control --site-name=T2_IT_Legnaro --task-type=Analysis --task-slots=20
./config/crabserver/manage execute-agent wmagent-resource-control --plugin=gLitePlugin --site-name=T2_IT_Legnaro --site-slots=20 --se-name=t2-srm-02.lnl.infn.it --ce-name=t2-ce-06.lnl.infn.it
./config/crabserver/manage execute-agent wmagent-resource-control --site-name=T2_IT_Legnaro --task-type=Analysis --task-slots=20
./config/crabserver/manage execute-agent wmagent-resource-control --plugin=gLitePlugin --site-name=T2_IT_Legnaro --site-slots=20 --se-name=t2-srm-02.lnl.infn.it --ce-name=t2-ce-03.lnl.infn.it
./config/crabserver/manage execute-agent wmagent-resource-control --site-name=T2_IT_Legnaro --task-type=Analysis --task-slots=20
./config/crabserver/manage execute-agent wmagent-resource-control --plugin=gLitePlugin --site-name=T2_IT_Legnaro --site-slots=20 --se-name=t2-srm-02.lnl.infn.it --ce-name=t2-ce-04.lnl.infn.it
./config/crabserver/manage execute-agent wmagent-resource-control --site-name=T2_IT_Legnaro --task-type=Analysis --task-slots=20
./config/crabserver/manage execute-agent wmagent-resource-control --plugin=gLitePlugin --site-name=T2_IT_Legnaro --site-slots=20 --se-name=t2-srm-02.lnl.infn.it --ce-name=t2-ce-01.lnl.infn.it
./config/crabserver/manage execute-agent wmagent-resource-control --site-name=T2_IT_Legnaro --task-type=Analysis --task-slots=20

./config/crabserver/manage execute-agent wmagent-resource-control --plugin=gLitePlugin --site-name=T2_BE_IIHE --site-slots=20 --se-name=maite.iihe.ac.be --ce-name=cream01.iihe.ac.be
./config/crabserver/manage execute-agent wmagent-resource-control --site-name=T2_BE_IIHE  --task-type=Analysis --task-slots=20
  • Added CMSSW releases
./config/crabserver/manage execute-reqmgr requestDbAdmin add -v all
  • Check the status of the server
couch admin url: http://vocms104.cern.ch:5984/_utils/
wmagent url: http://vocms104.cern.ch:8687/reqmgr/
check resources: ./config/crabserver/manage execute-agent wmagent-resource-control -p
  • Stop a current server completely
./config/crabserver/manage stop-crabserver
./config/crabserver/manage stop-services
ps aux | grep -i mysql
ps aux | grep -i beam
ps aux | grep -i wmagent #for i in $(ps aux | grep -i wmagent | awk '{print $2}'); do echo "kill -9 $i"; kill -9 $i; done


Template:TracNotice

Retrieved from ‘https://t2bwiki.iihe.ac.be/index.php?title=ObsoleteInstructions2&oldid=197’