FTS

Howto

• Setup the environment

  export LCG_GFAL_INFOSYS=bdii.iihe.ac.be:2170
  export GLITE_SD_PLUGIN=bdii
  # lyon
  export GLITE_SD_SITE=IN2P3-CC
  export GLITE_SD_VO=cms

• get one of the admins in as channel manager to setup and control the channel
• try the user side glite-transfer- commands

Submit Transfers from a UI

Transfers are submitted from a UI (LCG 2_7_0) .

• Before any transfer, one needs a valid proxy stored by a MyProxy server to allow the FTS server to renew proxy when expiring during transfer. We can use myproxy-fts.cern.ch as the default for FTS.

 To store a proxy on a MyProxy server:

grid-proxy-init
myproxy-init -s myproxy-fts.cern.ch -d 

Transfers submitted by a DN are not accessible from another DN.

Checking FTS channels

 /opt/glite/bin/glite-transfer-channel-list -s https://cclcgftsli01.in2p3.fr:8443/glite-data-transfer-fts/services/ChannelManagement

Submission

 glite-transfer-submit -s https://cclcgftsli01.in2p3.fr:8443/glite-data-transfer-fts/services/FileTransfer     <SOURCE-SURL> <DEST-SURL>

• • (sample of SURL : srm://ccsrm.in2p3.fr:8443/srm/managerv1?SFN=/pnfs/in2p3.fr/data/dteam/hpss/test/test_fts_bnl2lyon_jul14.1)

This command returns a UID (ex.: 604c290c-04fa-11da-816d-adeeeb012d0c) which is used to track the transfer status.

Transfer status

 glite-transfer-status -s https://cclcgftsli01.in2p3.fr:8443/glite-data-transfer-fts/services/FileTransfer -l 604c290c-04fa-11da-816d-adeeeb012d0c 

Here is the possible ouput of this command :

 Done
 Source: srm://ccsrm.in2p3.fr:8443/srm/managerv1?SFN=/pnfs/in2p3.fr/data/atlas/test/test_fts_bnl2lyon_jul14.1
 Destination: srm://ccsrm.in2p3.fr:8443/srm/managerv1?SFN=/pnfs/in2p3.fr/data/atlas/test/2005-08-04.1654
 State:       Done
 Retries:     0
 Reason:      (null)
 Duration:    25 

Destroying a transfer

 glite-transfer-cancel -s https://cclcgftsli01.in2p3.fr:8443/glite-data-transfer-fts/services/FileTransfer 604c290c-04fa-11da-816d-adeeeb012d0c

• Listing ongoing transfers :

 glite-transfer-list -s https://cclcgftsli01.in2p3.fr:8443/glite-data-transfer-fts/services/FileTransfer -c <NOM-du-CANAL>

More options with this command available with argument -help.

Deleting files in SRM

You can not delete a file on SRM using FTS. It handles only transfers. So once test transfers are done please delete test files with:

 srm-advisory-delete <SRM path>

Modification of channel parameters

To be able to change the channel parameters, you need to be a channle manager.

 glite-transfer-channel-set -s https://cclcgftsli01.in2p3.fr:8443/glite-data-transfer-fts/services/ChannelManagement  -f <number-of-files> -T <number-fo-streams> <CHANNEL_NAME>

To get a list of all channels:

 glite-transfer-channel-list -s https://cclcgftsli01.in2p3.fr:8443/glite-data-transfer-fts/services/ChannelManagement

To get detailed inof on a channel:

 glite-transfer-channel-list -s https://cclcgftsli01.in2p3.fr:8443/glite-data-transfer-fts/services/ChannelManagement <CHANNEL_NAME>

Test scripts

• Python script from Sabine Elles to run transfer commands (globus-url-copy, srmcp, lcg_cp, ...) as threads : http://lappweb.in2p3.fr/informatique/GRID/transfert_concurrent.tar.gz
• FTS transfer test script from GridPP available here : http://www.gridpp.ac.uk/wiki/Transfer_Test_Python_Script_HOWTO
  

Links

• Documentation http://grid-deployment.web.cern.ch/grid-deployment/documentation/DataManagement/R3.0/
• Tutorial from Tier2 Workshop http://indico.cern.ch/getFile.py/access?contribId=1&sessionId=s0&resId=1&materialId=slides&confId=a058483