OtherSoftware: Difference between revisions
No edit summary |
No edit summary |
||
Line 41: | Line 41: | ||
At this moment your environment has been changed to use all the versions in this specific software area. | At this moment your environment has been changed to use all the versions in this specific software area. | ||
=== Be careful when loading a different version of python === | |||
When the software reopistory you want to use contains a version of python that is higher than the one installed on the cluster, you might encounter a problem with the gfal libraries: | |||
<pre> | |||
'import site' failed; use -v for traceback | |||
Traceback (most recent call last): | |||
File "/usr/bin/gfal-mkdir", line 24, in <module> | |||
from gfal2_util.shell import Gfal2Shell | |||
ImportError: No module named gfal2_util.shell | |||
</pre> | |||
This happens because of a mismatch between the software used and the libraries installed. The easiest solution is to use python 3 and a specific version of the UI (user interface) software like in the following example: | |||
<pre> | |||
source /cvmfs/sft.cern.ch/lcg/views/setupViews.sh LCG_93python3 x86_64-slc6-gcc7-opt | |||
source /cvmfs/grid.cern.ch/emi3ui-latest/etc/profile.d/setup-ui-example.sh | |||
</pre> | |||
=== CMS specific area === | === CMS specific area === |
Revision as of 10:12, 26 November 2019
Software available from the T2 UI machines
The T2 has many more software than what is available directly from the M machines. All are provided by cern's centrally managed files system called cvmfs.
They are divided in a CMS specific area and a more general area aimed at high energy in general.
The CMS specific area comes with a home brew script that makes it easy for searching specific versions of the software you need. However, the set-up is a lot more complicated than the general purpose area. Therefore we recommend the general purpose area unless you do not find the specific version you need in it.
General purpose area
Instead of trying to explain in details how the /cvmfs sub-directories are organized, we will limit ourselves in this wiki to give some relevant links about the general purpose area:
Highlevel description of the software packages and how they are grouped in LCG Configurations
Website of the SFT group managing what's in /cvmfs/sft.cern.ch
Load a specific software repository
The software packages are grouped in LCG Configurations. In each of these configurations, you will normally find set of software versions that are compatible with each others. To get the list of LCG Configurations :
/cvmfs/sft.cern.ch/lcg/views/checkSetupViews.sh
Now, let's say you want to know more about the "LCG_93c" configuration :
/cvmfs/sft.cern.ch/lcg/views/checkSetupViews.sh LCG_93c Available <arch-os-compiler> for LCG_93c : x86_64-centos7-gcc62-opt x86_64-centos7-gcc7-dbg x86_64-slc6-gcc62-dbg x86_64-slc6-gcc62-opt x86_64-slc6-gcc7-dbg
If you are on an SL6 UI and we want gcc62, we have to issue the following command :
source /cvmfs/sft.cern.ch/lcg/views/setupViews.sh LCG_93c x86_64-slc6-gcc62-opt
Check the version of gcc :
$ gcc -v Using built-in specs. COLLECT_GCC=gcc COLLECT_LTO_WRAPPER=/cvmfs/sft.cern.ch/lcg/contrib/gcc/6.2.0native/x86_64-slc6/bin/../libexec/gcc/x86_64-pc-linux-gnu/6.2.0/lto-wrapper Target: x86_64-pc-linux-gnu Configured with: ../gcc-6.2.0/configure --prefix=/build/pmendez-sftnight/install-620local -with-system-zlib --disable-multilib --enable-languages=all Thread model: posix gcc version 6.2.0 (GCC)
At this moment your environment has been changed to use all the versions in this specific software area.
Be careful when loading a different version of python
When the software reopistory you want to use contains a version of python that is higher than the one installed on the cluster, you might encounter a problem with the gfal libraries:
'import site' failed; use -v for traceback Traceback (most recent call last): File "/usr/bin/gfal-mkdir", line 24, in <module> from gfal2_util.shell import Gfal2Shell ImportError: No module named gfal2_util.shell
This happens because of a mismatch between the software used and the libraries installed. The easiest solution is to use python 3 and a specific version of the UI (user interface) software like in the following example:
source /cvmfs/sft.cern.ch/lcg/views/setupViews.sh LCG_93python3 x86_64-slc6-gcc7-opt source /cvmfs/grid.cern.ch/emi3ui-latest/etc/profile.d/setup-ui-example.sh
CMS specific area
The T2 hosts many software that are packaged with specific versions of CMSSW but that can be used in a stand alone mode. A tool was designed to easily find what is available and which versions can be used.
To list all the available software:
/swmgrs/cmss/soft.pl --list
Most used software are specific version of gcc that are needed, or a root or geant4 version. To find all the available gcc versions:
/swmgrs/cmss/soft.pl --versions gcc
Now, to get a given version of gcc (4.6.2 in this example) :
/swmgrs/cmss/soft.pl --load gcc/4.6.2
This prints the full path of the init.sh that you have to source to get the desired version of gcc :
source /cvmfs/cms.cern.ch/slc6_amd64_gcc462/external/gcc/4.6.2/etc/profile.d/init.sh
Let's now check the version of gfortran :
gfortran --version GNU Fortran (GCC) 4.6.2