Maintenance script: Created page with " === SL4 x86_64 on WNs === ==== Setup ==== Setup a sufficient compatible environment for the nodes. Using the packages from GRIF is ok. ==== CMS soft ==== ==== XCMSI ====..."

2015-08-26T12:29:03Z

Created page with " === SL4 x86_64 on WNs === ==== Setup ==== Setup a sufficient compatible environment for the nodes. Using the packages from GRIF is ok. ==== CMS soft ==== ==== XCMSI ====..."

New page

=== SL4 x86_64 on WNs ===
==== Setup ====
Setup a sufficient compatible environment for the nodes.
Using the packages from GRIF is ok.
==== CMS soft ====
==== XCMSI ====
*set VO_CMS_SW_DIR if not done already!!
*don't source init.sh from the apt installation! it works with normal rpm.
*export SCRAM_ARCH=slc3_ia32_gcc323
**i only needed to add a compat-glibc package
*modify cmsarch.pl: add
$arch{"Scientific Linux CERN SLC release 4.3 (Beryllium)"} =
[ "slc3_ia32_gcc323", "" , "" ];
*generate the default cmsset_default.sh files.
rm -f cmsset_default.sh cmsset_default.csh
./cmsi.pl -c default -a slc3_ia32_gcc323 -f cmsset_default.sh;./cmsi.pl -c default -a slc3_ia32_gcc323 -f cmsset_default.csh
*cmsi will install it's own scram version and this will use it's own perl libraries to run, BUT it makes use of the default @INC to construct a path for the included perl modules. Although it generates the necessay links to the architectures (i386-linux-thread-multi <= x86_64-linux-thread-multi), but ofcourse it doesn't symlink the default lib to lib64 path. fix this before anything is installed with (it's probably not needed for V0_20_0 and V1_0_0)
for i in V1_0_2 V1_0_1 V1_0_0 V0_20_0
do
dirr=$VO_CMS_SW_DIR/Releases/SCRAM/$i/Installation/TT2
mkdir -p $dirr/lib
cd $dirr
ln -s lib lib64
cd -
done

*first installation
./cmsi.pl -a slc3_ia32_gcc323 -f cmsset_default.sh -d ORCA_8_7_5
*updating/adding installation
./cmsi.pl -a slc3_ia32_gcc323 -f cmsset_default.sh -u -d CMSSW_0_6_1
*to manually install another scram version, from XCMSI/RPMS
rpm -Uhv --dbpath /swmgrs/cmss/rpmdb --prefix /swmgrs/cmss SCRAM_V1_0_2-shared-4.i386.rpm SCRAM_V0_20_0-shared-4.i386.rpm
==== aptinstaller: SL3 prep procedure ====
Nothing actually prevents one to install a complete SL3 distro on the CMS path. Given the huge size of the cms software, nobody will notice.
*set VO_CMS_SW_DIR
*get the follwoing rpms from sl3 (examples from slc305)
<pre>
apt-0.5.15cnc6-8.SL.cern.i386.rpm
popt-1.8.2-21_nonptl.i386.rpm
rpm-4.2.3-21_nonptl.i386.rpm
rpm-build-4.2.3-21_nonptl.i386.rpm
rpmdb-SL-305-0.20050601.i386.rpm
rpm-libs-4.2.3-21_nonptl.i386.rpm
curl-7.10.6-6.rhel3.i386.rpm
</pre>
**the curl rpm is needed because i couldn't find the needed compat version for curl.so.2 (symlink might have fixed that, but this is way more powerful.)
*make new directory
<pre>
mkdir -p $VO_CMS_SW_DIR/sl3/var/lib/rpm
</pre>

*install rpm rpmdb
<pre>
rpm --define "_rpmlock_path $VO_CMS_SW_DIR/sl3/var/lib/rpm/lock" --root $VO_CMS_SW_DIR/sl3 --dbpath $VO_CMS_SW_DIR/sl3/var/lib/rpm/ --relocate /=$VO_CMS_SW_DIR/sl3 -Uvh --nodeps
</pre>

**if you keep having SElinux trouble (errors with lsetfilecon message), try with --nocontexts switch
*install other rpms with same command
**ignore errors like
<pre>
/sbin/ldconfig: Can't create temporary cache file /etc/ld.so.cache~: Permission denied
error: %post(apt-0.5.15cnc6-8.SL.cern.i386) scriptlet failed, exit status 1
</pre>

*copy the following files:
<pre>
cp $VO_CMS_SW_DIR/sl3/usr/lib/rpm/macros ~/.rpmmacros
cp $VO_CMS_SW_DIR/sl3/usr/lib/rpm/rpmpopt-4.2.3 ~/.popt
</pre>

*create an init.sh script file (maybe later cat >> ~/.bashrc??)
<pre>
#!/bin/sh
if [ -z $VO_CMS_SW_DIR ]
then
echo "VO_CMS_SW_DIR not set. Exiting..."
exit 1
fi
if [ -z $LD_LIBRARY_PATH ];
then
export LD_LIBRARY_PATH=$VO_CMS_SW_DIR/sl3/usr/lib
else
export LD_LIBRARY_PATH=$VO_CMS_SW_DIR/sl3/usr/lib:$LD_LIBRARY_PATH
fi
export PATH=$VO_CMS_SW_DIR/sl3/bin:$VO_CMS_SW_DIR/sl3/usr/bin:$PATH
export SCRAM_ARCH=slc3_ia32_gcc323
export BUILD_ARCH=slc3_ia32_gcc323
</pre>

*source init.sh

==== aptinstaller ====
*set VO_CMS_SW_DIR if not done already!!
*download aptinstaller.sh here (yes, it's modified) [http://mon.iihe.ac.be/trac/t2b/attachment/wiki/SL4_x86_64_WNs/aptinstaller.sh?format=raw aptinstaller.sh]
*run ./aptinstaller.sh setup -arch slc3_ia32_gcc323
*eval <tt>$VO_CMS_SW_DIR/aptinstaller.sh config -path $VO_CMS_SW_DIR</tt> (or with -csh)
*apt-get update
*apt-get install ...
*all cms users now need to have their environment prepared by the init.sh script.
**well, certainly the SCRAM_ARCH part. as long as the curl.so.2 is never called by one of the jobs, it'll be all ok.

=== SL4.4 x86_64 pre ===
Use correct apt version without chaningin system rpm
Nothing actually prevents one to install a complete SL4 distro on the CMS path. Given the huge size of the cms software, nobody will notice.
*set VO_CMS_SW_DIR
<pre>
export VO_CMS_SW_DIR=$PWD
</pre>

*get the following rpms from sl4 (examples from sl4.4)
<pre>
apt-0.5.15lorg3.2-1.el4.rf.x86_64.rpm
curl-7.12.1-8.rhel4.x86_64.rpm
libidn-0.5.6-1.x86_64.rpm
popt-1.9.1-18_nonptl.x86_64.rpm
rpm-4.3.3-18_nonptl.x86_64.rpm
rpm-build-4.3.3-18_nonptl.x86_64.rpm
rpmdb-SL-44-0.20061019.x86_64.rpm
rpm-libs-4.3.3-18_nonptl.x86_64.rpm
xorg-x11-Mesa-libGLU-6.8.2-1.EL.13.37.2.x86_64.rpm
</pre>
*and possibly also (but for this one the alias 'which' should be modified as it is hardcoding the path)
<pre>
which-2.16-4.x86_64.rpm
</pre>

*you can use this script to fetch them [http://mon.iihe.ac.be/trac/t2b/attachment/wiki/SL4_x86_64_WNs/wgetrpms.sh?format=raw wgetrpms.sh]

*make new directory
<pre>
mkdir -p $VO_CMS_SW_DIR/sl4/var/lib/rpm
</pre>

*first install rpm rpmdb
<pre>
rpm --define "_rpmlock_path $VO_CMS_SW_DIR/sl4/var/lib/rpm/lock" --root $VO_CMS_SW_DIR/sl4 --dbpath $VO_CMS_SW_DIR/sl4/var/lib/rpm/ --relocate /=$VO_CMS_SW_DIR/sl4 -Uvh --nodeps
</pre>

**if you keep having SElinux trouble (errors with lsetfilecon message), try with --nocontexts switch
*install other rpms with same command
**ignore errors like
<pre>
/sbin/ldconfig: Can't create temporary cache file /etc/ld.so.cache~: Permission denied
error: %post(apt-0.5.15lorg3.2-1.el4.rf.x86_64) scriptlet failed, exit status 1
</pre>
*create an init.sh script file (maybe later cat >> ~/.bashrc??)
<pre>
#!/bin/sh
if [ -z $VO_CMS_SW_DIR ]
then
echo "VO_CMS_SW_DIR not set. Exiting..."
exit 1
fi
if [ -z $LD_LIBRARY_PATH ];
then
export LD_LIBRARY_PATH=$VO_CMS_SW_DIR/sl4/usr/lib64
else
export LD_LIBRARY_PATH=$VO_CMS_SW_DIR/sl4/usr/lib64:$LD_LIBRARY_PATH
fi
export PATH=$VO_CMS_SW_DIR/sl4/bin:$VO_CMS_SW_DIR/sl4/usr/bin:$PATH
export SCRAM_ARCH=slc4_ia32_gcc345
export BUILD_ARCH=slc4_ia32_gcc345
</pre>

*source init.sh
*modify the default aptinstaller.sh
**use the following patch
<pre>
--- aptinstaller.sh 2007-02-06 18:16:53.000000000 +0100
+++ aptinstaller-sl4.sh 2007-05-04 17:21:52.000000000 +0200
@@ -150,7 +150,7 @@

// Locations of binaries
Bin {
- methods "/usr/@LIBDIR_NAME@/apt/methods/";
+ methods "@ROOTDIR@/sl4/usr/@LIBDIR_NAME@/apt/methods/";
gzip "/bin/gzip";
dpkg "/usr/bin/dpkg";
dpkg-source "/usr/bin/dpkg-source";
@@ -207,7 +207,7 @@
seed="glibc glibc-32bit coreutils bash tcsh zsh pdksh perl tcl tk perl-Tk
readline openssl ncurses XFree86-libs
e2fsprogs krb5-libs freetype fontconfig XFree86-Mesa-libGLU XFree86-Mesa-libGL
- xorg-x11-deprecated-libs xorg-x11-libs xorg-x11-Mesa-libGLU xorg-x11-Mesa-libGL compat-libstdc++-33 fglrx_6_8_0 libidn"
+ xorg-x11-deprecated-libs xorg-x11-libs xorg-x11-Mesa-libGLU xorg-x11-Mesa-libGL compat-libstdc++-33 fglrx_6_8_0 libidn curl"

if [ "$unsupportedDistribution" != "false" ]
then
@@ -288,6 +288,12 @@
rpm -q $p --list | grep '\.so' | sed 's!^.*/Provides: !'
rpm -q $p --list | grep '/bin/' | sed 's!^Provides: !'
done
+ for q in $seed; do
+ p="--dbpath $rootdir/sl4/var/lib/rpm/ --root $rootdir/sl4 $q"
+ rpm -q $p --provides | grep -v "not installed" | sed 's!<*=.*!!; s!^Provides: !'
+ rpm -q $p --list | grep '\.so' | sed 's!^.*/Provides: !'
+ rpm -q $p --list | grep '/bin/' | sed 's!^Provides: !'
+ done
fi
echo; echo "%description"; echo "Seeds RPM repository from the base system."
echo; echo "%prep"; echo "%build"; echo "%install"; echo "%files";
@@ -398,11 +404,13 @@
generateAptConfiguration $arch
(echo "rpm http://$server $serverDir/$arch $groups"; \
echo "rpm-src http://$server $serverDir/$arch $groups"; ) > $architecture/etc/apt/sources.list
-relocateVariables $arch
+#relocateVariables $arch

rm -rf $rootdir/$rpmdb
mkdir -p $rootdir/$rpmdb
rpm --define "_rpmlock_path $rpmlock" --dbpath $rootdir/$rpmdb --initdb
+relocateVariables $arch
+rpm --define "_rpmlock_path $rpmlock" --dbpath $rootdir/$rpmdb --rebuilddb

seed

</pre>
**or the revisited version [http://mon.iihe.ac.be/trac/t2b/attachment/wiki/SL4_x86_64_WNs/aptinstaller-sl4.sh?format=raw aptinstaller-sl4.sh]

*run aptinstaller.sh with setup and config option
<pre>
$VO_CMS_SW_DIR/aptinstaller.sh setup -path $VO_CMS_SW_DIR -arch slc4_ia32_gcc345
eval <tt>$VO_CMS_SW_DIR/aptinstaller.sh config -arch slc4_ia32_gcc345 -path $VO_CMS_SW_DIR -sh</tt>
</pre>
*https://twiki.cern.ch/twiki/bin/view/CMS/CMSSW_aptinstaller#Installation_instructions_for_sl
*test the installation
**logout and re-login
**run
<pre>
export VO_CMS_SW_DIR=$PWD
source $VO_CMS_SW_DIR/cmsset_default.sh
scramv1 list
</pre>
**you should see the list of installed software

{{TracNotice|{{PAGENAME}}}}

SL4 x86 64 WNs - Revision history

Maintenance script: Created page with " === SL4 x86_64 on WNs === ==== Setup ==== Setup a sufficient compatible environment for the nodes. Using the packages from GRIF is ok. ==== CMS soft ==== ==== XCMSI ====..."