osg roll: Users Guide: 
| ||
|---|---|---|
| Prev | Chapter 2. Customizing the OSG Roll | Next |
This section describes the default OSG configuration and some simple customizations that can be applied in Rocks with version >= 5.4
By default, Hadoop, Condor and WorkerClient with glexec are installed on Rocks compute appliances, while Gridftp and gatekeper server on login-0-0 host and Gridftp hadoop and bestman2 on login-0-1 host. For Rocks 5.2 and newer, the OSG roll makes use of attributes to enable Hadoop, Condor and WorkerClient with glexec, Bestman2 server, Gridftp server, hdfs gridftp server, gatekeeper (CE) server to be installed on any appliance. This may be particularly useful to groups who are including the Xen/KVM roll and would like OSG servers to install on VM Container appliances.
The basic customizations that can be applied without and scripting/programming by setting global, appliance, or host attributes. Please see the commands rocks set attr help and rocks list attr help
Table 2-1. Attributes Used in OSG Roll
| Attibute Name | Description |
|---|---|
| OSG_GumsServer | Configure Gums server name used on any particular Appliance or Host installation. Default: rocks-gums.&Kickstart_PublicDNSDomain; (rocks-gums.public.domain on a New Cluster Server install) |
| OSGGUMSPrivate | Configure which cluster node is the gums server node (private domain). Default: login-0-2 |
| OSG_CEServer | Configure Grid gatekeeper server name used on any particular Appliance or Host or gatekeeper installation. Default: rocks-ce.&Kickstart_PublicDNSDomain; (rocks-ce.public.domain on a New Cluster Server install) |
| OSGCEPrivate | Configure which cluster node is the Grid gatekeeper server node (private domain). Default: login-0-0 |
| OSG_SEServer | Configure bestman server name used on any particular Appliance or Host or bestaman server installation. Default: rocks-se.&Kickstart_PublicDNSDomain; (rocks-se.public.domain on a New Cluster Server install) |
| OSGSEPrivate | Configure which cluster node is the bestman server node (private domain). Default: login-0-1 |
| OSG_GFTPServer | Configure gridftp server name (non-hdfs) used on any particular Appliance or Host installation. Default: rocks-ce.&Kickstart_PublicDNSDomain; |
| OSG_HadoopNameNode | Configure Hadoop NodeName server name used on any particular Appliance or Host installation. Check for a line like this: HADOOP_NAMENODE=compute-0-0 in /etc/sysconfig/hadoop Default: compute-0-0 |
| OSG_HadoopSecondaryNode | Configure Hadoop SecondaryName server name used on any particular Appliance or Host installation. Check for a line like this: HADOOP_SECONDARY_NAMENODE=compute-0-1 in /etc/sysconfig/hadoop Default: compute-0-1 |
| OSG_HadoopDataDir | Configure Hadoop base data dir used on any particular Appliance or Host installation. Check for a line like this: HADOOP_DATADIR=/hadoop in /etc/sysconfig/hadoop Default: /hadoop |
| OSG_HadoopData | Configure Hadoop data dir used on any particular Appliance or Host installation. Check for a line like this: HADOOP_DATA=/hadoop/data in /etc/sysconfig/hadoop Default: /hadoop/data |
| OSG_HadoopCheckPointDirs | Configure Hadoop check point dirs used on any particular Appliance or Host installation. Check for a line like this: HADOOP_CHECKPOINT_DIRS=/home/hadoop,/scratch/hadoop in /etc/sysconfig/hadoop Default: /home/hadoop,/scratch/hadoop |
| OSG_HadoopCheckPointPeriod | Configure Hadoop check point period used on any particular Appliance or Host installation. Check for a line like this: HADOOP_CHECKPOINT_PERIOD=600 in /etc/sysconfig/hadoop Default: 600 |
| OSG_HadoopUpdateFstab | Configure Hadoop for update fstab used on any particular Appliance or Host installation. Check for a line like this: HADOOP_UPDATE_FSTAB=1 in /etc/sysconfig/hadoop Default: 1 |
| OSG_GlobusPortRange | Configure Globus Port Range used on any particular Appliance or Host installation. This entry is used for setting iptable firewall on grid servers. Default: 20000:25000 |
| OSG_GlobusTcpPortRange | Configure Globus TCP Port Range used on any particular Appliance or Host installation. This entry is used for setting GLOBUS_TCP_PORT_RANGE on grid servers. (note change : by , compared with OSG_GlobusPortRange) Default: 20000,25000 |
| OSG_GlobusTcpSourceRange | Configure Globus TCP Source Range used on any particular Appliance or Host installation. This entry is used for setting GLOBUS_TCP_SOURCE_RANGE on grid servers. (note change : by , compared with OSG_GlobusPortRange) Default: 20000,25000 |
| OSG_SRMlocalPathListAllowed | Configure localPathListAllowed used on any particular Appliance or Host installation of bestman server. Check for a line like this: localPathListAllowed=/mnt/hadoop;/data/se in /etc/bestman2/conf/bestman2.rc Default: /mnt/hadoop;/data/se |
| OSG_SRMsupportedProtocolList | Set supportedProtocolList used on any particular Appliance or Host installation of bestman server. This is the default gridftp server. Check for a line like this: gsiftp://rocks-ce.&Kickstart_PublicDNSDomain;:2811 in /etc/bestman2/conf/bestman2.rc Default: gsiftp://rocks-ce.&Kickstart_PublicDNSDomain;:2811 |
| OSG_Client | Enable/Disable OSG worker node Client Installation on any particular Appliance or Host. Install includes glexec. Default: true (on compute appliance) |
| OSG_CE | Enable/Disable osg-ce-condor (="condor") or osg-ce-sge (="sge") Installation on any particular Appliance or Host. Default: condor (on login-0-0) |
| OSG_SE | Enable/Disable bestman-server Installation on any particular Appliance or Host. Default: true (on login-0-1) |
| OSG_GRIDFTP | Enable/Disable standalone gridftp server Installation on any particular Appliance or Host. Default: true (on login-0-0) |
| OSG_GFTP_HDFS | Enable/Disable hadoop gridftp server Installation on any particular Appliance or Host. Default: true (on login-0-1) |
| OSG_StoredCertsDir | Set Base Dir where grid certs are stored for Appliance or Host installation. During installation of CE or SE hostcert.pem and hostkey.pem are copied to /root. Default: /root/certs |
| OSG_Condor_Client | Enable/Disable Condor Client Installation on any particular Appliance or Host. Default: true (on compute appliance) |
| OSG_Condor_Master | Redefine the Condor Master that nodes use. Default: public frontend name |
| OSG_Condor_Network | Define which network interface is used for Condor traffic. Default: frontends are set to public, clients are set to private. |
| OSG_Condor_Daemons | Define which Condor execution daemons are installed. Default: [MASTER (global)], [MASTER, SCHEDD, COLLECTOR, NEGOTIATOR (frontends)], [MASTER, SCHEDD (login appliance)], [MASTER, STARTD (compute appliance)] |
| OSG_Condor_PortLow | Lower Port range that Condor will use to communicate among daemons. Removal of this Attribute will result in removal of the LOWPORT entry in 01_rocks_condor_config.local after syncing the configuration. Default: 40000 |
| OSG_Condor_PortHigh | Upper Port range that Condor will use to communicate among daemons. Removal of this Attribute will result in removal of the HIGHPORT entry in 01_rocks_condor_config.local after syncing the configuration. Default: 50000 |
| OSG_Condor_HostAllow | Comma separates list of allowed readers/writers for Condor. Translates to HOSTALLOW directive in Condor Configuration file. Default: + rocks-ce |
| OSG_Condor_PasswordAuth | Use a shared pool password, instead of host-based authentication. Default: no. |
| OSG_Condor_EnableMPI | Configure a local scheduler for MPI Universe Support. Default: no |
| OSG_Condor_EnableAMAZON_EC2 | Configure a local scheduler for AMAZON_EC2 Support. Default: no |
| OSG_Condor_EnableT3GRID_SUBMIT | Configure a local grid submitter for interactive nodes (I use to called it CRAB submit). Default: no |
| OSG_Condor_EnableT3GRID_CMSSW | Configure a local compute nodes for CMS jobs. Default: yes |
| OSG_GUMSBackupDir | Configure the directory in which is located the backup config files and database for gums. Default: /path/to/gums/backup |
| OSG_GUMSDNADMIN | Configure the admin DN for gums used in the configuration scripts. Default: /DC=org/DC=doegrids/OU=People/CN=Name M LastName 123456 |
| OSG_squiduid | Configure uid for squid user. Default: 450 |
| OSG_squidgid | Configure gid for squid user (group). Default: 450 |
| OSG_cvmfsuid | Configure uid for cvmfs user. Default: 470 |
| OSG_cvmfsgid | Configure gid for cvmfs user (group). Default: 470 |
| OSG_fusegid | Configure gid for fuse group. Default: 408 |
| OSG_CVMFS_REPOSITORIES | Configure CVMFS_REPOSITORIES for cvmfs. Default: cms.cern.ch |
| OSG_CVMFS_CACHE_BASE | Configure CVMFS_CACHE_BASE for cvmfs. Default: "/var/cache/cvmfs" |
| OSG_CVMFS_QUOTA_LIMIT | Configure CVMFS_QUOTA_LIMIT for cvmfs (in MB). Default: 10000 |
| OSG_CVMFS_HTTP_PROXY | Configure CVMFS_HTTP_PROXY for cvmfs. Default: "http://login-0-2:3128" |
| OSG_CMS_LOCAL_SITE | Configure CMS_LOCAL_SITE for cvmfs. Default: "T3_US_PuertoRico" |