2.1. Customizing the OSG Roll

This section describes the default OSG configuration and some simple customizations that can be applied in Rocks with version >= 5.4

By default, Hadoop, Condor and WorkerClient with glexec are installed on Rocks compute appliances, while Gridftp and gatekeper server on login-0-0 host and Gridftp hadoop and bestman2 on login-0-1 host. For Rocks 5.2 and newer, the OSG roll makes use of attributes to enable Hadoop, Condor and WorkerClient with glexec, Bestman2 server, Gridftp server, hdfs gridftp server, gatekeeper (CE) server to be installed on any appliance. This may be particularly useful to groups who are including the Xen roll and would like OSG servers to install on VM Container appliances.

The basic customizations that can be applied without and scripting/programming by setting global, appliance, or host attributes. Please see the commands rocks set attr help and rocks list attr help

Table 2-1. Attributes Used in OSG Roll

Attibute NameDescription
OSG_GumsServerSet Gums server name used on any particular Appliance or Host installation. Default: rocks-gums.&Kickstart_PublicDNSDomain;
OSG_CEServerSet Grid gatekeeper server name used on any particular Appliance or Host or gatekeeper installation. Default: rocks-ce.&Kickstart_PublicDNSDomain;
OSG_SEServerSet bestman server name used on any particular Appliance or Host or bestaman server installation. Default: rocks-se.&Kickstart_PublicDNSDomain;
OSG_HadoopNameNodeSet Hadoop NodeName server name used on any particular Appliance or Host installation. Check for a line like this: HADOOP_NAMENODE=compute-0-0 in /etc/sysconfig/hadoop Default: compute-0-0
OSG_HadoopSecondaryNodeSet Hadoop SecondaryName server name used on any particular Appliance or Host installation. Check for a line like this: HADOOP_SECONDARY_NAMENODE=compute-0-1 in /etc/sysconfig/hadoop Default: compute-0-1
OSG_HadoopDataDirSet Hadoop base data dir used on any particular Appliance or Host installation. Check for a line like this: HADOOP_DATADIR=/hadoop in /etc/sysconfig/hadoop Default: /hadoop
OSG_HadoopDataSet Hadoop data dir used on any particular Appliance or Host installation. Check for a line like this: HADOOP_DATA=/hadoop/data in /etc/sysconfig/hadoop Default: /hadoop/data
OSG_HadoopCheckPointDirsSet Hadoop check point dirs used on any particular Appliance or Host installation. Check for a line like this: HADOOP_CHECKPOINT_DIRS=/home/hadoop,/scratch/hadoop in /etc/sysconfig/hadoop Default: /home/hadoop,/scratch/hadoop
OSG_HadoopCheckPointPeriodSet Hadoop check point period used on any particular Appliance or Host installation. Check for a line like this: HADOOP_CHECKPOINT_PERIOD=600 in /etc/sysconfig/hadoop Default: 600
OSG_HadoopUpdateFstabSet Hadoop for update fstab used on any particular Appliance or Host installation. Check for a line like this: HADOOP_UPDATE_FSTAB=1 in /etc/sysconfig/hadoop Default: 1
OSG_GlobusPortRangeSet Globus Port Range used on any particular Appliance or Host installation. This entry is used for setting iptable firewall on grid servers. Default: 20000:25000
OSG_GlobusTcpPortRangeSet Globus TCP Port Range used on any particular Appliance or Host installation. This entry is used for setting GLOBUS_TCP_PORT_RANGE on grid servers. (note change : by , compared with OSG_GlobusPortRange) Default: 20000,25000
OSG_GlobusTcpSourceRangeSet Globus TCP Source Range used on any particular Appliance or Host installation. This entry is used for setting GLOBUS_TCP_SOURCE_RANGE on grid servers. (note change : by , compared with OSG_GlobusPortRange) Default: 20000,25000
OSG_SRMlocalPathListAllowedSet localPathListAllowed used on any particular Appliance or Host installation of bestman server. Check for a line like this: localPathListAllowed=/mnt/hadoop;/data/se in /etc/bestman2/conf/bestman2.rc Default: /mnt/hadoop;/data/se
OSG_SRMsupportedProtocolListSet supportedProtocolList used on any particular Appliance or Host installation of bestman server. This is the default gridftp server. Check for a line like this: gsiftp://rocks-ce.&Kickstart_PublicDNSDomain;:2811 in /etc/bestman2/conf/bestman2.rc Default: gsiftp://rocks-ce.&Kickstart_PublicDNSDomain;:2811
OSG_ClientEnable/Disable OSG worker node Client Installation on any particular Appliance or Host. Install includes glexec. Default: true (on compute appliance)
OSG_CEEnable/Disable osg-ce-condor Installation on any particular Appliance or Host. Default: true (on login-0-0)
OSG_SEEnable/Disable bestman-server Installation on any particular Appliance or Host. Default: true (on login-0-1)
OSG_GRIDFTPEnable/Disable standalone gridftp server Installation on any particular Appliance or Host. Default: true (on login-0-0)
OSG_GFTP_HDFSEnable/Disable hadoop gridftp server Installation on any particular Appliance or Host. Default: true (on login-0-1)
OSG_StoredCertsDirSet Base Dir where grid certs are stored for Appliance or Host installation. During installation of CE or SE hostcert.pem and hostkey.pem are copied to /root. Default: /root/certs
OSG_Condor_ClientEnable/Disable Condor Client Installation on any particular Appliance or Host. Default: true (on compute appliance)
OSG_Condor_MasterRedefine the Condor Master that nodes use. Default: public frontend name
OSG_Condor_Network Define which network interface is used for Condor traffic. Default: frontends are set to public, clients are set to private.
OSG_Condor_DaemonsDefine which Condor execution daemons are installed. Default: [MASTER (global)], [MASTER, SCHEDD, COLLECTOR, NEGOTIATOR (frontends)], [MASTER, SCHEDD (login appliance)], [MASTER, STARTD (compute appliance)]
OSG_Condor_PortLow Lower Port range that Condor will use to communicate among daemons. Removal of this Attribute will result in removal of the LOWPORT entry in 01_rocks_condor_config.local after syncing the configuration. Default: 40000
OSG_Condor_PortHigh Upper Port range that Condor will use to communicate among daemons. Removal of this Attribute will result in removal of the HIGHPORT entry in 01_rocks_condor_config.local after syncing the configuration. Default: 50000
OSG_Condor_HostAllowComma separates list of allowed readers/writers for Condor. Translates to HOSTALLOW directive in Condor Configuration file. Default: + rocks-ce
OSG_Condor_PasswordAuth Use a shared pool password, instead of host-based authentication. Default: no.
OSG_Condor_EnableMPI Configure a local scheduler for MPI Universe Support. Default: no
OSG_Condor_EnableAMAZON_EC2 Configure a local scheduler for AMAZON_EC2 Support. Default: no
OSG_Condor_EnableT3GRID_SUBMITConfigure a local grid submitter for interactive nodes (I use to called CRAB submit). Default: no
OSG_Condor_EnableT3GRID_CMSSWConfigure a local compute nodes for CMS jobs. Default: yes