3.3. Customizing Hadoop

By default Hadoop is installed on Rocks compute appliances.

Table 3-3. Attributes Used in OSG Roll for Hadoop customization

Attibute NameDescription
OSG_HadoopNameNodeConfigure Hadoop NodeName server name used on any particular Appliance or Host installation. Check for a line like this: HADOOP_NAMENODE=compute-0-0 in /etc/sysconfig/hadoop Default: compute-0-0
OSG_HadoopSecondaryNodeConfigure Hadoop SecondaryName server name used on any particular Appliance or Host installation. Check for a line like this: HADOOP_SECONDARY_NAMENODE=compute-0-1 in /etc/sysconfig/hadoop Default: compute-0-1
OSG_HadoopDataDirConfigure Hadoop base data dir used on any particular Appliance or Host installation. Check for a line like this: HADOOP_DATADIR=/hadoop in /etc/sysconfig/hadoop Default: /hadoop
OSG_HadoopDataConfigure Hadoop data dir used on any particular Appliance or Host installation. Check for a line like this: HADOOP_DATA=/hadoop/data in /etc/sysconfig/hadoop Default: /hadoop/data
OSG_HadoopCheckPointDirsConfigure Hadoop check point dirs used on any particular Appliance or Host installation. Check for a line like this: HADOOP_CHECKPOINT_DIRS=/home/hadoop,/scratch/hadoop in /etc/sysconfig/hadoop Default: /home/hadoop,/scratch/hadoop
OSG_HadoopCheckPointPeriodConfigure Hadoop check point period used on any particular Appliance or Host installation. Check for a line like this: HADOOP_CHECKPOINT_PERIOD=600 in /etc/sysconfig/hadoop Default: 600
OSG_HadoopUpdateFstabConfigure Hadoop for update fstab used on any particular Appliance or Host installation. Check for a line like this: HADOOP_UPDATE_FSTAB=1 in /etc/sysconfig/hadoop Default: 1