2.4. Customizing Hadoop

By default Hadoop is NOT installed on Rocks clusters. To install on Rocks compute appliances set attr BIGTOP_HADOOP.

##
## turn on Bigtop Hadoop installation for compute nodes at kickstart.
##
#/opt/rocks/bin/rocks add appliance attr compute BIGTOP_HADOOP value=true

Table 2-1. Attributes Used in hadoop bigtop Roll for Hadoop customization

Attibute NameDescription
BIGTOP_HadoopNameNodeConfigure Hadoop NodeName server name used on any particular Appliance or Host installation. Check for a line like this: HADOOP_NAMENODE=compute-0-0 in /etc/sysconfig/hadoop Default: compute-0-0
BIGTOP_HadoopSecondaryNameNodeConfigure Hadoop SecondaryName server name used on any particular Appliance or Host installation. Check for a line like this: HADOOP_SECONDARY_NAMENODE=compute-0-1 in /etc/sysconfig/hadoop Default: compute-0-1
BIGTOP_HadoopDataDirConfigure Hadoop base data dir used on any particular Appliance or Host installation. Check for a line like this: HADOOP_DATADIR=file:///hadoop in /etc/sysconfig/hadoop Default: file:///hadoop
BIGTOP_HadoopDataConfigure Hadoop data dir used on any particular Appliance or Host installation. Check for a line like this: HADOOP_DATA=file:///hadoop/data in /etc/sysconfig/hadoop Default: file:///hadoop/data
BIGTOP_HadoopCheckPointDirsConfigure Hadoop check point dirs used on any particular Appliance or Host installation. Check for a line like this: HADOOP_CHECKPOINT_DIRS=file:///hadoop in /etc/sysconfig/hadoop Default: file:///hadoop
BIGTOP_HadoopNamenodeNameDirConfigure Hadoop Name node dirs used on any particular Appliance or Host installation. Check for a line like this: HADOOP_NAMENODE_NAME_DIR=file:///hadoop in /etc/sysconfig/hadoop Default: file:///hadoop
BIGTOP_HadoopCheckPointPeriodConfigure Hadoop check point period used on any particular Appliance or Host installation. Check for a line like this: HADOOP_CHECKPOINT_PERIOD=600 in /etc/sysconfig/hadoop Default: 600
BIGTOP_HadoopUpdateFstabConfigure Hadoop for update fstab used on any particular Appliance or Host installation. Check for a line like this: HADOOP_UPDATE_FSTAB=1 in /etc/sysconfig/hadoop Default: 1
BIGTOP_Hadoop_StartDaemonDataNodeConfigure to start Hadoop DataNode daemon in a particular Appliance or Host after installation Default: no default
BIGTOP_Hadoop_StartDaemonNameNodeConfigure to start Hadoop NameNode daemon in a particular Appliance or Host after installation Default: no default
BIGTOP_Hadoop_StartDaemonSecondaryNameNodeConfigure to start Hadoop SecondaryNameNode daemon in a particular Appliance or Host after installation Default: no default