4.10. Reconfiguring Hadoop

The configuration of Hadoop is done during the OS install, the resulting configuration file is /etc/sysconfig/hadoop.

Note

In case hadoop was not installed at kickstart, it is possible to install it in a node or appliance after kickstart by setting OSG_HADOOP (or OSG_Client or OSG_SE or OSG_GFTP_HDFS or OSG_CE='condor') on a host or appliance followed by syncing as shown below:

# rocks set host attr <hostname> OSG_HADOOP value=true
# rocks sync host osg hadoop install <hostname>

To reconfigure Hadoop on a node, make appropriate attribute changes (see table Customizing OSG Hadoop attrs) using the rocks commands above and then run

# rocks sync host osg hadoop <hostname>

This will rewrite the file /etc/sysconfig/hadoop and then calls the Hadoop command /root/HadoopConfigurator

Note

To view the contents of the /etc/sysconfig/hadoop before making changes, use rocks report host osg hadoop config <hostname>