4. Start MapReduce JobHistory Server

Execute these commands from the JobHistory server to set up directories on HDFS :

su $HDFS_USER
hadoop fs -mkdir -p /mapred/history/done_intermediate
hadoop fs -chmod -R 1777 /mapred/history/done_intermediate
hadoop fs -mkdir -p /mapred/history/done
hadoop fs -chmod -R 1777 /mapred/history/done
hadoop fs -chown -R $MAPRED_USER:$HDFS_USER /mapred

Execute these commands from the JobHistory server:

su - $MAPRED_USER
export HADOOP_LIBEXEC_DIR=/usr/lib/hadoop/libexec/
export HADOOP_MAPRED_HOME=/usr/lib/hadoop-mapreduce
export HADOOP_MAPRED_PID_DIR=/var/run/hadoop/mapred
export HADOOP_MAPRED_LOG_DIR=/var/log/hadoop/mapred

<login as $MAPRED_USER and source the directories.sh companion script>
source directories.sh
/usr/lib/hadoop-mapreduce/sbin/mr-jobhistory-daemon.sh start historyserver --config $HADOOP_CONF_DIR

where:

$HDFS_USER is the user owning the HDFS services. For example, hdfs.
$MAPRED_USER is the user owning the MapRed services. For example, mapred.
$HADOOP_CONF_DIR is the directory for storing the Hadoop configuration files. For example, /etc/hadoop/conf.

Legal notices