3. Configure MapReduce on HDFS

To use MapReduce, in HDFS make the MapReduce history folder, tmp, application logs, and a Yarn folders and then set permissions to the folders.

%HADOOP_HOME%\bin\hadoop.cmd dfs -mkdir -p /mapred/history/done /mapred/history/done_intermediate 
%HADOOP_HOME%\bin\hadoop.cmd dfs -chmod -R 1777 /mapred/history/done_intermediate 
%HADOOP_HOME%\bin\hadoop.cmd dfs -chmod 770 /mapred/history/done 
%HADOOP_HOME%\bin\hadoop.cmd dfs -chown -R hadoop:hadoopUsers /mapred 
%HADOOP_HOME%\bin\hadoop.cmd dfs -chmod 755 /mapred /mapred/history 
%HADOOP_HOME%\bin\hadoop.cmd dfs -mkdir /tmp 
%HADOOP_HOME%\bin\hadoop.cmd dfs -chmod 777 /tmp 
%HADOOP_HOME%\bin\hadoop.cmd dfs -mkdir /app-logs 
%HADOOP_HOME%\bin\hadoop.cmd dfs -chown hadoop:hadoopUsers /app-logs 
%HADOOP_HOME%\bin\hadoop.cmd dfs -chmod 1777 /app-logs 
%HADOOP_HOME%\bin\hadoop.cmd dfs -mkdir -p /yarn /yarn/generic-history/ 
%HADOOP_HOME%\bin\hadoop.cmd dfs -chmod -R 700 /yarn 
%HADOOP_HOME%\bin\hadoop.cmd dfs -chown -R hadoop:hadoop /yarn  


loading table of contents...