8.3.2. Known issues for MapReduce

  • BUG-12005: Mapreduce.task.io.sort.mb is capped at 2047.

    Problem: mapreduce.task.io.sort.mb is hardcoded to not allow values larger than 2047. If you enter a value larger then this the map tasks will always crash at this line:

    https://github.com/apache/hadoop-mapreduce/blob/HDFS-641/src/java/org/apache/hadoop/mapred/MapTask.java?source=cc#L746 
  • BUG-14749: CombineFileInputFormat.getSplits() including directories in its results.

    Problem: This is causing Hive test root_dir_external_table.q to fail when running against hadoop-2. Opened Apache Jira MAPREDUCE-5756 Created in Monarch as https://hwxmonarch.atlassian.net/browse/HADOOP-801, creating equivalent bug for Baikal.

  • BUG-15360: In HDFS HA mode, Distcp/SLive with webhdfs on secure cluster fails with Client cannot authenticate via:[TOKEN, KERBEROS] error.