BUG-15796: Sigsegv in mapred history server due to segfault in JniBasedUnixGroupsMapping.
Problem: Got sigsegv in mapred-mapred-historyserver-hor3n25.gq1.ygridcore.net.out:
14/03/28 15:48:28 INFO hs.HistoryFileManager: Deleting JobSummary file: [hdfs://hor3n25.gq1.ygridcore.net:8020/mapred/history/done_intermediate/hrt_qa/job_1396000455255_0525.summary] 14/03/28 15:48:28 INFO hs.HistoryFileManager: Moving hdfs://hor3n25.gq1.ygridcore.net:8020/mapred/history/done_intermediate/hrt_qa/job_1396000455255_0525-1396021694603-hrt_qa-PigLatin%3Aid.pig-1396021706500-1-0-SUCCEEDED-default-1396021699875.jhist to hdfs://hor3n25.gq1.ygridcore.net:8020/mapred/history/done/2014/03/28/000000/job_1396000455255_0525-1396021694603-hrt_qa-PigLatin%3Aid.pig-1396021706500-1-0-SUCCEEDED-default-1396021699875.jhist 14/03/28 15:48:28 INFO hs.HistoryFileManager: Moving hdfs://hor3n25.gq1.ygridcore.net:8020/mapred/history/done_intermediate/hrt_qa/job_1396000455255_0525_conf.xml to hdfs://hor3n25.gq1.ygridcore.net:8020/mapred/history/done/2014/03/28/000000/job_1396000455255_0525_conf.xml # # A fatal error has been detected by the Java Runtime Environment: # # SIGSEGV (0xb) at pc=0x00007f6ef9cdf984, pid=5986, tid=140112490882816 # # JRE version: 7.0_09 # Java VM: OpenJDK 64-Bit Server VM (23.2-b09 mixed mode linux-amd64 compressed oops) # Problematic frame: # C 0x00007f6ef9cdf984 # # Failed to write core dump. Core dumps have been disabled. To enable core dumping, try ""ulimit -c unlimited"" before starting Java again # # An error report file with more information is saved as: # /tmp/hs_err_pid5986.log # # If you would like to submit a bug report, please include # instructions on how to reproduce the bug and visit: # http://icedtea.classpath.org/bugzilla #
BUG-825: EC2 m1.large cluster root partition is only 5GB and fills up quickly by HDP logs
Problem: Directories and disks that you assign for logging in HDP do NOT have enough space to maintain logs during HDP operations.
Workaround: Designate least 10 GB of free space on a disk that will be used by HDP logging.
