5.1. Known Issues for Hadoop

  • Old logs getting deleted instead of being copied to a new file.

    Problem: Log4J's DailiyRollingFileAppender on Windows can truncate log files instead of creating backups during the daily rollover.

    Workaround: Reconfigure log4j.properties to use a different appender.

  • File upload fails to upload in NFS-MountDir.

    Problem: While uploading files to NFS-MountDir, the following error is reported in the DataNode log file:

    INFO org.apache.hadoop.hdfs.nfs.nfs3.OpenFileCtx: requesed offset=4980736 and current filesize=0

    Workaround: On some environments, especially for virtualized environments, copying large files of size close to 1GB fails intermittently. This issue is expected to be addressed in the upcoming release.

  • Do not use init.d scripts for starting or stopping Hadoop services. It is not recommended.