9. Known Issues for HDP 2.2.9

HDP 2.2.9 has the following known issues, scheduled for resolution in a future release. Where available, a workaround has been provided.

Hortonworks Bug IDApache JIRAComponentSummary
BUG-33843 TezLog warnings or fail early if there are too many tasks for a job
BUG-36601 HBase

Scanner keyvalue size / partial results

Issue: In 2.2 clusters, setting "hbase.client.scanner.max.result.size" differently on the client side or server side might result in missed data from large scans because the scanner might wrongly assume region is exhausted before the region boundary is reached. Additionally, the result size calculation might be different if cell level tags are used even if "hbase.client.scanner.max.result.size" is the same between 2.2 and 2.3 clusters. This issue also affects rolling upgrades between 2.2 and 2.3 clusters, where a 2.2 client might miss data in a large scan when rolling upgrading or talking to 2.3 servers. As a protection, 2.3 does not set "hbase.client.scanner.max.result.size" by default.

Workaround: Do not use partial scan results to be returned (by not setting "hbase.client.scanner.max.result.size") is recommended.

BUG-38980HBASE-14223HBase

Meta WALs are not split or cleared

Issue: In case a meta region gets moved from one region server to another region server, the write ahead logs for the meta table might be left in the HDFS directory for the regionserver if that particular regionserver fails. This might leave the WAL files in that directory until they are removed manually, and also may result in the previous regionservers to be listed as "dead regionservers" in the master UI indefinitely. However, this is harmless and does not cause any data loss other other operational issues in HBase.

BUG-42084 HivePrevent misconfiguration when StorageBasedAuthorization is set on hive.security.authorization.manager
BUG-42498HDFS-8999HDFSBlock received messages put heavy load on namenode
BUG-42569HIVE-10022HiveCreate database [db_name] location /tmp/[db_name].db' via beeline throws [hrt_qa] does not have [WRITE] privilege although hive.server2.enable.doAs=false when Ranger or StdAuth is on
BUG-42937HDFS-8864HDFSPadding is needed in remaining space check
BUG-42938HDFS-8871HDFSDecommissioning of a node with a failed volume may not start
BUG-42939HDFS-8870HDFSLease is leaked on write failure
BUG-43023

HDFS-5215

HDFS-9038

HDFSdfs.datanode.du.reserved is not considered while computing available space
BUG-43330 Tez, YARNFunctional standalone UI (hosted in ATS) for Tez
BUG-43583SLIDER-931Slidertest_runintegrationtestzkandfspermissions failed on HBase-Slider
BUG-43979 YARNRM UI prints ZK RM connection state="CONNECTED" , if >50% ZKs are disconnected from active RM
BUG-44485 OozieOozie should invoke Hive/MR/Pig client API to setup caller context
BUG-44538

HBASE-13250

HBASE-14445

HBaseExportSnapshot does not honor -chuser, -chgroup, -chmod options
BUG-44732 OozieOozie should push workflow id information to ATS when a new workflow is instantiated
BUG-45381TEZ-2923TezUpdate counters page in vertex, task & attempt pages
BUG-45383 TezUpdate Graphical view while in progress
BUG-45387 TezUpdate status & progress at a faster pace
BUG-45389 TezUpdate status and progress in All DAGs table
BUG-45757 PhoenixRows get "locked" and block Phoenix operations
BUG-45759 PhoenixBuild index error on phoenix
BUG-46041TEZ-2902TezNPE if a container heartbeat fails before the task starts running
BUG-46313 YARNRM UI should be smarter on when and when not to use authentication
BUG-46599 HBaseHBase's ExportSnapshotTool requires hdfs user to trigger ExportSnapshot, but application fails with 'Requested user hdfs is banned'
BUG-46660 HiveLog HiveConf on startup for metastore
BUG-46661HIVE-11891HiveAdd basic performance logging to metastore calls
BUG-46663HIVE-11892Hive

Local fetch task does not work with UDTF

Workaround: Disable fetch task conversion if using a UDTF that forwards rows during GenericUDTF.close().

BUG-46664 HiveHive query execution failed complaining about absence of lock
BUG-46726 HiveSelect join tables fails in a case of there are ten thousand of orc files
BUG-46886HADOOP-8830TezStandalone Tez UI is not accessible in Secure cluster
BUG-46983 HiveHDP 2.2.8 has hive.exec.parallel.* in confWhitelist, not including hive.exec.parallel
BUG-47062 HBaseExportSnapshot with chown is not usable with current hdfs and yarn constraints
BUG-47099 HiveInsert query on skewed table runs into MoveTask error in MR mode
BUG-47226 HiveJoin query returns different result with and without vectorization in Tez mode when all the entries are NaN
BUG-47377 TezTez UI: Update counters page in dag page
BUG-47472 HiveQuery fails on ORC ppd on timestamp datatype on stripes with all null on the column
BUG-47749HBASE-11617HBaseCherry-pick HBASE-11617