Fixed Issues
Fixed issues represents selected issues previously logged by Hortonworks Support and addressed in the current release. These issues might have been reported in previous versions within the Known Issues section, meaning that they were reported by customers or identified by Hortonworks Quality Engineering team.
Hortonworks Data Platform (HDP) 2.3.6 is the first maintenance release that aligns the 2.3.x core with the 2.4.x core; see New Features for details.
Potential Data Loss
|
Hortonworks Bug ID |
Apache JIRA |
Apache Component |
Summary | Source |
|---|---|---|---|---|
| BUG-52962 | HDFS-9289 | HDFS | Make DataStreamer#block thread safe and verify genStamp in commitBlock. | 2.3.6 |
| BUG-52963 | HDFS-9289 | HDFS | Make DataStreamer#block thread safe and verify genStamp in commitBlock. | 2.4.2 |
| BUG-55474 | HDFS-10178 | HDFS | Permanent write failures can happen if pipeline recoveries occur for the first packet. | 2.3.6 |
Security
|
Hortonworks Bug ID |
Apache JIRA |
Apache Component |
Summary | Source |
|---|---|---|---|---|
| BUG-46092 | HIVE-7193 | Hive | We need to filter users who can connect on our HiveServer2 to those in a particular LDAP group (with nested groups). | 2.3.6 |
| BUG-46910 | Hue | Request to add HUE-1663 to fix LDAP referral handling for authentication. | 2.4.0 | |
| BUG-48092 | RANGER-746 | Ranger | Ranger Admin: For validating plugins SSL certs - Add wildcard, multiple CN & SAN support. | 2.4.2 |
| BUG-50350 | HBASE-14471 | HBase | Thrift - HTTP Error 413 full HEAD if using Kerberos authentication. | 2.4.0 |
| BUG-51013 | TEZ-3025 | Tez | InputInitializer creation should use the dag UGI. | 2.4.0 |
| BUG-51298 | HBASE-15145 | HBase | Default hbase-env.sh breaks add peer command that writes to /hbase-secure/replication znode for kerberized clusters. | 2.4.2 |
| BUG-52193 | RANGER-798 | Ranger | Ranger "Access > Audit" not showing anything with Source "Solr" due to Time filter Issue (GMT). | 2.4.2 |
| BUG-52636 | STORM-1521 | Storm | Kerberos login from keytab with multiple bolts/executors ticket is not renewed for HBase Bolt. | 2.4.2 |
| BUG-53766 | STORM-1535 | Storm | Storm-HDFS - When using keytab, Kerberos ticket is not renewed with multiple bolts/executors. | 2.4.2 |
| BUG-55917 | STORM-1711 | Storm | HiveUtils.authenticate reuses current UGI, mixes up principles in use. | 2.3.6 |
| BUG-57857 | STORM-721 | Storm | Storm UI server should support SSL. | 2.3.6 |
Incorrect Results
|
Hortonworks Bug ID |
Apache JIRA |
Apache Component |
Summary | Source |
|---|---|---|---|---|
| BUG-50338 | Hive | NULL table comparison within CASE does not work as previous Hive versions. | 2.3.6 | |
| BUG-52194 | RANGER-798 | Ranger | Ranger "Access > Audit" not showing anything with Source "Solr" due to Time filter Issue (GMT). | 2.3.6 |
| BUG-53374 | HADOOP-12716 | HDFS | KerberosAuthenticator#doSpnegoSequence use incorrect class to determine isKeyTab in JDK8. | 2.3.6 |
| BUG-53777 | PIG-4690 | Pig | Pig on TEZ creates wrong result with replicated join. | 2.4.2 |
| BUG-53918 | PHOENIX-2601 | Phoenix | Query result is incorrect when both index hint and limit are used. | 2.4.2 |
| BUG-53927 | HIVE-13330 | Hive | Vectorization returns NULL for empty values for varchar/string data type. | 2.4.2 |
| BUG-54492 | HIVE-12165 | Hive | Wrong result when hive.optimize.sampling.orderby=true with some aggregate functions. | 2.3.6 |
| BUG-55552 | HIVE-13200 | Hive | Aggregation functions returning empty rows on partitioned columns. | 2.3.6 |
| BUG-55811 | HIVE-13242 | Hive | DISTINCT keyword is dropped by the parser for windowing. | 2.3.6 |
| BUG-56283 | HIVE-12768 | Hive | Tez various wrong results with map <- (map , reduce) join on decimal query. | 2.3.6 |
| BUG-56434 | MAPREDUCE-6680 | MapReduce | JHS directory scan issues on AzureFileSystem due to time inaccurate. | 2.3.6 |
| BUG-57030 | PHOENIX-2876 | Phoenix | Phoenix ORDER BY clause does not work if the ORDER BY column is not present in the Select clause. | 2.3.6 |
| BUG-57038 | RANGER-893 | Ranger | Ranger ugsync with LDAP is not able to fetch group information. | 2.3.6 |
| BUG-58985 | HIVE-13602 | Hive | TPCH q16 return wrong result when CBO is on. | 2.3.6 |
| BUG-59049 | Ranger | Ranger UI : policy status search is not working on policy listing page. | 2.3.6 |
Stability
|
Hortonworks Bug ID |
Apache JIRA |
Apache Component |
Summary | Source |
|---|---|---|---|---|
| BUG-18218 | YARN-3846 | YARN | Scheduler queue filter failed to work because index of queue column changed. | 2.3.6 |
| BUG-41224 | Hue | Workaround Hiveserver2 memory Leak. | 2.4.0 | |
| BUG-41311 | HDFS-9917 | HDFS | NameNode quickly runs out of memory at start due to queued incremental block reports. | 2.3.6 |
| BUG-43129 | Hive | ACID update/delete query fails with ArrayIndexOutOfBoundsException when there is null struct. | 2.3.6 | |
| BUG-46394 | Hive | Hiveserver2 error seen after upgrade. | 2.3.6 | |
| BUG-47626 | HBase, Hive, Phoenix | Creating Hive table on HBase fails in HDP 2.3.x with Phoenix Dependencies. | 2.3.6 | |
| BUG-48217 | YARN-4325 | YARN | After restarting Yarn services, applications stays in ACCEPTED state. | 2.3.6 |
| BUG-49345 | Hive | Tez queries stopped running - ApplicationNotFoundException. | 2.3.6 | |
| BUG-49788 | HBASE-14968 | Phoenix | Altering session consistency blocks SYSTEM.CATALOG table. | 2.3.6 |
| BUG-49898 | HIVE-12684 | Hive | Autoquerygen tests failing in secure runs. | 2.3.6 |
| BUG-50148 | HIVE-12660 | Hive | HS2 memory leak with .hiverc file use. | 2.3.6 |
| BUG-50215 | FALCON-1595 | Falcon | In secure cluster, Falcon server loses ability to communicate with HDFS over time. | 2.4.0 |
| BUG-50410 | HBASE-14987 | HBase | Compaction marker whose region name doesn't match current region's needs to be handled. | 2.3.6 |
| BUG-51034 | HIVE-11097 | Hive | MR mode query fails if one table path string starts with another's. | 2.3.6 |
| BUG-51454 | HBASE-14471 | HBase | Thrift - HTTP Error 413 full HEAD if using Kerberos authentication. | 2.3.6 |
| BUG-51829 | YARN-4820 | YARN | ResourceManager JMX Redirects in HA Mode Drops the Query Parameters. | 2.4.2 |
| BUG-52310 | HBASE-14347 | HBase | Add a switch to DynamicClassLoader to disable it. | 2.3.6 |
| BUG-52418 | YARN-4680 | YARN | TimerTasks leak in ATS V1.5 Writer. | 2.3.6 |
| BUG-52479 | Phoenix | Phoenix-Spark integration inoperative in HDP 2.3.4. | 2.4.2 | |
| BUG-52780 | PHOENIX-2667 | Phoenix | Race condition between IndexBuilder and Split for region lock. | 2.3.6 |
| BUG-52957 | PHOENIX-2295 | Phoenix | NullPointerException when parsing a query with hints in UNION ALL. | 2.4.2 |
| BUG-53482 | PIG-4814 | Pig | AvroStorage does not take NameNode HA as part of schema file URL. | 2.4.2 |
| BUG-53499 | PIG-4790 | Pig | Cannot use values iterator on the previous K-V pair after moveToNext has been invoked to move to the next K-V. | 2.4.2 |
| BUG-54199 | PHOENIX-2616 | Phoenix | Indexes over immutable tables not marked as immutable. | 2.4.2 |
| BUG-54603 | TEZ-3114 | Tez | .Shuffle OOM due to EventMetaData flood. | 2.3.6 |
| BUG-54650 | KNOX-695 | Knox | Intermittent java.net.ConnectException: Connection timed out between Knox server and Hiveserver2. | 2.4.2 |
| BUG-54713 | STORM-1689 | Storm | Large request header causes 413 ERROR when accessing Storm Logviewer. | 2.4.2 |
| BUG-55235 | HIVE-10729 | Hive | Query failed when select complex columns from joined table (Tez map join only). | 2.3.6 |
| BUG-55895 | PIG-4873 | Pig | Pig job fails with Backend error : java.lang.NullPointerException. | 2.3.6 |
| BUG-56083 | HIVE-13394 | Hive | Analyze table fails in Tez on empty partitions/files/tables. | 2.3.6 |
| BUG-56423 | HDFS-10312 | HDFS | NameNode is stuck at SafeMode due to not all data blocks validated. | 2.3.6 |
| BUG-56577 | Accumulo, HDFS | KMS SPNEGO sequence does not work with WEBHDFS and KMS connection failures should trigger TGT renewal. | 2.3.6 | |
| BUG-56919 | YARN-2910 | YARN | FSLeafQueue can throw ConcurrentModificationException. | 2.3.6 |
| BUG-57460 | HBase, Phoenix | Invalid MemStore state during close of region for Phoenix table. | 2.3.6 | |
| BUG-57513 | HDFS | BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages. | 2.3.6 | |
| BUG-57653 | HIVE-13051 | Hive, Hive2 | Deadline class has numerous issues. | 2.3.6 |
| BUG-57732 | HBase | MasterProcWALs never clean up. | 2.3.6 | |
| BUG-57814 | HBASE-13318 | HBase | RpcServer.getListenerAddress should handle when the accept channel is closed. | 2.3.6 |
| BUG-57906 | HBASE-14460 | HBase | Regression for CheckAndPut and Increment updates. | 2.3.6 |
| BUG-57907 | PHOENIX-2892 | HBase | Scan for pre-warming the block cache for 2ndary index should be removed. | 2.3.6 |
| BUG-58254 | HBASE-15811 | HBase | Batch Get after batch Put does not fetch all Cells. | 2.3.6 |
| BUG-59089 | HIVE-13592 | Hive | Metastore calls map is not thread safe. | 2.3.6 |
Query Failure
|
Hortonworks Bug ID |
Apache JIRA |
Apache Component |
Summary | Source |
|---|---|---|---|---|
|
BUG-54388 BUG-51701 BUG-53494 | MAPREDUCE-6635 | MapReduce, Tez | java.lang.IndexOutOfBoundsException running select count(*) query on table with skip.header.line.count. | 2.4.2 |
Upgrade
|
Hortonworks Bug ID |
Apache JIRA |
Apache Component |
Summary | Source |
|---|---|---|---|---|
| BUG-53878 | Kafka | Running bin/kafka-console-consumer.sh outputs "No brokers found in ZK". Script modified to address this issue. | 2.4.2 | |
| BUG-54155 | RANGER-882 | Ranger | Ranger policy engine initialization failure caused NameNode startup to fail. | 2.4.2 |
| BUG-55263 | Storm | Storm Nimbus error: "Could not find leader nimbus from seed hosts". | 2.3.6 |
Usability
|
Hortonworks Bug ID |
Apache JIRA |
Apache Component |
Summary | Source |
|---|---|---|---|---|
| BUG-47662 | RANGER-218 | Ranger | UserSync - group sync is marked as INTERNAL even if the group is synced from LDAP. | 2.4.2 |
| BUG-48573 | OOZIE-2322 | Oozie | Oozie Web UI doesn't work with Kerberos in Internet Explorer 10 or 11 and curl. | 2.4.2 |
| BUG-49428 | HBASE-13153 | HBase | Bulk Loaded HFile Replication. | 2.3.6 |
| BUG-50576 | SQOOP-2779 | Sqoop | Sqoop Metastore doesn't seem to recognize --schema option. | 2.3.6 |
| BUG-52257 | FALCON-1315 | Falcon | Falcon UI Hive mirroring : Unable to provide security credentials. | 2.4.2 |
| BUG-52260 | SQOOP-2737 | Sqoop | Cannot import table from Oracle with column with spaces in name. | 2.4.2 |
| BUG-52702 | SQOOP-2779 | Sqoop | Sqoop Metastore doesn't seem to recognize --schema option. | 2.4.2 |
| BUG-52951 | FALCON-1647 | Falcon | Unable to create feed : FilePermission error under cluster staging directory. | 2.4.2 |
| BUG-54681 | RANGER-889 | Ranger | Create new method for partners to use for integration. | 2.4.2 |
| BUG-55216 | FALCON-748 | Falcon | Falcon webUI return 413 error when SSL is enabled. | 2.4.2 |
| BUG-58351 | OOZIE-2112 | Hive, Oozie, Tez | Empty ‘ExternalChildID’ returned when using Hive Action in Oozie. | 2.3.6 |
| BUG-58450 | PHOENIX-2568 | Flume, Hive, Phoenix | Flume dependency of Phoenix is bringing in an old version of Thrift (0.7.0). | 2.3.6 |
Performance
|
Hortonworks Bug ID |
Apache JIRA |
Apache Component |
Summary | Source |
|---|---|---|---|---|
| BUG-42479 | HBASE-14575 | HBase | Relax region read lock for compactions. | 2.4.0 |
| BUG-49426 | HBASE-14606 | HBase | TestSecureLoadIncrementalHFiles tests timed out in trunk build on Apache. | 2.3.6 |
| BUG-49427 | HBASE-14604 | HBase | Improve MoveCostFunction in StochasticLoadBalancer. | 2.3.6 |
| BUG-50147 | HBASE-15014 | HBase | Fix slow filterCellByStore in WALsplitter. | 2.3.6 |
| BUG-52708 | RANGER-809 | Ranger | Remove reference to getLocalHost() call from Audit code to avoid performance impact. | 2.4.2 |
| BUG-52729 | RANGER-821 | Ranger | NameNode shutdown hangs due to Ranger HDFS plugin. | 2.4.2 |
| BUG-53028 | Ranger | Policy download optimizations. | 2.4.2 | |
| BUG-53657 | HDFS-9710 | HDFS | Change DN to send block receipt IBRs in batches. | 2.3.6 |
| BUG-53757 | Hive, Hive2 | Stats are not properly accounted for when multiple COUNT(DISTINCT) are in the query. | 2.3.6 | |
| BUG-55291 | HDFS-10223 | HDFS | peerFromSocketAndKey performs SASL exchange before setting connection timeouts. | 2.3.6 |
| BUG-56776 | MapReduce | MR job can infinitely increase number of reducer resource requests and job hangs as ask is not updated after ramping down of all reducers. | 2.3.6 | |
| BUG-56869 | HDFS-9902 | HDFS | Support different values of dfs.datanode.du.reserved per storage-type. | 2.3.6 |
Other
|
Hortonworks Bug ID |
Apache JIRA |
Apache Component |
Summary | Source |
|---|---|---|---|---|
| BUG-50101 | Hadoop Common | Remove ivy jar from hadoop-lzo source code. | 2.4.0 | |
| BUG-51738 | HBASE-15147 | HBase | Backport HBASE-15147: Shell should use Admin.listTableNames() instead of Admin.listTables(). | 2.4.2 |
| BUG-53095 | HADOOP-12825 | Hadoop Common | Log slow name resolutions. | 2.4.2 |
| BUG-53390 | HADOOP-12794 | Hadoop Common | Support additional compression levels for GzipCodec | 2.3.6 |
| BUG-53871 | HBASE-15128 | HBase | Disable region splits and merges switch in master. | 2.4.2 |
| BUG-54764 | MAPREDUCE-6436 | MapReduce | JobHistoryServer cache issues. | 2.4.2 |
| BUG-56772 | HDFS, Ranger | NameNode went down on the production cluster. | 2.3.6 | |
| BUG-57450 | HUE-2880 | Hue | Failure when uploading large files to a kerberized HTTPFS. | 2.3.6 |