The following features and fixes were contributed back to Apache with the release of HDP 2.3.4.
Potential Data Loss
None.
Security
|
Hortonworks Bug ID |
Apache JIRA |
Component |
Summary |
|---|---|---|---|
| BUG-28778 | HIVE-9013 | Hive | Hive set command exposes metastore db password |
| BUG-35952 | RANGER-680 | Ranger | Default policies for KMS repo |
| BUG-45035 | RANGER-661 | Ranger | Plugin receives empty policy list though the service has policies |
| BUG-45039 | RANGER-663 | Ranger | Race condition during policy update causes policy to get in an bad state |
| BUG-45431 | HDFS-9175 | HDFS | Change scope of 'AccessTokenProvider.getAccessToken()' and 'CredentialBasedAccessTokenProvider.getCredential()' abstract methods to public |
| BUG-45489 | HIVE-11995 | Hive | Remove repetitively setting permissions in insert/load overwrite partition |
| BUG-46149 | HIVE-10528 | Hive | Hiveserver2 in HTTP mode is not applying auth_to_local rules |
| BUG-46556 | RANGER-714 | Ranger | Restrict group and role data for only ADMIN users |
| BUG-47553 | RANGER-608 | Ranger | Denied access to HDFS file/directory is not audited in Ranger |
| BUG-47606 | RANGER-749 | Ranger | Ranger KMS to support multiple KMS instances with keys across multiple clusters |
| BUG-47823 | HADOOP-12049 | Hadoop Common | Control http authentication cookie persistence via configuration. HADOOP-12049 introduces a new configuration setting to control the persistence of the HTTP cookie passed to the client during authentication with Hadoop HTTP consoles. |
| BUG-49158 | HADOOP-12617 | Hadoop Common | SPNEGO authentication request to non-default realm gets default realm name inserted in target server principal |
Incorrect Results
|
Hortonworks Bug ID |
Apache JIRA |
Component |
Summary |
|---|---|---|---|
| BUG-41313 | HIVE-11432 | Hive | Hive macro give same result for different arguments |
| BUG-44378 | RANGER-657 | Ranger | Ranger-Solr: Issue with Mapping Principals to usernames "solr" |
| BUG-44489 | HIVE-11892 | Hive | UDTF run in local fetch task does not return rows forwarded during GenericUDTF.close() |
| BUG-44539 | SQOOP-2399 | Sqoop | Sqoop import into Hbase - BigDecimalSplitter java.lang.ArrayIndexOutOfBoundsException |
| BUG-45496 | HIVE-11517 | Hive | Vectorized auto_smb_mapjoin_14.q produces different results |
| BUG-46167 | PHOENIX-2313 | Phoenix | org.apache.phoenix.schema.TypeMismatchException Error while querying a table that has an index with a Boolean |
| BUG-46507 | HIVE-12230 | Hive | custom UDF configure() not called in Vectorization mode |
| BUG-47209 | Ranger | check_db_connnection in Ambari setup_ranger.py does not properly escape before passing to shell |
Stability
|
Hortonworks Bug ID |
Apache JIRA |
Component |
Summary |
|---|---|---|---|
| BUG-26978 | HDFS-6481 | HDFS | DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs |
| BUG-27659 | HIVE-12556 | Hive | Ctrl-C in beeline doesn't kill Tez query on HS2 |
| BUG-30068 | HIVE-12444 | Hive | Global Limit optimization on ACID table without base directory may throw exception |
| BUG-42203 | HIVE-11499 | Hive | Datanucleus leaks classloaders when used using embedded metastore with HiveServer2 with UDFs |
| BUG-42415 | HIVE-11422 | Hive | Join a ACID table with non-ACID table fail with MR |
| BUG-43592 | HIVE-12204 | Hive | Tez queries stopped running with ApplicationNotRunningException |
| BUG-43603 | HIVE-12262 | Hive | Session log dir cannot be created in some cases |
| BUG-44212 | HIVE-12084 | Hive | Hive queries with ORDER BY and large LIMIT fails with OutOfMemoryError Java heap space |
| BUG-44549 | PHOENIX-2118 | Phoenix | Remove/modfiy usages of Guava StopWatch and deprecated ComparisonChain methods |
| BUG-45090 | ZOOKEEPER-1952 | Zookeeper | zookeeper.log.file property is not respected; log output goes only to the zookeeper.out |
| BUG-45179 | PIG-4635 | Pig, Tez | Pig 0.15 on Tez 0.7 NPE |
| BUG-45238 | HADOOP-12089 | Hadoop Common | StorageException complaining "no lease ID" when updating FolderLastModifiedTime in WASB |
| BUG-45240 | HADOOP-12239 | Hadoop Common | StorageException complaining "no lease ID" when updating FolderLastModifiedTime in WASB |
| BUG-45361 | HBASE-14594 | HBase | Use new DNS API introduced in HADOOP-12437 |
| BUG-45465 | HIVE-11977 | Hive | Hive should handle an external avro table with zero length files present |
| BUG-45717 | STORM-1030 | Storm | Synchronization error between HiveBolt and heartbeat thread causing missed HiveWriter |
| BUG-45943 | HBASE-14207 | HBase | Region was hijacked and remained in transition when RS failed to open a region and later regionplan changed to new RS on retry |
| BUG-45952 | HBASE-14317 | HBase | Stuck FSHLog: bad disk (HDFS-8960) and can't roll WAL |
| BUG-45955 | HBASE-14361 | HBase | ReplicationSink should create Connection instances lazily |
| BUG-46328 | YARN-2910 | YARN | FSLeafQueue can throw ConcurrentModificationException |
| BUG-46607 | HADOOP-12484 | Hadoop Common | Single File Rename Throws Incorrectly In Potential Race Condition Scenarios |
| BUG-47136 | HADOOP-11685 | Hadoop Common | StorageException complaining "no lease ID" during HBase distributed log splitting |
| BUG-47179 | HADOOP-12508 | Hadoop Common | Delete fails with exception when lease is held on blob |
| BUG-47180 | HADOOP-12533 | Hadoop Common | Introduce FileNotFoundException in WASB for read and seek API |
| BUG-47480 | FALCON-1595 | Falcon | Falcon server loses ability to communicate with HDFS over time |
| BUG-47483 | HIVE-11698 | Hive | Add additional test for PointLookupOptimizer |
| BUG-47563 | HIVE-12364 | Hive | Distcp job fails when run under Tez |
| BUG-47757 | HIVE-12156 | Hive, Hive View | expanding view doesn't quote reserved keyword |
| BUG-47910 | HIVE-12250 | Hive | Zookeeper connection leaks in Hive's HBaseHandler. |
| BUG-48437 | HIVE-12476 | Hive | Metastore NPE on Oracle with Direct SQL |
| BUG-49159 | STORM-1030 | Storm | Storm HiveBolt sendHeartBeat flag is set to false after connectivity is lost with Hive database, causing heartbeats to stop until worker is restarted |
Query Failure
None.
Upgrade
|
Hortonworks Bug ID |
Apache JIRA |
Component |
Summary |
|---|---|---|---|
| BUG-44874 | RANGER-677 | Ranger | After upgrade, Ranger Admin fails to render policies referring to groups that contain "." in name |
| BUG-44884 | RANGER-706 | Ranger | 2.2 to 2.3 upgrade timeout while migrating Ranger |
Usability
|
Hortonworks Bug ID |
Apache JIRA |
Component |
Summary |
|---|---|---|---|
| BUG-43333 | YARN-4009, YARN-2513 | Tez, YARN | Functional standalone UI (hosted in ATS) for Tez |
| BUG-43578 | HIVE-11919 | Hive | Hive Union Type Mismatch |
| BUG-44481 | HDFS-9082 | HDFS | Change the log level in WebHdfsFileSystem.initialize() from INFO to DEBUG |
| BUG-44568 | YARN-291, YARN-313 | YARN | Support NM resource dynamic reconfiguration with CLI. |
| BUG-45264 | HADOOP-12437 | HDFS | HDFS and YARN configs for Keberized Dual Homing |
| BUG-45569 | HIVE-12235 | Hive | Improve beeline logging for dynamic service discovery |
| BUG-45583 | HIVE-11960 | Hive | braces in join conditions are not supported |
| BUG-45722 | HADOOP-12350 | Hadoop Common | WASB Logging: Improve WASB Logging around deletes, reads and writes |
| BUG-47306 | RANGER-712 | Ranger | Add a samples project to Ranger to enable clients and VARs to write extensions to Ranger |
| BUG-47475 | HIVE-10592 | Hive | ORC file dump in JSON format |
| BUG-48014 | HDFS-8829 | HDFS | Make SO_RCVBUF and SO_SNDBUF size configurable for DataTransferProtocol sockets and allow configuring auto-tuning |
| BUG-48022 | STORM-1203 | Storm | Worker metadata file creation doesn't use storm.log.dir config |
| BUG-48187 | MAPREDUCE-6478 | MapReduce | Add an option to skip cleanupJob stage or ignore cleanup failure during commitJob(). |
Performance
|
Hortonworks Bug ID |
Apache JIRA |
Component |
Summary |
|---|---|---|---|
| BUG-44879 | RANGER-681 | Ranger | Usersync interval between cycles is set to 1ms |
| BUG-46319 | PIG-4703 | Pig | TezOperator.stores shall not ship to backend |
| BUG-47415 | HIVE-12354 | Hive | MapJoin with double keys is slow on MR |
| BUG-47481 | HIVE-11461 | Hive | Transform flat AND/OR into IN struct clause |
| BUG-47485 | HIVE-11573 | Hive | PointLookupOptimizer can be pessimistic at a low nDV |
| BUG-47904 | HIVE-12312 | Hive | Excessive logging in PPD code |
Other
|
Hortonworks Bug ID |
Apache JIRA |
Component |
Summary |
|---|---|---|---|
| BUG-44329 | HDFS-9063 | HDFS | HDFS - Correctly handle snapshot path for getContentSummary |
| BUG-44544 | HADOOP-11098 | Hadoop Common | Max Non Heap Memory default changed between JDK7 and 8 |
| BUG-45083 | HIVE-10752 | HCatalog, Pig | Pig scripts that involve more than 66 columns return null results when MapReduce is the execution engine. |
| BUG-47431 | HADOOP-12334 | Hadoop Common | Change Mode Of Copy Operation of HBase WAL Archiving to bypass Azure Storage Throttling after retries |
| BUG-47612 | HADOOP-12551 | Hadoop Common | Introduce FileNotFoundException for open and getFileStatus API's in WASB |
| BUG-47731 | HDFS-8099 | HDFS | Change "DFSInputStream has been closed already" message to debug log level |
| BUG-47820 | HBASE-14788 | HBase | Splitting a region does not support the hbase.rs.evictblocksonclose config when closing source region |
| BUG-49167 | HDFS-9434 | HDFS | Recommission a datanode with 500k blocks may pause NN for 30 seconds |
| BUG-49324 | HDFS-9397 | HDFS | Fix typo for readChecksum() LOG.warn in BlockSender.java |
| BUG-49952 | YARN | Backport YARN-3604/YARN-3987 to 2.3-maint |
