The following features and fixes were contributed back to Apache with the release of HDP 2.2.9:
Incorrect Results
| Hortonworks Bug ID | Apache JIRA | Component | Summary |
|---|---|---|---|
| BUG-41313 | Hive | Hive temporary macro with variable inputs returning incorrect results | |
| BUG-42916 | HIVE-11606 | Hive | Bucket mapjoin error "capacity must be power of two" when #rows < #buckets |
| BUG-43169 | Hive | Hive + Tez: map side join giving different query results | |
| BUG-44538 | HBase | ExportSnapshot does not honor -chuser, -chgroup, -chmod options | |
| BUG-44924 | Hive | SMB Join query not returning proper results | |
| BUG-45117 | HIVE-11132 | Hive | BackPort - wrong results: non-mapjoin with auto.convert.join.noconditionaltask=false and hive.optimize.reducededuplication=true wrong plan for join followed with group by |
| BUG-45656 | Hive | Correctness: Wrong results when using a not exists subquery with CBO off | |
| BUG-45723 | Phoenix | org.apache.phoenix.schema.TypeMismatchException Error while querying a table that has an index with a Boolean |
Other
| Hortonworks Bug ID | Apache JIRA | Component | Summary |
|---|---|---|---|
| BUG-43228 | HDFS-8885 | HDFS | ByteRangeInputStream used in webhdfs does not override available() |
| BUG-44034 | HDFS-9112 | HDFS | After implementing distcp between two HA clusters, the HDFS haadmin commands do not work - Unable to determine the nameservice id. |
| BUG-44480 | HDFS-9082 | HDFS | Change the log level in WebHdfsFileSystem.initialize() from INFO to DEBUG |
Performance
| Hortonworks Bug ID | Apache JIRA | Component | Summary |
|---|---|---|---|
| BUG-38575 | Hive | Join on partition columns plan should know column stats without having to compute them, unreasonable estimate on partition stats may disable dynamic partition pruning | |
| BUG-43027 | HBase | Have metrics for blockcache take into account replicas | |
| BUG-43071 | HIVE-9223 | Hive, Hue | HS2/hue/tez: multiple concurrent queries not allowed in single tez session |
| BUG-43268 | HIVE-10651 | Hive | OrcProto$StripeStatistics cache grows causing severe GC in Application master |
| BUG-44683 | PIG-4679 | Pig | Drastic performance degradation due to InputSizeReducerEstimator |
| BUG-45735 | Phoenix | Index HINT not forcing the usage of secondary Index | |
| BUG-46376 | Hive | Vectorization Udf: GenericUDFOPGreaterThan, is not supported | |
| BUG-46749 | HDFS | Allow block reports to be processed during checkpointing on standby name node |
Potential Data Loss
None.
Query Failure
None.
Security
| Hortonworks Bug ID | Apache JIRA | Component | Summary |
|---|---|---|---|
| BUG-28778 | HIVE-9013 | Hive | Beeline (hiveserver2 client) exposes sensitive metastore DB connection info (connection, password) |
| BUG-36587 | HBASE-12366 | HBase | Add login code to HBase Canary tool |
| BUG-43224 | HDFS-8155 | HDFS | Support OAuth2 in WebHDFS |
| BUG-43238 | HIVE-10528 | Hive | Hiveserver2 in HTTP mode is not applying auth_to_local rules |
| BUG-44889 | Ranger | Implement X-Frame-Option header | |
| BUG-44891 | Ranger | Implement best practices for authentication cookies | |
| BUG-45430 | HDFS-9175 | HDFS | Change scope of 'AccessTokenProvider.getAccessToken()' and 'CredentialBasedAccessTokenProvider.getCredential()' abstract methods to public |
| BUG-46555 | Ranger | Restrict group and role data for only ADMIN users |
Stability
| Hortonworks Bug ID | Apache JIRA | Component | Summary |
|---|---|---|---|
| BUG-28507 | Ranger | Add timeout for connection settings | |
| BUG-31129 | YARN-3145 | YARN | java.sql.SQLException: Error while processing statement: FAILED: Hive Internal Error: java.util.ConcurrentModificationException |
| BUG-37456 | Ranger | Ambari's treatment of ranger-admin setup.sh can corrupt security-applicationContext.xml | |
| BUG-40689 | HIVE-11193 | Hive | Query plan fails, tez dynamic partiton pruning "fail to find child from parent " in this case (left outer join union all with constant on different data types) |
| BUG-41828 | HIVE-11408 | Hive | Hiveserver2 failing with OOM PermGen when using temporary functions due to Hadoop reflections utils caching classloaders |
| BUG-42203 | HIVE-11499 | Hive | Hiveserver2 failing with OOM PermGen when using temporary functions due to DataNucleus caching classloaders |
| BUG-43221 | TEZ-2745 | Tez | ClassNotFound in InputInitializer causes AM to crash |
| BUG-43226 | HDFS-8435 | HDFS | Support CreateFlag in WebHDFS |
| BUG-43543 | HBASE-14309 | HBase | Allow load balancer to operate when there is region in transition by adding force flag |
| BUG-43604 | Hive | Exception in FileSink when num_bucket > num_reducer | |
| BUG-43658 | HDFS-8995 | HDFS | Flaw in registration bookeeping can make DN die on reconnect |
| BUG-43895 | HDFS-8797 | HDFS | WebHdfsFileSystem creates too many connections for position read |
| BUG-43986 | HBASE-12635 | HBase | Delete acl notify znode of table after the table is deleted |
| BUG-44099 | Hive | Hiveserver2 failing with OOM PermGen when use temporary functions due to Hadoop ReflectionUtils caching classloaders | |
| BUG-44212 | HIVE-12084 | Hive | Hive queries with ORDER BY & large LIMIT or PTF order by high cadinality fails with OutOfMemoryError Java heap space |
| BUG-44257 | YARN-3896 | YARN | Node Manager processes becomes unresponsive after RM restart |
| BUG-44260 | HBASE-14412 | HBase | Removing HBase cross cluster replication peer id containing hyphen "-" doesn't seem to remove all the related entries from ZooKeeper |
| BUG-44503 | KNOX-598 | Knox | Concurrent JDBC clients via KNOX to Kerberized HiveServer2 - causes HTTP 401 error (due to Kerberos Replay attack error) |
| BUG-44722 | Storm | Worker on one machine crashes due to a failure of another worker on another machine | |
| BUG-44937 | HBASE-12464 | HBase | Meta table region assignment stuck in the FAILED_OPEN state due to region server not fully ready to serve |
| BUG-44943 | Hive | Tez queries stopped running - ApplicationNotFoundException | |
| BUG-45049 | HIVE-7049 | Hive | Error: java.io.IOException: org.apache.avro.AvroTypeException: Found string, expecting union (state=,code=0) |
| BUG-45083 | HIVE-10752 | HCatalog, Pig | More than 66 columns breaks MR but not tez (Pig HCat) |
| BUG-45098 | HIVE-11960 | Hive | Hive query parse issue |
| BUG-45215 | HADOOP-12089 | Hadoop Common | StorageException complaining "no lease ID" when updating FolderLastModifiedTime in WASB |
| BUG-45216 | HADOOP-12239 | Hadoop Common | StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB |
| BUG-45465 | HIVE-11977 | Hive | Hive should handle an external avro table with zero length files present |
| BUG-45954 | HBase | Cache configuration and RpcController selection for Table in Connection | |
| BUG-46165 | HBASE-14207 | HBase | Region was hijacked and remained in transition when RS failed to open a region and later regionplan changed to new RS on retry |
| BUG-46166 | HBASE-14361 | HBase | ReplicationSink should create Connection instances lazily |
| BUG-46327 | YARN-2910 | YARN | FSLeafQueue can throw ConcurrentModificationException |
| BUG-46587 | Ranger | Prevent thread exhaustion in Ranger due to badly configured service connection | |
| BUG-47098 | HDFS-8626 | HDFS | Reserved RBW space is not released if creation of RBW File fails |
Upgrade
None.
Usability
| Hortonworks Bug ID | Apache JIRA | Component | Summary |
|---|---|---|---|
| BUG-30784 | ZOOKEEPER-1952 | Zookeeper | zookeeper.log.file property is not respected; log output goes only to the zookeeper.out |
| BUG-43350 | Ranger | Ranger Installation fails due to missing ojdbc.jar in CLASSPATH for ambari 2.1.0 | |
| BUG-43403 | HIVE-11581 | Hive | HS2 url parameters should be stored in zookeeper |
| BUG-43465 | Hive | Hive "SLF4J: Class path contains multiple SLF4J bindings." error | |
| BUG-43603 | HIVE-12262 | Hive | hive does not translate ${system:java.io.tmpdir}/${system:user.name}/operation_logs properly |
| BUG-43766 | HDFS-8180 | HDFS | AbstractFileSystem Implementation for WebHDFS |
| BUG-43799 | HDFS-8542 | HDFS | WebHDFS getHomeDirectory behavior does not match specification |
| BUG-45263 | HADOOP-12437 | HDFS | HDFS and YARN configs for Keberized Dual Homing |
| BUG-45360 | HBASE-14594 | HBase | HBase configs for Kerberized Dual Homing |
| BUG-45675 | Ranger | Allow special characters in passwords for manual install of Ranger | |
| BUG-45721 | HADOOP-12350 | Hadoop Common | WASB Logging: Improve WASB Logging around deletes, reads and writes |
| RMP-3882 | RANGER-684 | Ranger | Mapping of Ranger AD usersync groups to Linux AD groups |
