The following features and fixes were contributed back to Apache with the release of HDP 2.3.2.
Potential Data Loss
|
Component |
Hortonworks Bug ID |
Apache JIRA |
Summary |
|---|---|---|---|
| Hive | BUG-42935 | HIVE-11607 | Fix and backport HIVE-11607 for 2.3-maint (Export tables broken for data > 32 MB) |
| Storm | BUG-42792 | STORM-960 | While using a storm/hive/bolt to populate an ACID ORC table, it causes data loss and scan jobs fails with 'java.io.EOFException' error |
Security
|
Component |
Hortonworks Bug ID |
Apache JIRA |
Summary |
|---|---|---|---|
| HDFS | BUG-43223 | HDFS-8155 | Support OAuth2 in WebHDFS |
Incorrect Results
|
Component |
Hortonworks Bug ID |
Apache JIRA |
Summary |
|---|---|---|---|
| Hive | BUG-44508 | HIVE-11839 | Vectorization wrong results with filter of (CAST AS CHAR) |
| Hive | BUG-43168 | HIVE-11605 | Hive + Tez: map side join giving different query results |
| Knox | BUG-44504 | KNOX-598 | Concurrent JDBC clients via KNOX to Kerberized HiveServer2 - causes HTTP 401 error (due to Kerberos Replay attack error) |
| Ranger | BUG-43030 | RANGER-615 | Exceptions related to XA secure audit record - cloned for Grainger |
Stability
|
Component |
Hortonworks Bug ID |
Apache JIRA |
Summary |
|---|---|---|---|
| Falcon | BUG-40941 | FALCON-1373 | Hive DR not work on destination cluster |
| HBase | BUG-42155 | HBASE-14196 | Thrift server connection idle timeout issue |
| HCatalog, Hive | BUG-41418 | HIVE-11317 | ACID: Improve transaction Abort logic due to timeout |
| HDFS | BUG-43896 | HDFS-8797 | WebHdfsFileSystem creates too many connections for pread |
| HDFS | BUG-43306 | HDFS-8809 | HDFS fsck reports under construction blocks as "CORRUPT" |
| HDFS | BUG-43657 | HDFS-8995 | Flaw in registration bookeeping can make DN die on reconnect |
| Hive | BUG-34774 | HIVE-10231 | Compute partition column stats fails if partition col type is date |
| Hive | BUG-43270 | HIVE-10651 | ORC : OrcProto$StripeStatistics cache grows causing severe GC in Application master |
| Sqoop | BUG-41537 | SQOOP-2387 | NPE during sqoop import when column contains a special character |
| Storm | BUG-41546 | STORM-951 | Storm Hive Bolt leaking a transaction for every txnBatch |
| Tez | BUG-43220 | TEZ-2745 | ClassNotFound in InputInitializer causes AM to crash |
| YARN | BUG-41417 | YARN-2019 | RM crashes with FATAL error STATE_STORE_OP_FAILED |
Query Failure
|
Component |
Hortonworks Bug ID |
Apache JIRA |
Summary |
|---|---|---|---|
| Hive | BUG-44673 | HIVE-11193 | query plan fails, tez dynamic partiton pruning "fail to find child from parent " in this case (left outer join union all with constant on different data types) |
| Hive | BUG-43315 | HIVE-11344 | While reading table using hive hcatalog api throws null pointer exception. |
| Hive | BUG-42919 | HIVE-11606 | bucket mapjoin error "capacity must be power of two" when #rows < #buckets |
| Hive, Tez | BUG-41584 | HIVE-11356 | Error thrown when Empty tables and SMB (OUTER) JOINs are used |
Upgrade
None.
Usability
|
Component |
Hortonworks Bug ID |
Apache JIRA |
Summary |
|---|---|---|---|
| HDFS | BUG-43767 | HDFS-8180 | AbstractFileSystem Implementation for WebHdfs |
| HDFS | BUG-43225 | HDFS-8435 | Support CreateFlag in WebHdfs |
| Hive | BUG-43159 | HIVE-11581 | HS2 url parameters should be stored in zookeeper |
| Hive | BUG-42834 | HIVE-11658 | Load data inpath fails with SemanticException when used with ORC files |
| Phoenix | BUG-43284 | Phoenix-2031 | Unable to process timestamp data loaded via Phoenix org.apache.phoenix.pig.PhoenixHBaseLoader |
| Phoenix | BUG-41321 | Phoenix-1659 | Backport Phoenix-1659 to Dal maintenance |
| Ranger | BUG-43276 | RANGER-628 | RangerAuthenticationProvider is using anonymous bind for search when credentials are specified |
| Ranger | BUG-43313 | RANGER-638 | Ranger admin should redirect back to login page when login cookies are no longer valid |
| Storm | BUG-41859 | STORM-512 | KafkaBolt doesn't handle ticks properly |
| Storm | BUG-43462 | STORM-833, STORM-848 | Build same version of slf4j-api and log4j-over-slf4j |
| Storm | BUG-43141 | STORM-848 | Clean up dependencies and shade as much as possible |
| Storm | BUG-42794 | STORM-938 | Add an option to the storm hive-bolt to flush at a certain interval |
Performance
|
Component |
Hortonworks Bug ID |
Apache JIRA |
Summary |
|---|---|---|---|
| HDFS | BUG-42941 | HDFS-8826 | Balancer may not move blocks efficiently in some cases. |
| Hive | BUG-43118 | HIVE-6727 | table fast stats numFiles, totalSize set to 0 when table has non-default location |
| Pig | BUG-44276 | PIG-4679 | Drastic performance degradation due to InputSizeReducerEstimator since PIG-3754 |
| Ranger | BUG-41359 | RANGER-591 | CLONE - UserSync process performance issue due to user group cache inconsistency. |
Other
|
Component |
Hortonworks Bug ID |
Apache JIRA |
Summary |
|---|---|---|---|
| HDFS | BUG-42942 | HDFS-8278 | HDFS Balancer should consider remaining storage % when checking for under-utilized machines. |
| HDFS | BUG-43786 | HDFS-8542 | WebHDFS getHomeDirectory behavior does not match specification |
| HDFS | BUG-41192 | HDFS-8767 | HDFS listStatus on unix pipe file fails with NPE (hive and other components can not use it) |
| HDFS | BUG-43227 | HDFS-8885 | ByteRangeInputStream used in webhdfs does not override available() |
| HDFS | BUG-43787 | HDFS-8939 | Test(S)WebHdfsFileContextMainOperations failing on branch-2 |
| Hive | BUG-42396 | HIVE-11442 | commons-configuration-1.6.jar is backwards incompatible and regressive |
