The following features and fixes were contributed back to Apache with the release of HDP 2.2.6:
Potential Data Loss
|
Component |
Apache JIRA |
Key |
Summary |
|---|---|---|---|
| HDFS | HADOOP-11482, HDFS-7208 | BUG-34432 | NameNode doesn't schedule replication when a DataNode fails |
| HDFS | HDFS-7960, HDFS-7575, HDFS-7596 | BUG-34958 | The full block report should prune zombie storages even if they're not empty |
Security
Component | Apache JIRA | Key | Summary |
|---|---|---|---|
| HBase | HBASE-13239 | BUG-33070 | HBASE grants at specific column level does not work for Groups |
| Hive | BUG-33167 | Hive does not prevent non-whitelisted config params from being set under certain condtions | |
| Hue | BUG-35674 | Support LDAP authentication via Hue to Hiveserver2 | |
| Ranger | BUG-31949 | In hive plugin TABLE policy restriction for all tables {{*}} fails when UDF policy for all functions {{*}} is maintained for a database. | |
| Ranger | BUG-33792 | Bundle oraclejdbc.jar with Ranger | |
| Ranger | BUG-33822 | Do not display the Tomcat SessionId as part of Audit report | |
| Ranger | BUG-34640 | Admin REST API appears to be open to password-less modifications | |
| Ranger | BUG-35442 | UserSync Process didn't sync the group when groups are added to the user at later time | |
| YARN | BUG-23732 | Fix how ZooKeeperSecurity works with ResourceManager |
Incorrect Results
|
Component |
Apache JIRA |
Key |
Summary |
|---|---|---|---|
| Ranger | BUG-36124 | First name and last name fields should support underscores, dashes and space characters | |
| Ranger | HDFS-8219 | BUG-36123 | setStoragePolicy with folder behavior is different after cluster restart |
| Tez | TEZ-2397 | BUG-35923 | Tez jobs can fail on a cluster with HDFS HA |
Stability
|
Component |
Apache JIRA |
Key |
Summary |
|---|---|---|---|
| Hadoop Common, HDFS | HADOOP-11333 | BUG-34682 | Fix deadlock in DomainSocketWatcher when the notification pipe is full |
| Hadoop Common, HDFS | HDFS-4882 | BUG-34388 | Prevent the Namenode's LeaseManager from looping forever in checkLeases |
| HBase | HBASE-13515, HBASE-13169, HBASE-13469,HBASE-13518 | BUG-36599 | Fixes to region replicas |
| Hive | HIVE-10208 | BUG-34033 | Hive job via WebHCat now requires /tez-client/conf/tez-site.xml |
| Hive | HIVE-20085 | BUG-33904 | Laterview on top of a view throws RuntimeException error |
| Hive | BUG-32795 | HIVE schema failed to upgrade from HDP 2.0/2.1 to HDP 2.2 with schematool | |
| Hive | BUG-33402 | HiveServer2 fails to start without kerberos ticket in place before starting. | |
| Hive | BUG-33403 | Tez job submission fails via WebHCat | |
| Tez | TEZ-2334 | BUG-34965 | ContainerManagementProtocolProxy modifies IPC timeout configuration without making a backup copy |
| YARN | YARN-2340 | BUG-35602 | Fixed NPE when queue is stopped during RM restart |
| YARN | YARN-2414 | BUG-35604 | RM web UI: app page will crash if app is failed before any attempt has been created |
| YARN | YARN-2816 | BUG-35600 | NM fail to start with NPE during container recovery |
| YARN | YARN-2874 | BUG-35601 | Dead lock in "DelegationTokenRenewer" which blocks RM to execute any further apps |
| YARN | YARN-2905 | BUG-35605 | AggregatedLogsBlock page can infinitely loop if the aggregated log file is corrupted |
| YARN | YARN-2992 | BUG-34388 | ZKRMStateStore crashes due to session expiry |
| YARN | YARN-3393 | BUG-33546 | Getting application(s) goes wrong when app finishes before starting the attempt |
Upgrade
|
Component |
Apache JIRA |
Key |
Summary |
|---|---|---|---|
|
Knox |
|
BUG-33818 |
Persisted service registry is not updated to support HA after upgrade |
|
Knox |
|
BUG-34770 |
Persisted service registry is not updated to support HA after upgrade |
Usability
|
Component |
Apache JIRA |
Key |
Summary |
|---|---|---|---|
|
Ranger |
|
BUG-36124 |
First name and last name fields should support underscores, dashes and space characters |
|
Ranger |
BUG-36123 |
setStoragePolicy with folder behavior is different after cluster restart | |
|
TEZ |
BUG-35923 | Tez jobs can fail on a cluster with HDFS HA |
Performance
|
Component |
Apache JIRA |
Key |
Summary |
|---|---|---|---|
| Falcon | BUG-35569 | Provide the ability to disable oozie dryrun while scheduling the Falcon process | |
| HDFS | HDFS-7531 | BUG-34296 | Improve the concurrent access on FsVolumeList. |
Other
Component | Apache JIRA | Key | Summary |
|---|---|---|---|
| Flume | FLUME-2095 | BUG-35597 | JMS source setup fails with "org.apache.flume.FlumeException: Could not lookup ConnectionFactory" |
| Flume | FLUME-2586 | BUG-34523 | HDFS Sink should have an option to try to rename even if close fails |
| Hadoop Common | HADOOP-11710 | BUG-35343 | Make CryptoOutputStream behave like DFSOutputStream with respect to synchronization |
| Hadoop Common | HADOOP-11730 | BUG-35340 | Running Jobs using S3n results in 'java.net.SocketTimeoutException' when using large >2G data sets |
| HDFS | HADOOP-11482 | BUG-35643 | Use correct UGI when KMSClientProvider is called by a proxy user |
| HDFS | HDFS-8219 | BUG-36123 | . setStoragePolicy with folder behavior is different after cluster restart |
| Hive | HIVE-10421 | BUG-35670 | StorageBasedAuthorizationProvider can't drop partitioned table with database prefix |
| Hive | BUG-35266 | Tez 2 sub queries with same group by key, when one set group by key empty, outer join on those group-by keys generate different wrong results depending on #reducers of the join | |
| Phoenix | BUG-33674 | Support cross joins and comma-separated table list | |
| Phoenix | BUG-34505 | Unable to load tab delimited data via Phoenix | |
| Ranger | BUG-34504 | Remove condition to copy DB driver jar file | |
| Ranger | BUG-33342 | Setup Nexus proxy within openstack | |
| Ranger, Windows | BUG-33815 | Validation of Ranger settings is missing in MSI |
