The following features and fixes were contributed back to Apache with the release of HDP 2.2.6:
Potential Data Loss
Component |
Apache JIRA |
Key |
Summary |
---|---|---|---|
HDFS | HADOOP-11482, HDFS-7208 | BUG-34432 | NameNode doesn't schedule replication when a DataNode fails |
HDFS | HDFS-7960, HDFS-7575, HDFS-7596 | BUG-34958 | The full block report should prune zombie storages even if they're not empty |
Security
Component | Apache JIRA | Key | Summary |
---|---|---|---|
HBase | HBASE-13239 | BUG-33070 | HBASE grants at specific column level does not work for Groups |
Hive | BUG-33167 | Hive does not prevent non-whitelisted config params from being set under certain condtions | |
Hue | BUG-35674 | Support LDAP authentication via Hue to Hiveserver2 | |
Ranger | BUG-31949 | In hive plugin TABLE policy restriction for all tables {{*}} fails when UDF policy for all functions {{*}} is maintained for a database. | |
Ranger | BUG-33792 | Bundle oraclejdbc.jar with Ranger | |
Ranger | BUG-33822 | Do not display the Tomcat SessionId as part of Audit report | |
Ranger | BUG-34640 | Admin REST API appears to be open to password-less modifications | |
Ranger | BUG-35442 | UserSync Process didn't sync the group when groups are added to the user at later time | |
YARN | BUG-23732 | Fix how ZooKeeperSecurity works with ResourceManager |
Incorrect Results
Component |
Apache JIRA |
Key |
Summary |
---|---|---|---|
Ranger | BUG-36124 | First name and last name fields should support underscores, dashes and space characters | |
Ranger | HDFS-8219 | BUG-36123 | setStoragePolicy with folder behavior is different after cluster restart |
Tez | TEZ-2397 | BUG-35923 | Tez jobs can fail on a cluster with HDFS HA |
Stability
Component |
Apache JIRA |
Key |
Summary |
---|---|---|---|
Hadoop Common, HDFS | HADOOP-11333 | BUG-34682 | Fix deadlock in DomainSocketWatcher when the notification pipe is full |
Hadoop Common, HDFS | HDFS-4882 | BUG-34388 | Prevent the Namenode's LeaseManager from looping forever in checkLeases |
HBase | HBASE-13515, HBASE-13169, HBASE-13469,HBASE-13518 | BUG-36599 | Fixes to region replicas |
Hive | HIVE-10208 | BUG-34033 | Hive job via WebHCat now requires /tez-client/conf/tez-site.xml |
Hive | HIVE-20085 | BUG-33904 | Laterview on top of a view throws RuntimeException error |
Hive | BUG-32795 | HIVE schema failed to upgrade from HDP 2.0/2.1 to HDP 2.2 with schematool | |
Hive | BUG-33402 | HiveServer2 fails to start without kerberos ticket in place before starting. | |
Hive | BUG-33403 | Tez job submission fails via WebHCat | |
Tez | TEZ-2334 | BUG-34965 | ContainerManagementProtocolProxy modifies IPC timeout configuration without making a backup copy |
YARN | YARN-2340 | BUG-35602 | Fixed NPE when queue is stopped during RM restart |
YARN | YARN-2414 | BUG-35604 | RM web UI: app page will crash if app is failed before any attempt has been created |
YARN | YARN-2816 | BUG-35600 | NM fail to start with NPE during container recovery |
YARN | YARN-2874 | BUG-35601 | Dead lock in "DelegationTokenRenewer" which blocks RM to execute any further apps |
YARN | YARN-2905 | BUG-35605 | AggregatedLogsBlock page can infinitely loop if the aggregated log file is corrupted |
YARN | YARN-2992 | BUG-34388 | ZKRMStateStore crashes due to session expiry |
YARN | YARN-3393 | BUG-33546 | Getting application(s) goes wrong when app finishes before starting the attempt |
Upgrade
Component |
Apache JIRA |
Key |
Summary |
---|---|---|---|
Knox |
|
BUG-33818 |
Persisted service registry is not updated to support HA after upgrade |
Knox |
|
BUG-34770 |
Persisted service registry is not updated to support HA after upgrade |
Usability
Component |
Apache JIRA |
Key |
Summary |
---|---|---|---|
Ranger |
|
BUG-36124 |
First name and last name fields should support underscores, dashes and space characters |
Ranger |
BUG-36123 |
setStoragePolicy with folder behavior is different after cluster restart | |
TEZ |
BUG-35923 | Tez jobs can fail on a cluster with HDFS HA |
Performance
Component |
Apache JIRA |
Key |
Summary |
---|---|---|---|
Falcon | BUG-35569 | Provide the ability to disable oozie dryrun while scheduling the Falcon process | |
HDFS | HDFS-7531 | BUG-34296 | Improve the concurrent access on FsVolumeList. |
Other
Component | Apache JIRA | Key | Summary |
---|---|---|---|
Flume | FLUME-2095 | BUG-35597 | JMS source setup fails with "org.apache.flume.FlumeException: Could not lookup ConnectionFactory" |
Flume | FLUME-2586 | BUG-34523 | HDFS Sink should have an option to try to rename even if close fails |
Hadoop Common | HADOOP-11710 | BUG-35343 | Make CryptoOutputStream behave like DFSOutputStream with respect to synchronization |
Hadoop Common | HADOOP-11730 | BUG-35340 | Running Jobs using S3n results in 'java.net.SocketTimeoutException' when using large >2G data sets |
HDFS | HADOOP-11482 | BUG-35643 | Use correct UGI when KMSClientProvider is called by a proxy user |
HDFS | HDFS-8219 | BUG-36123 | . setStoragePolicy with folder behavior is different after cluster restart |
Hive | HIVE-10421 | BUG-35670 | StorageBasedAuthorizationProvider can't drop partitioned table with database prefix |
Hive | BUG-35266 | Tez 2 sub queries with same group by key, when one set group by key empty, outer join on those group-by keys generate different wrong results depending on #reducers of the join | |
Phoenix | BUG-33674 | Support cross joins and comma-separated table list | |
Phoenix | BUG-34505 | Unable to load tab delimited data via Phoenix | |
Ranger | BUG-34504 | Remove condition to copy DB driver jar file | |
Ranger | BUG-33342 | Setup Nexus proxy within openstack | |
Ranger, Windows | BUG-33815 | Validation of Ranger settings is missing in MSI |