HDP-2.3.0 Release Notes
Also available as:
PDF

Fixed Issues

Fixed issues represents selected issues that were previously logged via Hortonworks Support, but are now addressed in the current release. These issues may have been reported in previous versions within the Known Issues section; meaning they were reported by customers or identified by Hortonworks Quality Engineering team.

Potential Data Loss

Component

Hortonworks Bug ID

Apache JIRA

Summary

HBaseBUG-33249HBASE-13576HBCK failed to recover certain regions

Security

Component

Hortonworks Bug ID

Apache JIRA

Summary

FalconBUG-32768FALCON-954Secure Kerberos setup : Falcon should periodically revalidate security credentials.
Falcon DocumentationBUG-31545 Add details of Falcon directory permissions to documentation
HBaseBUG-30856HBASE-11869Support snapshot owner other than Global Admins in HBase
HBaseBUG-33278HBASE-13239HBASE grants at specific column level does not work for Groups
HBaseBUG-36565HBASE-13734deleteall behavior changes after applying org.apache.hadoop.hbase. security.visibility. VisibilityController to HBase
HiveBUG-33338HIVE-10528Hiveserver2 in HTTP mode is not applying auth_to_local rules
HiveBUG-35992HIVE-10875SELECT a.* FROM (SELECT * FROM source_view) a results in permission denied error.
HueBUG-28794 Security scan -- The Hue web application is vulnerable to stored Cross-Site Scripting (XSS)
HueBUG-30961 Security scan -- The Hue web application is vulnerable to stored Cross-Site Scripting (XSS)
HueBUG-32176 Django Vulnerabilities in Hue
HueBUG-32729 Directory listing is enabled for HUE
HueBUG-33163 Clear Text Password Shows In Hue UI for Oozie jobs and job log files.
KnoxBUG-33708KNOX-525persisted service registry is not updated to support HA after upgrade
Knox, RangerBUG-36431 Found Jersey client API incompatibility that prevent HTTPS Knox from working
OozieBUG-33621 Clear Text Password Shows In Oozie workflow configuration
RangerBUG-30108RANGER-375Ranger - when backend DB not reachable error thrown is "incorrect password/username" when trying to log into Ranger
RangerBUG-31425 PolicyManager throws 404 error when creating HBase repo in Ranger
RangerBUG-33819RANGER-483Provide an option to create password using alternate message digest algorithm
YARN, HADOOPBUG-41100 Yarn services Tomcat instance upgraded to 6.0.44

Incorrect Results

Component

Hortonworks Bug ID

Apache JIRA

Summary

HCatalogBUG-22370HIVE-5545HCatRecord getInteger method returns String when used on Partition columns of type INT
HiveBUG-31914HIVE-9278arithmetic operators return incorrect results from certain operand types
HiveBUG-33275HIVE-8746ORC timestamp columns are sensitive to daylight savings time
HiveBUG-34210HIVE-9278multiple built-in date functions return incorrect results in same where clause
HiveBUG-34971HIVE-10481ACID table update finishes but values not really updated if column names are not all lower case
HiveBUG-36223 wrong results for 2 left outer joins with overlapping join on keys, filter IS NULL pushed to left side table wrongly.
HiveBUG-40100HIVE-11104Insert overwrite query does not return expected value
HueBUG-33631 Hue 2.6.1-2041 not displaying tables in alphabetical order
PhoenixBUG-34506PHOENIX-896Unable to load tab delimited data via Phoenix
PigBUG-34138 Receiving exception 'No such file or directory' when using 'pig -useHCatalog'
PigBUG-36853PIG-4541Skewed full outer join does not return records if any relation is empty. Outer join does not return any record if left relation is empty
PigBUG-37485PIG-4556Pig tests abort with Check of prerequites failed: <Failed running /usr/bin/pig -e fs -ls />

Stability

Component

Hortonworks Bug ID

Apache JIRA

Summary

FalconBUG-34020FALCON-1165Falcon will fail to start, if a cluster entity that was defined is not reachable.
HBaseBUG-21924HBASE-13555HBase web gives a 500 error when you attempt to view table details and it's not the master
HBaseBUG-29350HBASE-12791HBase does not attempt to clean up an aborted SPLIT when the Regions Server is shutting down.
HBaseBUG-33349HBASE-13608500 Error with Stargate through Knox, using AD, SPNEGO, and Pre-Auth
HDFSBUG-34175HDFS-8072Non-HDFS disk space is not reclaimed until after Datanode restart
HDFSBUG-5700 NameNode should shut down if out of memory error occurs
HueBUG-30224 django.db.utils.DatabaseError: current transaction is aborted when setting up Hue on PostgreSQL database
HueBUG-33284 Hue - "/usr/lib/hue/build/env/bin/hue syncdb --noinput" in MySQL5.6 will result in an error
KnoxBUG-33488KNOX-530Running Oozie jobs through Knox on a cluster with HDFS HA does not use proper namenode host name.
OozieBUG-26984OOZIE-1728Queue configuration is not working for distcp action
StormBUG-28119STORM-563Kafka Spout doesn't pick up from the beginning of the queue unless forceFromStart specified

Query Failure

Component

Hortonworks Bug ID

Apache JIRA

Summary

HCatalogBUG-30038 Sqoop Import on External Hcatalog Table
HiveBUG-27636HIVE-10500intermittent acid_concurrency test failures due to NoSuchLockException
HiveBUG-29427HIVE-9235Turn off Parquet Vectorization until all data types work: DECIMAL, DATE, TIMESTAMP, CHAR, and VARCHAR
HiveBUG-30901HIVE-10559with constant propagation off, left join and join, hive.tez.dynamic.partition. pruning throw compile error IndexOutOfBoundsException
HiveBUG-33145 HS2 HTTP Mode - Beeline Hanging after upgrading from HDP 2.1 to HDP 2.2
HiveBUG-33857HIVE-10273Select * on Table View (with UNION ALL) throws NullPointerException if Tez execution engine is used
HiveBUG-34809HIVE-10242ACID: insert overwrite prevents create table command
HiveBUG-34872HIVE-10559Hive tez dynamic pruning throws IndexOutOfBounds exception on certain queries
HiveBUG-34956Hive-10677Analyze table compute stats for columns, ColumnStatsTask fail when hive.exec.parallel=true (default false)
HiveBUG-35048HIVE-10483insert overwrite table with self join gets into a deadlock state in ACID DBTxnManager
HiveBUG-35795HIVE-10286orc ppd does not typecast of string to timestamp when evaluate predicate for timestamp column
HiveBUG-36111HIVE-8470Orc writer cant handle column of type void
HiveBUG-37304HIVE-9950Hive query using Cuckoo hashing causing NullPointerException
HiveBUG-37429HIVE-9937vectorization with ACID table, count(1) fails with ArrayIndexOutOfBounds Exception
HiveBUG-38292HIVE-10929In Tez mode,dynamic partitioning query with union all fails at moveTask,Invalid partition key & values
HiveBUG-38817HIVE-11031Hive Alter table, concatenate partition files, throws error
HiveBUG-39159HIVE-11027Hive Incorrect query results with Bucket Map joins vs Shuffle Joins.
HiveBUG-39868HIVE-11051Tez Optimized MapJoin: Tables with Array<String> causes task failures
HiveBUG-40036PIG-4624empty ORC file without schema produced by Hive

Upgrade

Component

Hortonworks Bug ID

Apache JIRA

Summary

HDFSBUG-34508HDFS-8127NameNode Failover during HA upgrade can cause DataNode to finalize upgrade that will fail datanode -rollback
HueBUG-32999 After upgrading to HDP 2.2 from HDP 2.1. HUE now throws an error when trying to delete users

Usability

Component

Hortonworks Bug ID

Apache JIRA

Summary

FalconBUG-34630AMBARI-11140Falcon UI does not allow login by any user other than ambari-qa
FalconBUG-35141 Regression in the Falcon UI; Only 10 results shown for all entities.
FlumeBUG-35598FLUME-2095JMS source setup fails with "org.apache.flume. FlumeException: Could not lookup ConnectionFactory"
HBaseBUG-35338HBASE-13555HBase web gives a 500 error when you attempt to view Thread Stacks
HCatalogBUG-30186HIVE-9381Cannot load data into specific Hive table via pig HCatStorer
HiveBUG-23032 Jars added in Hive shell whilst in Tez mode are not recognized
HiveBUG-31113 Hive "SLF4J: Class path contains multiple SLF4J bindings." error
HiveBUG-31899HIVE-10271remove hive.server2.thrift.http.min/max.worker.threads properties
HiveBUG-32859HIVE-9977Hive metastore auto major compaction not happening if data is loaded through dynamic partitioning insert
HiveBUG-33876HIVE-10226ANALYZE TABLE (compute_stats) UDAF doesn't have Date support
HiveBUG-35285HIVE-3682, HIVE-5672cannot use separator of choice for Hive export in HDFS
HiveBUG-35511 hive.support.concurrency= false doesn't turn of Transactions
Hive, HueBUG-29899HIVE-9223HS2/hue/tez: multiple concurrent queries not allowed in single tez session
HueBUG-32301 Not able to change Hue users passwords via the Hue UI
HueBUG-33632 Hue 2.6.1-2041 does not allow you to copy data displayed when doing a query
HueBUG-33693 Hue - Enable Parameterization doesn't work
HueBUG-35310 Not able to access/edit the workflow from Oozie Job Designer when the workflow is not in Page 1
HueBUG-38607 Hue does not respect Support dfs.umaskmode, fs.permissions.umask-mode when creating files or folders
PigBUG-29616PIG-4381On PIG grunt shell DEFINE commands fails when it spans multiple lines.
RangerBUG-21763RANGER-451Policy Admin User/Group page doesn't show groups for users when the user belongs to large number of groups
RangerBUG-22120RANGER-244Option to disable/hide imported users/groups
RangerBUG-28060 RANGER-281Support for PostgreSQL as DB server for XA Secure (Ranger, Argus)
RangerBUG-29900RANGER-318Not able to add user with only numbers
RangerBUG-31749RANGER-320Usersync NPE when object does not have userNameAttribute
RangerBUG-31782RANGER-337Ranger gives error when using hyphen or space in name field
RangerBUG-37467 AMBARI-10924Ambari replaces ranger-admin install.properties with default after every start making it harder to debug
SparkBUG-39567SPARK-8383Spark History Server shows Last Updated as 1969/12/31 when SparkPI application completed
WebHCatBUG-7691 Provide/extend API to support table views
YARNBUG-19508YARN-2246Job History Link in RM UI is redirecting to the URL which contains Job Id twice
YARNBUG-27558YARN-3526ResourceManager probe on standby server in HA mode doesn't complete the redirect
YARNBUG-9512YARN-2238Applications sometimes are not visible in RM web UI

Performance

Component

Hortonworks Bug ID

Apache JIRA

Summary

HDFSBUG-38249HDFS-7435PB encoding of block reports is very inefficient
HiveBUG-25165HIVE-9709Performance Issue Beeline > Knox > HS2
HiveBUG-33592HIVE-9644, HIVE-9645case/when query not optimized, partition pruning not happening
HiveBUG-37846 unix_timestamp non-deterministic causing less performance, current_timestamp not available in HDP 2.2.x
Hive, TezBUG-39394HIVE-10746Mapred.TextInputFormat defaults to 1 byte FileSplits
HueBUG-33579 Character Limit in Group Names unable to sync more than 30 characters.
PigBUG-33853PIG-4488Pig on Tez only uses default queue
RangerBUG-21901RANGER-192 XASecure loading groups for user hang if there are too many groups for the user
RangerBUG-34139 Ranger is running out of database connection when looking up user/groups
TezBUG-23856TEZ-14Support for speculative execution of slow tasks

Other

Component

Hortonworks Bug ID

Apache JIRA

Summary

HDFSBUG-31287HDFS-8055NullPointerException when topology script is missing.
HDP / StackBUG-33764 hdp-select needs to handle user created directories in /usr/hdp
HueBUG-26357 Display Hue server details
HueBUG-29981 Support HiveServer2 HTTP/S transport in hue
HueBUG-30145 Support LDAP authentication via Hue to Hiveserver2
HueBUG-31350 Hue UTF8 Filter Decoding
HueBUG-32315 Users cannot use the job browser to investigate FAILED jobs. It works for other job types.
HueBUG-33469 Hue - log empty for create and insert statements
HueBUG-34408 hue-plugins.x86_64 has hadoop dependency
HueBUG-35047 Can't see Tez job details from Hue job browser while Tez job is running
HueBUG-35847 Select has a 1024 fd limit. If the FD number goes above 1024 for some reason (long running process), then all apps relying on thrift will fail.
HueBUG-36121 In HUE, clicking on useradmin -> groups gives "NoReverseMatch at /useradmin/groups" if group name with URL encoding crossing 80 characters
KafkaBUG-32049 No Kafka Documentation Available at docs.hortonworks.com