Release Notes
Also available as:
PDF

Behavioral Changes

Behavioral changes denote a marked change in behavior from the previously released version to this version of software. In HDP 2.6.0, behavioral changes affect the following Hadoop components.

Table 1.13. Behavioral Changes

Hortonworks Bug IDApache ComponentApache JIRASummaryDetails
BUG-66121HiveHIVE-14251 Union All of different types resolves to incorrect data

Scenario: UNION result handling

Previous Behavior: queries in which union operator was used may have created an invalid output type.for example, the column type is ambigous in the following query:

select cast(1 as int) union select cast(1 as string)

Selecting the inappropriate type may cause the value to be changed to NULL.

New Behavior: The types are checked prior to execution; and the ambigous cases are rejected;

FAILED: SemanticException Schema of both sides of union should match: Column _c0 is of type int on first table and type string on second table. Cannot tell the position of null AST. (state=42000,code=40000)

The query should be clarified with explicit casts.

BUG-68588SparkN/ALivy Interpreter should run in Scoped mode

Component Affected: Livy Interpreter in Zeppelin

Scenario: The Livy interpreter has been refactored in HDP 2.6.0 to change the mode from shared to per user scoped. Shared mode does not work for HDP 2.6.0.

Previous Behavior: Use shared mode in HDP 2.5.

New Behavior: Use per user scoped mode in HDP 2.6.

Workaround: Change the mode to per user scoped mode when upgrading from HDP 2.5.x to HDP 2.6.0.

BUG-69438ZeppelinAMBARI-18975Remove Zeppelin View from Ambar

Component Affected: Zeppelin, Ambari Views

Scenario: Zeppelin view on Ambari is deprecated.

Previous Behavior: Zeppelin view was available in the list of views on Ambari UI.

New Behavior: There is no view for Zeppelin. Users can access Zeppelin via Quick links or by directly going to the configured Zeppelin hostname and port.

BUG-72046Oozie Spark actionN/AYarn-client mode for the Spark action is deprecated

Component Affected: Spark action in Oozie

Scenario: The yarn-client mode of the Spark action has been deprecated in HDP 2.6.0 and will be removed in HDP 3.0.0.

New Behavior: No change in current behavior for HDP 2.6.0. For HDP 3.0.0, yarn-client mode for the Spark action in Oozie will no longer be available.

BUG-76651SparkN/ABehavior change of Livy interpreter

Component Affected: Spark

Scenario: Livy Interpreter in Zeppelin

Previous Behavior: In HDP 2.5. 0, Livy would parse the code line by line, streaming the output to the frontend user as it is received.

New Behavior: In HDP 2.6.0, Livy recieves the code in blocks. This means the output is only displayed when the entire block is recieved.

BUG-91290Hive, RangerN/AAdditional ranger hive policies required for INSERT OVERWRITE

Scenario:Additional ranger hive policies required for INSERT OVERWRITE

Previous behavior: Hive INSERT OVERWRITE queries succeed as usual.

New behavior: Hive INSERT OVERWRITE queries are unexpectedly failing after upgrading to HDP-2.6.x with the error:

Error while compiling statement: FAILED: HiveAccessControlException Permission denied: user jdoe does not have WRITE privilege on /tmp/*(state=42000,code=40000)

As of HDP-2.6.0, Hive INSERT OVERWRITE queries require a Ranger URI policy to allow write operations, even if the user has write privilege granted through HDFS policy.

Workaround/Expected Customer Action:

  1. Create a new policy under the Hive repository.

  2. In the dropdown where you see Database, select URI.

  3. Update the path (Example: /tmp/*)

  4. Add the users and group and save.

  5. Retry the insert query.

RMP-8089ZeppelinN/AAmbari service definition to change to work with Azure LLAP Clusters

Component Affected: Zeppelin

Scenario: In the previous release of Zeppelin in HDP 2.5, Spark was a required service to install Zeppelin.

Previous Behavior: On Ambari install wizard Spark was selected during the installation process.

New Behavior: There is no Spark dependency while running Ambari install wizard. Spark/Spark 2 are optional and are required only if the user wish to run Spark Interpreter in Zeppelin.