3.5. Patch Information for Hive

Hive is based on Apache Hive 0.12.0 and includes the following Apache JIRAs for this release:

  • HIVE-1511: Hive plan serialization is slow

  • HIVE-3025: Fixed Hive archive command for Hadoop v 0.22 and 0.23

  • HIVE-3448: Fixed failures for the skewjoin.q testcase on Windows

  • HIVE-3441: Fixed failures caused due to the partition column strings in Windows file names

  • HIVE-3436: Fixed the script_pipe.q failures on Windows

  • HIVE-3483: Fixed issues with joins that use partitioned table on Windows

  • HIVE-3317: Fixed TestDocToUnix unit tests on Windows

  • HIVE-3320: Fixed test case failures caused by incorrect handling of CRLF line endings on Windows

  • HIVE-3319: Fixed path related issues that caused the unit test failures for Windows

  • HIVE-3327: Fixed failures caused while execution of the /bin/cat script files on Windows

  • HIVE-3479: Fixed issues with negative unit tests

  • HIVE-3494: Fixed JDBC test case failures on Windows

  • HIVE-3480: Fixed file handle leaks in Symbolic and symlink related input formats

  • HIVE-3815: Hive table rename fails if filesystem cache is disabled

  • HIVE-3846: alter view rename NPEs with authorization on

  • HIVE-4388: HBase tests fail against Hadoop 2

  • HIVE-4417: Make unit tests pass on Windows which use Linux script in query files

  • HIVE-4485: beeline prints null as empty strings

  • HIVE-4545: HS2 should return describe table results without space padding

  • HIVE-4679: WebHCat can deadlock Hadoop if the number of concurrently running tasks is higher or equal than the number of mappers

  • HIVE-4763: Add support for thrift over http transport in HS2

  • HIVE-4831: QTestUtil based test exiting abnormally on windows fails startup of other QTestUtil tests

  • HIVE-4844: Add varchar data type

  • HIVE-4910: Hadoop 2 archives broken

  • HIVE-5070: Need to implement listLocatedStatus() in ProxyFileSystem for 0.23 shim

  • HIVE-5072: [WebHCat] Enable directly invoke Sqoop job through Templeton

  • HIVE-5098: Fix metastore for SQL Server

  • HIVE-5099: Some partition publish operation cause OOM in metastore backed by SQL Server

  • HIVE-5112: Upgrade protobuf to 2.5 from 2.4

  • HIVE-5115: WebHCat e2e tests TestMapReduce_1 and TestHeartbeat_2 require changes for Hadoop 2

  • HIVE-5127: Upgrade xerces and xalan for WebHCat

  • HIVE-5129: Multiple table insert fails on count(distinct)

  • HIVE-5133: WebHCat jobs that need to access metastore fails in secure mode

  • HIVE-5150: UnsatisfiedLinkError when running hive unit test

  • HIVE-5156: HiveServer2 jdbc ResultSet.close should free up resources on server side

  • HIVE-5176: Wincompat: Changes for allowing various path compatibilities with Windows

  • HIVE-5218: datanucleus does not work with MS SQLServer in Hive metastore

  • HIVE-5229: Better thread management for IveServer2 async threads

  • HIVE-5241: Default log4j level for WebHCat should be INFO not DEBUG

  • HIVE-5260: Introduce HivePassThroughOutputFormat that allows Hive to use general purpose OutputFormats instead of HiveOutputFormats in StorageHandlers

  • HIVE-5261: Make the Hive HBase storage handler work from HCatalog, and use HiveStorageHandlers instead of HCatStorageHandlers

  • HIVE-5263: Query Plan cloning time could be improved by using Kryo

  • HIVE-5274: HCatalog package renaming backward compatibility follow-up

  • HIVE-5278: Move some string UDFs to GenericUDFs, for better varchar support

  • HIVE-5279: Kryo cannot instantiate GenericUDAFEvaluator in GroupByDesc

  • HIVE-5290: Some HCatalog tests have been behaving flaky

  • HIVE-5353: Job submission that requires access to metastore should not require additional jars to be shipped to target node

  • HIVE-5364: NPE on some queries from partitioned orc table

  • HIVE-5379: NoClassDefFoundError is thrown when using lead/lag with kryo serialization

  • HIVE-5410: Hive command line option --auxpath still does not work post HIVE-5363

  • HIVE-5411: Migrate expression serialization to Kryo

  • HIVE-5413: StorageDelegationAuthorizationProvider uses non-existent org.apache.hive.hcatalog.hbase.HBaseHCatStorageHandler

  • HIVE-5422: Upgrade Kyro to 2.22 now that it is released

  • HIVE-5425: Provide a configuration option to control the default stripe size for ORC

  • HIVE-5431: PassthroughOutputFormat SH changes causes IllegalArguementException

  • HIVE-5433: Fix varchar unit test to work with hadoop-2.1.1

  • HIVE-5448: WebHCat duplicate test TestMapReduce_2 should be removed

  • HIVE-5453: jobsubmission2.conf should use 'timeout' property

  • HIVE-5474: drop table hands when concurrency=true

  • HIVE-5478: WebHCat e2e testsuite for hcat authorization tests needs some fixes

  • HIVE-5479: SBAP restricts hcat -e'show databases'

  • HIVE-5480: WebHCat e2e tests or doAs feature are failing

  • HIVE-5484: TestSchema failures when Hive version has more than 3 revision numbers

  • HIVE-5485: SBAP errors on null partition being passed into partition level authorization

  • HIVE-5496: hcat -e "drop database if exists" fails on authorizing non-existent null db

  • HIVE-5507: [WebHCat] test.other.user.name parameter is missing from build.xml in e2e harness

  • HIVE-5508: [WebHCat] ignore log collector e2e tests for Hadoop 2

  • HIVE-5511: percentComplete returned by job status from WebHCat is null

  • HIVE-5115: WebHCat e2e tests TestMapReduce_1 and TestHeartbeat_2 require changes or Hadoop 2

  • HIVE-5542: WebHCat is failing to run ddl command on a secure cluster

  • HIVE-5789: WebHCat E2E tests do not launch on Windows

  • HIVE-5975: [WebHCat] templeton mapreduce job failed if provide "define" parameters

  • HIVE-6035: Windows: percentComplete returned by job status from WebHCat is null

  • HIVE-6064: Wincompat; wndows path substitutions overriden by MiniMrShim.getConfiguration() on hadoop 2

  • HIVE-6065: orc/FileDump and testRCFile should close on appropriate resources

  • HIVE-6066: Wincompat: describe_comment_nonascii.q failing on Windows

  • HIVE-6068: HiveServer2 beeline client on windows does not handle the non-ascii characters properly

  • HIVE-6071: Create hive command script for Windows, hive.cmd

  • HIVE-6087: Hive/Templeton winpkg build

  • HIVE-6088: Change StreamingDelegator to pass distributed cache files to jar delegator

  • HCATALOG-512: [HCATALOG] Fixed HCatalog unit tests on Windows

  • HCATALOG-514: [HCATALOG] Fixed HCatalog python scripts in the package build for Windows