# # Copyright 2012, Hortonworks Inc. All rights reserved.# # Licensed under the Apache License, Version 2.0 (the "License"); # you may not use this file except in compliance with the License. # You may obtain a copy of the License at # http://www.apache.org/licenses/LICENSE-2.0 # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # RELEASE NOTES: Hortonworks Data Platform powered by Apache Hadoop Product Version: HDP-1.0.2 PREVIEW-4 ======================================= Packaging information ============================ This release of Hortonworks Data Platform (HDP) deploys the following Hadoop-related components: * Apache Hadoop 1.0* * Apache Pig 0.9.2 * Apache HBase 0.92.0 * Apache HCatalog 0.3.0** * Apache Hive 0.8.0** * Ganglia 3.0.7 * Nagios 3.2.3 * The included version of Hadoop incorporates two patches over and above the Apache Hadoop 1.0.1 release in order to achieve compatibility with other components; we expect this patch or equivalent to be included in future releases of Apache Hadoop. *** The included version of Hive incorporates few patches over and above the Hive 0.8 release in order to achieve compatibility with HCatalog; we expect these patches or equivalent to be included in future Apache releases of Hive. Improvements for HDP-1.0.2-Preview-4 ========================================= * Added support for JDK 32-bit and 64-bit. (64-bit JDK is supported on NameNode, Secondary NameNode, JobTracker, HbaseMaster, HbaseRegionServers and HcatServer.) * Added support for centralized download. It is not required to have the Internet access on all your host machines (except for the master-install-machine) now. * Added health check scripts. These scripts are responsible for providing health status for all the TaskTracker nodes in your cluster * Added support for lzo compression * Added support for installing Zookeeper independent of HBase * Added support for displaying smoke test summary * Added support for executing the smoke tests independent of the HDP Deployment. To do this, execute the script file: gsSmokeTest.sh (located here: master-install-location/HDP.1.0.1-Preview-2/tools * Added web URL validation for all the web services * Added support for Ganglia and Nagios monitoring. For details, see: docs/HDP_Book_7_Deploying_HDP_UNIVERSE_Components_For_Monitoring.pdf * Added support for customizing the cluster configuration. To customize your cluster, see the instructions listed below: docs/HDP_Book_6_Reference.pdf. * Added support for CentOS v5.x Known issues with HDP-1.0.2-Preview-4 ======================================= * Upper case name in the hostname part of the principals does not work with Kerberos. (JIRA: https://issues.apache.org/jira/browse/HADOOP-7988 * To be able to deploy Ganglia and Nagios, you must use the rpm based installations. * Ganglia and Nagios monitoring is not available for the existing central collectors. * RPM based installations must be performed only as the root user. The cluster must be configured to allow the root user to do password-less ssh between install host and the cluster nodes * The installer installs Datanodes, Tasktrackers on the same nodes, as standard practice. * User must provide a accessible MySql instance while installing HCatalog. * The Ganglia metadata server may occasionally crash because of the known issue of buffer overflow. As a workaround, restart the Ganglia gmetad daemon as a root user. For details, see: docs/HDP_Book_5_Troubleshooting_Guide.pdf. Patches ============ * HBase is patched to include HBASE-4635, HBASE-4415, HBASE-4535 and HBASE-4337. * Hadoop is patched to include HADOOP-5203 and HADOOP-7988. * HCatalog installs Hive as well. * Hive installation is based on 0.8 + HIVE-2631, HIVE-2616, HIVE-2629, HIVE-2589, and HIVE-2735. * Hcatalog installation is based on 0.3.0-rc0 + HCATALOG-204, HCATALOG-207, HCATALOG-208, HCATALOG-227 and HCATALOG-226. About Hortonworks =================== Hortonworks offers technical support subscriptions for Hortonworks Data Platform. For more information, please visit http://hortonworks.com/support/ or contact us directly at info@hortonworks.com.