# # Copyright 2012, Hortonworks Inc. All rights reserved.# # Licensed under the Apache License, Version 2.0 (the "License"); # you may not use this file except in compliance with the License. # You may obtain a copy of the License at # http://www.apache.org/licenses/LICENSE-2.0 # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # RELEASE NOTES: Hortonworks Data Platform powered by Apache Hadoop Product Version: HDP-1.0.7-PREVIEW-3-Build-9 ============================================ This release of Hortonworks Data Platform (HDP) deploys the following Hadoop-related components: * Apache Hadoop 1.0.2 * Apache Pig 0.9.2 * Apache HBase 0.92.0 * Apache Zookeeper 3.3.4 * Apache HCatalog 0.4.0 * Apache Hive 0.8.1** * Ganglia 3.2.0 * Nagios 3.2.3 * Apache Templeton 0.1.3 * Apache Oozie 3.1.3 * Apache Sqoop 1.4.1 ** The included version of Hive incorporates few patches over and above the Hive 0.8.1 release in order to achieve compatibility with HCatalog; we expect these patches or equivalent to be included in future Apache releases of Hive. HBase is patched to include HBASE-5286 and HBASE-5325. Hive is patched to include HIVE-2748, HIVE-2865, HIVE-2771, HIVE-2822, HIVE-1634, HIVE-2815, and HIVE-2819. Oozie is patched to include OOZIE-698, OOZIE-697, and OOZIE-810. Sqoop is patched to include SQOOP-438 and SQOOP-462. HCatalog is patched to include HCATALOG-359 and HCATALOG-342. Minimum system requirements ============================================== Operating system ------------------------------------- Red Hat compatible systems: 64-bit Red Hat Enterprise Linux (RHEL) v5.x, v6.x 64-bit CentOS v5.x, v6.x IMPORTANT: * All the nodes in your cluster must use the same version of the operating system. * HDP Easy Installer is available only for RHEL v5.x and CentOS v5.x platforms, non-secure deployment; see: docs/Using_HDP_Easy_Installer.pdf * Secure deployment option is available only for RHEL v5.x and CentOS v5.x platforms; see: docs/HDP_Advanced_Deploying_Secure_Hadoop_Cluster.pdf. * To deploy HDP for RHEL v6.x and CentOS v6.x platforms, see: docs/HDP_Deploying_Non_Secure_Hadoop_Cluster.pdf Hardware requirements ------------------------------------- * The hardware on all Hadoop cluster servers is assumed to be 64-bit hardware. However, the DataNodes and TaskTrackers are configured at the software level to run on 32-bit JVM in order to conserve memory usage. For more details, see: http://docs.hortonworks.com/CURRENT/About_HDP_Installer.htm. Software requirements ------------------------------------- * Following binaries must be installed on all the nodes in your cluster: rpm, yum (RHEL), scp, curl, wget, unzip, tar, pdsh You can also use the auxiliary script gsPreRequisites.sh to install the wget and curl binaries on all the nodes. * Ensure that all the nodes have JDK v1.6 update 26 installed. Also ensure that for all the nodes, the JAVA_HOME variable points to a common location (for example: /usr/java/default). If you choose to use pre-existing JDKs, you must ensure that your pre-existing JDKs are version 1.6 update 26. To install JDK, see: http://docs.hortonworks.com/CURRENT/About_Hortonworks_Data_Platform/Minimum_System_Requirements_And_Deployment_Options.htm. Improvements for HDP-1.0.7-Preview-3-Build-9 ============================================= * Added support for RHEL v6.x and CentOS v6.x. * Added compatibility with Apache Bigtop. * Templeton is upgraded to version 0.1.3. * Fixed HCatalog to be a client. The HCatalog client now talks to the Hive Metastore. Known issues with HDP-1.0.7-Preview-3-Build-9 ============================================= * To be able to deploy HDP Monitoring Components (Ganglia and Nagios), you must use the RPM based installations and must provide yum repository access (For more details, see: Configuring local yum repository). * Currently, the alerts for checking the health of Nagios server and Ganglia daemons are not displayed on HDP monitoring dashboard.To view these alerts from the HDP Monitoring Dashboard, click on the Nagios tab. This will display the Nagios UI. On the Nagios UI, go to the "Services" menu. * HDP Monitoring dashboard may be slow in rendering the service graphs from Ganglia. Typically, this happens if Ganglia server does not have enough processing power. * Using init.d scripts for starting and stopping services is not recommended. * To use Zookeeper command line client, you must execute the following command: source /etc/zookeeper/conf/zookeeper-env.sh ; export ZOOCFGDIR=/etc/zookeeper/conf * To use Oozie command line client, you must first export JAVA_HOME. Also see: docs/ReadMe.txt for more details on HDP Installer. docs/HDP_Manifest.txt file for more details on the directory structure for HDP Installer. Hortonworks offers technical support subscriptions for Hortonworks Data Platform. For more information, please visit http://hortonworks.com/support/ or contact us directly at info@hortonworks.com.