# # Copyright 2012, Hortonworks Inc. All rights reserved.# # Licensed under the Apache License, Version 2.0 (the "License"); # you may not use this file except in compliance with the License. # You may obtain a copy of the License at # http://www.apache.org/licenses/LICENSE-2.0 # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # RELEASE NOTES: Hortonworks Data Platform powered by Apache Hadoop Product Version: HDP-1.0.5 PREVIEW 7 ======================================= Packaging information This release of Hortonworks Data Platform (HDP) deploys the following Hadoop-related components: * Apache Hadoop 1.0.2 * Apache Pig 0.9.2 * Apache HBase 0.92.0 * Apache Zookeeper 3.3.4 * Apache HCatalog 0.4.0* * Apache Hive 0.8.1** * Ganglia 3.2.0 * Nagios 3.2.3 * Templeton 0.1.2 * Apache Oozie 3.1.3 * Apache Sqoop 1.4.1 * The included version of HCatalog incorporates two patches over and above the HCatalog 0.4.0 release. ** The included version of Hive incorporates few patches over and above the Hive 0.8 release in order to achieve compatibility with HCatalog; we expect these patches or equivalent to be included in future Apache releases of Hive. Patch information --------------------- * Hadoop is patched to include HADOOP-7206,HADOOP-4855, and HADOOP-8090. * Hadoop is patched to include HDFS-3075, HDFS-2701, HDFS-2702, and HDFS-2703. * HBase is patched to include HBASE-4635, HBASE-4415, HBASE-4535, HBASE-5325, and HBASE-4337. * HCatalog is patched to include is based on HCATALOG-267 and HCATALOG-312. * Hive is patched to include HIVE-2748, HIVE-2771, HIVE-2822, HIVE-2865, HIVE-1634, HIVE-2815, and HIVE-2819. * Oozie is patched to include OOZIE-697, OOZIE-698, and OOZIE-718. * Sqoop is patched to include SQOOP-438. * Zookeeper is patched to include ZOOKEEPER-1302. System requirements for test and production clusters ====================================================== Operating system ------------------ Red Hat compatible systems: * 64-bit Red Hat Enterprise Linux (RHEL) v5.x, v6.x * 64-bit CentOS v5.x, v6.x SUSE systems: * 64-bit SUSE Linux Enterprise Server 11 (SLES 11) Service pack 1 or later IMPORTANT: * All the nodes in your cluster must use the same version of the operating system. Hardware requirements The hardware on all Hadoop cluster servers is assumed to be 64-bit hardware. However, the DataNodes and TaskTrackers are configured at the software level to run on 32-bit JVM in order to conserve memory usage. For more details, see: http://docs.hortonworks.com/CURRENT/About_HDP_Installer.htm. Software requirements ======================= * Following binaries must be installed on all the nodes in your cluster: rpm, yum (RHEL), scp, curl, wget, unzip, tar, pdsh You can also use the auxiliary script gsPreRequisites.sh to install the wget and curl binaries on all the nodes. * Additionally, verify if you all the nodes in your cluster have sudo version 1.7.x or later. * To use Oozie command line client, you must first export JAVA_HOME. Improvements for HDP-1.0.5-Preview-7 ====================================== * Added support for SUSE based systems. * HDP -1.0.5 release introduces the HDP Easy Installer. HDP Easy Installer is the web based installer for deploying non-secure Hadoop clusters. For more details, see: docs/HDP_Easy_Installer or see: http://docs.hortonworks.com * Hadoop is upgraded to version 1.0.2 * Templeton is upgraded to version 0.1.1 Known issues with HDP-1.0.5-Preview-7 ======================================== * To be able to deploy HDP Monitoring Components (Ganglia and Nagios), you must use the RPM based installations and must provide yum repository access (see: Configuring local yum repository). * Currently, the alerts for checking the health of Nagios server and Ganglia daemons are not displayed on HDP monitoring dashboard. * To view these alerts from the HDP Monitoring Dashboard, click on the Nagios tab. This will display the Nagios UI. On the Nagios UI, go to the "Services" menu. * HDP Monitoring dashboard may be slow in rendering the service graphs from Ganglia. Typically, this happens if Ganglia server does not have enough processing power. * If the JVM default is overridden and the DataNodes are installed with 64-bit JVM, they will work in non-secure mode, but will fail to start in secure mode. (https://issues.apache.org/jira/browse/HADOOP-8132). * On the SLES platform, currently only non-secure RPM-based installation is supported. * HDP UNIVERSE Components for Monitoring (Nagios and Ganglia) currently do not install correctly on SLES platform. Also see: ============== • docs/ReadMe.txt for more details on HDP Installer. • docs/HDP_Manifest.txt file for more details on the directory structure for HDP Installer. About Hortonworks =================== Hortonworks offers technical support subscriptions for Hortonworks Data Platform. For more information, please visit http://hortonworks.com/support/ or contact us directly at info@hortonworks.com.