# # Copyright 2012, Hortonworks Inc. All rights reserved.# # Licensed under the Apache License, Version 2.0 (the "License"); # you may not use this file except in compliance with the License. # You may obtain a copy of the License at # http://www.apache.org/licenses/LICENSE-2.0 # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # RELEASE NOTES: Hortonworks Data Platform powered by Apache Hadoop Product Version: HDP-1.0.3 PREVIEW-5 ======================================= Packaging information This release of Hortonworks Data Platform (HDP) deploys the following Hadoop-related components: • Apache Hadoop 1.0.1* • Apache Pig 0.9.2 • Apache HBase 0.92.0 • Apache Zookeeper 3.3.4 • Apache HCatalog 0.4.0 • Apache Hive 0.8.0** • Ganglia 3.2.0 • Nagios 3.2.3 • Templeton 0.1 • Apache Oozie 3.1.3 • Apache Sqoop 1.4.1 * The included version of Hadoop incorporates two patches over and above the Apache Hadoop 1.0.1 release in order to achieve compatibility with other components; we expect this patch or equivalent to be included in future releases of Apache Hadoop. ** The included version of Hive incorporates few patches over and above the Hive 0.8 release in order to achieve compatibility with HCatalog; we expect these patches or equivalent to be included in future Apache releases of Hive. Patch information • HBase is patched to include HBASE-4635, HBASE-4415, HBASE-4535, HBASE-5325, and HBASE-4337. • Hive is patched to include HIVE-2748, HIVE-2771, HIVE-2822, and HIVE-2735. • Oozie is patched to include OOZIE-697, OOZIE-698, and OOZIE-718. • Sqoop is patched to include SQOOP-438. • Zookeeper is patched to include ZOOKEEPER-1302. System requirements for test and production clusters Operating system Red Hat compatible systems: • 64-bit Red Hat Enterprise Linux (RHEL) v5.x • 64-bit CentOS v5.x SUSE systems: • 64-bit SUSE Linux Enterprise Server 11 (SLES 11) Service pack 1 or later IMPORTANT: • All the nodes in your cluster must use the same version of the operating system. Hardware requirements The hardware on all Hadoop cluster servers is assumed to be 64-bit hardware. However, the DataNodes and TaskTrackers are configured at the software level to run on 32-bit JVM in order to conserve memory usage. For more details, see: http://docs.hortonworks.com/CURRENT/About_HDP_Installer.htm. Software requirements • Following binaries must be installed on all the nodes in your cluster: rpm, yum (RHEL), scp, curl, wget, unzip, tar, pdsh You can also use the auxiliary script gsPreRequisites.sh to install the wget and curl binaries on all the nodes. • Additionally, verify if you all the nodes in your cluster have sudo version 1.7.x or later. • To use Oozie command line client, you must first export JAVA_HOME. Improvements for HDP-1.0.3-Preview-5 * Added support for deploying Templeton. (Note that you can use Templeton only with non secure Hadoop clusters in this release.) * Added support for deploying Oozie. (Note that you can use Oozie only with non secure Hadoop clusters in this release.) * Added support for deploying Sqoop. Added support for LZO compressor/decompressor for both 32-bit and 64-bit JVMs. * Added support for Snappy compressor/decompressor. * Added HDP Monitoring Dashboard.HDP Monitoring Dashboard gathers data from Nagios and Ganglia and presents it in an easy-to-understand way. It also provides key alerts, metrics, and administration console for your Hadoop clusters accessible from a single location. For more details, see: http://docs.hortonworks.com Known issues with HDP-1.0.3-Preview-5 ======================================= * To be able to deploy HDP Monitoring Components (Ganglia and Nagios), you must use the RPM based installations and must provide yum repository access (see: Configuring local yum repository). * Currently, the alerts for checking the health of Nagios server and Ganglia daemons are not displayed on HDP monitoring dashboard. * To view these alerts from the HDP Monitoring Dashboard, click on the Nagios tab. This will display the Nagios UI. On the Nagios UI, go to the "Services" menu. * HDP Monitoring dashboard may be slow in rendering the service graphs from Ganglia. Typically, this happens if Ganglia server does not have enough processing power. * If the JVM default is overridden and the DataNodes are installed with 64-bit JVM, they will work in non-secure mode, but will fail to start in secure mode. (https://issues.apache.org/jira/browse/HADOOP-8132). Also see: =========== • docs/ReadMe.txt for more details on HDP Installer. • docs/HDP_Manifest.txt file for more details on the directory structure for HDP Installer. About Hortonworks ===================== Hortonworks offers technical support subscriptions for Hortonworks Data Platform. For more information, please visit http://hortonworks.com/support/ or contact us directly at info@hortonworks.com.