# Copyright 2012, Hortonworks Inc. All rights reserved.# # Licensed under the Apache License, Version 2.0 (the "License"); # you may not use this file except in compliance with the License. # You may obtain a copy of the License at # http://www.apache.org/licenses/LICENSE-2.0 # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # RELEASE NOTES: Hortonworks Data Platform powered by Apache Hadoop Product Version: HDP-1.0.0.12 ============================================ This release of Hortonworks Data Platform (HDP) deploys the following Hadoop-related components: * Apache Hadoop 1.0.3 * Apache Pig 0.9.2 * Apache HBase 0.92.1+ * Apache Zookeeper 3.3.4 * Apache HCatalog 0.4.0 * Apache Hive 0.9.0 * Ganglia 3.2.0 * Nagios 3.2.3 * Templeton 0.1.4 * Apache Oozie 3.1.3 * Apache Sqoop 1.4.1 Patch Information ---------------------------------------- * Hadoop is patched to include HADOOP-5464, HDFS-2617, HDFS-3466, HDFS-3461, HADOOP-6947, and MAPREDUCE-3837. * HBase is based on Apache SVN branch 0.92, revision 1344056, plus patches for HBASE-6054, HBASE-5986, HBASE-6088, and HBASE-6107. * Hive is patched to include HIVE-2084 and HIVE-2918. * Oozie is patched to include OOZIE-698, OOZIE-697, OOZIE-810, and OOZIE-863. * Sqoop is patched to include SQOOP-438 and SQOOP-462. * HCatalog is patched to include HCATALOG-412, HCATALOG-410, and HCATALOG-420. Minimum system requirements ============================================== Hardware Recommendations --------------------------- Although there is no single hardware requirement for installing HDP, there are some basic guide­lines. You can see sample setups here:http://docs.hortonworks.com/CURRENT/index.htm#About_Hortonworks_Data_Platform/Suggested_Hardware_Recommendations_For_Apache_Hadoop.htm Operating Systems Requirements ------------------------------------ The following operating systems are supported: * 64-bit Red Hat Enterprise Linux (RHEL) v5.* * 64-bit CentOS v5.* IMPORTANT: All hosts in the cluster must run the same OS, version and patch sets. Graphics Requirements ------------------------ The HMC deployment wizard runs as a browser-based Web app. You must have a machine capable of running a graphical browser to use this tool. Software Requirements ----------------------- On each of your hosts: * yum * rpm * scp * curl * wget * pdsh * net-snmp * net-snmp-utils On the machine from which you will run HMC: * Firefox v.12+ Database Requirements ----------------------- Hive or HCatalog requires a MySQL database for its use. You can choose to use a current instance or let the HMC deployment wizard create one for you. Improvements for HDP-1.0.0.12 ============================================= * Introduced Hortonworks Management Center (HMC). HMC is the graphical user interface (GUI) based installer for managing and monitoring end-to-end Hadoop deployments. For more details, see: http://docs.hortonworks.com/CURRENT/Deploying_Hortonworks_Data_Platform/Using_HMC/Getting_Ready_To_Install/Getting_Ready_to_Install.htm * Upgraded multiple components. * Added support for Talend Open Studio. HDP packages Talend Open Studio to provide a graphical interface for Extract, Transform, and Load (ETL). Talend utilizes HDP’s HCatalog metadata management capability to import raw data into Hadoop, create and manage schemas on the raw data, and facilitate transformational queries on that data. For more details, see: http://docs.hortonworks.com/CURRENT/index.htm#Data_Integration_Services_With_HDP/Using_ETL_Services_Powered_By_Talend.htm Known issues with HDP-1.0.0.12 ============================================= * HMC installation currently does not support Hadoop security. * Using init.d scripts for starting and stopping services is not recommended. * To use Oozie command line client, you must first export JAVA_HOME. * Pig jobs submitted via Templeton fail. For workaround, see: http://docs.hortonworks.com/CURRENT/index.htm#Deploying_Hortonworks_Data_Platform/Using_HMC/Troubleshooting/Specific_Issues.htm * The Sqoop client deployed by HMC does not have the neccessary MySQL connector JAR file. For workaround, see: http://docs.hortonworks.com/CURRENT/index.htm#Deploying_Hortonworks_Data_Platform/Using_HMC/Troubleshooting/Specific_Issues.htm * Pig or MapReduce jobs get incorrect data when reading binary data type from the HCatalog table. For more details, see: https://issues.apache.org/jira/browse/HCATALOG-430. Hortonworks offers technical support subscriptions for Hortonworks Data Platform. For more information, please visit http://hortonworks.com/support/ or contact us directly at info@hortonworks.com.