Hortonworks Data Platform

Installing HDP Manually

2013-08-30


Contents

1. Getting Ready to Install
1. Understand the Basics
2. Meet Minimum System Requirements
2.1. Hardware Recommendations
2.2. Operating Systems Requirements
2.3. Software Requirements
2.4. Database Requirements
2.5. JDK Requirements
2.6. Virtualization and Cloud Platforms
3. Configure the Remote Repositories
4. Decide on Deployment Type
5. Collect Information
6. Prepare the Environment
6.1. Enable NTP on the Cluster
6.2. Check DNS
6.3. Disable SELinux
6.4. Disable IPTables
7. [Optional] Install MySQL
8. Download Companion Files
9. Define Environment Parameters
10. [Optional] Create System Users and Groups
2. Installing HDFS and YARN
1. Set Default File and Directory Permissions
2. Install the Hadoop RPMs
3. Install Compression Libraries
3.1. Install Snappy
3.2. Install LZO
4. Create Directories
4.1. Create the NameNode Directories
4.2. Create the SecondaryNameNode Directories
4.3. Create DataNode and YARN NodeManager Local Directories
4.4. Create the Log and PID Directories
3. Setting Up the Hadoop Configuration
4. Validating the Core Hadoop Installation
1. Format and Start HDFS
2. Smoke Test HDFS
3. Start YARN
4. Start MapReduce JobHistory Server
5. Smoke Test MapReduce
5. Installing Apache Pig
1. Install the Pig RPMs
2. Set Up Configuration Files
3. Validate the Installation
6. Installing Apache Hive and Apache HCatalog
1. Install the Hive and HCatalog RPMs
2. Set Directories and Permissions
3. Set Up the Hive/HCatalog Configuration Files
4. Create Directories on HDFS
5. Validate the Installation
7. Installing Hue
1. Prerequisites
2. Configure HDP
3. Install Hue
4. Configure Hue
4.1. Configure Web Server
4.2. Configure Hadoop
4.3. Configure Beeswax
4.4. Configure JobDesigner and Oozie
4.5. Configure UserAdmin
4.6. Configure WebHCat
5. Start Hue
6. Validate Configuration
8. Installing WebHCat
1. Install the WebHCat RPMs
2. Set Directories and Permissions
3. Modify WebHCat Configuration Files
4. Set Up HDFS User and Prepare WebHCat Directories On HDFS
5. Validate the Installation
9. Installing HBase and Zookeeper
1. Install the HBase and ZooKeeper RPMs
2. Set Directories and Permissions
3. Set Up the Configuration Files
4. Validate the Installation
10. Installing Apache Oozie
1. Install the Oozie RPMs
2. Set Directories and Permissions
3. Set Up the Oozie Configuration Files
4. Validate the Installation
11. Installing Apache Sqoop
1. Install the Sqoop RPMs
2. Set Up the Sqoop Configuration
3. Validate the Installation
12. Installing and Configuring Flume in HDP
1. Understand Flume
1.1. Flume Components
2. Install Flume
2.1. Prerequisites
2.2. Installation
2.3. Users
2.4. Directories
3. Configure Flume
4. Start Flume
5. HDP and Flume
5.1. Sources
5.2. Channels
5.3. Sinks
6. A Simple Example
13. Manual Install Appendix: Tarballs
14. Uninstalling HDP

loading table of contents...