Hortonworks Data Platform

Installing HDP Manually

2013-10-22


Contents

1. Getting Ready to Install
1. Understand the Basics
2. Meet Minimum System Requirements
2.1. Hardware Recommendations
2.2. Operating Systems Requirements
2.3. Software Requirements
2.4. Database Requirements
2.5. JDK Requirements
2.6. Virtualization and Cloud Platforms
3. Configure the Remote Repositories
4. Decide on Deployment Type
5. Collect Information
6. Prepare the Environment
6.1. Enable NTP on the Cluster
6.2. Check DNS
6.3. Disable SELinux
6.4. Disable IPTables
7. [Optional] Install MySQL
8. Download Companion Files
9. Define Environment Parameters
10. [Optional] Create System Users and Groups
2. Installing HDFS and YARN
1. Set Default File and Directory Permissions
2. Install the Hadoop Packages
3. Install Compression Libraries
3.1. Install Snappy
3.2. Install LZO
4. Create Directories
4.1. Create the NameNode Directories
4.2. Create the SecondaryNameNode Directories
4.3. Create DataNode and YARN NodeManager Local Directories
4.4. Create the Log and PID Directories
3. Setting Up the Hadoop Configuration
4. Validating the Core Hadoop Installation
1. Format and Start HDFS
2. Smoke Test HDFS
3. Start YARN
4. Start MapReduce JobHistory Server
5. Smoke Test MapReduce
5. Installing HBase and Zookeeper
1. Install the HBase and ZooKeeper RPMs
2. Set Directories and Permissions
3. Set Up the Configuration Files
4. Validate the Installation
6. Installing Apache Pig
1. Install the Pig RPMs
2. Set Up Configuration Files
3. Validate the Installation
7. Installing Apache Hive and Apache HCatalog
1. Install the Hive and HCatalog RPMs
2. Set Directories and Permissions
3. Set Up the Hive/HCatalog Configuration Files
4. Create Directories on HDFS
5. Validate the Installation
8. Installing WebHCat
1. Install the WebHCat RPMs
2. Set Directories and Permissions
3. Modify WebHCat Configuration Files
4. Set Up HDFS User and Prepare WebHCat Directories On HDFS
5. Validate the Installation
9. Installing Apache Oozie
1. Install the Oozie RPMs
2. Set Directories and Permissions
3. Set Up the Oozie Configuration Files
4. Validate the Installation
10. Installing Hue
1. Prerequisites
2. Configure HDP
3. Install Hue
4. Configure Hue
4.1. Configure Web Server
4.2. Configure Hadoop
4.3. Configure Beeswax
4.4. Configure JobDesigner and Oozie
4.5. Configure UserAdmin
4.6. Configure WebHCat
5. Start Hue
6. Validate Configuration
11. Installing Apache Sqoop
1. Install the Sqoop RPMs
2. Set Up the Sqoop Configuration
3. Validate the Installation
12. Installing Mahout
13. Installing and Configuring Flume in HDP
1. Understand Flume
1.1. Flume Components
2. Install Flume
2.1. Prerequisites
2.2. Installation
2.3. Users
2.4. Directories
3. Configure Flume
4. Start Flume
5. HDP and Flume
5.1. Sources
5.2. Channels
5.3. Sinks
6. A Simple Example
14. Installing Ganglia
1. Install the Ganglia RPMs
2. Install the Configuration Files
2.1. Extract the Ganglia Configuration Files
2.2. Copy the Configuration Files
2.3. Set Up Ganglia Hosts
2.4. Set Up Configurations
2.5. Set Up Hadoop Metrics
3. Validate the Installation
3.1. Start the Ganglia Server
3.2. Start Ganglia Monitoring on All Hosts
3.3. Confirm that Ganglia is Running
15. Installing Nagios
1. Install the Nagios RPMs
2. Install the Configuration Files
2.1. Extract the Nagios Configuration Files
2.2. Create the Nagios Directories
2.3. Copy the Configuration Files
2.4. Set the Nagios Admin Password
2.5. Set the Nagios Admin Email Contact Address
2.6. Register the Hadoop Configuration Files
2.7. Set Hosts
2.8. Set Host Groups
2.9. Set Services
2.10. Set Status
3. Validate the Installation
3.1. Validate the Nagios Installation
3.2. Start Nagios and httpd
3.3. Confirm Nagios is Running
3.4. Test Nagios Services
3.5. Test Nagios Access
3.6. Test Nagios Alerts
16. Manual Install Appendix: Tarballs
17. Upgrade HDP Manually
1. Getting Ready to Upgrade
2. Upgrade Hadoop
3. Migrate the HDP Configurations
4. Create Local Directories
5. Start HDFS
5.1. Verify HDFS filesystem health
5.2. Finalize Upgrade
5.3. Create HDFS Directories
5.4. Start YARN/MapReduce Services
5.5. Run Hadoop Smoke Tests
6. Upgrade ZooKeeper
7. Upgrade HBase
8. Upgrade Hive and HCatalog
9. Upgrade Oozie
10. Upgrade WebHCat (Templeton)
11. Upgrade Pig
12. Upgrade Sqoop
13. Upgrade Flume
13.1. Validate Flume
14. Upgrade Mahout
14.1. Mahout Validation
15. Upgrade Hue
18. Setting Up Security for Manual Installs
1. Preparing Kerberos
1.1. Kerberos Overview
1.2. Installing and Configuring the KDC
1.3. Creating the Database and Setting Up the First Administrator
1.4. Creating Service Principals and Keytab Files for HDP
2. Configuring HDP
2.1. Configuration Overview
2.2. Creating Mappings Between Principals and UNIX Usernames
2.3. Adding Security Information to Configuration Files
19. Uninstalling HDP

loading table of contents...