DPS Installation and Setup
Also available as:
PDF
loading table of contents...

Abstract

Please visit the Hortonworks DataPlane Service page for more information on Hortonworks DPS technology. For more information on Hortonworks support services, please visit either the Support or Training page. Feel free to contact us directly to discuss your specific needs.

Hortonworks reserves the right to change any products described herein at any time, and without notice. Hortonworks assumes no responsibility or liability arising from the use of products described herein, except as expressly agreed to in writing by Hortonworks.

Trademark: Hortonworks DataPlane Service and DPS are trademarks of Hortonworks, Inc. in the United States and other countries. All other trademarks are the property of their respective owners.


Contents

1. Overview
Supported Configurations
2. Planning for a DPS Installation
Support Matrix information
Requirements for DataPlane Service Platform Host
DPS Support Matrix Information
Required Docker Versions
Other Software Requirements
Processing and Memory Requirements
Port and Network Requirements
LDAP and AD Support Requirements
HDP 2.6.3 Apache Component Requirements
SmartSense Requirements
Additional DPS Requirements and Recommendations
DPS Service Requirements for HDP Clusters
DPS Support Matrix Information
Configuring Cluster Security for DPS Services
Data Lifecycle Manager (DLM) Installation Requirements and Recommendations
DLM Support Matrix Information
Port and Network Requirements
HDP 2.6.3 Apache Component Requirements
Additional DLM Requirements and Recommendations
Data Steward Studio (DSS) Installation Requirements and Recommendations
DSS Support Matrix Information
Other Software Requirements
Port and Network Requirements
HDP 2.6.3 Apache Component Requirements
3. Preparing Your External Database
4. Setting Up the Local Repository for Your DPS Installation
Prepare the Web Server for the Local Repository
Set Up a Local Repository
Create the Repository Configuration File
5. Installing DPS Services, Engines, and Agents
Install DPS Platform
Install the DPS Services
Install the Engines and Agents on Ambari Clusters
Configure the Beacon User if DLM Is Installed
Configure the Engines and Agents on Existing Ambari-Managed Clusters
Configure the Engines and Agents on New Ambari Clusters
6. Configuring DPS for Secure Clusters
Enabling DPS to Interact with HDP Clusters
Configure Ranger to Restrict Access to DPS
Overview of Knox Integration with DPS
7. Setting Up the DPS Services
Preparing for DPS Service Setup
Locate the Required IP Address if Using Packaged LDAP Server (Non-Production Only)
Gather LDAP Server Details if Using Corporate LDAP
Gather Additional Setup Information
Accessing DPS Platform for the First Time
Configure LDAP for DPS
Add Users and Assign Roles for Services
Register Clusters with DPS
Enable Services
Enable Clusters for a Service
Navigating Between Services
8. Reference
Installation Configuration Properties
dpdeploy.sh Script Command Reference
9. Examples
Example token.xml Topology File with Ranger Enabled
10. Troubleshooting Installation Issues
Logging in Using the DPS Local Admin Role
wget Command is Not Available
Delete and Clean Up Docker Containers
Cluster Registration Error Messages
Cluster is not reachable
Knox is not set up on the HDP cluster, or Ambari credentials are incorrect for 'seeded user' mode
Knox setup is incorrect on the HDP cluster
Cannot register a cluster, other causes
Cluster status displays incorrectly on Details page