Chapter 2. Quick Start Guide for Single Node HDP Installation

Use the following instructions to deploy HDP on a single node Windows Server machine:

  1. Install the necessary prerequisites using one of the following options:

    • Option I - Use CLI: Download all prerequisites to a single directory and use command line interface (CLI) to install these prerequisites on a machine.

    • Option II - Install manually: Download each prerequisite and follow the step by step GUI driven manual instructions provided after download.

  2. Prepare the single node machine.

    1. Collect Information.

      Get the hostname of the server where you plan to install HDP. Open the command shell on that cluster host and execute the following command:

      > hostname
      WIN-RT345SERVER
                  

      Use the output of this command to identify the cluster machine.

    2. Configure firewall.

      HDP uses multiple ports for communication with clients and between service components.

      If your corporate policies require maintaining per server firewall, you must enable the ports listed here. Use the following command to open these ports:

      netsh advfirewall firewall add rule name=AllowRPCCommunication dir=in action=allow protocol=TCP localport=$PORT_NUMBER
      • For example, the following command will open up port 80 in the active Windows Firewall:

        netsh advfirewall firewall add rule name=AllowRPCCommunication dir=in action=allow protocol=TCP localport=135
      • For example, the following command will open ports all ports from 49152 to 65535. in the active Windows Firewall:

        netsh advfirewall firewall add rule name=AllowRPCCommunication dir=in action=allow protocol=TCP localport=49152-65535

      If your networks security policies allow you open all the ports, use the following instructions to disable Windows Firewall: http://technet.microsoft.com/en-us/library/cc766337(v=ws.10).aspx

  3. Specify the configuration for HDP on a single node machine.

    Create a clusterproperties.txt file. (The clusterproperties.txt is a text file and contains parameter definitions (like the hostnames of the nodes in your cluster, the roles for each of them, etc.).)

    Start creating the clusterproperties.txt file by copying the example text provided at the bottom of this section and modify it according to the hostname of your machine

    The following snapshot illustrates a sample clusterproperties.txt file:

    #Log directory
    HDP_LOG_DIR=c:\hadoop\logs
    
    #Data directory
    HDP_DATA_DIR=c:\hdp\data
    
    #Hosts (Roles for the host machines in your cluster)
    NAMENODE_HOST=${Hostname for your single node cluster}
    SECONDARY_NAMENODE_HOST=${Hostname for your single node cluster}
    JOBTRACKER_HOST=${Hostname for your single node cluster}
    HIVE_SERVER_HOST=${Hostname for your single node cluster}
    OOZIE_SERVER_HOST=${Hostname for your single node cluster}
    WEBHCAT_HOST=${Hostname for your single node cluster}
    FLUME_HOSTS=${Hostname for your single node cluster}
    HBASE_MASTER=${Hostname for your single node cluster}
    HBASE_REGIONSERVERS=${Hostname for your single node cluster}
    ZOOKEEPER_HOSTS=${Hostname for your single node cluster}
    SLAVE_HOSTS=${Hostname for your single node cluster}
    
    #Database host
    DB_FLAVOR=derby
    DB_HOSTNAME=${Hostname for your single node cluster}
    
    #Hive properties
    HIVE_DB_NAME=hive
    HIVE_DB_USERNAME=hive
    HIVE_DB_PASSWORD=hive
    
    #Oozie properties
    OOZIE_DB_NAME=oozie
    OOZIE_DB_USERNAME=oozie
    OOZIE_DB_PASSWORD=oozie

    More details on the clusterproperties.txt configuration options are available here.

  4. Install and start HDP,

    1. Download the HDP for Windows MSI from here.

      Open a command prompt with Administrator priveliges and execute the MSI installer command:

       msiexec /i "<$MSI_PATH>" /lv "<$PATH_to_Installer_Log_File>" HDP_LAYOUT="<$PATH_to_clusterproperties.txt_File>" HDP_DIR="<$PATH_to_HDP_Install_Dir>" DESTROY_DATA="<Yes_OR_No>"

      The following example illustrates the command, with parameters, to launch the installer:

       msiexec /i "hdp-win-1.1.msi" /lv "hdp.log" HDP_LAYOUT="C:\config\clusterproperties.txt" HDP_DIR="C:\hdp\hadoop" DESTROY_DATA="no"
                    

      As shown in the example above, the following command parameters should be modified to match your files and directotories:

      • HDP_LAYOUT: Absolute path to cluster properties file

      • HDP_DIR: Install directory for HDP

      • DESTROY_DATA: Whether to preserve or delete existing HDP data

    2. Start all HDP services on the single machine.

      In a command prompt, navigate to the HDP install directory. This is the 'HDP_DIR' setting from the msiexec command.

      Then execute 'start_local_hdp_services.cmd'.

       cd <$PATH_TO_HDP_DIR>
      start_local_hdp_services
                    
    3. Validate the install by running the full suite of smoke tests.

      Run-SmokeTests