DocsHortonworks Data Platform

 

 3.2.2. Instructions

  • Temporarily reconfigure your firewall to allow Internet access from your mirror server host.

  • Execute the following command to download the appropriate Hortonworks yum client configuration file and save it in /etc/yum.repos.d/ directory on the mirror server host.

    Table 4.4. Deploying HDP - Option II
    Cluster OS HDP Repository Tarballs

    RHEL/ CentOS 5.x

    wget http://dev.hortonworks.com.s3.amazonaws.com/HDP-2.0.4.0/repos/centos5/hdp.repo -O /etc/yum.repos.d/hdp.repo

    RHEL/ CentOS 6.x

    wget http://dev.hortonworks.com.s3.amazonaws.com/HDP-2.0.4.0/repos/centos6/hdp.repo -O /etc/yum.repos.d/hdp.repo

  • Create an HTTP server.

    1. On the mirror server, install an HTTP server (such as Apache httpd) using the instructions provided http://httpd.apache.org/download.cgi

    2. Activate this web server.

    3. Ensure that the firewall settings (if any) allow inbound HTTP access from your cluster nodes to your mirror server.

      [Note]Note

      If you are using EC2, make sure that SELinux is disabled.

  • On your mirror server, create a directory for your web server.

    • For example, from a shell window, type: mkdir –p /var/www/html/hdp/.

    • If you are using a symlink, enable the followsymlinks on your web server.

  • Copy the contents of entire HDP repository for your desired OS from the remote yum server to your local mirror server.

    • Continuing the previous example, from a shell window, type:

      cd /var/www/html/hdp
reposync -r HDP-2.0.4.0
reposync -r HDP-UTILS-1.1.0.15

      You should now see both an HDP-2.0.4.0 directory and an HDP-UTILS-1.1.0.15 directory, each with several subdirectories.

  • Generate appropriate metadata.

    This step defines each directory as a yum repository. From a shell window, type: 

    createrepo /var/www/html/hdp/HDP-2.0.4.0
createrepo /var/www/html/hdp/HDP-UTILS-1.1.0.15

    You should see a new folder called repodata inside both HDP directories.

  • Verify the configuration.

    • The configuration is successful, if you can access the above directory through your web browser.

      To test this out, browse to the following location: http://yourwebserver/hdp/HDP-2.0.4.0/

    • You should now see directory listing for all the HDP components.

  • At this point, it is okay to disable external Internet access for the mirror server, so that the mirror server is once again entirely within your data center firewall.

  • Depending on your cluster OS, configure the yum clients on all the nodes in your cluster

    1. Edit the /etc/yum.repos.d/hdp.repo file, changing the value of the baseurl property to point to your local repositories based on your cluster OS. 

      [HDP-2.0.4.0]
name=Hortonworks Data Platform Version - HDP-2.0.4.0
baseurl=http://$yourwebserver/hdp/HDP-2.0.4.0/repos/$os
gpgcheck=1
gpgkey=http://dev.hortonworks.com.s3.amazonaws.com/HDP-2.0.4.0/repos/$os/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1

[HDP-UTILS-1.1.0.15]
name=Hortonworks Data Platform Utils Version - HDP-UTILS-1.1.0.15
baseurl=http://$yourwebserver/hdp/HDP-UTILS-1.1.0.15/repos/$os
gpgcheck=1
gpgkey=http://dev.hortonworks.com.s3.amazonaws.com/HDP-2.0.4.0/repos/$os/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1

      where

      • $yourwebserver is your local mirror server

      • $os can be either centos5 or centos6

    2. Use scp or pdsh to copy the client yum configuration file to /etc/yum.repos.d/ directory on every node in the cluster.

  • If you have multiple repositories configured in your environment, deploy the following plugin on all the nodes in your cluster.

    1. Install the plugin.

      • For RHEL and CentOs v5.x

        yum install yum-priorities

      • For RHEL and CentOs v6.x

        yum install yum-plugin-priorities

    2. Edit the /etc/yum/pluginconf.d/priorities.conf file to add the following: 

      [main]
enabled=1
gpgcheck=0

Legal notices