Installing an HDF Cluster
Also available as:
PDF
loading table of contents...

Setting up a Local Repository With Temporary Internet Access

Prerequisites

Complete the Getting Started Setting up a Local Repository procedure.

Steps

  1. Put the repository configuration files for Ambari and the Stack in place on the host.

  2. Confirm availability of the repositories.

    For RHEL/CentOS/Oracle Linux:
    yum repolist
    For SLES:
    zypper repos
    For Debian/Ubuntu:
    dpkg-list
  3. Synchronize the repository contents to your mirror server.

    • Browse to the web server directory:

      For RHEL/CentOS/Oracle Linux:
      cd /var/www/html
      For SLES:
      cd /srv/www/htdocs/rpms
      For Debain/Ubuntu:
      cd /var/www/html
    • For Ambari, create ambari directory and reposync.

      mkdir -p ambari/<OS>
      cd ambari/<OS>
      reposync -r Updates-Ambari-2.6.0.0

      where <OS> is centos6, centos7, sles11, sles12, ubuntu14, ubuntu16, or debian7.

    • For HDP Stack Repositories, create hdp directory and reposync.

       mkdir -p hdp/<OS>
      cd hdp/<OS>
      reposync -r HDP-<latest.version>
      reposync -r HDP-UTILS-<version>
    • For HDF Stack Repositories, create an hdf directory and reposync.

       mkdir -p hdf/<OS>
      cd hdf/<OS>
      reposync -r HDF-<latest.version>
  4. Generate the repository metadata.

    For Ambari:
    createrepo <web.server.directory>/ambari/<OS>/Updates-Ambari-2.6.0.0
    For HDP Stack Repositories:
    createrepo <web.server.directory>/hdp/<OS>/HDP-<latest.version>
    createrepo <web.server.directory>/hdp/<OS>/HDP-UTILS-<version>
    For HDF Stack Repositories:
    createrepo <web.server.directory>/hdf/<OS>/HDF-<latest.version>
  5. Confirm that you can browse to the newly created repository.

    URLs for the New Repository

    Ambari Base URL

    http://<web.server>/ambari/<OS>/Updates-Ambari-2.6.0.0

    HDF Base URL

    http://<web.server>/hdf/<OS>/HDF-<latest.version>

    HDP Base URL

    http://<web.server>/hdp/<OS>/HDP-<latest.version>

    HDP-UTILS Base URL

    http://<web.server>/hdp/<OS>/HDP-UTILS-<version>

    Where:

    • <web.server> – The FQDN of the web server host

    • <version> – The Hortonworks stack version number

    • <OS> – centos6, centos7, sles11, sles12, ubuntu14, ubuntu16, or debian7

    [Important]Important

    Be sure to record these Base URLs. You will need them when installing Ambari and the Cluster.

  6. Optional. If you have multiple repositories configured in your environment, deploy the following plug-in on all the nodes in your cluster.

    1. Install the plug-in.

      For RHEL and CentOS 7:
      yum install yum-plugin-priorities
      For RHEL and CentOS 6:
      yum install yum-plugin-priorities
    2. Edit the /etc/yum/pluginconf.d/priorities.conf file to add the following:

      [main]
      enabled=1
      gpgcheck=0