Use a workstation with access to the Internet and download the tarball image of the appropriate Hortonworks yum repository.
Table 4.3. Deploying HDP - Option I Cluster OS HDP Repository Tarballs RHEL/ CentOS 5.x
HDP Repository:
//public-repo-1.hortonworks.com/HDP-1.2.0/repos/centos5/HDP-1.2.0-centos5.tar.gz
HDP-Utils Repository:
//public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.15/repos/centos5/HDP-UTILS-1.1.0.15-centos5.tar.gz
Ambari Repository (Optional):
//public-repo-1.hortonworks.com/AMBARI-1.x/repos/centos5/AMBARI-1.2.0.1-centos5.tar.gz
RHEL/ CentOS 6.x
HDP Repository:
//public-repo-1.hortonworks.com/HDP-1.2.0/repos/centos6/HDP-1.2.0-centos6.tar.gz
HDP-Utils Repository:
//public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.15/repos/centos6/HDP-UTILS-1.1.0.15-centos6.tar.gz
Ambari Repository (Optional):
//public-repo-1.hortonworks.com/AMBARI-1.x/repos/centos6/AMBARI-1.2.0.1-centos6.tar.gz
SLES 11
HDP Repository:
//public-repo-1.hortonworks.com/HDP-1.2.0/repos/suse11/HDP-1.2.0-suse11.tar.gz
HDP-Utils Repository:
//public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.15/repos/suse11/HDP-UTILS-1.1.0.15-suse11.tar.gz
Ambari Repository (Optional):
//public-repo-1.hortonworks.com/AMBARI-1.x/repos/suse11/AMBARI-1.2.0.1-suse11.tar.gz
Note The EPEL repository is not available as a tarball currently. Use one of Options II through IV to provide access to the EPEL repository.
Create an HTTP server.
On the mirror server, install an HTTP server (such as Apache httpd) using the instructions provided here.
Activate this web server.
Ensure that the firewall settings (if any) allow inbound HTTP access from your cluster nodes to your mirror server.
Note If you are using EC2, make sure that SELinux is disabled.
On your mirror server, create a directory for your web server.
For example, from a shell window, type:
mkdir –p
/var/www/html/hdp/
If you are using a symlink, enable the
followsymlinks
on your web server.
Copy the HDP Repository Tarballs to the directory created in step 3, and untar these tarballs.
Verify the configuration.
The configuration is successful, if you can access the above directory through your web browser. To test this out, browse to the following location:
http://
yourwebserver
/hdp/HDP-1.2.0/repos/os
where,
os
can be centos5, centos6, or suse11.You should see directory listing for all the HDP components along with the RPMs at the following location:
HDP-1.2.0/repos/
.os
Configure the
yum
orzypper
clients on all the nodes in your cluster.Fetch the yum configuration file from your mirror server.
http://yourwebserver/hdp/HDP-1.2.0/repos/os/hdp.repo
where
os
is either centos5, centos6, or suse11.Store the
hdp.repo
file in a temporary location and edit it, changing the value of the baseurl property to the local mirror URL. For example, http://yourwebserver
/hdp/HDP-1.2.0/repos/os
For RHEL and CentOS:
Use scp or pdsh to copy the client yum configuration file to
/etc/yum.repos.d/
directory on every node in the cluster.
For SLES:
Store the hdp.repo file back into the repository location in the web server.
cp /tmp/hdp.repo /var/www/html/hdp/HDP-1.2.0/repos/suse11/
On every node, invoke the following command:
zypper addrepo -r http://yourwebserver/hdp/HDP-1.2.0/repos/suse11/hdp.repo
OPTIONAL: To use HDP-UTILS, configure the HDP-UTILS repository on all the nodes in your cluster.
Fetch the client yum configuration file (
hdp-utils.repo
) from your mirror server.http://yourwebserver/hdp/HDP-UTILS-1.1.0.15/repos/os/hdp-utils.repo
where
os
is either centos5, centos6, or suse11.Store the
hdp-utils.repo
file in a temporary location and edit it, changing the value of the baseurl property to the local mirror URL.For example, http://
yourwebserver
/hdp/HDP-UTILS-1.1.0.15/repos/os
Copy the client yum configuration file on to
/etc/yum.repos.d/
directory on every node in the cluster.For RHEL and CentOS:
Use scp or pdsh to copy the client yum configuration file to
/etc/yum.repos.d/
directory on every node in the cluster.For SLES:
Store the
hdp-utils.repo
file back into the repository location in the web server.cp /tmp/ambari.repo /var/www/html/hdp/HDP-1.2.0/suse11/
On every node, invoke the following command:
zypper addrepo -r http://yourwebserver/hdp/HDP-1.2.0/repos/suse11/ambari.repo
OPTIONAL: To use Ambari for deploying HDP, configure the Ambari repository on all the nodes in your cluster.
Fetch the client yum configuration file (
ambari.repo
) from your mirror server.http://yourwebserver/hdp/AMBARI-1.x/repos/os/ambari.repo
where
os
is either centos5, centos6, or suse11 .Store the
ambari.repo
file in a temporary location and edit it, changing the value of the baseurl property to the local mirror URL.For example, http://
yourwebserver
/hdp/AMBARI-1.x/repos/os
Copy the client yum configuration file on to
/etc/yum.repos.d/
directory on every node in the cluster.For RHEL and CentOS:
Use scp or pdsh to copy the client yum configuration file to
/etc/yum.repos.d/
directory on every node in the cluster.
For SLES:
Store the
ambari.repo
file back into the repository location in the web server.cp /tmp/ambari.repo /var/www/html/hdp/AMBARI-1.x/suse11/
On every node, invoke the following command:
zypper addrepo -r http://yourwebserver/hdp/AMBARI-1.x/repos/suse11/ambari.repo
If your cluster runs CentOS or RHEL, and if you have multiple repositories configured in your environment, deploy the following plugin on all the nodes in your cluster.
Install the plugin.
For RHEL and CentOS v5.x
yum install yum-priorities
For RHEL and CentOS v6.x
yum install yum-plugin-priorities
Edit the
/etc/yum/pluginconf.d/priorities.conf
file to add the following:[main] enabled=1 gpgcheck=0