Ambari Managed HDF Upgrade
Also available as:
PDF

Chapter 5. Upgrading HDF Services

About This Task

If you are upgrading HDF Services in an Ambari-managed HDP cluster, some manual upgrade steps are required on each host where and HDF service is running.

Steps

  1. Update the Base URL for HDF to the URL for HDF 3.0.2.

    [root@host ~]# vi /etc/yum.repos.d/HDF.repo
    baseurl=<os-specific-base-url>

    For the Base URL appropriate for your OS, see the HDF 3.0.2 Release Notes.

  2. Confirm the HDF components and version you have installed.

    For example:

    [root@host registry]# yum list installed | grep HDF
    
    hdf-select.noarch                 3.0.0.0-453.el6           @HDF-3.0            
    nifi_3_0_0_0_453.x86_64           1.2.0.3.0.0.0-453.el6     @HDF-3.0            
                                      0.7.0.3.0.0.0-453.el6     @HDF-3.0            
    registry_3_0_0_0_453.noarch       0.3.0.3.0.0.0-453.el6     @HDF-3.0            
    storm_3_0_0_0_453.x86_64          1.1.0.3.0.0.0-453.el6     @HDF-3.0            
    streamline_3_0_0_0_453.x86_64     0.5.0.3.0.0.0-453.el6     @HDF-3.0            
    zookeeper_3_0_0_0_453.noarch      3.4.6.3.0.0.0-453.el6     @HDF-3.0 
    
  3. Display the current version associated with each service.

    For example:

    [root@host registry]# hdf-select status | grep 3.0.0.0-453
    
    nifi - 3.0.0.0-453
    registry - 3.0.0.0-453
    storm-client - 3.0.0.0-453
    storm-nimbus - 3.0.0.0-453
    storm-supervisor - 3.0.0.0-453
    streamline - 3.0.0.0-453
    zookeeper-client - 3.0.0.0-453
    zookeeper-server - 3.0.0.0-453
    
  4. Install the binaries for each HDF service.

    [Note]Note

    On each Ambari Agent, do this only for the services you have already installed. For example, if only NiFi is installed, only perform the updated install for the NiFi service.

    For example:

    [root@host ~]# yum install -y nifi_3_0_2_0_76*
    [root@host ~]# yum install -y registry_3_0_2_0_76*
    [root@host ~]# yum install -y streamline_3_0_2_0_76*
    
  5. Use hdf-select to ensure that you have the appropriate links to the newly installed version.

    [Note]Note

    Installing SAM creates Storm and ZooKeeper dependencies that you can address by falling the Warning notes during the installation.

    For example:

    [root@host ~]# hdf-select set nifi 3.0.2.0-76
    [root@host ~]# hdf-select set registry 3.0.2.0-76
    [root@host ~]# hdf-select set streamline 3.0.2.0-76
    [root@host ~]# hdf-select set storm-nimbus 3.0.2.0-76
    [root@host ~]# hdf-select set storm-supervisor 3.0.2.0-76
    [root@host ~]# hdf-select set zookeeper-client 3.0.2.0-76
    
    WARNING: Replacing link /usr/bin/zookeeper-client from /usr/hdp/current/zookeeper-client/bin/zookeeper-client
    
    [root@host ~]# hdf-select set zookeeper-server 3.0.2.0-76
    
    WARNING: Replacing link /usr/bin/zookeeper-server from /usr/hdp/current/zookeeper-server/bin/zookeeper-server
    WARNING: Replacing link /usr/bin/zookeeper-server-cleanup from /usr/hdp/current/zookeeper-server/bin/zookeeper-server-cleanup
    
  6. Confirm your HDF service upgrades.

    For example:

    [root@host ~]# hdf-select status | grep 3.0.2.0-76
    nifi - 3.0.2.0-76
    registry - 3.0.2.0-76
    storm-nimbus - 3.0.2.0-76
    storm-supervisor - 3.0.2.0-76
    streamline - 3.0.2.0-76
    zookeeper-client - 3.0.2.0-76
    zookeeper-server - 3.0.2.0-76
    
  7. Execute the following operation on one host where SAM is installed:

    [root@host ~]# export JAVA_HOME=/usr/jdk64/jdk1.8.0_112 ; source 
    /usr/hdf/current/streamline/conf/streamline-env.sh ; 
    /usr/hdf/current/streamline/bootstrap/bootstrap-storage.sh create
    
  8. Execute the following operation on one host where Schema Registry is installed:

    [root@host ~]# export JAVA_HOME=/usr/jdk64/jdk1.8.0_112 ; source 
    /usr/hdf/current/registry/conf/registry-env.sh ; 
    /usr/hdf/current/registry/bootstrap/bootstrap-storage.sh create
    

Result

You can now log onto Ambari and start your upgrade NiFi, SAM, and Schema Registry services.