Upgrading HDP Manually
Also available as:
PDF
loading table of contents...

Configure and Start Apache Sqoop

Before you can upgrade Apache Sqoop, you must have first upgraded your HDP components to the latest version (in this case, 2.4.0). This section assumes that you have already upgraded your components for HDP 2.4.0. If you have not already completed these steps, return to Getting Ready to Upgrade and Upgrade 2.2 Components for instructions on how to upgrade your HDP components to 2.4.0.

[Note]Note

The su commands in this section use keywords to represent the Service user. For example, "hdfs" is used to represent the HDFS Service user. If you are using another name for your Service users, you will need to substitute your Service user name in each of the su commands.

  1. Replace your configuration after upgrading. Copy /etc/sqoop/conf from the template to the conf directory in sqoop hosts.

  2. As the HDFS Service user, upload the Sqoop tarball to HDFS.

    su - hdfs -c "hdfs dfs -mkdir -p /hdp/apps/2.4.0.0-$BUILD/sqoop" 
                    
    su - hdfs -c "hdfs dfs -chmod -R 555 /hdp/apps/2.4.0.0-$BUILD/sqoop" 
    
    su - hdfs -c "hdfs dfs -chown -R hdfs:hadoop /hdp/apps/2.4.0.0-$BUILD/sqoop" 
    
    su - hdfs -c "hdfs dfs -put /usr/hdp/2.4.0.0-$BUILD/sqoop/sqoop.tar.gz /hdp/apps/2.4.0.0-$BUILD/sqoop/sqoop.tar.gz" 
    
    su - hdfs -c "hdfs dfs -chmod 444 /hdp/apps/2.4.0.0-$BUILD/sqoop/sqoop.tar.gz"
  3. If you are using the MySQL database as a source or target, then the MySQL connector jar must be updated to 5.1.29 or later.

    Refer to the MySQL web site for information on updating the MySQL connector jar.

  4. Because Sqoop is a client tool with no server component, you will need to run your own jobs to validate the upgrade.