To keep the same metadata and user data when upgrading, use the directory settings and database settings in the cluster properties file of your current version to form the basis of your new cluster properties file.
Using the existing HDP cluster properties file, make the following changes:
Upgrading from HDP 1.3 to HDP 2.2:
Change
JOBTRACKER_HOST
toRESOURCEMANAGER_HOST
(leave the definition the same).(Optional:)Add a definition for
CLIENT_HOSTS
.(Optional:) Add a definition for
KNOX_HOST
.(Optional:) Add a definition for
STORM_NIMBUS
.(Optional:) Add a definition for
STORM_SUPERVISORS
.(Optional:) Add a definition for
FALCON_HOSTS
.If you are upgrading a High Availability cluster, change
HA_NAMENODE_HOST
toNN_HA_STANDBY_NAMENODE_HOST
.Add a definition for
DB_PORT
. (Default port for derby is1527.)(Required) Add a definition for
IS_TEZ
.(Required) Add a definition for
IS_PHOENIX
.(Required) Add a definition for
HDFS_NAMENODE_DATA_DIR
. (Default isc:\hdpdata\hdfs
.)(Required) Add a definition for
HDFS_DATANODE_DATA_DIR
. (Default isc:\hdpdata\hdfs
.)(Required) Add a definition for
IS_HDFS_HA
. (Default is "no".)(Required) If you are using
msiexec
to install HDP 2.2, there are two new mandatory parameters:RANGER
(default = "no") andKNOX_MASTER_SECRET
(user-supplied password). If you plan to use Ranger, see Manually Creating a Cluster Properties File for a list of Ranger properties.
Upgrading from HDP 2.0 to HDP 2.2:
(Optional:) Add a definition for
KNOX_HOST
.(Optional:) Add a definition for
STORM_NIMBUS
.(Optional:) Add a definition for
STORM_SUPERVISORS
.(Optional:) Add a definition for
FALCON_HOSTS
.Add a definition for
DB_PORT
. (Default port for derby is 1527.)(Required) Add a definition for
IS_TEZ
.(Required) Add a definition for
IS_PHOENIX
.For High Availability clusters, update the HA properties as follows:
Change
HA_NAMENODE_HOST
toNN_HA_STANDBY_NAMENODE_HOST
.Change
HA_JOURNALNODE_HOSTS
toNN_HA_JOURNALNODE_HOSTS
.Change
HA_CLUSTER_NAME
toNN_HA_CLUSTER_NAME
.Change
HA_JOURNALNODE_EDITS_DIR
toNN_HA_JOURNALNODE_EDITS_DIR
(Required) Add a definition for
HDFS_NAMENODE_DATA_DIR
. (Default isc:\hdpdata\hdfs
.)(Required) Add a definition for
HDFS_DATANODE_DATA_DIR
. (Default isc:\hdpdata\hdfs
.)(Required) Add a definition for
IS_HDFS_HA
. (Default is "No".)(Required) If you are using
msiexec
to install HDP 2.2, there are two new mandatory parameters:RANGER
(default = "no") andKNOX_MASTER_SECRET
(user-supplied password). If you plan to use Ranger, see Manually Creating a Cluster Properties File for a list of Ranger properties.
Upgrading from HDP 2.1 to HDP 2.2
(Required) Add a definition for
HDFS_NAMENODE_DATA_DIR
. (Default isc:\hdpdata\hdfs
.)(Required) Add a definition for
HDFS_DATANODE_DATA_DIR
. (Default isc:\hdpdata\hdfs
.) Note that NameNode and DataNode service startup might fail if the new datanode and namenode directories do not have hadoop user permissions. This could happen if you restore HDFS metadata from a backup. To avoid this issue, add the original datanode/namenode path to the cluster properties file before upgrading.(Required) Add a definition for
IS_HDFS_HA
. (Default is "No".)(Required) If you are using
msiexec
to install HDP 2.2, there are two new mandatory parameters:RANGER
(default = "no") andKNOX_MASTER_SECRET
If you plan to use Ranger, see Manually Creating a Cluster Properties File for a list of Ranger properties.
Save the new cluster properties file for use with the installer.