2. Meet Minimum System Requirements

To run the Hortonworks Data Platform, your system must meet minimum requirements.

 2.1. Hardware Recommendations

Although there is no single hardware requirement for installing HDP, there are some basic guidelines. You can see sample setups here: Hardware Recommendations for Apache Hadoop.

 2.2. Operating Systems Requirements

The following operating systems are supported:

  • 64-bit Red Hat Enterprise Linux (RHEL) 5 or 6

  • 64-bit CentOS 5 or 6

  • 64-bit SUSE Linux Enterprise Server (SLES) 11, SP1

 2.3. Software Requirements

On each of your hosts:

  • yum [for RHEL or CentOS]

  • zypper [for SLES]

  • rpm

  • scp [for multiple node installs]

  • curl

  • wget

  • unzip

  • tar

  • pdsh [for multiple node installs over many hosts]

 2.4. Database Requirements

  • To use external database for Hive or Oozie metastore, ensure that a MySQL or Oracle database is deployed and available.

    (By default, Oozie uses Derby database for its metastore.)

    • For instructions on deploying and/or configuring MySQL database instance, see here.

    • For instructions on configuring an existing Oracle database instance, see here.

      [Note]Note

      To deploy a new Oracle instance, consult your database administrator.

  • Ensure that your database administrator creates the following databases and users. (For instructions on creating users for MySQL, see here.):

    • If deploying Hive:

      1. hive_dbname: Required if using MySQL database for Hive Metastore.

      2. hive_dbuser

      3. hive_dbpasswd

    • If deploying Oozie:

      1. oozie_dbname: Required if using MySQL database for Oozie Metastore.

      2. oozie_dbuser

      3. oozie_dbpasswd

 Instructions to setup MySQL database

  1. Connect to the host machine where you plan to deploy MySQL instance and from a terminal window, type:

    • For RHEL and CentOS:

      yum install mysql-server
    • For SLES:

      zypper install mysql
  2. Start the instance.

    • For RHEL and CentOS:

      /etc/init.d/mysqld start
    • For SLES:

      /etc/init.d/mysql start
  3. Set the root user password and remove unnecessary information from log and STDOUT.

    mysqladmin -u root password ‘$password’
    mysqladmin -u root 2>&1 >/dev/null
  4. Install the MySQL connector jar

    yum install mysql-connector-java-5.0.8-1

 Instructions to configure Oracle database

  • Download the Oracle JDBC (OJDBC) driver from here and copy the downloaded JAR file to the following locations:

    [Note]Note

    The following instructions are for OJDBC driver for Oracle 11g.

    • If installing Hive: Copy the JAR file to /usr/lib/hive/lib/.

    • If using external Oracle database for Oozie metastore: Copy the JAR file to /usr/lib/oozie/libtools/.

    • If installing Sqoop: Copy the JAR file to /usr/lib/sqoop/lib.

  • Ensure that the following SQL script is run against your Hive schema:

    master-install-location/gsInstaller/confSupport/sql/oracle/hive-schema-0.10.0.oracle.sql

 Instructions on manually creating users for MySQL:

  • As root, use mysql (or other client tool) to create the “dbuser” and grant it adequate privileges.

    (For access to Hive metastore, create hive_dbuser and for access to Oozie metastore, create oozie_dbuser.

    CREATE USER 'dbusername'@'%' IDENTIFIED BY 'dbuserpassword';
    GRANT ALL PRIVILEGES ON *.* TO 'dbusername'@'%';
    flush privileges;
  • See if you can connect to the database as that user. You are prompted to enter the dbuserpassword password above.

    mysql -u $dbusername -p

 2.5. JDK Requirements

Your system must have the correct JDK installed on all the nodes of the cluster. HDP requires Oracle JDK 1.6 update 31. For more information, see Install the Java Development Kit.


loading table of contents...