2. Install Flume

Flume is included in the HDP repository, but it is not installed automatically as part of the standard HDP installation process.

 2.1. Prerequisites

  1. The following Flume components have HDP component dependencies. You cannot use these Flume components if the dependencies are not installed.

     

    Table 13.1. Flume 1.4.0 Dependencies

    Flume 1.4.0 ComponentHDP Component Dependencies
    HDFS SinkHadoop 2.2.0
    HBase SinkHBase 0.96.1


    See HDP Deployment Options for more information.

  2. Verify the HDP repositories are available:

    yum list flume

    The output should list at least one Flume package similar to the following:

    flume.noarch 1.5.2.2.2.6.0-2800.el6 HDP-2.2

    If yum responds with "Error: No matching package to list" as shown below, yum cannot locate a matching RPM. This can happen if the repository hosting the HDP RPMs is unavailable, or has been disabled. Follow the instructions at Configure the Remote Repositories to configure either a public or private repository before proceeding.

    Error: No matching package to list.

  3. You must correctly set and export your JAVA_HOME environment variable for your operating system. See JDK Requirements for instructions on installing JDK.

 2.2. Installation

Verify the HDP repositories are available for your Flume installation by entering yum list flume. See Prerequisites for more information.

To install Flume, from a terminal window type:

  • For RHEL or CentOS

    yum install flume
    yum install flume-agent #This installs init scripts
  • For SLES

    zypper install flume
    zypper install flume-agent #This installs init scripts
  • For Ubuntu

    apt-get install flume
    apt-get install flume-agent #This installs init scripts

 2.3. Users

The installation process automatically sets up the appropriate flume user and flume group in the operating system.

 2.4. Directories

The main Flume files are located in /usr/lib/flume and the main configuration files are located in /etc/flume/conf.


loading table of contents...