Flume is included in the HDP repository, but it is not installed automatically as part of the standard HDP installation process.
The following Flume components have HDP component dependencies. You cannot use these Flume components if the dependencies are not installed.
Table 13.1. Flume 1.4.0 Dependencies
Flume 1.4.0 Component HDP Component Dependencies HDFS Sink Hadoop 2.2.0 HBase Sink HBase 0.96.1
See HDP Deployment Options for more information.
Verify the HDP repositories are available:
yum list flume
The output should list at least one Flume package similar to the following:
flume.noarch 1.5.2.2.2.6.0-2800.el6 HDP-2.2
If yum responds with "Error: No matching package to list" as shown below, yum cannot locate a matching RPM. This can happen if the repository hosting the HDP RPMs is unavailable, or has been disabled. Follow the instructions at Configure the Remote Repositories to configure either a public or private repository before proceeding.
Error: No matching package to list.
You must correctly set and export your
JAVA_HOME
environment variable for your operating system. See JDK Requirements for instructions on installing JDK.
Verify the HDP repositories are available for your Flume installation by entering
yum list flume
. See Prerequisites for more information.
To install Flume, from a terminal window type:
For RHEL or CentOS
yum install flume yum install flume-agent #This installs init scripts
For SLES
zypper install flume zypper install flume-agent #This installs init scripts
For Ubuntu
apt-get install flume apt-get install flume-agent #This installs init scripts
The installation process automatically sets up the appropriate
flume
user and flume
group in the
operating system.