3. Install Compression Libraries

Make the following compression libraries available on all the cluster nodes.

 3.1. Install Snappy

  1. Install Snappy.

    • For RHEL and CentOS

      yum install snappy snappy-devel
      
    • For SLES

      zypper install snappy snappy-devel
      
  2. Make the Snappy libraries available to Hadoop:

    ln -sf /usr/lib64/libsnappy.so /usr/lib/hadoop/lib/native/Linux-amd64-64/.

 3.2. Install LZO

[For RHEL and CentOS]

yum install hadoop-lzo lzo lzo-devel hadoop-lzo-native

[For SLES]

zypper install lzo lzo-devel hadoop-lzo hadoop-lzo-native

loading table of contents...