Administering Ambari
Also available as:
PDF
loading table of contents...

Write custom Java to create LZO files

You may also write java that creates LZO files from text-formatted Hive query output.

  1. Create text files as the output of the Hive query.
  2. Write custom Java code to convert Hive query generated text files to .lzo files and generate lzo.index files for the .lzo files.

  3. Prefix the query string with these parameters:
    Table 1. Hive Query Parameters
    Parameter Value
    SET hive.exec.compress.output false
    SET mapreduce.output.fileoutputformat.compress false
    hive -e "SET hive.exec.compress.output=false;SET mapreduce.output.fileoutputformat.compress=false;<query-string>"