Release Notes
Also available as:
PDF

Flume

HDP 2.5.0 provides Flume 1.5.2 and the following Apache patch:

  • FLUME-2498: Implement Taildir Source.

  • FLUME-2500: Add a channel that uses Kafka.

  • FLUME-2523: Document Kafka channel.

  • FLUME-2560: Add Kafka Channel to dist tarballs.

  • FLUME-2562: Add metrics for Kafka Source, Kafka Sink and Kafka Channel.

  • FLUME-2729: Allow pollableSource backoff times to be configurable.

  • FLUME-2734: Kafka Channel timeout property is overridden by default value.

  • FLUME-2781: Kafka Channel with parseAsFLUMEEvent=true should write data as is, not as FLUME events.

  • FLUME-2801: Performance improvement on TailDir source.

  • FLUME-2823: FLUME-Kafka-Channel with new APIs.

  • FLUME-2901: Document Kerberos setup for Kafka channel.

  • FLUME-2947: Upgrade Hive and thrift dependencies.