Getting Started with Streaming Analytics
Also available as:
PDF
loading table of contents...

Streaming Violation Events into a Data Lake and Operational Data Store

Another common requirement is to stream data into an operational data store like HBase to power real-time web applications as well as a data lake powered by HDFS for long term storage and batch ETL and analytics.

  1. Drag the HBase sink to the canvas and connect it to the ViolationEvents Rule processor.

  2. Configure the Hbase Sink using the following parameters.

  3. Drag the HDFS sink to the canvas and connect it to the ViolationEvents Rule processor.

  4. Configure HDFS as below.

    Make sure you have permission to write into the directory you have configured for HDFS path.