Understanding Parsing
Also available as:
PDF

Parser Configuration

The configuration for the various parser topologies is defined by JSON documents stored in ZooKeeper.

The JSON document consists of the following attributes:
parserClassName

The fully qualified class name for the parser to be used.

sensorTopic

The Kafka topic to send the parsed messages to.

parserConfig

A JSON Map representing the parser implementation specific configuration.

fieldTransformations

An array of complex objects representing the transformations to be done on the message generated from the parser before writing out to the Kafka topic.

The fieldTransformations is a complex object which defines a transformation that can be done to a message. This transformation can perform the following:

  • Modify existing fields to a message

  • Add new fields given the values of existing fields of a message

  • Remove existing fields of a message