Overview

Currently, HCP supports the following indices:

Elasticsearch
Solr
HDFS under /apps/metron/enrichment/indexed

Depending on how you start the indexing topology, it can have HDFS and either Elasticsearch or SOLR writers running.

Just like the Global Configuration file, the Indexing Configuration file format is a JSON file stored in ZooKeeper and on disk at $METRON_HOME/config/zookeeper/indexing.

Errors during indexing are sent to a Kafka queue called index_errors.

Within the sensor-specific configuration, you can configure the individual writers. The parameters currently supported are:

index: The name of the index to write to (defaulted to the name of the sensor).
batchSize: The size of the batch that is written to the indices at once (defaulted to 1).
enabled: Whether the index or writer is enabled (default true).

​Overview

Overview