Administration
Also available as:
PDF
loading table of contents...

Storm is Not Receiving Data From a New Data Source

  1. Ensure that your Grok parser statement is valid.

    You can use GrokConstructor to test your parser statement.

    If you need to modify your Grok parser statement, you must kill the topology for your new data source in the Storm UI and then resubmit your data source.

    1. Log into HOST $HOST_WITH_ENRICHMENT_TAG as root.

    2. Deploy the new parser topology:

      $METRON_HOME/bin/start_parser_topology.sh -k $KAFKA_HOST:6667 -z $ZOOKEEPER_HOST:2181 -s $DATASOURCE
    3. Go to the Storm UI. You should now see the new topology. Ensure that the topology has no errors.

  2. Ensure that the Kafka topic you created for your new data source is receiving data.

  3. Check your NiFi configuration to ensure that data is flowing between the Kafka topic for your new data source into HCP.