Tuning Guide
Also available as:
PDF

Modifying Enrichments Properties Using Flux (Advanced)

Some of the tuning enrichment properties can only be modified using Flux. However, if you manually change your Flux file, if you perform an upgrade, Ambari will overwrite all of your changes. Be sure to save your Flux changes prior to performing an upgrade.

[Important]Important

You should be familiar with Storm Flux before you adjust the values in this section. Changes to Flux file properties that are managed by Ambari will render Ambari unable to further manage the property.

You can find the enrichment Flux file at $METRON_HOME/flux/enrichment/remote.yaml.

The following table lists the enrichment properties you can modify in the flux file:

Table 3.2. 

CategoryFlux Property or FunctionFlux Section Location
Kafka spoutsession.timeout.msline 201, id: kafkaProps
 enable.auto.commitline 201, id: kafkaProps
 setPollTimeoutMsline 230, id: kafkaConfig
 setMaxUncommittedOffsetsline 230, id: kafkaConfig
 setOffsetCommitPeriodMsline 230, id: kafkaConfig

You can add Kafka spout properties or functions using two methods:

Flux properties - Flux → kafkaProps

Add a new key/value to the kafkaProps section HashMap on line 201. For example, if you want to set the Kafka Spout consumer's session.timeout.ms to 30 seconds, add the following:

       -   name: "put"
           args:
               - "session.timeout.ms"
               - 30000
Flux functions - Flux → kafkaConfig

Add a new setter to the kafkaConfig object section on line 230. For example, if you want to set the Kafka Spout consumer's poll timeout to 200 milliseconds, add the following under configMethods:

         -   name: "setPollTimeoutMs"
             args:
                 - 200