Run the Batch Profiler
HCP provides a script called
start_batch_profiler.sh to simplify
running the batch profiler.
start_batch_profiler.shscript assumes the following:
- The script builds the profiles defined in
- The properties defined in
$METRON_HOME/config/batch-profiler.propertiesare passed to both the profiler and Spark. You can define both Spark and profiler properties in this same file.
- Spark is installed at
/usr/hdp/current/spark-client. This can be overridden if you define an environment variable called
SPARK_HOMEprior to executing the script.
Start the batch profile by entering the following:
source /etc/default/metron cd $METRON_HOME bin/start_batch_profiler.sh