Collecting Profile Data Globally (By Modifying Environment Variables)

In addition to collecting profile data by modifying the training script, you can also enable profiling by setting environment variables. A configuration example is provided as follows:

1
2
3
4

# Enable profiling.
export PROFILING_MODE=true 
# Configure profiling configuration options.
export PROFILING_OPTIONS='{"output":"/home/HwHiAiUser/output","training_trace":"on","task_trace":"on","aicpu":"on","fp_point":"","bp_point":"","aic_metrics":"PipeUtilization"}'

For details about how to set the PROFILING_OPTIONS environment variable, see Auxiliary Functions > Profile Data Collection in Environment Variables.

Note that the configuration item profiling_mode in the training script is prior to the environment variable PROFILING_MODE.