Collecting Profile Data Globally (By Modifying Environment Variables)

In addition to collecting profile data by modifying the training script, you can also enable profiling by setting environment variables. A configuration example is provided as follows:

1
2
3
4

# Enable profiling.
export PROFILING_MODE=true 
# Configure profiling configuration options.
export PROFILING_OPTIONS='{"output":"/home/test/output","training_trace":"on","task_trace":"on","aicpu":"on","fp_point":"","bp_point":"","aic_metrics":"PipeUtilization"}'

For details about how to set the PROFILING_OPTIONS environment variable, see "Profile Data Collection" in Environment Variables.

Note that the environment variable PROFILING_MODE takes lower priority than the profiling_mode configuration item in the training script.