Analyzing AI Core Errors

Description

Analyze the fault information about AI Core errors to help locate the errors.

During service execution, if the log file or screen print information contains the following AI Core error information, you need to obtain the fault information related to the AI Core error (see Collecting AI Core Error Information), and then use msaicerr to analyze the fault information and locate the AI Core error.

# Error message
there is an xx aicore error

# Or error example
there is an xx aivec error

Applicability

Notes

In the collected fault information, check whether dump files or abnormal operator compilation information (.o and .json files) exist in the dfx/data-dump directory in advance. Check whether log files exist in the dfx/log/host/cann directory. If no log file exists, the msaicerr tool cannot be used to extract AI Core error information.

Command

python3 msaicerr.py -p path1 -out path2 -dev 0

Parameters

• -p or --report_path: The parameter is mandatory. It specifies the directory for storing AI Core error information during AI Core error analysis. Do not run the msaicerr tool in the directory or subdirectory specified by the -p parameter. Otherwise, the tool parsing may be suspended or fail.
• -out or --output_path: The parameter is optional. It specifies the path for storing the parsing result file. If the path is not specified, the parsing result is stored in the current path where the command is executed by default. The directory specified by the -out parameter cannot be the directory or subdirectory specified by the -p parameter. Otherwise, the tool parsing may be suspended or fail. If the value of -out is empty or invalid, the specified directory does not have the write permission, or the directory fails to be created, the msaicerr tool exits and an error is reported.
• -dev or --device_id: The parameter is optional. It specifies the ID of the device where the built-in operator sample runs. If this parameter is not set, the default device ID is 0. When analyzing AI Core errors, the msaicerr tool runs a built-in operator sample to check whether the software and hardware environments are normal.

Usage Example and Output Description

python3 msaicerr.py -p $HOME/aic_err_info -out $HOME/result