Overview

Check the Comparison Result Description for this scenario.

In ONNX scenarios, only accuracy comparison of non-quantized models is supported. The following table lists the data files required for comparison.

Table 1 Data file requirements for comparison between a non-quantized original model and a non-quantized offline model

File

Description

How to Obtain

.npy file of the non-quantized original model

Benchmark data

Preparing ONNX .npy Files

.json file generated by converting the offline model file using ATC

Operator mapping obtaining

Preparing a Network-wide Information File

Dump data file of the non-quantized offline model running on the Ascend AI Processor

Data to be compared

The methods of obtaining dump data in the NPU environment in offline inference scenarios are the same for different frameworks. For details, see:

Preparing Dump Data of an Offline Model