Overview

Check the Comparison Result Description for this scenario.

In ONNX scenarios, only accuracy comparison of non-quantized models is supported. The following table lists the input data to be prepared.

Table 1 Input data requirements for comparison between a non-quantized original model and a non-quantized offline model

File

Description

How to Obtain

.npy file of the non-quantized original model

Benchmark data

Preparing .npy Data of an ONNX Model

.json file generated by converting the offline model file using ATC

Operator mapping obtaining

Network-wide Information File

Dump data file of the non-quantized offline model running on the Ascend AI Processor

Data to be compared

In the offline inference scenario, the methods for obtaining the dump data of the NPU environment are the same for different frameworks. For details, see the following:

Preparing Dump Data of an Offline Model