One-Click Accuracy Analyzer Deployment

Overview

One-Click Accuracy Analyzer analyzes the network accuracy from the following aspects:

• Floating-Point Exception Detection
• Network Accuracy Comparison
• Fusion Exception Detection

This tool encapsulates the runtime parameters of TF Adapter and encapsulates and extends the accuracy analysis tool in CANN Toolkit, facilitating accuracy fault location.

Constraints

• Overflow/Underflow data collection is mutually exclusive with accuracy data dump.
• Set a proper epoch number, which helps avert running out of disk space caused by a large number of files generated during overflow/underflow data collection or accuracy data dump.

Deployment

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11

├── resnet                              // Training working directory.
│    ├── __init__.py     
│    ├── imagenet_main.py              // Script for training the network based on the ImageNet dataset.
│    ├── imagenet_preprocessing.py     // ImageNet preprocessing module.
│    ├── resnet_model.py               // ResNet model file.
│    ├── resnet_run_loop.py            // Data input processing and run loop (for training, validation, and test).
│    ├── cifar10_main                  // Training entry point file.
│    ├── ...
│    ├── precision_tool           // Directory of the one-click accuracy analyzer
│    │    ├── cli.py                   
│    │    ├── ...

• If the CANN development and operating environments are set up on the same server, simply upload the precision_tool directory to the training directory.
• If the CANN development and operating environments are set up on separate servers, upload the precision_tool directory to the training directory in the CANN operating environment and any directory in the CANN development environment.
  

  The CANN operating environment (where NPU training is run on the AI processor) is mainly used for collecting accuracy data during training accuracy tuning.

  The CANN development environment is mainly used for accuracy analysis during training accuracy tuning.

Typical Workflow

Figure 1 CANN development and operating environments set up on the same server

Figure 2 CANN development and operating environments set up separately