Overview

This section describes the quantization scenarios supported by AMCT and functions in each scenario.

Based on whether retraining is required, quantization is classified into PTQ and QAT. For details about quantization concepts, see Compression Concepts. For details about quantization algorithms, see Compression Algorithms.

• PTQ

  Quantization takes two forms: Manual Quantization and Automatic Quantization based on whether the quantization configuration file is manually tuned after quantization.

  If the accuracy of the quantized model is not as expected, perform Automatic Quantization (recommended) or Manual Tuning until the accuracy meets your requirement.

• QAT

  Currently, QAT supports quantization only for float32 network models.

  Currently, only manual quantization is supported. If the accuracy of the quantized model is not as expected, perform Manual Tuning.