create_quant_retrain_config

Applicability

Product	Supported
Atlas A3 training series products/Atlas A3 inference series products	INT8 quantization: √
Atlas A2 training products/Atlas A2 inference products	INT8 quantization: √
Atlas 200I/500 A2 inference product	INT8 quantization: √
Atlas inference series products	INT8 quantization: √
Atlas training products	INT8 quantization: √

Description

Finds all quantizable layers in a graph, creates a quantization configuration file, and writes the quantization configuration of the quantizable layers to the configuration file.

Prototype

create_quant_retrain_config(config_file, graph, config_defination=None)

Parameters

Parameter	Input/Output	Description
config_file	Input	Path (including the file name) of the QAT configuration file. The existing file (if any) in the path will be overwritten upon this API call. A string.
graph	Input	tf.Graph of the model for quantization. A tf.Graph.
config_defination	Input	Simplified QAT configuration file. The simplified configuration file quant.cfg is generated based on the retrain_config_tf.proto file. The .proto file is stored in /amct_tensorflow/proto/* under the AMCT installation directory. For details about the parameters in the .proto file and the generated simplified quantization configuration file quant.cfg, see Simplified QAT Configuration File. A string. Default: None*

Parameter

Input/Output

Description

config_file

Input

Path (including the file name) of the QAT configuration file.

The existing file (if any) in the path will be overwritten upon this API call.

A string.

graph

Input

tf.Graph of the model for quantization.

A tf.Graph.

config_defination

Input

Simplified QAT configuration file.

The simplified configuration file quant.cfg is generated based on the retrain_config_tf.proto file. The *.proto file is stored in /amct_tensorflow/proto/ under the AMCT installation directory. For details about the parameters in the *.proto file and the generated simplified quantization configuration file quant.cfg, see Simplified QAT Configuration File.

A string.

Default: None

Returns

None

Example

PATH, _ = os.path.split(os.path.realpath(__file__))
config_path = os.path.join(PATH, 'resnet50_config.json')
simple_config = './retrain/retrain.cfg'
graph = tf.compat.v1.get_default_graph()
amct.create_quant_retrain_config(config_path, graph, simple_config)

The following is an example of the generated quantization configuration file in JSON format. (The configuration file output by this API will be overwritten when quantization is performed again.) For details about the parameters, see Quantization Configuration File.

{
    "version":1,
    "batch_num":1,
    "conv1":{
        "retrain_enable":true,
        "retrain_data_config":{
            "algo":"ulq_quantize",
            "dst_type":"INT8"
        },
        "retrain_weight_config":{
            "algo":"arq_retrain",
            "channel_wise":true,
            "dst_type":"INT8"
        }
    },
    "conv2_1/expand":{
        "retrain_enable":true,
        "retrain_data_config":{
            "algo":"ulq_quantize",
            "dst_type":"INT8"
        },
        "retrain_weight_config":{
            "algo":"arq_retrain",
            "channel_wise":true,
            "dst_type":"INT8"
        }
    }
}

Parent topic: QAT APIs