create_quant_config_ascend

Applicability

Product	Supported
Atlas A3 training series products/Atlas A3 inference series products	x
Atlas A2 training products/Atlas A2 inference products	x
Atlas 200I/500 A2 inference product	x
Atlas inference series products	x
Atlas training products	√

Description

Finds all quantizable layers in a graph, creates a quantization configuration file, and writes the quantization configuration of the quantizable layers to the configuration file.

Prototype

create_quant_config_ascend(config_file, graph, skip_layers=None, activation_offset=True, config_defination=None)

Parameters

Parameter	Input/Output	Description
config_file	Input	Path (including the file name) of the quantization configuration file. The existing file (if any) in the path will be overwritten upon this API call. A string.
graph	Input	tf.Graph of the model to be quantized. A tf.Graph.
skip_layers	Input	Name of the layer that does not need to be quantized in tf.Graph. Default: None A list of strings. Restrictions: If a simplified quantization configuration file is used as the input, this parameter must be set in the configuration file. In this case, the parameter setting in the input does not take effect.
activation_offset	Input	Whether to quantize activations with offset. Default: True A bool Restrictions: If a simplified quantization configuration file is used as the input, this parameter must be set in the configuration file. In this case, the parameter setting in the input does not take effect.
config_defination	Input	Simplified quantization configuration file quant.cfg generated based on the calibration_config_ascend_tf.proto file. The .proto file is stored in /amct_tensorflow/proto/* under the AMCT installation directory. For details about the parameters in the .proto file and the generated simplified quantization configuration file quant.cfg, see Simplified Configuration File. Default: None* A string. Restrictions: If it is set to None, a configuration file is generated based on the remaining arguments (skip_layers and activation_offset). In other cases, a configuration file in JSON format is generated based on config_defination.

Returns

None

Example

import amct_tensorflow as amct
# Build a graph of the network to be quantized.
network = build_network()
# Create a quantization configuration file.
amct.create_quant_config_ascend(config_file="./configs/config.json",
                    graph=tf.get_default_graph(),
                    skip_layers=None,
                    activation_offset=True)

Flush file: a quantization configuration file in JSON format. (The quantization configuration file output by this API will be overwritten when quantization is performed again.)

{
    "version":1,
    "activation_offset":true,
    "do_fusion":true,
    "skip_fusion_layers":[],
    "MobilenetV2/Conv/Conv2D":{
        "quant_enable":true,
        "activation_quant_params":{
            "max_percentile":0.999999,
            "min_percentile":0.999999,
            "search_range":[
                0.7,
                1.3
            ],
            "search_step":0.01,
            "act_algo":"ifmr",
            "asymmetric":false
        },
        "weight_quant_params":{
            "wts_algo":"arq_quantize",
            "channel_wise":true
        }
    },
    "MobilenetV2/Conv_1/Conv2D":{
        "quant_enable":true,
        "activation_quant_params":{
            "max_percentile":0.999999,
            "min_percentile":0.999999,
            "search_range":[
                0.7,
                1.3
            ],
            "search_step":0.01,
            "act_algo":"ifmr",
            "asymmetric":false
        },
        "weight_quant_params":{
            "wts_algo":"arq_quantize",
            "channel_wise":true
        }
    }
}

Parent topic: PTQ APIs