Repository Generated After Tuning Cannot Be Matched
Symptom
The AOE tuning tool completes tuning and generates a repository, but the repository cannot be matched.
Solution
Check whether the parameters during tuning are consistent with those during ATC-to-model conversion or AOE re-tuning. The following parameters must be consistent to ensure that the generated repository can be matched.
Option |
Cause Affecting the Matching of the Subgraph Repository |
Description |
|---|---|---|
--input_format |
Sets the input data format. |
Supported by both ATC and AOE. The values must be consistent. |
--input_shape |
Sets the shape of each input. |
Supported by both ATC and AOE. The values must be consistent. |
--output_type |
Sets the output data type of a network or an output node. |
Supported by both ATC and AOE. The values must be consistent. |
--insert_op_conf |
Inserts new operators, affecting the network structure. |
Supported by both ATC and AOE. The values must be consistent. |
--out_nodes |
Sets different nodes on the network as output nodes. |
Supported by both ATC and AOE. The values must be consistent. |
--input_fp16_nodes |
Sets the name of the input node whose input data type is FP16, affecting the data type of the input node. |
Supported by both ATC and AOE. The values must be consistent. |
--is_input_adjust_hw_layout |
Sets whether the network input data type is FP16 and whether the data format is NC1HWC0, affecting the network input data type and format. |
Supported by both ATC and AOE. The values must be consistent. |
--is_output_adjust_hw_layout |
Sets whether the network output data type is FP16 and whether the data format is NC1HWC0, affecting the network output data type and format. |
Supported by both ATC and AOE. The values must be consistent. |
--fusion_switch_file |
Sets different fusion patterns, affecting the network structure. |
Supported by both ATC and AOE. The values must be consistent. |
--enable_scope_fusion_passes |
Sets different fusion patterns, affecting the network structure. |
Supported by both ATC and AOE. The values must be consistent. |
--enable_small_channel |
Changes the network fusion pattern. |
Supported by both ATC and AOE. The values must be consistent. |
--precision_mode |
Affects the dtype of some network operators. |
Supported by both ATC and AOE. The values must be consistent. |
--op_precision_mode |
Affects the dtype of some network operators. |
Supported by both ATC and AOE. The values must be consistent. |
--modify_mixlist |
Affects the dtype of some network operators. |
Supported by both ATC and AOE. The values must be consistent. |
--keep_dtype |
Affects the dtype of some network operators. |
Supported by both ATC and AOE. The values must be consistent. |
--op_select_implmode |
Affects the dtype of some network operators. |
Supported by both ATC and AOE. The values must be consistent. |
--optypelist_for_implmode |
Affects the dtype of some network operators. |
Supported by both ATC and AOE. The values must be consistent. |
--dynamic_batch_size |
Affects the network shape and needs to be kept consistent. |
The dynamic batch is complex. The repository saved for tuning corresponds to the repository of some profiles that have performance benefits. The values must be consistent. |
--dynamic_image_size |
Affects the network shape and needs to be kept consistent. |
The dynamic image size is complex. The repository saved for tuning corresponds to the repository of some profiles that have performance benefits. The values must be consistent. |
--dynamic_dims |
Affects the network shape and needs to be kept consistent. |
The dynamic shape is complex. The repository saved for tuning corresponds to the repository of some profiles that have performance benefits. The values must be consistent. |
If the parameter values are inconsistent, you need to change them to be consistent and perform tuning again to generate a repository with the consistent parameters.