--enable_small_channel

Applicability

Product

Supported

Atlas A3 training products/Atlas A3 inference products

Atlas A2 training products/Atlas A2 inference products

Atlas 200I/500 A2 inference products

Atlas inference products

Atlas training products

Description

Enables small channel optimization to yield performance benefits at convolutional layers with channel size <= 4. You are advised to enable this function in inference scenarios.

See Also

You are advised to use this option in conjunction with the --insert_op_conf AIPP option to achieve better performance.

This option can only be used together with static AIPP and cannot work with dynamic AIPP, due to software restrictions.

Argument

Argument:

  • 0 (default): Disables small channel optimization during model inference.
  • 1: Enables small channel optimization during model inference.

Restrictions: If the model input with channel ≤ 4, you are advised to use this option and use it in pair with --insert_op_conf to enable AIPP and obtain better performance. If the performance deteriorates after this option is used, you are advised to perform tiling.

Suggestions and Benefits

None

Example

--enable_small_channel=1

Restrictions

Use this option in conjunction with the --insert_op_conf AIPP option. Otherwise, there may be no benefits.