Dynamic Shape

AC_PARALLEL_ENABLE

Whether to allow AI CPU operators and AI Core operators to run in parallel in a dynamic shape graph. The corresponding options parameter is ac_parallel_enable.

In a dynamic shape graph, when it is enabled, the system automatically identifies AI CPU operators that can be concurrently executed with the AI Core operators in the graph. Operators of different engines are distributed to different flows to implement parallel execution among multiple engines, improving resource utilization and dynamic shape execution performance.

Arguments:

• 1: AI CPU operators and AI Core operators are allowed to run in parallel.
• 0 (default): AI CPU operators are not separately distributed.

Configuration example:

{ge::ir_option::AC_PARALLEL_ENABLE, "1"}

Applicable products:

• Atlas inference product: supported
• Atlas training product: supported
• AS31XM1X AI Processor: supported
• SoC (TsnsC): not supported
• Atlas inference product: supported
• Atlas inference product: supported