--ac_parallel_enable

Applicability

Product	Supported
Atlas A3 training products/Atlas A3 inference products	√
Atlas A2 training products/Atlas A2 inference products	√
Atlas 200I/500 A2 inference products	x
Atlas inference products	√
Atlas training products	√

Description

Sets whether to allow the AI CPU and AI Core operators to run in parallel in the dynamic shape graph.

In a dynamic shape graph, when this option is enabled, the system automatically identifies AI CPU operators that can be concurrently executed with the AI Core operators in the graph. Operators of different engines are distributed to different flows to implement parallel execution among multiple engines, improving resource utilization and dynamic shape execution performance.

Argument

1: AI CPU operators and AI Core operators are allowed to run in parallel.
0 (default): AI CPU operators are not separately distributed.

Suggestions and Benefits

None

Example

--ac_parallel_enable=1