--ac_parallel_enable

Applicability

Product	Supported (Yes/No)
Atlas 350 Accelerator Card	√
Atlas A3 training product/Atlas A3 inference product	√
Atlas A2 training product/Atlas A2 inference product	√
Atlas 200I/500 A2 inference product	x
Atlas inference product	√
Atlas training product	√

Description

Sets whether to allow the AI CPU and AI Core operators to run in parallel in the dynamic shape graph.

In a dynamic shape graph, when this option is enabled, the system automatically identifies AI CPU operators that can be concurrently executed with the AI Core operators in the graph. Operators of different engines are distributed to different flows to implement parallel execution among multiple engines, improving resource utilization and dynamic shape execution performance.

Argument

1: AI CPU operators and AI Core operators are allowed to run in parallel.
0 (default): AI CPU operators are not separately distributed.

Suggestions and Benefits

None

Example

--ac_parallel_enable=1