--ac_parallel_enable
Description
Indicates whether to allow the AI CPU and AI Core operators to run in parallel in the dynamic shape graph.
In a dynamic shape graph, when this option is enabled, the system automatically identifies AI CPU operators that can be concurrently executed with the AI Core operators in the graph. Operators of different engines are distributed to different flows to implement parallel execution among multiple engines, improving resource utilization and dynamic shape execution performance.
See Also
None
Argument
- 1: AI CPU operators and AI Core operators are allowed to run in parallel.
- 0: AI CPU operators are not separately distributed. The default value is 0.
Suggestions and Benefits
None
Example
--ac_parallel_enable=1
Applicability
Parent topic: Model Tuning Options