MAX_RUNTIME_CORE_NUMBER

Description

In training and online inference scenarios, this environment variable can be used to enable multi-thread task scheduling of the graph executor (host) for the network in dynamic shape graph mode.

The value of this environment variable must be an integer. If the value is greater than or equal to 2, multiple threads are enabled for graph execution and scheduling tasks on the host. The number of threads is the same as the value of this environment variable.

It is recommended that the value of this environment variable be less than or equal to the number of CPU cores in the current environment. Otherwise, the performance deteriorates.

Example

export MAX_RUNTIME_CORE_NUMBER=5

Restrictions

1. Currently, this environment variable is used only in graph mode.
2. To use this environment variable, the number of CPU cores that can be executed on the host must be greater than or equal to 2.

Applicability

Atlas Training Series Product