--enable_single_stream

Applicability

Product	Supported
Atlas A3 training products/Atlas A3 inference products	√
Atlas A2 training products/Atlas A2 inference products	√
Atlas 200I/500 A2 inference products	x
Atlas inference products	x
Atlas training products	√

Description

Sets whether to enable single-stream serial execution of model inference in the static shape scenario.

Streams preserve the order of a stack of asynchronous operations being executed on the device.

Argument

Values:

true: Enables single-stream serial execution of model inference.
false (default): Disables single-stream serial execution of model inference and enables multi-stream parallel execution.

Restrictions:

If the model contains the Cmo operator and the following control operators, the single-stream feature cannot be used. In this case, use the default value false.

Merge
Switch
Enter
RefEnter

Suggestions and Benefits

None

Example

--enable_single_stream=true

Restrictions