--enable_single_stream

Description

Limits a model to use only one stream at inference time.

Streams preserve the order of a stack of asynchronous operations being executed on the device.

Argument

Argument:

true: Each model can use only one stream at inference time.
false: Each model can use more than one stream at inference time. The default value is false.

Restrictions:

If the model contains the Cmo operator and the following control operators, the single-stream feature cannot be used. In this case, use the default value false.

Merge
Switch
Enter
RefEnter

Suggestions and Benefits

None

Example

--enable_single_stream=true

Applicability

Atlas Training Series Product

Restrictions