--deterministic_level

Applicability

Description

This option is used for debugging and cannot be used in commercial products. The function specified by this option will be released as a feature in later versions. This option applies only to 8.5.1 and later versions.

Specifies the deterministic computing level.

By default, the deterministic level is 0, that is, deterministic computing is disabled. The value of --deterministic must also be 0. To enable deterministic computing, set the deterministic level to 1 and the deterministic computing option --deterministic to 1. To enable strong consistency computing, set the level to 2 and the deterministic computing option --deterministic to 1.

If strong consistency computing is enabled (--deterministic_level is set to 2), the computing result is deterministic, meaning that multiple executions will generate the same result. In addition, the computing result is irrelevant to the data location. For example, when performing matrix multiplication, the order of accumulation across different rows may vary, which can lead to slight differences in results for the same data in different rows. However, when strong consistency computing is enabled, the computing results will be consistent as long as the inputs are the same, even if they are in different rows.

By default, the strong consistency computing function is disabled. In this default mode, the computing results may be inconsistent when the same data appears in different rows.

For performance considerations, you are advised not to enable strong consistency computing because it slows down the computing speed of operators and affects the overall efficiency. You are advised to enable this function only when the computing result is required to be strictly consistent for the same data in different locations or the model precision is being adjusted and debugged to optimize the overall performance.

See Also

This option needs to be used in conjunction with --deterministic.

Argument

• 0 (default): Disables deterministic computing.
• 1: Enables deterministic computing.
• 2: Enables strong consistency computing.

Suggestions and Benefits

None

Example

--deterministic=0  --deterministic_level=0

Dependencies and Restrictions

None