--buffer_optimize

Applicability

Product	Supported (√/x)
Atlas A3 training product/Atlas A3 inference product	√
Atlas A2 training product/Atlas A2 inference product	√
Atlas 200I/500 A2 inference product	√
Atlas inference product	√
Atlas training product	√

Description

Enables buffer optimization.

Arguments

Arguments:

l1_optimize: enables L1 optimization. Invalid in the current version. Equivalent to off_optimize.
l2_optimize: enables L2 optimization.
off_optimize: disables buffer optimization.

Default: l2_optimize

Suggestions and Benefits

You are advised to enable buffer optimization. This function can improve computing efficiency and performance. However, it is possible that your model contains an operator that is not yet covered by the current implementation, which affects the precision. You can disable data buffer optimization when the precision is affected. If the inference accuracy degradation is eliminated after the buffer optimization function is disabled, locate the fishy operator and submit it to Huawei technical support, who will add buffer optimization support to your operator as soon as possible.

Examples

--buffer_optimize=l2_optimize

Dependencies and Restrictions

The --buffer_optimize option takes effect only when --job_type is set to 2.

Parent topic: Advanced Functionality