AOE

MDL_BANK_PATH

Sets the directory of the custom repository generated after subgraph tuning. The corresponding options parameter is ge.mdl_bank_path.

This parameter must be used together with BUFFER_OPTIMIZE in Precision Comparison and takes effect only when buffer optimization is enabled to improve performance by temporarily storing data in the buffer at a high speed.

Parameter values: directory of the custom repository generated after model tuning.

Format: Only letters, digits, underscores (_), hyphens (-), and periods (.) are allowed.

Default value: $HOME/Ascend/latest/data/aoe/custom/graph/<soc_version>

Configuration example:

{ge::ir_option::MDL_BANK_PATH, "$HOME/custom_module_path"}

Restrictions:

Path (path of the custom repository generated after subgraph tuning) priority ranked from high to low: path specified by MDL_BANK_PATH > path specified by the TUNE_BANK_PATH environment variable > default path.

  1. If the TUNE_BANK_PATH environment variable is used to specify the custom repository path before model build and MDL_BANK_PATH is used to specify the custom repository path during model build, then the path specified by MDL_BANK_PATH takes effect and the path specified by the TUNE_BANK_PATH environment variable does not take effect.
  2. The default path takes effect if both the paths specified by MDL_BANK_PATH and the environment variable are invalid or the directories contain no custom repository.
  3. If no custom repository is available in the preceding directories, the built-in repository for subgraph tuning is searched in the ${INSTALL_DIR}/<arch>-linux/data/fusion_strategy/built-in path. <arch>/ indicates the OS architecture.

Applicable products:

  • Ascend 950PR/Ascend 950DT: not supported
  • Atlas A3 training products/Atlas A3 inference products: supported
  • Atlas A2 training products/Atlas A2 inference products: supported
  • Atlas 200I/500 A2 inference products: supported
  • Atlas inference products: supported
  • Atlas training products: supported

OP_BANK_PATH

Sets the directory of the custom repository generated after operator tuning. The corresponding options parameter is ge.op_bank_path.

Format: Only letters, digits, underscores (_), hyphens (-), and periods (.) are allowed.

Default: ${HOME}/Ascend/latest/data/aoe/custom/op

Configuration example:

{ge::ir_option::OP_BANK_PATH, "$HOME/custom_tune_path"}

Restrictions:

Path (path of the custom repository generated after operator tuning) priority ranked from high to low: path specified by the TUNE_BANK_PATH environment variable > path specified by OP_BANK_PATH > default path of the custom repository generated after operator tuning.

  1. If the TUNE_BANK_PATH environment variable is used to specify the custom repository path before model conversion and OP_BANK_PATH is used to specify the custom repository path during model build, then the path specified by the TUNE_BANK_PATH environment variable takes effect and the path specified by OP_BANK_PATH does not take effect.
  2. The default path takes effect if both the paths specified by OP_BANK_PATH and the environment variable are invalid.
  3. If none of the preceding directories contains the custom repository, the system searches the built-in directory of the custom repository generated after operator tuning.

Applicable products:

  • Ascend 950PR/Ascend 950DT: not supported
  • Atlas A3 training products/Atlas A3 inference products: supported
  • Atlas A2 training products/Atlas A2 inference products: supported
  • Atlas 200I/500 A2 inference products: supported
  • Atlas inference products: supported
  • Atlas training products: supported