Documentation

Usage of Tuned Custom Repositories

Repositories are your own assets. Properly archive them to your storage media.

Custom repositories generated after tuning can be used to improve the inference and training performance. The following describes how to use custom repositories in different scenarios.

Table 1 Usage of tuned custom repositories

Scenario

How to Use

The same user performs AOE tuning and inference/training in the same environment.
  1. Set TUNE_BANK_PATH to the path for storing the custom repository generated after AOE tuning. The following is an example. Replace /home/HwHiAiUser/custom_tune_bank with the actual path for storing the custom repository. The default value of TUNE_BANK_PATH is ${HOME}/Ascend/latest/data/aoe/custom/graph/${soc_version} or ${HOME}/Ascend/latest/data/aoe/custom/op/${soc_version}. For details, see Environment Variable Configuration.
    export TUNE_BANK_PATH=/home/HwHiAiUser/custom_tune_bank
  2. Perform inference/training.

The same user performs AOE tuning and inference/training in different environments.

Assume that AOE tuning is performed in environment A and a custom repository is generated, and you need to use the repository for inference/training in environment B.

  1. Copy the repository from environment A to environment B and grant the read and write permissions on the path for storing the repository in environment B.
    NOTE:

    If AOE tuning is performed in multiple environments, copy all repositories, merge them, and then perform the following operations.

  2. Set TUNE_BANK_PATH to the path for storing the repository in environment B. The following is an example. Replace /home/HwHiAiUser/custom_tune_bank with the actual path for storing the repository. The default value of TUNE_BANK_PATH is ${HOME}/Ascend/latest/data/aoe/custom/graph/${soc_version} or ${HOME}/Ascend/latest/data/aoe/custom/op/${soc_version}. For details, see Environment Variable Configuration.
    export TUNE_BANK_PATH=/home/HwHiAiUser/custom_tune_bank
  3. Perform inference/training.
  • Different users perform tuning and inference/training in the same environment.
  • Different users perform tuning and inference/training in different environments.

Assume that user A and user B perform AOE tuning in the same environment or different environments and two custom repositories are generated, and user A needs to use the repository of user B for inference/training.

  1. User A copies the repository of user B to the custom repository storage path and grants the read and write permissions on the path.
    NOTE:

    If AOE tuning is performed by multiple users, copy all repositories, merge them, and then perform the following operations.

  2. User A sets TUNE_BANK_PATH to the repository storage path. The following is an example. Replace /home/HwHiAiUser/custom_tune_bank with the actual path for storing the repository. The default value of TUNE_BANK_PATH is ${HOME}/Ascend/latest/data/aoe/custom/graph/${soc_version} or ${HOME}/Ascend/latest/data/aoe/custom/op/${soc_version}. For details, see Environment Variable Configuration.
    export TUNE_BANK_PATH=/home/HwHiAiUser/custom_tune_bank
  3. Perform inference/training.
Parent topic: Appendixes