Performance Verification
After the tuning is complete, use the tuned custom repository to perform inference again to check whether the performance is improved. For details about how to use the custom repository, see Usage of Tuned Custom Repositories.
The scenario of performing one-time AOE tuning followed by multiple ATC model conversions is feasible. After tuning a model with the AOE tool, if there is a need to reconvert it due to other service requirements, you can use the TUNE_BANK_PATH environment variable to specify the path of the AOE tuning repository, and then use the ATC tool to reconvert the model. In this way, the model can be compiled and converted based on the tiling policy in the repository to generate the tuned model.