Installation and Deployment
The ATB is integrated in CANN's neural network acceleration library (NNAL) package. Install the Ascend NPU driver and CANN software (including the toolkit, ops, and NNAL packages) and configure environment variables following the instructions in CANN Software Installation.
Before running the ATB, ensure that the process-level environment variable script set_env.sh has been configured. The script automatically becomes invalid after the user process ends. For details, see Environment Variables. The following example command uses the default path after installation as a non-root user:
1 | source ${HOME}/Ascend/nnal/atb/set_env.sh |
Note the following requirements for running the NNAL ATB:
- The glibc version must be 2.17 or later when you run the NNAL ATB. You can run the ldd --version command to query the glibc version (Mainstream Linux OSs meet the requirement of glibc versions. If the requirement is not meet, you are advised to reinstall the system of a new version. You are not advised to directly upgrade glibc, which may cause system breakdown).
- The running of the torch_atb plugin depends on PyTorch and torch_npu. Install the software listed in Table 1 as instructed in Ascend Extension for PyTorch Configuration and Installation. In addition, before running the torch_atb plugin, ensure that the ops operator package has been installed to adapt to the running of torch_npu.