Software Package Preparation

Software Package Download

You can currently install the CANN software offline or online (using Conda, Yum, apt-get, and pip). The way you obtain the software package varies depending on the installation type. This section explains how to obtain the correct package.

Downloading a software listed in the following table indicates your acknowledgement and agreement to the terms and conditions of Huawei Enterprise End User License Agreement (EULA).

Table 1 Software Package List

Software Type

Description

Name

How to Obtain

Ascend NPU driver

The driver is deployed on an Ascend AI Processor. It manages and queries the Ascend AI Processor and provides processor control and resource allocation interfaces for the upper-layer CANN software.

Ascend-hdk-<chip_type>-npu-driver_<version>_linux-<arch>.run

For offline and Conda online installation, click the link, confirm the product and version information, obtain the package, and upload it to any directory in the installation environment.

When the installation is performed online using the package manager, you can download or install the software with a few clicks. You do not need to obtain the software package.

Ascend NPU firmware

The firmware contains the OS, power component, and power consumption management control software of an Ascend AI Processor. Once loaded to the AI Processor, it is responsible for model calculation, processor startup control, and power consumption control, respectively.

Ascend-hdk-<chip_type>-npu-firmware_<version>.run

Toolkit

CANN development kit, which is used for training and inference services, model conversion, and development and compilation of operators, applications, and models.

Both Toolkit and ops must be installed in CANN 8.5.0.

Ascend-cann-toolkit_<version>_linux-<arch>.run

For offline installation, click the link, confirm the product and version information, obtain the package, and upload it to any directory in the installation environment.

When the installation is performed online using the package manager, you can download or install the software with a few clicks. You do not need to obtain the software package.

ops

The CANN operator package optimizes high-performance computing by integrating a comprehensive suite of libraries, including the basic operator framework, specialized libraries for Math, NN, CV, and Transformer, as well as the TBE operator, HCCL set communication library, HIXL unilateral communication library, and DVPP library. This package provides both dynamic and static library files for single-operator API execution (such as aclnn), alongside the source operator source code and kernel binary files. By bundling these diverse assets, CANN significantly enhances overall running capability and execution efficiency in intensive computing scenarios.

Before installing the ops, the Toolkit software package of the same version must be installed. Select the ops software package corresponding to the running device.

Ascend-cann-<chip_type>-ops_<version>_linux-<arch>.run

NNAL

(Ascend Neural Network Acceleration Library)

CANN neural network acceleration libraries, including the Ascend Transformer Boost (ATB) and Ascend SiP Boost (SiP).

  • ATB acceleration library: focuses on foundation models, improving the training and inference performance of foundation models.
  • SiP acceleration library: provides a series of high-performance operators related to the signal processing for AI model scenarios (Python), Torch NPU Adapter (PTA), and signal processing scenarios (C++).

The Toolkit of the same version is required during the installation.

Ascend-cann-nnal_<version>_linux-<arch>.run

Table 2 Software packages

Software Type

Description

Name

How to Obtain

Ascend NPU driver

The driver is deployed on an Ascend AI Processor. It manages and queries the Ascend AI Processor and provides processor control and resource allocation interfaces for the upper-layer CANN software.

Ascend-hdk-<chip_type>-npu-driver_<version>_linux-<arch>.run

Click the link, confirm the product and version information, obtain the package, and upload it to any directory in the installation environment.

Ascend NPU firmware

The firmware contains the OS, power component, and power consumption management control software of an Ascend AI Processor. Once loaded to the AI Processor, it is responsible for model calculation, processor startup control, and power consumption control, respectively.

Ascend-hdk-<chip_type>-npu-firmware_<version>.run

Toolkit

The CANN Toolkit development kit installed using pip is mainly used to run training and inference services on the framework side. For Toolkit packages in development and debugging scenarios (such as development and compilation of operators, applications, and models), select other installation modes.

Both Toolkit and ops must be installed in CANN 8.5.0.

Ascend-cann-toolkit_<version>_linux-<arch>.run

When the installation is performed online using pip, you can download or install the software with a few clicks. You do not need to obtain the software package.

ops

The CANN operator package optimizes high-performance computing by integrating a comprehensive suite of libraries, including the basic operator framework, specialized libraries for Math, NN, CV, and Transformer, as well as the TBE operator, HCCL set communication library, HIXL unilateral communication library, and DVPP library. This package provides both dynamic and static library files for single-operator API execution (such as aclnn), alongside the source operator source code and kernel binary files. By bundling these diverse assets, CANN significantly enhances overall running capability and execution efficiency in intensive computing scenarios.

Before installing the ops, the Toolkit software package of the same version must be installed. Select the ops software package corresponding to the running device.

Ascend-cann-<chip_type>-ops_<version>_linux-<arch>.run

  • <chip_type> indicates the AI processor type.
  • <version> indicates the software version.
  • <arch> indicates the CPU architecture.

Verifying the Digital Signature

To prevent software from being maliciously tampered with in storage or during transmission, download the corresponding digital signature file together with the software for integrity verification.

Click PGP Verify to obtain the tool package, decompress it and then verify the PGP digital signature. For details, see OpenPGP Signature Verification Guide. If the verification fails, do not use the software package. Visit Support to get help from the community or submit a service ticket.