Installing CANN (Online Installation Using Yum)

This section describes how to quickly install the CANN software using Yum.

To upgrade an earlier version to CANN 8.5.0, you must use parameters or uninstall all earlier versions and then install CANN 8.5.0. Otherwise, the installation may fail.

Dependency Installation

Before the installation, ensure that the Python environment and pip3 are available. Currently, CANN supports Python 3.7.x to 3.13.x. If the Python version does not meet the requirements, install it.
1
sudo yum install -y python3 python3-pip

If the installation fails, the version does not meet the requirements, or the dynamic library libpython3.x.so is not included, perform the operations in Compiling and Installing Python.

Configuring the Ascend Repository

Configure the Ascend repository. Otherwise, the installation will fail.

sudo curl https://repo.oepkgs.net/ascend/cann/ascend.repo -o /etc/yum.repos.d/ascend.repo && yum makecache

Installing the Toolkit Development Kit

The CANN Toolkit development kit is installed in the training, inference, and development and debugging scenarios. It is used for training and inference services, model conversion, and operator/application/model development and compilation.

  • Ensure that the available space of the installation directory is greater than 10 GB. If this requirement is not met, clear the space or change the installation directory.
  • Both Toolkit and ops need to be installed.
  1. Run the installation command.
    1
    sudo yum install -y Ascend-cann-toolkit-8.5.0
    

    During online installation using Yum, the Toolkit can be installed only in the default path /usr/local/Ascend directory.

  2. Configure environment variables.
    1
    source /usr/local/Ascend/cann/set_env.sh
    

    The preceding environment variables take effect only in the current window. You can add the preceding commands to the environment variable configuration file (for example, the .bashrc file) as required.

Installing the ops Operator Package

The CANN operator package optimizes high-performance computing by integrating a comprehensive suite of libraries, including the basic operator framework, specialized libraries for Math, NN, CV, and Transformer, as well as the TBE operator, HCCL set communication library, HIXL unilateral communication library, and DVPP library. This package provides both dynamic and static library files for single-operator API execution (such as aclnn), alongside the source operator source code and kernel binary files. By bundling these diverse assets, CANN significantly enhances overall running capability and execution efficiency in intensive computing scenarios.

Before installing the ops operator package, install Toolkit of the matching version in the same path. Currently, the ops operator packages of multiple chips cannot be installed in the same path. You can install Toolkit and ops of different chips in different paths to meet the development and deployment requirements in a multi-chip environment.

Table 1 Installation of the ops operator package

Product Type

Installation Command

Atlas A3 series

1
sudo yum install -y Ascend-cann-A3-ops-8.5.0

Atlas A2 series

1
sudo yum install -y Ascend-cann-910b-ops-8.5.0

Atlas training series

1
sudo yum install -y Ascend-cann-910-ops-8.5.0

Atlas inference series

1
sudo yum install -y Ascend-cann-310p-ops-8.5.0

Atlas 200I/500 A2 inference series

1
sudo yum install -y Ascend-cann-310b-ops-8.5.0

(Optional) Installing the NNAL Neural Network Acceleration Library

The NNAL neural network acceleration library provides the Ascend Transformer Boost (ATB) and AscendSiPBoost (SiP) signal processing acceleration libraries.

Before installing an acceleration library, install Toolkit of the matching version and configure environment variables.

  1. Run the installation command.
    1
    sudo yum install -y Ascend-cann-nnal-8.5.0
    

    During online installation using Yum, the Toolkit can be installed only in the default path /usr/local/Ascend directory.

  2. Configure environment variables.
    • ATB acceleration library:
      1
      source /usr/local/Ascend/nnal/atb/set_env.sh
      
    • SiP acceleration library:
      1
      source /usr/local/Ascend/nnal/asdsip/set_env.sh
      

    The preceding environment variables take effect only in the current window. You can add the preceding commands to the environment variable configuration file (for example, the .bashrc file) as required.