Linux

MindCluster Ascend Deployer allows you to download system dependencies, CANN packages, NPU firmware and drivers, AI frameworks, and MindCluster components (performance test, fault diagnosis, and cluster scheduling) on Linux. For details about all software packages supported by MindCluster Ascend Deployer, see Table 2.

The following download modes are supported:

Precautions

  • Only software packages of Ascend community editions can be downloaded online using MindCluster Ascend Deployer. The commercial editions cannot be directly pulled. To download the commercial editions, select and download only the OS dependency packages. For details about how to upload corresponding software packages, see Installing the Ascend Software (Using Prepared Software Packages).
  • Downloading software packages and dependencies requires a large amount of space. Ensure that the available space of the directory to place required packages and dependencies is at least 20 GB. If an error message indicating insufficient space is displayed during the download, configure the space based on the actual situation.
  • A large amount of open-source software needs to be installed, and the open-source software downloaded using MindCluster Ascend Deployer comes from the OS source. You need to fix the vulnerabilities of the open-source software as required. You are advised to use the official source to update the software regularly.
  • For more precautions on MindCluster Ascend Deployer, see Download Precautions.
  • The MTOS needs to use the kernel-devel package that cannot be obtained from the public network. The download function is reserved. If you need to use the package, replace it with the kernel-devel-5.10.0-218.0.0.mt20240808.560.mt2203sp4.aarch64.rpm package generated after image decompression.
  • Linux users can run the following command to refresh the list of software packages that can be downloaded:
    bash start_download.sh -h

    If the pip mode is used, run the following command:

    ascend-download -h

Prerequisites

  • You have downloaded MindCluster Ascend Deployer.
  • The user who performs the download operation must have the execute permission on the MindCluster Ascend Deployer directory.
  • Python 3 and pip3 exist in the current environment.

Download Mode 1

Install MindCluster Ascend Deployer using pip:
ascend-download --os-list=<OS> --download=<PK1>,<PK2>==<Version>

For details about the preceding parameters, see Table 1 or run ascend-download --help.

Before running the preceding command, ensure that the ascend-deployer directory does not exist in the $HOME directory. If it exists, delete it before running the command. When you run the command, the ascend-deployer directory is generated in the $HOME directory by default. You can change the path of the directory by setting the ASCEND_DEPLOYER_HOME environment variable.

Download Mode 2

You can use this download mode if you download and decompress the ZIP package of MindCluster Ascend Deployer.

Go to the directory generated after the MindCluster Ascend Deployer package is decompressed. Example:

cd $HOME/ascend-deployer-{version}/ascend_deployer
Run the following command:
bash start_download.sh --os-list=<OS> --download=<PK1>,<PK2>==<Version>

For details about the parameters, see Table 1 or run bash start_download.sh --help.

Table 1 Parameter description

Parameter

Description

Required or Not

--os-list=<OS>

--os-list specifies the OS of the target device. You can configure one or more OSs as required.

Example:

--os-list=Ubuntu_18.04_aarch64

To view all OSs supported by MindCluster Ascend Deployer, see Supported OSs and Architectures.

NOTICE:
  • You can specify multiple OSs for batch installation. In other cases, you need to specify only one OS.
  • During OS dependency download, the software packages of MPI 3.2.1 and Open MPI 4.1.5 are automatically downloaded to compile and install the hccl-test tool. During the installation, one of them is selected for compilation based on the configured IP address type of the target environment. When the IPv4 format is used, install MPI 3.2.1. When the IPv6 format is used, install Open MPI 4.1.5.
  • During batch deployment, if the architecture of the server where MindCluster Ascend Deployer is located is different from that of the target server, the --os-list option must also specify the architecture type of the server where the tool is located to ensure that the Nexus image exists in the current architecture.

Yes

--download=<PK1>,<PK2>==<Version>

For details about all software packages that can be downloaded online using --download, see Software Packages That Can Be Downloaded.

If you want to specify the version of the software package to be downloaded, contact Huawei technical support to obtain the version mapping table. If you do not specify the software version, the software package of the latest available version will be downloaded. Because the MindIE-image package is large, you need to specify the version and model when downloading it. Example:

--download=NPU,CANN,Torch-npu,DL,FaultDiag

The software packages listed in the preceding command include the following components:

NPU: npu-driver, npu-firmware, mcu

CANN: NNAE, NNRT, Toolkit, kernels, ToolBox

DL: Ascend Device Plugin, Ascend Docker Runtime, NodeD, NPU Exporter, Volcano, Ascend Operator, Resilience Controller, ClusterD, MindIO

FaultDiag: FaultDiag

MindSpore: MindSpore

TensorFlow: TensorFlow

Torch-npu: torch-npu, torch

MindIE-image: mindie-image

NOTE:

MindIO is not supported by MindCluster 7.1.RC1 and later versions.

No

Storage Path Description

  • If download mode 1 is used, the software package is automatically placed in the $HOME/ascend-deployer/resources directory after the download is completed.
  • If download mode 2 is used, the software package is automatically placed in the $HOME/ascend-deployer-{version}/ascend_deployer/resources directory after the download is completed.

Viewing the Download Result Report

After the download is complete, the download result file failed_download_result_{PID}_{Download_time}.json is generated in ~/.ascend_deployer/download_info. If the download fails, you can view the result file for details.

Follow-up Procedure

Installing Ascend Software