文档

Performing Online Download

You can download the Docker software and the OS dependencies required by the CANN package on Windows or Linux OSs.

Precautions

  • Only software packages in Ascend community editions can be downloaded online using ascend-deployer. The commercial editions cannot be directly pulled. To obtain the commercial editions, select and download only the OS dependency packages. For details about how to upload corresponding software packages, see Preparing Software Packages.
  • Once you download the software packages online, you agree to the terms and conditions of Huawei Enterprise End User License Agreement (EULA).
  • ascend-deployer provides the source configuration file. Huawei source is used by default. Replace it as required. For details, see Configuring the Source.
  • After the download operation is executed, the Docker software and the OS dependencies required by the CANN package are automatically downloaded and stored in the ascend-deployer/ascend_deployer/resources directory. Before installation and deployment, upload the entire ascend-deployer directory to the user home directory on the target device.
  • Downloading software packages and dependencies requires a large amount of space. Ensure that the available space of the directory to place required packages and dependencies is at least 20 GB. If an error message indicating insufficient space is displayed during the download, configure the space based on the actual situation.
  • To deploy MindIO, you can refer to this section to download the OS dependencies, refer to Preparing Software Packages to obtain the MindIO package, and upload the package to the target environment.
  • Specify Kylin_V10Tercel_aarch64 or Kylin_V10Tercel_x86_64 as the dependency for the Kylin V10 SP1 system. Specify Kylin_V10Sword_aarch64 as the dependency for the Kylin V10 SP2 system.
  • ascend-deployer cannot automatically download the x86_64 driver and firmware packages of Atlas A2 training products. If you want to set up an environment in this scenario, refer to method 2 in Preparing Software Packages to upload the driver and firmware packages to the resources directory of ascend-deployer.
  • (Optional) When using ascend-deployer to download the CANN package, run the pip install esdk-obs-python==3.22.2 command to install esdk-obs-python, which enables the resumable transmission function of the CANN package to prevent download failures or long re-download time due to large package sizes or network issues.
  • A large amount of open source software needs to be installed. The open source software downloaded using ascend-deployer comes from the OS source. You need to fix the vulnerabilities of the open source software as required. You are advised to use the official source to update the software regularly.
  • Due to the need to download a large number of software packages, parallel download is enabled in ascend-deployer by default. You can modify the parallel_download field in the ascend_deployer/downloader/config.ini file to determine whether to enable parallel download. The value 1 indicates that this function is enabled, and the value 0 indicates that this function is disabled. By default, the number of concurrent download threads is 16. You can change the number by setting the ASCEND_DEPLOYER_DOWNLOAD_MAX_SIZE environment variable.
  • During OS dependency download, the software packages of MPI 3.2.1 and Open MPI 4.1.5 are automatically downloaded to compile and install the hccl-test tool. During the installation, one of them is selected for compilation based on the configured IP address type of the target environment. When the IPv4 format is used, install MPI 3.2.1. When the IPv6 format is used, install open Open MPI 4.1.5.

Procedure

To download the driver, firmware, and CANN packages of versions earlier than 6.0.RC1 online, the requirements listed in Requirements for Online Download must be met.

  • Windows
    1. Download Python since Python 3 is required in the Windows environment. Python 3.7 or later is recommended. If it has been installed, skip this step.

      Download link: Python 3.7.5

      Complete the installation as prompted. During the installation, select Add Python to environment variables on the Advanced Options screen. Otherwise, you need to manually add environment variables.

    2. Start downloading.

      Run start_download_ui.bat.

      On the displayed simple screen, select the OS of the target device and the software packages to be downloaded online.

  • Linux
    • Both the root user and non-root users are allowed to perform the download operation. The user who performs the download operation must have the execute permission on the ascend-deployer directory.
    • Ensure that Python 3 and pip3 exist in the current environment.
    • If you want to install the software listed in Table 1 as a non-root user, you need to download the software as the root user and non-root user respectively.
    • To decompress the downloaded .zip package, go to the ascend-deployer directory and run the following command:
      bash start_download.sh --os-list=<OS1>,<OS2> --download=<PK1>,<PK2>==<Version>

      Run the bash start_download.sh --help command to view the options of <OS1>,<OS2> and <PK1>,<PK2>==<Version>. For details about the parameters, see Table 1.

    • Run the following command to install ascend-deployer using pip.
      ascend-download --os-list=<OS1>,<OS2> --download=<PK1>,<PK2>==<Version>

      Run the ascend-download --help command to view the options of <OS1>,<OS2> and <PK1>,<PK2>==<Version>. For details about the parameters, see Table 1.

      Before running the preceding command, ensure that the ascend-deployer directory does not exist in the $HOME directory. If it exists, delete it before running the command.

      When you run the command, the ascend-deployer directory is generated in the $HOME directory by default. You can change the path of the directory by setting the ASCEND_DEPLOYER_HOME environment variable.

    Table 1 Options

    Option

    Description

    Mandatory/Optional

    --os-list=<OS1>,<OS2>

    --os-list specifies the OS of the target device. You can configure one or more OSs as required. The following is an example:

    --os-list=Ubuntu_18.04_aarch64,Ubuntu_18.04_x86_64

    NOTICE:

    During batch deployment, if the architecture of the server where ascend-deployer is located is different from that of the target server, the --os-list option must also specify the architecture type of the server where ascend-deployer is located to ensure that the Nexus image exists in the current architecture.

    Mandatory

    --download=<PK1>,<PK2>==<Version>

    You can use the --download option to download the software packages listed in Table 1 online. If you want to obtain the software packages in other ways (For details, see Preparing Software Packages), delete this option. If you need to install MindX DL or MEF Center, specify the --download option to download it online.

    If you want to specify the version of the software package to be downloaded, pay attention to the version mapping. For details, see Ascend Data Center Solution Version Mapping. If you do not specify the software package version, the latest available version of the software package will be downloaded. The following is an example:

    --download=NPU,CANN,MindSpore,MindStudio,Torch-npu,DL,MEF

    • If --download is set to NPU, the system automatically downloads the driver and firmware packages and stores them in the ascend-deployer/ascend_deployer/resources/npu directory. If the versions of multiple specified software packages do not match, a prompt message will appear and you need to confirm before downloading the packages.
    • If --download is set to CANN, the system automatically downloads CANN-related packages (NNRT, NNAE, Toolkit, kernels, and TFPlugin) and the Toolbox package and stores them in the ascend-deployer/ascend_deployer/resources/CANN_x.x.x directory. If the versions of multiple specified software packages do not match, a prompt message will appear and you need to confirm before downloading the packages.
    • If --download is set to MindSpore, the system automatically downloads the MindSpore package and stores it in the Ascend folder in the ascend-deployer/ascend_deployer/resources/pylibs directory. If the versions of multiple specified software packages do not match, a prompt message will appear and you need to confirm before downloading the packages.
    • If --download is set to MindStudio, the system automatically downloads the MindStudio package and stores it in the ascend-deployer/ascend_deployer/resources/MindStudio_x.x.x directory. Currently, the ascend-deployer tool can be used to download and install MindStudio on Ubuntu_18.04, Ubuntu_22.04, openEuler_22.03LTS, and EulerOS_2.8 (AArch64) OSs.
    • If --download is set to Torch-npu, the system automatically downloads the official Torch package and Torch_npu and stores them in the ascend-deployer/ascend_deployer/resources/pylibs directory. Compile the Apex software package according to the instructions at Gitee and place it in the same directory.
    • If --download is set to TensorFlow, the system automatically downloads the TensorFlow package and stores it in the ascend-deployer/ascend_deployer/resources/pylibs directory.
    • If --download is set to DL, the system automatically downloads MindX DL-related components and stores them in mindxdl, docker, and k8s folders in the ascend-deployer/ascend_deployer/resources/ directory. Only Ubuntu_18.04, Ubuntu_20.04, Ubuntu_22.04, openEuler_20.03LTS, openEuler_22.03LTS, and CentOS 7.6 OSs are supported. If the versions of multiple specified software packages do not match, a prompt message will appear and you need to confirm before downloading the packages.
    • If --download is set to MEF, the system automatically downloads MEF Center-related components and stores them in mef, docker, and kubeedge folders in the ascend-deployer/ascend_deployer/resources/ directory.

      Only Ubuntu_20.04 and openEuler_22.03LTS OSs are supported.

    Optional
Parent topic: Installation Process