Uploading Software Packages

Upload the Ascend-cann-amct_{software version}_linux-{arch}.tar.gz package to any directory on the Linux server as the AMCT installation user. In this example, the package is uploaded to $HOME/amct/.

Decompress the AMCT package:

tar -zxvf Ascend-cann-amct-{software version}_linux-{arch}.tar.gz

Find the following extracted packages.

Table 1 Extracted parts of the AMCT package

Level-1 Directory

Level-2 Directory

Description

Use and Precaution

amct_acl

Software package to be installed when the compression function of AMCT is used for ATC, AOE, and graph development.

amct_caffe/

Caffe AMCT directory

  • The Atlas A2 training product/Atlas A2 inference product does not support the Caffe framework.
  • The Atlas A3 training product/Atlas A3 inference product does not support the Caffe framework.
  • The Atlas 350 Accelerator Card does not support the Caffe framework.
  • For details, see AMCT (Caffe).
  • A Caffe environment must be set up. Perform inference on a quantized model in the inference environment powered by the AI processor.

amct_caffe-{version}-py3-none-linux_{arch}.whl

Caffe AMCT package

caffe_patch.tar.gz

Caffe patch package

amct_tf/

TensorFlow AMCT directory

amct_tensorflow-{version}-py3-none-linux_{arch}.tar.gz

TensorFlow AMCT package, which is installed from source code

  • amct_tensorflow and amct_tensorflow_ascend are mutually exclusive.
  • For details, see AMCT (TensorFlow).
  • A TensorFlow environment must be set up. Perform inference on a quantized model in the inference environment powered by the AI processor.

amct_tensorflow_ascend-{version}-py3-none-linux_{arch}.tar.gz

TF Adapter AMCT package, which is installed from source code

  • amct_tensorflow and amct_tensorflow_ascend are mutually exclusive.
  • Only the Atlas training product supports the features in this directory.
  • For details, see AMCT (TensorFlow, Ascend).
  • A TensorFlow environment must be set up. Online inference can be performed on a quantized model based on the AI processor in the online inference environment powered by NPUs.

amct_pytorch/

PyTorch AMCT directory

  • For details, see AMCT (PyTorch).
  • A PyTorch environment must be set up. Perform inference on a quantized model in the inference environment powered by the AI processor.

amct_pytorch-{version}-py3-none-linux_{arch}.tar.gz

PyTorch AMCT source package

amct_onnx/

ONNX AMCT directory

  • For details, see AMCT (ONNX).
  • An ONNX Runtime environment must be set up. Perform inference on a quantized model in the inference environment powered by the AI processor.

amct_onnx-{version}-py3-none-linux_{arch}.whl

ONNX AMCT package

amct_onnx_op.tar.gz

ONNX Runtime AMCT custom operator package

{version} indicates the AMCT version. {software version} indicates the software version. {arch} indicates the OS architecture.