AMCT (ONNX)

Install software as the AMCT installation user. If the said user is a non-root user, check that the user has the sudo permission. Then run the su - username command to switch to the non-root user and run the commands listed in the following table. (If the installation user is root, delete --user from the dependency installation command.)

Table 1 Dependencies

Dependency

Version

Installation Command

ONNX

1.18.0, 1.14.0, 1.10.0, 1.9.0, 1.8.0

  • ONNX 1.18.0
    pip3 install onnx==1.18.0 --user
  • ONNX 1.14.0
    pip3 install onnx==1.14.0 --user
  • ONNX 1.10.0
    pip3 install onnx==1.10.0 --user
  • ONNX 1.9.0
    pip3 install onnx==1.9.0 --user
  • ONNX 1.8.0
    pip3 install onnx==1.8.0 --user

ONNX Runtime

1.20.0, 1.16.0, 1.9.0, 1.8.0, 1.6.0

For ONNX Runtime CPU, see the following commands. For ONNX Runtime earlier than 1.9.0 of GPU version, you need to install it yourself. EulerOS (AArch64) does not support quantization on the GPU.

  • ONNX Runtime 1.20.0
    • CPU version
      pip3 install onnxruntime==1.20.0 --user
    • GPU version. Before installation, install CUDA 12.6 and cuDNN 8.9.0–8.9.7 first. EulerOS (AArch64) does not support quantization on the GPU.
      pip3 install onnxruntime-gpu==1.20.0 --user 
  • ONNX Runtime 1.16.0
    • CPU version
      pip3 install onnxruntime==1.16.0 --user
    • ONNX Runtime GPU version. Before installation, install CUDA 11.8 and cuDNN 8.2.4–8.9.0 first. EulerOS (AArch64) does not support quantization on the GPU.
      pip3 install onnxruntime-gpu==1.16.0 --user 
  • ONNX Runtime 1.9.0
    pip3 install onnxruntime==1.9.0 --user

    Before installing the ONNX Runtime GPU, install CUDA 11.4 and cuDNN 8.2.4.

  • ONNX Runtime 1.8.0
    pip3 install onnxruntime==1.8.0 --user

    Before installing the ONNX Runtime GPU, install CUDA 11.0 and cuDNN 8.0.5.

  • ONNX Runtime 1.6.0
    pip3 install onnxruntime==1.6.0 --user

    Before installing the ONNX Runtime GPU, install CUDA 10.2 and cuDNN 8.0.3.

Python

Version 3.9.2 is used as an example.

For Ubuntu OS, see Python 3.9.2 Installation on Ubuntu.

For EulerOS, see Python3.9.2 Installation on EulerOS.

NumPy

  • ONNX 1.18.0 works with NumPy 2.0.0 and later versions.
  • ONNX 1.14.0 works with NumPy 1.21.6–1.26.4.
  • ONNX 1.10.0, 1.9.0, and 1.8.0 work with NumPy 1.20.0–1.23.5.
  • ONNX 1.18.0
    pip3 install numpy==2.0.0 --user
  • ONNX 1.14.0
    pip3 install numpy==1.21.6 --user
  • ONNX 1.10.0, 1.9.0, or 1.8.0
    pip3 install numpy==1.20.0 --user

Protobuf

  • ONNX 1.18.0 works with Protobuf 3.20.3.
  • ONNX 1.14.0 works with Protobuf 3.20.2–3.20.3.
  • ONNX 1.10.0, 1.9.0, and 1.8.0 work with Protobuf 3.20.2 and later versions.
pip3 install protobuf==3.20.3 --user

Or

pip3 install protobuf==3.20.2 --user