Important Notes

Version Mapping

The MindIE inference engine is used to call the ATB in the following scenarios:

  • The MindIE inference engine is used to call the ATB if the CANN version is 8.0.0 or later and the MindIE version is 1.0.0 or later. When the CANN version needs to be rolled back, the target CANN version cannot be earlier than 8.0.0.
  • If the CANN version is earlier than 8.0.0 or the MindIE version is earlier than 1.0.0, recompile the ATB calling program based on the target CANN version before upgrading or rolling back the CANN version so that the ATB can be properly used.

Applicable Products

Atlas 350 accelerator cards

Atlas A3 inference products/Atlas A3 training products

Atlas A2 training products/Atlas A2 inference products

Atlas training products

Atlas inference products

Atlas 200I/500 A2 inference products

By default, operators support Atlas inference products, Atlas A2 training products/Atlas A2 inference products and Atlas A3 inference products/Atlas A3 training products. The supported product models vary depending on the operator.

Operator Description

  • The Atlas inference products does not support the ACL_BF16 (bf16) data type.
  • The LCCL function of the communication operator BroadcastOperation is not applicable to the Atlas A3 inference products/Atlas A3 training products. The LCCL function of LinearParallelOperation is applicable to Atlas A3 inference products/Atlas A3 training products only when there are eight or fewer NPUs. If other operator functions are applicable to Atlas A2 training products/Atlas A2 inference products, they are also applicable to Atlas A3 inference products/Atlas A3 training products.
  • The LCCL function of the communication operator will be deleted in later versions. You are advised to use the HCCL function. For details, see the operator description.