Important Notes
Version Mapping
The MindIE inference engine is used to call the ATB in the following scenarios:
- The MindIE inference engine is used to call the ATB if the CANN version is 8.0.0 or later and the MindIE version is 1.0.0 or later. When the CANN version needs to be rolled back, the target CANN version cannot be earlier than 8.0.0.
- If the CANN version is earlier than 8.0.0 or the MindIE version is earlier than 1.0.0, recompile the ATB calling program based on the target CANN version before upgrading or rolling back the CANN version so that the ATB can be properly used.
Applicable Products
Atlas 350 accelerator cards
By default, operators support
Operator Description
- The
Atlas inference products does not support the ACL_BF16 (bf16) data type. - The LCCL function of the communication operator BroadcastOperation is not applicable to the
Atlas A3 inference products /Atlas A3 training products . The LCCL function of LinearParallelOperation is applicable toAtlas A3 inference products /Atlas A3 training products only when there are eight or fewer NPUs. If other operator functions are applicable toAtlas A2 training products /Atlas A2 inference products , they are also applicable toAtlas A3 inference products /Atlas A3 training products . - The LCCL function of the communication operator will be deleted in later versions. You are advised to use the HCCL function. For details, see the operator description.
Parent topic: API Reference