Atlas A2 Training Product / Atlas A2 Inference Product

This section describes the communication operators supported by the Atlas A2 training product/Atlas A2 inference product.

  • Single-operator zero-copy: To reduce the memory copy overhead, HCCL can directly operate the memory transferred by the service to improve communication performance.
  • Communication operator retry: When the communication is intermittently interrupted due to a network fault, HCCL attempts to retry the communication operator to improve communication stability.
  • Deterministic computing: The same output is generated if a reduction communication operator is executed for multiple times with the same hardware and input.
  • The following tables list the communication operators supported in expansion mode. Modes not listed are unsupported.
  • In tables of this section, "√" indicates supported, "☓" indicates unsupported, and "N/A" indicates not involved. The Atlas A2 training product/Atlas A2 inference product does not support single-operator zero-copy or operator retry.
  • Operators and network modes not listed are not supported.

HOST/HOST_TS

Operator

Network Mode

Single-Operator Zero-Copy

Deterministic Computing

Retry

Intra-Rank Communication

Inter-Rank Communication

Broadcast

Single-operator

N/A

Graph (Ascend IR)

N/A

Graph capture (ACLGraph)

N/A

AllGather

Single-operator

N/A

Graph (Ascend IR)

N/A

Graph capture (ACLGraph)

N/A

AllGatherV

Single-operator

N/A

Graph (Ascend IR)

N/A

Graph capture (ACLGraph)

N/A

Reduce

Single-operator

Graph (Ascend IR)

Graph capture (ACLGraph)

AllReduce

Single-operator

Graph (Ascend IR)

Graph capture (ACLGraph)

Scatter

Single-operator

N/A

Graph (Ascend IR)

N/A

Graph capture (ACLGraph)

N/A

ReduceScatter

Single-operator

Graph (Ascend IR)

Graph capture (ACLGraph)

ReduceScatterV

Single-operator

Graph (Ascend IR)

Graph capture (ACLGraph)

AlltoAll

Single-operator

N/A

Graph (Ascend IR)

N/A

Graph capture (ACLGraph)

N/A

AlltoAllV

Single-operator

N/A

Graph (Ascend IR)

N/A

Graph capture (ACLGraph)

N/A

AlltoAllVC

Single-operator

N/A

Graph (Ascend IR)

N/A

Graph capture (ACLGraph)

N/A

Send

Single-operator

N/A

Graph (Ascend IR)

N/A

Graph capture (ACLGraph)

N/A

Recv

Single-operator

N/A

Graph (Ascend IR)

N/A

Graph capture (ACLGraph)

N/A

BatchSendRecv

Single-operator

N/A

Graph (Ascend IR)

N/A

Graph capture (ACLGraph)

N/A

AIV

Operator

Network Mode

Single-Operator Zero-Copy

Deterministic Computing

Retry

Intra-Rank Communication

Inter-Rank Communication

Broadcast

Single-operator

N/A

Graph (Ascend IR)

N/A

Graph capture (ACLGraph)

N/A

AllGather

Single-operator

N/A

Graph (Ascend IR)

N/A

Graph capture (ACLGraph)

N/A

AllGatherV

Single-operator

N/A

Graph (Ascend IR)

N/A

Graph capture (ACLGraph)

N/A

AllReduce

Single-operator

Graph (Ascend IR)

Graph capture (ACLGraph)

ReduceScatter

Single-operator

Graph (Ascend IR)

Graph capture (ACLGraph)

ReduceScatterV

Single-operator

Graph (Ascend IR)

Graph capture (ACLGraph)

AlltoAll

Single-operator

N/A

Graph (Ascend IR)

N/A

Graph capture (ACLGraph)

N/A

AlltoAllV

Single-operator

N/A

Graph (Ascend IR)

N/A

Graph capture (ACLGraph)

N/A

AlltoAllVC

Single-operator

N/A

Graph (Ascend IR)

N/A

Graph capture (ACLGraph)

N/A