biu_group/aic_core_group/aiv_core_group (AI Core and AI Vector Bandwidth and Latency)

The AI Core and AI Vector bandwidth and latency data does not contain the summary information. The timeline information is displayed at the biu_group, aic_core_group, and aiv_core_group levels in the msprof_*.json file.

Availability

Atlas A2 Training Series Product/Atlas 800I A2 Inference Product

Atlas A3 Training Series Product

Data At biu_group, aic_core_group, and aiv_core_group Levels in msprof_*.json

Figure 1 biu_group
Figure 2 aic_core_group
Figure 3 aiv_core_group
Table 1 Field description

Field

Description

biu_group

Bandwidth Read

Bandwidth for the BIU bus interface to read instructions.

Bandwidth Write

Bandwidth for the BIU bus interface to write instructions.

Latency Read

Latency for the BIU bus interface to read instructions.

Latency Write

Latency for the BIU bus interface to write instructions.

aic_core_group

Cube

Cycle quantity and ratio of matrix operation instructions in the current sampling period.

Mte1

Cycle quantity and ratio of L1-to-L0A/L0B transfer instructions in the current sampling period.

Mte2

Cycle quantity and ratio of on-chip memory to AI Core movement instructions in the current sampling period.

Mte3

Cycle quantity and ratio of AI Core to on-chip memory movement instructions in the current sampling period.

aiv_core_group

Mte1

Cycle quantity and ratio of L1-to-L0A/L0B transfer instructions in the current sampling period.

Mte2

Cycle quantity and ratio of on-chip memory to AI Core movement instructions in the current sampling period.

Mte3

Cycle quantity and ratio of AI Core to on-chip memory movement instructions in the current sampling period.

Scalar

Cycle quantity and ratio of scalar operation instructions in the current sampling period.

Vector

Cycle quantity and ratio of vector operation instructions in the current sampling period.