npu_mem (NPU Memory Usage)

Availability

Atlas 200/500 A2 Inference Product

Atlas Inference Series Product

Atlas Training Series Product

Atlas A2 Training Series Product/Atlas 800I A2 Inference Product

Atlas A3 Training Series Product

Data at the NPU MEM Layer in msprof_*.json

The following figure shows data at the NPU MEM layer in the msprof_*.json file. (The following figure is only an example. The actual display depends on the product implementation.)

Figure 1 NPU memory layer

The preceding figure shows the process-level and device-level memory usage, in KB. The Memory field indicates the total memory usage.

npu_mem_*.csv File

The file content is formatted as follows.

Figure 2 npu_mem_*.csv

The preceding table lists the memory usage details, in KB. The Memory field indicates the total memory usage.