npu_mem (NPU Memory Usage)

The timeline information of the NPU memory usage is displayed at the NPU MEM layer in the msprof_*.json file, and the summary information is summarized in the npu_mem_*.csv file.

Applicability

Product

Supported

Atlas 350 Accelerator Card

Atlas A3 training product/Atlas A3 inference product

Atlas A2 training product/Atlas A2 inference product

Atlas 200I/500 A2 inference product

Atlas inference product

Atlas training product

Data at the NPU MEM Layer in msprof_*.json

The following figure shows data at the NPU MEM layer in the msprof_*.json file. (The following figure is only an example. The actual display depends on the product implementation.)

Figure 1 NPU memory layer

The preceding figure shows the process-level and device-level memory usage, in KB. The Memory field indicates the total memory usage.

npu_mem_*.csv File

The following shows the file content format.

Figure 2 npu_mem_*.csv

The preceding table lists the memory usage details, in KB. The Memory field indicates the total memory usage.