npu_mem (NPU Memory Usage)

The timeline information of the NPU memory usage is displayed at the NPU MEM level in the msprof_*.json file, and the summary information is summarized in the npu_mem_*.csv file.

Availability

Atlas 200/300/500 Inference Product

Atlas Training Series Product

Data at NPU MEM Level in msprof_*.json

The following figure shows data at the NPU MEM level in the msprof_*.json file. (The following figure is only an example. The actual display depends on the product implementation.)

Figure 1 NPU memory layer

The preceding figure shows the process-level and device-level memory usage, in KB. The Memory field indicates the total memory usage.

npu_mem_*.csv File

The file content is formatted as follows.

Figure 2 npu_mem_*.csv

The preceding table lists the memory usage details, in KB. The Memory field indicates the total memory usage.