npu_module_mem (Memory Usage of NPU Components)

The NPU component memory usage data does not contain the timeline information. The summary information is summarized in the npu_module_mem_*.csv file.

Applicability

Product

Supported

Atlas 350 Accelerator Card

Atlas A3 training product/Atlas A3 inference product

Atlas A2 training product/Atlas A2 inference product

Atlas 200I/500 A2 inference product

Atlas inference product

Atlas training product

Data Description of the npu_module_mem_*.csv File

The following shows the file content format.

Figure 1 npu_module_mem_*.csv
Table 1 Field description

Field

Description

Device_id

Device ID.

Component

Component name.

Timestamp(us)

Timestamp, in μs. You can view the memory used by the component at the current time point.

Total Reserved(KB)

Memory usage, in KB. If the value is -1, only the released memory is collected for the component.

Device

Device type and device ID. Only NPUs are involved.