npu_module_mem (Memory Usage of NPU Components)

The NPU component memory usage data does not contain the timeline information. The summary information is summarized in the npu_module_mem_*.csv file.

Applicable Products

Product

Supported

Ascend 950PR/Ascend 950DT

√

Atlas A3 training products/Atlas A3 inference products

√

Atlas A2 training products/Atlas A2 inference products

√

Atlas 200I/500 A2 inference products

√

Atlas inference products

√

Atlas training products

√

Data Description of the npu_module_mem_*.csv File

The file content is formatted as follows.

Figure 1 npu_module_mem_*.csv
Table 1 Field description

Field

Description

Device_id

Device ID.

Component

Component name.

Timestamp(us)

Timestamp, in μs. You can view the memory used by the component at the current time point.

Total Reserved(KB)

Memory usage, in KB. If the value is -1, only the released memory is collected for the component.

Device

Device type and device ID. Only NPUs are involved.