(memory_record) Memory Usage of CANN Operators

The memory usage records of CANN operators do not contain the timeline information. The summary information is summarized in the memory_record_*.csv file, which records the memory allocated to the GE component at the CANN layer and the occupation time.

Availability

Atlas 200/300/500 Inference Product

Atlas Training Series Product

Data Description of the memory_record_*.csv File

The file content is formatted as follows.

Figure 1 memory_record_*.csv
Table 1 Field description

Field

Description

Device_id

Device ID.

Component

Component. The performance analysis tool in the CANN software package can collect data only from the GE component.

Timestamp(us)

Timestamp, which records the start time of memory usage (μs).

Total Allocated(KB)

Total allocated memory (KB).

Total Reserved(KB)

Total reserved memory (KB).

Device

Device type and device ID. Only NPUs are involved.