(memory_record) Memory Usage of CANN Operators

The memory usage records of CANN operators do not contain the timeline information. The summary information is summarized in the memory_record_*.csv file, which records the memory allocated to the GE component at the CANN layer and the occupation time.

Availability

Atlas 200/500 A2 Inference Product

Atlas Inference Series Product

Atlas Training Series Product

Atlas A2 Training Series Product/Atlas 800I A2 Inference Product

Atlas A3 Training Series Product

Data Description of the memory_record_*.csv File

The file content is formatted as follows.

Figure 1 memory_record_*.csv
Table 1 Field description

Field

Description

Device_id

Device ID.

Component

Component. The performance analysis tool in the CANN software package can collect data only from the GE component.

Timestamp(us)

Timestamp, which records the start time of memory usage, in μs.

Total Allocated(KB)

Total allocated memory, in KB.

Total Reserved(KB)

Total reserved memory, in KB.

Device

Device type and device ID. Only NPUs are involved.