(memory_record) Memory Usage of CANN Operators

The memory usage records of CANN operators do not contain the timeline information. The summary information is summarized in the memory_record_*.csv file, which records the memory allocated to the GE component at the CANN layer and the occupation time.

Applicability

Product

Supported

Atlas 350 Accelerator Card

Atlas A3 training product/Atlas A3 inference product

Atlas A2 training product/Atlas A2 inference product

Atlas 200I/500 A2 inference product

Atlas inference product

Atlas training product

Atlas 350 Accelerator Card

Data Description of the memory_record_*.csv File

The following shows the file content format.

Figure 1 memory_record_*.csv
Table 1 Field description

Field

Description

Device_id

Device ID.

Component

Component. The performance analysis tool in the CANN software package can collect data only from the GE component.

Timestamp(us)

Timestamp, which records the start time of memory usage, in μs.

Total Allocated(KB)

Total allocated memory, in KB.

Total Reserved(KB)

Total reserved memory, in KB.

Device

Device type and device ID. Only NPUs are involved.