(memory_record) Memory Usage of CANN Operators

The memory usage records of CANN operators do not contain the timeline information. The summary information is summarized in the memory_record_*.csv file, which records the memory allocated to the GE component at the CANN layer and the occupation time.

Applicability

Product

Supported

Atlas 350 Accelerator Card

√

Atlas A3 training product/Atlas A3 inference product

√

Atlas A2 training product/Atlas A2 inference product

√

Atlas 200I/500 A2 inference product

√

Atlas inference product

√

Atlas training product

√

Atlas 350 Accelerator Card

√

Data Description of the memory_record_*.csv File

The following shows the file content format.

Figure 1 memory_record_*.csv
Table 1 Field description

Field

Description

Device_id

Device ID.

Component

Component. The performance analysis tool in the CANN software package can collect data only from the GE component.

Timestamp(us)

Timestamp, which records the start time of memory usage, in μs.

Total Allocated(KB)

Total allocated memory, in KB.

Total Reserved(KB)

Total reserved memory, in KB.

Device

Device type and device ID. Only NPUs are involved.