host_mem_usage (Host-side Memory Usage)

The timeline information of the host-side memory usage data is displayed at the Memory Usage layer in the msprof_*.json file. The summary information is summarized in the host_mem_usage_*.csv file.

Applicability

Product

Supported

Atlas A3 training product/Atlas A3 inference product

√

Atlas A2 training product/Atlas A2 inference product

√

Atlas 200I/500 A2 inference product

√

Atlas inference product

√

Atlas training product

√

Atlas 350 Accelerator Card

√

Data at the Memory Usage Layer in msprof_*.json

The following figure shows data at the Memory Usage layer in the msprof_*.json file.

Figure 1 Memory Usage layer
Table 1 Field description

Field

Description

Memory Usage

Memory usage.

host_mem_usage_*.csv File

The following shows the file content format.

Figure 2 host_mem_usage_*.csv
Table 2 Field description

Field

Description

Device_id

Device ID. host is displayed for data on the host.

Total Memory(KB)

Total system memory, in KB.

Peak Used Memory(KB)

Peak memory usage, in KB.

Recommend Memory(KB)

Recommended memory allocation in virtualization scenarios, in KB.