l2_cache (L2 Cache Hit Ratio)

The L2 cache data does not contain the timeline information. The summary information is summarized in the l2_cache_*.csv file.

Applicability

Product

Supported

Atlas 350 Accelerator Card

Atlas A3 training product/Atlas A3 inference product

Atlas A2 training product/Atlas A2 inference product

Atlas 200I/500 A2 inference product

Atlas inference product

Atlas training product

l2_cache_*.csv File

The following shows the file content format.

Figure 1 l2_cache_*.csv

For the following products:

  • Atlas inference product
  • Atlas training product

The Hit Rate and Victim Rate for the first operator in this file are not intended for reference.

For the following products:

  • Atlas 200I/500 A2 inference product
  • Atlas A2 training product/Atlas A2 inference product
  • Atlas A3 training product/Atlas A3 inference product
  • Atlas 350 Accelerator Card

Data of the first operator in the file is missing. This does not affect the overall performance analysis.

Table 1 Field description

Field

Description

Device_id

Device ID.

Stream Id

ID of the stream where a task is located.

Task Id

Task ID.

Hit Rate

Ratio of the number of times that memory access requests hit L2 to the total number of memory access requests.

For the Atlas 200I/500 A2 inference product, you are advised to use the L2 cache group of aic_metrics to collect hit rate data. In this collection mode, the hit rate data is displayed in the op_summary_*.csv file.

For the Atlas A2 training product/Atlas A2 inference product, you are advised to use the L2 cache group of aic_metrics to collect hit rate data. In this collection mode, the hit rate data is displayed in the op_summary_*.csv file.

For the Atlas A3 training product/Atlas A3 inference product, you are advised to use the L2 cache group of aic_metrics to collect hit rate data. In this collection mode, the hit rate data is displayed in the op_summary_*.csv file.

Victim Rate

Ratio of the number of times that memory access requests are missed and data in the cache is swapped out to the total number of memory access requests.

For the Atlas 200I/500 A2 inference product, the value of Victim Rate may be greater than 1.

For the Atlas A2 training product/Atlas A2 inference product, the value of Victim Rate may be greater than 1.

For the Atlas A3 training product/Atlas A3 inference product, the value of Victim Rate may be greater than 1.

Op Name

Operator name.