l2_cache (L2 Cache Hit Ratio)

The L2 cache data does not contain the timeline information. The summary information is summarized in the l2_cache_*.csv file.

Availability

Atlas 200/500 A2 Inference Product

Atlas Inference Series Product

Atlas Training Series Product

Atlas A2 Training Series Product/Atlas 800I A2 Inference Product

Atlas A3 Training Series Product

l2_cache_*.csv File

The file content is formatted as follows.

Figure 1 l2_cache_*.csv

For the following products:

  • Atlas Inference Series Product
  • Atlas Training Series Product

The Hit Rate and Victim Rate for the first operator in this file are not intended for reference.

For the following products:

  • Atlas 200/500 A2 Inference Product
  • Atlas A2 Training Series Product/Atlas 800I A2 Inference Product
  • Atlas A3 Training Series Product

Data of the first operator in the file is missing. This does not affect the overall performance analysis.

Table 1 Field description

Field

Description

Device_id

Device ID.

Stream Id

ID of the stream where a task is located.

Task Id

Task ID.

Hit Rate

Ratio of the number of times that memory access requests hit L2 to the total number of memory access requests.

For the Atlas 200/500 A2 Inference Product, you are advised to use the L2 cache group of aic_metrics to collect hit rate data. In this collection mode, the hit rate data is displayed in the op_summary_*.csv file.

For the Atlas A2 Training Series Product/Atlas 800I A2 Inference Product, you are advised to use the L2 cache group of aic_metrics to collect hit rate data. In this collection mode, the hit rate data is displayed in the op_summary_*.csv file.

For the Atlas A3 Training Series Product, you are advised to use the L2 cache group of aic_metrics to collect hit rate data. In this collection mode, the hit rate data is displayed in the op_summary_*.csv file.

Victim Rate

Ratio of the number of times that memory access requests are missed and data in the cache is swapped out to the total number of memory access requests.

For the Atlas 200/500 A2 Inference Product, the value of Victim Rate may be greater than 1.

For the Atlas A2 Training Series Product/Atlas 800I A2 Inference Product, the value of Victim Rate may be greater than 1.

For the Atlas A3 Training Series Product, the value of Victim Rate may be greater than 1.

Op Name

Operator name.