Instructions

Computing Operator

This page is displayed when Group By is set to Computing Operator. You can view details about a single computing operator to quickly locate the performance problems of the computing operator, as shown in Figure 1. Table 1 describes the fields in the Operator Details area. You can click next to the field to perform fuzzy search on the related field.

Figure 1 Computing Operator
Table 1 Computing Operator fields

Field

Description

Name

Operator name.

Type

Operator type.

Accelerator Core

AI accelerator core type, including AI Core and AI CPU.

Start Time(ms)

Operator execution start time.

Duration(μs)

Execution duration of the current operator.

Wait Time(μs)

Waiting time for executing the operator.

Block Dim

Number of running splits, which corresponds to the number of cores during task running.

Input Shapes

Operator input shape.

Input Data Types

Input data type of the operator.

Input Formats

Input format of the operator.

Output Shapes

Operator output shape.

Output Data Types

Output data type of the operator.

Output Formats

Output format of the operator.

If the performance file imported to MindStudio Insight contains the collected register values, parameters such as aicore_time and aic_total_cycles are displayed in the computing operator details. For details about the parameters, see "op_summary (Operator Details)" in Profiling Instructions.

Computing Operator Type

This page is displayed when Group By is set to Computing Operator Type. You can view the duration percentage and detailed data of operators of different computing operator types to quickly locate performance problems of computing operators of a specific type, as shown in Figure 2. Table 2 describes the fields in the Operator Details area. You can click next to the field to perform fuzzy search on the related field.

Figure 2 Computing Operator Type
Table 2 Computing Operator Type fields

Field

Description

Type

Operator type.

Accelerator Core

AI accelerator core type, including AI Core and AI CPU.

Count

Number of operator executions.

Total Time(μs)

Total operator execution time.

Avg Time(μs)

Average operator execution time.

Max Time(μs)

Maximum operator execution time.

Min Time(μs)

Minimum operator execution time.

Details

Click See more in the Details column to display details about a single computing operator. For details, see Table 1.

Computing Operator Name and Input Shape

This page is displayed when Group By is set to Computing Operator Name and Input Shape. You can view the duration percentage and detailed data of computing operators of different types with specific input shapes to quickly locate performance problems of operators of a specific input shape, as shown in Figure 3. Table 3 describes the fields in the Operator Details area. You can click next to the field to perform fuzzy search on the related field.

Figure 3 Computing Operator Name and Input Shape
Table 3 Computing Operator Name and Input Shape fields

Field

Description

Name

Operator name.

Shape

Operator input shape.

Accelerator Core

AI accelerator core type, including AI Core and AI CPU.

Count

Number of operator executions.

Total Time(μs)

Total operator execution time.

Avg Time(μs)

Average operator execution time.

Max Time(μs)

Maximum operator execution time.

Min Time(μs)

Minimum operator execution time.

Details

Click See more in the Details column to display details about a single operator. For details, see Table 1.

Communication Operator

This page is displayed when Group By is set to Communication Operator. You can view details about a single communication operator to quickly locate performance problems of the communication operator, as shown in Figure 4. Table 4 describes the fields in the Operator Details area. You can click next to the field to perform fuzzy search on the related field.

Figure 4 Communication Operator
Table 4 Communication Operator fields

Field

Description

Name

Communication operator name.

Type

Communication operator type.

Start Time(ms)

Start time of communication operator execution.

Duration(μs)

Execution duration of the current communication operator.

Wait Time(μs)

Waiting time for executing the communication operator.

Communication Operator Type

This page is displayed when Group By is set to Communication Operator Type. You can view the duration percentage and detailed data of operators of different communication operator types to quickly locate performance problems of communication operators of a specific type, as shown in Figure 5. Table 5 describes the fields in the Operator Details area. You can click next to the field to perform fuzzy search on the related field.

Figure 5 Communication Operator Type
Table 5 Communication Operator Type fields

Field

Description

Type

Communication operator type.

Count

Number of communication operator executions.

Total Time(μs)

Total execution time of the communication operator.

Avg Time(μs)

Average execution time of the communication operator.

Max Time(μs)

Maximum execution time of the communication operator.

Min Time(μs)

Minimum execution time of the communication operator.

Details

Click See more in the Details column to display details about a single communication operator. For details, see Table 4.

Comparing Data Between Two Cards

MindStudio Insight allows developers to compare the operator performance between two cards to intuitively view the differences between them. For details about how to set baseline data and comparison data, see Data Comparison.

In card comparison mode, the Operator page does not display the duration percentage pie chart. Only the operator details table is displayed. The value of Rank ID is fixed and cannot be switched. Group By can be selected as required. Top N data records can be displayed.

The operator details table displays the difference between two cards. You can click See more in the Details column to view the baseline data and comparison data details, as shown in Figure 6. For details about the fields, see the field description corresponding to each value of Group By. The following figure shows the data comparison details when Group By is set to Computing Operator Type.

Figure 6 Operator comparison