MindStudio Insight displays the end-to-end request execution in the timeline view, showing the duration of the request in each key phase and the status of the request. This helps users quickly identify service performance bottlenecks and adjust the profiling policy accordingly.
Environment Preparation
Install MindStudio Insight first. For details, see .
Data preparation
Import profile data in the correct format. For details about the data, see . For details about how to import data, see .
MindStudio Insight allows users to import profile data files and displays related content in graphics. In the serving tuning scenario, two types of data can be imported: SQLite database file (profiler.db) of the visualization curve and JSON file (chrome_tracing.json) of the inference serving request trace data.
MindStudio Insight provides various import modes based on the file type. For details, see .
Table 1 Data import modes [object Object][object Object]
Precautions
- The profile data of system tuning and serving tuning can be imported at the same time. You need to place the data of the two scenarios in the same folder and select the folder when importing the data.
- For details about how to obtain the data, see .
During serving tuning, MindStudio Insight displays the end-to-end request execution in the timeline view, showing the duration of the request in each key phase and the status of the request. By analyzing the timeline, you can quickly identify service performance bottlenecks and adjust the tuning policy based on the symptom.
You can check the duration and interval at each level in the timeline view to determine whether performance problems exist in the corresponding key phase.
GUI Display
The Timeline tab page consists of the toolbar (area 1), graphical display (area 2), and data pane (area 3), as shown in .
Figure 1 Timeline page [object Object][object Object]
- Area 1: toolbar, which contains common shortcut keys. From left to right, the shortcut keys are Marker List, Filter (card or unit), Search, Flow Events, Reset (page restoration), Timeline Zoom Out, and Timeline Zoom In.
- Area 2: graphical display. The profile data collected by service is displayed on the left. The first level is the process, and the second level is the key phase information of the request. describes the unit information. The timeline view is displayed on the right line by line, including the execution sequence and duration of each key phase.
- Area 3: data pane, which displays statistics or instruction details. If you select Slice Detail, the details of a single key phase are displayed. If you select Slice List, the key phase list information of the selected area in the unit is displayed.
Unit Information[object Object][object Object]
Table 1 Unit information
For details about how to use the Timeline tab page in the serving tuning scenario, see "" in the MindStudio Insight System Tuning.
Slice Detail
When you select a key phase block, the details about the key phase are displayed on the Slice Detail tab page in the lower part. If res_list exists on the Slice Detail tab page, click any row in the rid list. The request details of the corresponding RID are displayed in the right pane of the Slice Detail tab page, as shown in . For details about the fields, see .
Figure 1 Slice Detail [object Object][object Object]
Table 1 Slice Detail fields [object Object][object Object]
System View
On the System View tab page, when you select Stats System View, the Rank ID selection box and serving data are displayed. You can select the rank to be viewed from the Rank ID selection box.
The serving data includes the kvcache_usage, batch_info, request_data, and forward_info tab pages, as shown in .
When you select a serving data type, the corresponding details are displayed in the right area. For details about the fields, see . You can search for information by clicking next to the field name.
Figure 2 System View [object Object][object Object]
Table 2 Servitization View fields [object Object][object Object]
Generating Line Charts by Blocks
The duration and bubble line charts of blocks are available in the serving tuning scenario, facilitating fault analysis.
On the Timeline tab page, right-click a block in any unit and choose Generate Duration Line Chart By Block or Generate Bubble Line Chart By Block from the shortcut menu. The Curve tab page is displayed, showing the curve (duration and average duration) and data details of the unit where the block is located, as shown in .
Figure 3 Generating a curve by block [object Object] [object Object]
If you spot an anomaly in the curve, zoom into that area and click on the anomaly. Check the related information in the data details table below the curve. Right-click the data row and choose Find in Timeline from the shortcut menu. The Timeline page is displayed, as shown in .
Figure 4 Find in Timeline [object Object] [object Object]
Data changes can be displayed in curves and data details tables, facilitating analysis. The Curve tab page is displayed only when the profiler.db file is imported.
The Curve tab page consists of the parameter configuration area (area 1), curve data (area 2), and table data details (area 3), as shown in .
Figure 1 Curve page [object Object] [object Object]
- Area 1: parameter configuration area, including the card ID and grouping mode.
- Area 2: curve chart, showing data changes.
- Area 3: table data details, showing the detailed data of the SQLite database. The table supports sorting and pagination. You can click the table header of each column to display data in ascending, descending, or default order.
Zooming In and Out on a Curve
MindStudio Insight allows you to left-click to drag select and zoom in on the selected part of the curve and right-click to zoom out on the curve. To improve the display performance, most points are hidden in the curve when the data volume is large. You can select a fine area to display all points or right-click the selected part to restore the original display effect.
In the curve, click and drag the mouse to the end point to be zoomed in and release the mouse. The selected region is zoomed in. If some points are still hidden, repeat the zoom-in operation to display the hidden points. shows the selected zoom-in region.
You can click to dim a legend on the top to hide the curve. You can also click the dimmed legend to show the curve.
Figure 1 Selected zoom-in region [object Object] [object Object]
[object Object]