Memory Channel Throughput Waveform
The visualize_data.bin file generated by msprof op simulator can be visualized using MindStudio Insight. The GUI supports timeline-based memory bandwidth statistical analysis of the MTE channels of operators, enabling developers to identify bandwidth usage in each phase and analyze the feasibility of bandwidth optimization. For details about the feature support, see Figure 1.
- To use MindStudio Insight, you need to install the MindStudio Insight software package separately. For details about the download link, see"Installation and Uninstallation".
- For details about how to import the visualize_data.bin file to MindStudio Insight, see Importing Profile Data.
- For details about the MindStudio Insight operations and fields, see .
- The memory channel throughput waveform function applies only to
Atlas A2 training products /Atlas A2 inference products andAtlas A3 training products /Atlas A3 inference products . - This function is disabled by default. The --core-id setting does not take effect for this function.
Memory Channel Throughput Waveform
- Displays the data throughput (MB/s) of various memory channels (GM_TO_L1, GM_TO_TOTAL, GM_TO_UB, L1_TO_GM, TOTAL_TO_GM, and UB_TO_GM). For example, GM_TO_UB indicates the throughput of data transfer from GM to UB, and GM_TO_TOTAL indicates the throughput of data transfer from GM to each memory unit.
- Displays the throughput when MTE instructions are executed, helping users identify operator performance issues.
- The throughput is calculated based on the data obtained after multiple requests of the same instruction are completed.
- The throughput waveform may appear within the start and end time range of an instruction (including both the start time and end time). For example, for an instruction with a duration of 1–3 μs, the throughput data may be distributed across the 1–2 μs, 2–3 μs, and 3–4 μs histogram bars.
Parent topic: msProf (Operator Tuning)