Documentation

msproftx Data Description

Availability

Atlas 200/300/500 Inference Product

Atlas Training Series Product

General Description

msproftx collects the profile data output by the user and upper-layer framework program. The data is saved in the mindstudio_profiler_output directory.

For details about the related data, see Table 1.

Table 1 Data file introduction

File Name

Description

msprof_*.json

Timeline summary data. For details, see msproftx timeline Summary Data.

msprof_tx_*.json

msproftx timeline data. It is a subset of msprof_*.json.

msprof_tx_*.csv

msproftx summary data. The collected host msproftx summary data is combined by thread for associated performance display. For details, see msprof_tx Summary Data.

msproftx timeline Summary Data

The timeline summary data of msproftx is displayed in msprof_*.json, as shown below.

Figure 1 Timeline summary data

As shown in Figure 1, the timeline summary data is displayed in the following areas:

  • Area 1: msproftx dotting, that is, recording upper-layer application data, including the time consumption information of upper-layer application running.
  • Area 2: data at the CANN layer, including the time consumption data of components (such as AscendCL and Runtime) and nodes (operators).
  • Area 3: bottom-layer NPU data, including the time consumption data of Task Scheduler, iteration trace data, and other Ascend AI Processor system data.
  • Area 4: details about each operator and API in a timeline, which are displayed when you click the timeline.
    • The field information displayed in area 3 is the upper-layer application operator information collected by msproftx in area 1. For details about the fields, see Table 2.
    • When viewing a .json file in tracing, enable MsTx under Flow events to display the delivery and execution mapping from traininginference process dotting tasks to NPU dotting operators on Ascend Hardware. This mapping is generated when the aclprofMarkEx API is called for dotting.

msprof_tx Summary Data

msprof_tx summary data: msprof_tx_*.csv.

The file content is formatted as follows.

Figure 2 msprof_tx Summary Data
Table 2 Field description

Field

Description

Device_id

Device ID.

pid

Process ID.

tid

Thread ID of an AscendCL API.

category

Type of the msproftx profiling process, which is used to identify the profiling content in the msproftx process. (reserved, not used currently).

event_type

Event type.

payload_type

Data type of the additional information payload carried in the msproftx profiling process (reserved, not used currently).

payload_value

Pointer to the additional information payload carried in the msproftx profiling process (reserved, not used currently).

Start_time(us)

Start time of the msproftx profiling process, in μs.

End_time(us)

End time of the msproftx profiling process, in μs.

message_type

Character string type carried in the msproftx profiling process (reserved, not used currently).

message

Character string description carried in the msproftx profiling process.