Overview

Leveraging the OpenTelemetry Protocol (OTLP), msServiceProfiler Trace offers the forwarding service to collect, process, and route distributed Trace data, enabling performance monitoring and analysis across microservice architectures.

msServiceProfiler Trace profiles request metrics, such as response time, response status, client IP address/port, and server IP address/port, from MindIE Motor services and exports them to OTLP-compliant, open-source platforms like Jaeger for analysis.

• The current version targets the MindIE inference framework, supporting both single-node and multi-node PD contention deployments.
• Trace monitoring is currently supported only for the two core request APIs of MindIE: /v1/chat/completions and /v1/completions.
• For details about the msServiceProfiler APIs for trace data monitoring, see "msServiceProfiler API Reference (C++)" > "Trace Data Monitoring."
• For details about MindIE Motor, see MindIE Service Development Guide.