Telegraf Data Description

After you run Telegraf, the monitored data information of Ascend AI processors is displayed. The following information is for reference only. For more details, see the following content or refer to Data Description.

...
Ascend910-0,host=xxx  npu_chip_link_speed=104857600000i,npu_chip_roce_rx_cnp_pkt_num=0i,npu_chip_roce_unexpected_ack_num=0i,npu_chip_optical_vcc=3245.1,npu_chip_optical_rx_power_1=0.8585,npu_chip_info_hbm_used_memory=0i,npu_chip_mac_rx_pause_num=0i,npu_chip_roce_tx_all_pkt_num=0i,npu_chip_roce_tx_cnp_pkt_num=0i,npu_chip_info_temperature=46,npu_chip_mac_rx_bad_pkt_num=0i,npu_chip_roce_tx_err_pkt_num=0i,npu_chip_optical_rx_power_3=0.8466,npu_chip_optical_rx_power_0=0.7933,npu_chip_info_network_status=0i,npu_chip_mac_rx_pfc_pkt_num=0i,npu_chip_mac_tx_bad_pkt_num=0i,npu_chip_roce_rx_all_pkt_num=0i,npu_chip_mac_rx_bad_oct_num=0i,npu_chip_optical_tx_power_1=0.9162,npu_chip_info_utilization=0,npu_chip_info_power=73.9000015258789,npu_chip_info_link_status=1i,npu_chip_info_bandwidth_rx=0,npu_chip_mac_tx_pfc_pkt_num=0i,npu_chip_roce_rx_err_pkt_num=0i,npu_chip_roce_verification_err_num=0i,npu_chip_optical_state=1i,npu_chip_info_bandwidth_tx=0,npu_chip_mac_tx_bad_oct_num=0i,npu_chip_roce_out_of_order_num=0i,npu_chip_roce_qp_status_err_num=0i,npu_chip_optical_rx_power_2=0.855,npu_chip_optical_tx_power_0=0.9095,npu_chip_info_hbm_utilization=0,npu_chip_link_up_num=2i,npu_chip_info_health_status=1i,npu_chip_mac_tx_pause_num=0i,npu_chip_roce_new_pkt_rty_num=0i,npu_chip_optical_temp=53,npu_chip_optical_tx_power_2=1.0342,npu_chip_optical_tx_power_3=0.9715 1694772754612200641,npu_chip_info_process_info_num=0i

This API can be used to query both the default and custom metrics groups. Custom Metric Development describes how to customize a metrics group, and the default metrics group contains the following parts. The collection and reporting of a metrics group are governed by its corresponding configuration parameter. When enabled, the metrics group is collected and reported; when disabled, it is neither collected nor reported.

Version Information
NPU Information
vNPU Information
Network Information
On-chip Memory Information
HCCS Data Information
PCIe Information
RoCE Data Information
SIO Data Information
Optical Module Data Information
DDR Information

NPU Exporter obtains data information by calling the underlying HDK APIs. For more details, see HDK APIs to Be Called.
NPU Exporter does not report data if it does not support the device or HDK APIs fail to be called when a data record is queried.

Version Information

**Table 1** Version information
Type	Data Name	Data Description	Value/Unit	Supported Product
Version	npu_exporter_version_info	NPU Exporter version information	-	Atlas training products Atlas A2 training products Atlas A3 training products Inference server (equipped with Atlas 300I inference cards) Atlas inference products Atlas 800I A2 inference server A200I A2 Box heterogeneous component

NPU Information

**Table 2** NPU information
Type	Data Name	Data Description	Value/Unit	Supported Product
NPU	machine_npu_nums	Number of Ascend AI processors	Unit: integer	Atlas training products Atlas A2 training products Atlas A3 training products Inference server (equipped with Atlas 300I inference cards) Atlas inference products Atlas 800I A2 inference server A200I A2 Box heterogeneous component
NPU	npu_chip_info_name	Name and ID of the Ascend AI processor	-
NPU	npu_chip_info_health_status	Health status of the Ascend AI processor	The value can be 0 or 1. 1: healthy 0: unhealthy
NPU	npu_chip_info_power	Power consumption of the Ascend AI processor	Unit: watt (W)
NPU	npu_chip_info_temperature	Temperature of the Ascend AI processor	Unit: °C
NPU	First error code: npu_chip_info_error_code Other error codes: npu_chip_info_error_code_X	Error code of the Ascend AI processor This field is not reported when Ascend AI processors do not have error codes. NOTE: For Prometheus: If an Ascend AI processor contains multiple error codes, only the first 10 error codes can be reported due to Prometheus format restrictions. The value of X ranges from 1 to 9. Telegraf: A maximum of 128 error codes can be reported. For details about the error codes, see Processor Fault Code Reference Documents.	-
NPU	npu_chip_info_process_info_num	Number of processes that occupy the Ascend AI processor	-
NPU	npu_chip_info_utilization	AI Core usage of the Ascend AI processor	Unit: %
NPU	npu_chip_info_aicore_current_freq	Current frequency of the AI Core of the Ascend AI processor	Unit: MHz
NPU	npu_chip_info_process_info	Information about the process that occupies the Ascend AI processor The value 0 is reported only when no process occupies the Ascend AI processor.	Unit: MB
NPU	npu_chip_info_process_info_PID	Information about the process that occupies the Ascend AI Processor. PID indicates the process ID on the host. The value is the memory used by the process.	Unit: MB
NPU	npu_chip_info_voltage	Voltage of the Ascend AI processor	Unit: V
NPU	npu_chip_info_serial_number	SN of the Ascend AI processor	-
NPU	npu_chip_info_network_status	Network health status of the Ascend AI processor	The value can be 0 or 1. 1: The network is healthy and can be connected. 0: The network is unhealthy and cannot be connected.	Atlas training products Atlas A2 training products Atlas A3 training products Atlas 800I A2 inference server A200I A2 Box heterogeneous component
NPU	npu_chip_info_overall_utilization	Overall usage of the Ascend AI processor	Unit: %	Atlas A2 training products Atlas A3 training products Atlas 800I A2 inference server A200I A2 Box heterogeneous component
NPU	npu_chip_info_vector_utilization	AI Vector usage of the Ascend AI processor	Unit: %	Atlas A2 training products Atlas A3 training products Inference server (equipped with Atlas 300I inference cards) Atlas inference products Atlas 800I A2 inference server A200I A2 Box heterogeneous component

vNPU Information

**Table 3** vNPU information
Type	Data Name	Data Description	Value/Unit	Supported Product
vNPU	vnpu_pod_aicore_utilization	AI Core usage of a vNPU	Unit: %	Atlas inference product
vNPU	vnpu_pod_total_memory	Total memory of a vNPU	Unit: KB
vNPU	vnpu_pod_used_memory	Memory used by a vNPU	Unit: KB

Network Information

**Table 4** Network information
Type	Data Name	Data Description	Value/Unit	Supported Product
Network	npu_chip_info_bandwidth_rx	Real-time RX rate of the network port of the Ascend AI processor	Unit: MB/s	Atlas training products Atlas A2 training products Atlas A3 training products Atlas 800I A2 inference server A200I A2 Box heterogeneous component
Network	npu_chip_info_bandwidth_tx	Real-time TX rate of the network port of the Ascend AI processor	Unit: MB/s
Network	npu_chip_info_link_status	Network port link status of the Ascend AI processor	The value can be 0 or 1. 1: UP 0: DOWN
Network	npu_chip_link_speed	Default network port rate of the Ascend AI processor.	Unit: MB/s
Network	npu_chip_link_up_num	Number of times when the network port of the Ascend AI processor is up.	Unit: integer

On-chip Memory Information

**Table 5** On-chip memory information
Type	Data Name	Data Description	Value/Unit	Supported Product
On-chip memory	npu_chip_info_hbm_used_memory	Used on-chip memory of the Ascend AI processor	Unit: MB	Atlas training products Atlas A2 training products Atlas A3 training products A200I A2 Box heterogeneous component Atlas 800I A2 inference server
On-chip memory	npu_chip_info_hbm_total_memory	Total on-chip memory of the Ascend AI processor	Unit: MB
On-chip memory	npu_chip_info_hbm_utilization	On-chip memory usage of the Ascend AI processor.	Unit: %
On-chip memory	npu_chip_info_hbm_ecc_enable_flag	ECC enabling status of the on-chip memory of the Ascend AI processor.	The value can be 1 or 0. 0: ECC detection is disabled. 1: ECC detection is enabled.
On-chip memory	npu_chip_info_hbm_ecc_single_bit_error_cnt	Current number of single-bit errors of the on-chip memory of the Ascend AI processor	-
On-chip memory	npu_chip_info_hbm_ecc_double_bit_error_cnt	Current number of double-bit errors of the on-chip memory of the Ascend AI processor	-
On-chip memory	npu_chip_info_hbm_ecc_total_single_bit_error_cnt	Total number of single-bit errors during the on-chip memory lifecycle of the Ascend AI processor	-
On-chip memory	npu_chip_info_hbm_ecc_total_double_bit_error_cnt	Total number of double-bit errors during the on-chip memory lifecycle of the Ascend AI processor	-
On-chip memory	npu_chip_info_hbm_ecc_single_bit_isolated_pages_cnt	Number of isolated memory pages with single-bit errors of the on-chip memory of the Ascend AI processor	-
On-chip memory	npu_chip_info_hbm_ecc_double_bit_isolated_pages_cnt	Number of isolated memory pages with double-bit errors of the on-chip memory of the Ascend AI processor	-
On-chip memory	npu_chip_info_hbm_temperature	On-chip memory temperature of the Ascend AI processor	Unit: °C
On-chip memory	npu_chip_info_hbm_bandwidth_utilization	On-chip memory bandwidth usage of the Ascend AI processor	Unit: %

HCCS Data Information

**Table 6** HCCS data information
Type	Data Name	Data Description	Value/Unit	Supported Product
HCCS	npu_chip_info_hccs_statistic_info_tx_cnt_X X range: 1 to 7 (Atlas A2 training products or Atlas 900 A3 SuperPoD)or 2 to 7 (Atlas 9000 A3 SuperPoD)	Number of packets transmitted over the Xth HDLC link. The unit is flit. If the collection fails, -1 is reported.	-	Atlas A2 training products Atlas A3 training products
HCCS	npu_chip_info_hccs_statistic_info_rx_cnt_X X range: 1 to 7 (Atlas A2 training products or Atlas 900 A3 SuperPoD)or 2 to 7 (Atlas 9000 A3 SuperPoD)	Number of packets received over the Xth HDLC link. The unit is flit. If the collection fails, -1 is reported.	-
HCCS	npu_chip_info_hccs_statistic_info_crc_err_cnt_X X range: 1 to 7 (Atlas A2 training products or Atlas 900 A3 SuperPoD)or 2 to 7 (Atlas 9000 A3 SuperPoD)	Number of packets with CRC errors received over the Xth HDLC link. The unit is flit. If the collection fails, -1 is reported.	-
HCCS	npu_chip_info_hccs_bandwidth_info_profiling_time	Sampling duration of the HCCS link bandwidth. The value ranges from 1 to 1000.	Unit: ms
HCCS	npu_chip_info_hccs_bandwidth_info_total_tx	Total bandwidth for sending data on HCCS links. -1 is reported when data collection fails.	Unit: GB/s
HCCS	npu_chip_info_hccs_bandwidth_info_total_rx	Total bandwidth for receiving data on HCCS links. -1 is reported when data collection fails.	Unit: GB/s
HCCS	npu_chip_info_hccs_bandwidth_info_tx_X X range: 1 to 7 (Atlas A2 training products, Atlas 900 A3 SuperPoD) or 2 to 7 (Atlas 9000 A3 SuperPoD)	Total bandwidth for sending data on a single HCCS link. -1 is reported when data collection fails.	Unit: GB/s
HCCS	npu_chip_info_hccs_bandwidth_info_rx_X X range: 1 to 7 (Atlas A2 training products, Atlas 900 A3 SuperPoD) or 2 to 7 (Atlas 9000 A3 SuperPoD)	Total bandwidth for receiving data on a single HCCS link. -1 is reported when data collection fails.	Unit: GB/s

PCIe Information

**Table 7** PCIe information
Type	Data Name	Data Description	Value/Unit	Supported Product
PCIe	npu_chip_info_pcie_rx_p_bw	Remote-write PCIe bandwidth obtained by the Ascend AI processor.	Unit: MB/ms	Atlas A2 training products Atlas 800I A2 inference server A200I A2 Box heterogeneous component
PCIe	npu_chip_info_pcie_rx_np_bw	Remote-read PCIe bandwidth obtained by the Ascend AI processor.	Unit: MB/ms
PCIe	npu_chip_info_pcie_rx_cpl_bw	Remote-read PCIe bandwidth with CPL response obtained by the Ascend AI processor	Unit: MB/ms
PCIe	npu_chip_info_pcie_tx_p_bw	Remote-write PCIe bandwidth obtained by the Ascend AI processor	Unit: MB/ms
PCIe	npu_chip_info_pcie_tx_np_bw	Remote-read PCIe bandwidth obtained by the Ascend AI processor	Unit: MB/ms
PCIe	npu_chip_info_pcie_tx_cpl_bw	Remote-write PCIe bandwidth with CPL response obtained by the Ascend AI processor	Unit: MB/ms

RoCE Data Information

**Table 8** RoCE data information
Type	Data Name	Data Description	Value/Unit	Supported Product
RoCE	npu_chip_mac_rx_pause_num	Total number of pause frames received by the MAC	-	Atlas training products Atlas A2 training products Atlas A3 training products Atlas 800I A2 inference server A200I A2 Box heterogeneous component
RoCE	npu_chip_mac_tx_pause_num	Total number of pause frames transmitted by the MAC	-
RoCE	npu_chip_mac_rx_pfc_pkt_num	Total number of PFC frames received by the MAC	-
RoCE	npu_chip_mac_tx_pfc_pkt_num	Total number of PFC frames transmitted by the MAC	-
RoCE	npu_chip_mac_rx_bad_pkt_num	Total number of bad packets received by the MAC	-
RoCE	npu_chip_mac_tx_bad_oct_num	Total bytes of bad packets transmitted by the MAC	-
RoCE	npu_chip_mac_rx_bad_oct_num	Total bytes of bad packets received by the MAC	-
RoCE	npu_chip_mac_tx_bad_pkt_num	Total number of bad packets transmitted by the MAC	-
RoCE	npu_chip_roce_rx_all_pkt_num	Total number of packets received by the RoCE	-
RoCE	npu_chip_roce_tx_all_pkt_num	Total number of packets transmitted by the RoCE	-
RoCE	npu_chip_roce_rx_err_pkt_num	Total number of bad packets received by the RoCE	-
RoCE	npu_chip_roce_tx_err_pkt_num	Total number of bad packets transmitted by the RoCE	-
RoCE	npu_chip_roce_rx_cnp_pkt_num	Number of CNP packets received by the RoCE	-
RoCE	npu_chip_roce_tx_cnp_pkt_num	Number of CNP packets transmitted by the RoCE	-
RoCE	npu_chip_roce_new_pkt_rty_num	Number of packet transmission retries by the RoCE	-
RoCE	npu_chip_roce_unexpected_ack_num	Number of unexpected ACK packets received by the RoCE. These packets are deprecated by the NPU, without affecting services.	-
RoCE	npu_chip_roce_out_of_order_num	Number of PSN packets received by the RoCE > expected PSN packets or duplicate PSN packets. If packets are out of order or lost, transmission retry is triggered.	-
RoCE	npu_chip_roce_verification_err_num	Number of packets with field verification failure received by the RoCE. The field verification includes the ICRC, packet length, and destination port number.	-
RoCE	npu_chip_roce_qp_status_err_num	Number of packets received by the RoCE during abnormal QP connection	-
RoCE	npu_chip_info_rx_ecn_num	Number of ECNs received by the Ascend AI processor's network	-
RoCE	npu_chip_info_rx_fcs_num	Number of FCSs received by the Ascend AI processor's network	-

SIO Data Information

**Table 9** SIO data information
Type	Data Name	Data Description	Value/Unit	Supported Product
SIO	npu_chip_info_sio_crc_tx_err_cnt	Number of error packets transmitted by the SIO	-	Atlas A3 training products
SIO	npu_chip_info_sio_crc_rx_err_cnt	Number of error packets received by the SIO	-	Atlas A3 training products

Optical Module Data Information

**Table 10** Optical module data information
Type	Data Name	Data Description	Value/Unit	Supported Product
Optical module	npu_chip_optical_state	Optical module status	The value can be 0 or 1. 0: not detected 1: detected	Atlas training products Atlas A2 training products Atlas 900 A3 SuperPoD Atlas 800I A2 inference server A200I A2 Box heterogeneous component
Optical module	npu_chip_optical_tx_power_X (X ranges from 0 to 3)	TX power of the optical module	Unit: mW
Optical module	npu_chip_optical_rx_power_X (X ranges from 0 to 3)	RX power of the optical module	Unit: mW
Optical module	npu_chip_optical_vcc	Optical module voltage	Unit: mV
Optical module	npu_chip_optical_temp	Optical module temperature	Unit: °C

DDR Information

**Table 11** DDR information
Type	Data Name	Data Description	Value/Unit	Supported Product
DDR	npu_chip_info_used_memory	Used DDR memory of the Ascend AI processor	Unit: MB	Atlas training products Inference server (with Atlas 300I inference cards) Atlas inference products
DDR	npu_chip_info_total_memory	Total DDR memory of the Ascend AI processor	Unit: MB

HDK APIs to Be Called

NPU Exporter obtains data information by calling the underlying HDK APIs. For details about HDK APIs called to obtain the above data, see HDK APIs Called by NPU Exporter. To search for the required HDK APIs, perform the following steps:

Visit Ascend Computing Documentation and select a product name to go to the document page. For example, if you are a user of Atlas 800I A2 inferences, click Atlas 800I A2.
In the navigation pane on the left, click Developer Documents.
In the search box on the home page of the document, search for an API name or keyword to view the API information.

Parent topic: NPU Exporter