On-Chip Memory Diagnosis

Function

Diagnose the on-chip memory and output the diagnosis result.

Table 1 Diagnostic items

Item

Time Required

Whether NPU Training or Inference Is Affected

Application Scenario

On-chip memory diagnosis

2–4 seconds

No

An on-chip memory ECC error occurs on the NPU during training or inference.

  • The on-chip memory stress test and on-chip memory diagnosis apply to different scenarios. For details about the on-chip memory stress test, see Table 1. Perform the on-chip memory stress test or on-chip memory diagnosis as required.
  • If you want to conduct the on-chip memory diagnosis, on-chip memory stress test, and on-chip memory high-risk address stress test at the same time, refer to One-Click On-Chip Memory Stress Test/Diagnosis.

Parameters

Table 2 lists only a test-specific parameter. For details about other common parameters, see Common Parameters.

Table 2 Parameter description

Parameter

Description

Mandatory

[-i, --items]

Specifies the diagnosis check item.

  • Currently, only hbm and chipMemory are supported. hbm and chipMemory cannot be specified at the same time.
    • For the Atlas A2 training products, Atlas A2 inference products, Atlas A3 training products, Atlas A3 inference products, and Ascend 950PR and 950DT products, set the value to hbm.
    • For the Atlas 300I Pro inference card, Atlas 300V video analysis card, Atlas 300V Pro video analysis card, and Atlas 300I Duo inference card, set the value to chipMemory.

Yes

Example

  • hbm of the Atlas A2 training product

    ascend-dmi -dg -i hbm

    1
    2
    3
    4
    5
    6
    7
    8
    9
    [***@***]# ascend-dmi -dg -i hbm
    Summary:
        Arch: aarch64
        Mode: ******
        Time: 20250529-19:25:25
     
    Hardware:
        hbm:
            PASS
    
  • chipMemory of the Atlas 300I Duo inference card

    ascend-dmi -dg -i chipMemory

    1
    2
    3
    4
    5
    6
    7
    8
    9
    [***@***]# ascend-dmi -dg -i chipMemory
    Summary:
        Arch: aarch64
        Mode: ******
        Time: 20250529-19:25:25
     
    Hardware:
        chipMemory:
            PASS
    

Fault Check Items

Table 3 Fault check items

Command Output

Description

PASS

The on-chip memory check is passed and no exception occurs.

SKIP

The product or scenario does not support on-chip memory detection.

GENERAL_WARN

Isolated pages exist due to multi-bit errors, and the NPU health management fault code 0x80E18401 is triggered. If the number of these pages falls within the range of [16, 64), the normal operation is not affected.

NOTE:

When the diagnostic item is chipMemory, no alarm of this severity is generated.

EMERGENCY_WARN

  • If the number of real-time isolated pages caused by multi-bit errors is greater than or equal to 64, the current device is at high risk, and you are advised to use spare parts.
  • If the number of isolated pages caused by multi-bit errors is greater than 0 and is less than 64 and any of the following conditions is met, the current device is at high risk, and you are advised to use spare parts:
    • Within the same Bank (where Stack, PC, Sid, and Bank are all the same), the number of isolated rows shall be > 16.
    • Within the same HBMC (where Stack and PC are both the same), the number of Banks with isolated rows shall be ≥ 4, and the cumulative number of isolated rows within the PC shall be > 16.
    • Within the same Sid (where Stack and Sid are both the same), the number of isolated rows located in different HBMCs (i.e., with different PC) shall be ≥ 4.

FAIL

The on-chip memory check fails. Contact Huawei technical support or locate the fault by referring to the FAQs.