atlas200i A2集群中安装NPU插件报错,具体描述见文中描述
收藏回复举报
atlas200i A2集群中安装NPU插件报错,具体描述见文中描述
发表于2026-06-04 16:44:12
0 查看

1 基本的板卡环境:

1.1 硬件环境

使用Atlas200i A2加速卡,自研底板。(我方已经自研过好几框自研底板,在未使用集群情况下使用npu推理正常。)

1.2 软件环境

(CANN版本:8.0.0.beta1)

1.2.1 uname –a打印

Linux node1 5.10.0+ #1 SMP Mon Apr 15 00:00:00 CST 2024 aarch64 aarch64 aarch64 GNU/Linux

1.2.2 cat /etc/os-release打印

NAME="openEuler"

ID="openEuler"

VERSION_ID="22.03"

ANSI_COLOR="0;31"

VERSION="22.03 LTS dracut-055-4.oe2203"

PRETTY_NAME="openEuler 22.03 LTS dracut-055-4.oe2203 (Initramfs)"

DRACUT_VERSION="055-4.oe2203"

1.2.3 npu-smi info打印

+--------------------------------------------------------------------------------------------------------+

| npu-smi 24.1.rc1                                 Version: 24.1.rc1                                     |

+-------------------------------+-----------------+------------------------------------------------------+

| NPU     Name                  | Health          | Power(W)     Temp(C)           Hugepages-Usage(page) |

| Chip    Device                | Bus-Id          | AICore(%)    Memory-Usage(MB)                        |

+===============================+=================+======================================================+

| 0       310B1                 | OK              | 8.2          49                15    / 15            |

| 0       0                     | NA              | 0            1197 / 11578                            |

+===============================+=================+======================================================+

1.2.4 固件版本查看

/var/davinci/driver/upgrade-tool --device_index -1 --component -1 --version

{

Get component version(7.1.0.6.220) succeed for deviceId(0), componentType(11).

        {"device_id":0, "component":hboot1a, "version":7.1.0.6.220}

Get component version(7.1.0.6.220) succeed for deviceId(0), componentType(12).

        {"device_id":0, "component":hboot1b, "version":7.1.0.6.220}

Get component version(7.1.0.6.220) succeed for deviceId(0), componentType(13).

        {"device_id":0, "component":hboot2, "version":7.1.0.6.220}

Get component version(7.1.0.6.220) succeed for deviceId(0), componentType(14).

        {"device_id":0, "component":ddr, "version":7.1.0.6.220}

Get component version(7.1.0.6.220) succeed for deviceId(0), componentType(16).

        {"device_id":0, "component":hsm, "version":7.1.0.6.220}

Get component version(7.1.0.6.220) succeed for deviceId(0), componentType(18).

        {"device_id":0, "component":hlink, "version":7.1.0.6.220}

Get component version(7.1.0.6.220) succeed for deviceId(0), componentType(25).

        {"device_id":0, "component":Sys_Base_Config, "version":7.1.0.6.220}

Get component version(7.1.0.6.220) succeed for deviceId(0), componentType(30).

        {"device_id":0, "component":atf, "version":7.1.0.6.220}

Get component version(7.1.0.6.220) succeed for deviceId(0), componentType(31).

        {"device_id":0, "component":Usr_Base_Config, "version":7.1.0.6.220}

}

2 安装问题

//安装的组件版本及过程,问题描述。

2.1 dockre版本:

docker info

Client:

 Version:    24.0.6

 Context:    default

 Debug Mode: false

Server:

 Containers: 37

  Running: 34

  Paused: 0

  Stopped: 3

 Images: 42

 Server Version: 24.0.6

 Storage Driver: overlay2

  Backing Filesystem: extfs

  Supports d_type: true

  Using metacopy: false

  Native Overlay Diff: true

  userxattr: false

 Logging Driver: json-file

 Cgroup Driver: cgroupfs

 Cgroup Version: 1

 Plugins:

  Volume: local

  Network: bridge host ipvlan macvlan null overlay

  Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog

 Swarm: inactive

 Runtimes: ascend io.containerd.runc.v2 runc

 Default Runtime: runc

 Init Binary: docker-init

 containerd version: 7880925980b188f4c97b462f709d0db8e8962aff

 runc version: v1.1.9-0-gccaecfc

 init version: de40ad0

 Security Options:

  seccomp

   Profile: builtin

 Kernel Version: 5.10.0+

 Operating System: openEuler 22.03 LTS dracut-055-4.oe2203 (Initramfs) (containerized)

 OSType: linux

 Architecture: aarch64

 CPUs: 4

 Total Memory: 11.31GiB

 Name: node1

 ID: 58f99f10-2560-4039-b3f7-30d1c7ad7ed7

 Docker Root Dir: /var/lib/docker

 Debug Mode: false

 Experimental: false

 Insecure Registries:

  127.0.0.0/8

 Live Restore Enabled: false

 Product License: Community Engine

2.2 ascend-docker-runtime版本:

-sh-5.1# /usr/local/Ascend/Ascend-Docker-Runtime/ascend-docker-runtime --version

runc version 1.1.9

commit: v1.1.9-0-gccaecfc

spec: 1.0.2-dev

go: go1.20.7

libseccomp: 2.5.1

-sh-5.1#

2.3 docker配置:

cat /etc/docker/daemon.json

{

  "log-opts": {

    "max-size": "5m",

    "max-file":"3"

  },

  "data-root": "/var/lib/docker",

  "exec-opts": ["native.cgroupdriver=cgroupfs"],

  "runtimes": {

        "ascend": {

            "path": "/usr/local/Ascend/Ascend-Docker-Runtime/ascend-docker-runtime",

            "runtimeArgs": []

        }

    }

}

2.4 由于系统是欧拉,ascend-device-plugin是ubuntu,驱动文件分散到各目录,所以新建了目录:/usr/lib64-ascend将需要的驱动放置到该目录

 pwd

/usr/lib64-ascend

-sh-5.1# ls

libaicpu_processer.so  libascend_aac_adp.so   libascend_aac_sbr_dec.so         libascend_drv_baselib.so  libascend_protobuf.so.3.13.0.0  libdrvdsmi.so        libslog.so             libtsdclient.so

libaicpu_prof.so       libascend_aac_comm.so  libascend_aac_sbr_enc.so         libascend_drvdmp.so       libc_sec.so                     libdrvdsmi_efuse.so  libtsd_common.so

libaicpu_scheduler.so  libascend_aac_dec.so   libascend_aicpu_datadump.so      libascend_drvupgrade.so   libdcmi.so                      libdrvgpiocfg.so     libtsd_eventclient.so

libaicpu_sharder.so    libascend_aac_enc.so   libascend_camera_mpi_mfusion.so  libascend_hal.so          libdevmmap.so                   libmmpa.so           libtsdaemon.so

-sh-5.1#

直接使用docker运行ascend-device-plugin镜像(v7.3.1和v26.0.0)

```bash

docker run --rm -it --privileged \

  -v /usr/local/Ascend/driver:/usr/local/Ascend/driver \

  -v /usr/lib64-ascend:/usr/lib64-ascend \

  -v /dev:/dev \

  -v /sys:/sys \

  -v /usr/local/sbin/npu-smi:/usr/local/sbin/npu-smi \

  -v /tmp:/tmp \

  -e LD_LIBRARY_PATH=/usr/lib64-ascend:/usr/local/Ascend/driver/lib64 \

  ascend-k8sdeviceplugin:v7.3.1 \

  /lib/ld-linux-aarch64.so.1 /usr/local/sbin/npu-smi info

```

报错:`[ERROR] DRV(1,npu-smi):2026-06-02-10:02:55.123.951 [hdc_core.c:396][hdc] [hdcPcieInit 396] HDC init failed, driver may not load.`

目前在k8s集群(1.23.17)中运行ascend-device-plugin和直接用docker形式运行,都是报错:HDC初始化失败

本帖最后由 匿名用户2026/06/04 19:08:41 编辑

我要发帖子