救命!!TaiShan 200,鲲鹏920,300 i duo通过gpustack跑mindie推理模型,GetDeviceStatus后直接卡死 有host cpu not support
收藏回复举报
救命!!TaiShan 200,鲲鹏920,300 i duo通过gpustack跑mindie推理模型,GetDeviceStatus后直接卡死 有host cpu not support
t('forum.solved') 已解决
新人帖
发表于2025-05-21 00:33:19
0 查看

通过gpustack:v0.6.0-npu-310p ,用mindie方式跑qwen2.5:7b-instruct

cke_161.jpeg

执行命令如下

docker run -d --name gpustack \
    --restart=unless-stopped \
    --device /dev/davinci0 \
    --device /dev/davinci_manager \
    --device /dev/devmm_svm \
    --device /dev/hisi_hdc \
    -v /usr/local/dcmi:/usr/local/dcmi \
    -v /usr/local/bin/npu-smi:/usr/local/bin/npu-smi \
    -v /usr/local/Ascend/driver/lib64/:/usr/local/Ascend/driver/lib64/ \
    -v /usr/local/Ascend/driver/version.info:/usr/local/Ascend/driver/version.info \
    -v /etc/ascend_install.info:/etc/ascend_install.info \
    --network=host \
    --ipc=host \
    -v gpustack-data:/var/lib/gpustack \
    gpustack/gpustack:latest-npu-310p

我要发帖子