MindIE跑DeepSeek-R1-Distill-Qwen-32B,报错LLMInferEngine failed to init LLMInferModels
收藏回复举报
MindIE跑DeepSeek-R1-Distill-Qwen-32B,报错LLMInferEngine failed to init LLMInferModels
t('forum.solved') 已解决
发表于2025-02-14 19:57:27
0 查看

硬件:Atlas800I A2 32G
镜像:2.0.T3-800I-A2-py311-openeuler24.03-lts和1.0.0-800I-A2-py311-openeuler24.03-lts都试了

模型:DeepSeek-R1-Distill-Qwen-32B
驱动:24.1.0和24.1.rc3都试了

修改了/usr/local/Ascend/mindie/latest/mindie-service/conf/config.json中所需卡数和模型地址

cke_189.png

权重sha256值校验过了,docker镜像sha256也校验过,没问题
1111.png

我要发帖子