Mindie2 单卡启动deepseek-14b,无法运算
收藏回复举报
Mindie2 单卡启动deepseek-14b,无法运算
t('forum.solved') 已解决
发表于2025-02-20 15:07:57
0 查看
使用mindie2、mindie2.1启动单卡启动deepseek-14b模型,显存占用50g,无法调用,返回{"error":"Failed to get engine response.","error_type":"Incomplete Generation"}。
操作链接:https://modelers.cn/models/MindIE/DeepSeek-R1-Distill-Qwen-14B
驱动信息:npu-smi 24.1.rc3 Version: 24.1.rc3
启动成功日志:[2025-02-20 15:03:57,562] [4937] [281450127290720] [llm] [INFO] [logging.py-331] : trans to 29

[2025-02-20 15:03:57,562] [4937] [281450127290720] [llm] [INFO] [logging.py-331] : trans to 29

[2025-02-20 15:03:57,563] [4937] [281450127290720] [llm] [INFO] [logging.py-331] : trans to 29

[2025-02-20 15:03:57,564] [4937] [281450127290720] [llm] [INFO] [logging.py-331] : trans to 29

[2025-02-20 15:03:58,240] [4937] [281450127290720] [llm] [INFO] [logging.py-331] :

[2025-02-20 15:03:58,241] [4937] [281450127290720] [llm] [INFO] [logging.py-331] : >>>>>>id of kcache is 281458862208784 id of vcache is 281458862208688

Daemon start success!

curl请求错误返回:{"error":"Failed to get engine response.","error_type":"Incomplete Generation"}

我要发帖子