使用mindie2、mindie2.1启动单卡启动deepseek-14b模型,显存占用50g,无法调用,返回{"error":"Failed to get engine response.","error_type":"Incomplete Generation"}。
操作链接:https://modelers.cn/models/MindIE/DeepSeek-R1-Distill-Qwen-14B
驱动信息:npu-smi 24.1.rc3 Version: 24.1.rc3 启动成功日志:
[2025-02-20 15:03:57,562] [4937] [281450127290720] [llm] [INFO] [logging.py-331] : trans to 29 [2025-02-20 15:03:57,562] [4937] [281450127290720] [llm] [INFO] [logging.py-331] : trans to 29
[2025-02-20 15:03:57,563] [4937] [281450127290720] [llm] [INFO] [logging.py-331] : trans to 29
[2025-02-20 15:03:57,564] [4937] [281450127290720] [llm] [INFO] [logging.py-331] : trans to 29
[2025-02-20 15:03:58,240] [4937] [281450127290720] [llm] [INFO] [logging.py-331] :
[2025-02-20 15:03:58,241] [4937] [281450127290720] [llm] [INFO] [logging.py-331] : >>>>>>id of kcache is 281458862208784 id of vcache is 281458862208688
Daemon start success!
curl请求错误返回:{"error":"Failed to get engine response.","error_type":"Incomplete Generation"}
操作链接:https://modelers.cn/models/MindIE/DeepSeek-R1-Distill-Qwen-14B
驱动信息:npu-smi 24.1.rc3 Version: 24.1.rc3
启动成功日志:[2025-02-20 15:03:57,562] [4937] [281450127290720] [llm] [INFO] [logging.py-331] : trans to 29
[2025-02-20 15:03:57,562] [4937] [281450127290720] [llm] [INFO] [logging.py-331] : trans to 29
[2025-02-20 15:03:57,563] [4937] [281450127290720] [llm] [INFO] [logging.py-331] : trans to 29
[2025-02-20 15:03:57,564] [4937] [281450127290720] [llm] [INFO] [logging.py-331] : trans to 29
[2025-02-20 15:03:58,240] [4937] [281450127290720] [llm] [INFO] [logging.py-331] :
[2025-02-20 15:03:58,241] [4937] [281450127290720] [llm] [INFO] [logging.py-331] : >>>>>>id of kcache is 281458862208784 id of vcache is 281458862208688
Daemon start success!
curl请求错误返回:{"error":"Failed to get engine response.","error_type":"Incomplete Generation"}