300duo MindIE拉起服务化提示failed to init LLMInferModels
收藏回复举报
300duo MindIE拉起服务化提示failed to init LLMInferModels
t('forum.solved') 已解决
发表于2025-03-07 23:47:39
0 查看

【版本信息】

MindIE 1.0.0

CANN: 8.0.0

根据https://www.hiascend.com/document/detail/zh/mindie/100/envdeployment/instg/mindie_instg_0001.html 手动部署,但是拉起服务的时候报错,修改了配置文件也不行。下载镜像可以成功运行,想试一下手动部署,请问大佬这个是什么原因?

user@user:~/Ascend/mindie/latest/mindie-service$ bin/mindieservice_daemon
LLMInferEngine failed to init LLMInferModels
ERR: Failed to init endpoint! Please check the service log or console output.
Killed

日志

[2025-03-07 15:43:34.009493+00:00] [1537166] [1537168] [server] [ERROR] [llm_infer_model_instance.cpp:234] : [LLMInferModelInstance::Init] llmManager_ init fail!
[2025-03-07 15:43:34.009519+00:00] [1537166] [1537168] [server] [ERROR] [llm_infer_model.cpp:28] : ModelInstance init failed
[2025-03-07 15:43:34.009565+00:00] [1537166] [1537168] [server] [ERROR] [llm_infer_engine.cpp:48] : [MIE05E040001] [llm_backend] LLMInferEngine initialize LLMInferModels failed. please check the error stacks for more details
[2025-03-07 15:43:34.009594+00:00] [1537166] [1537168] [server] [ERROR] [infer_backend_manager.cpp:272] : [MIE04E060108] [backend_manager] Failed to init engine: mindieservice_llm_engine
[2025-03-07 15:43:34.009604+00:00] [1537166] [1537168] [server] [ERROR] [EndPoint endpoint.cpp:50] ERR: Failed to init backendManager! Please check in the mindservice.log, pythonlog.log(default path: mindie-llm/logs) or console output.

我要发帖子