InternVL2_5-8B模型MindIE启服务化失败:LLMInferEngine failed to init LLMInferModels
收藏回复举报
InternVL2_5-8B模型MindIE启服务化失败:LLMInferEngine failed to init LLMInferModels
t('forum.solved') 已解决
发表于2025-03-31 15:17:24
0 查看

MindIE 镜像:1.0.0-800I-A2-py311-openeuler24.03-lts

报错:

cke_299.png

 

[root@AT3500-16-69 mindie-service]# ./bin/mindieservice_daemon 

 

2025-03-31 15:05:04.670824 133135 LLM log default format: [yyyy-mm-dd hh:mm:ss.uuuuuu][processid] [threadid] [llm] [loglevel][file:line] [error code] msg 

[2025-03-31 15:05:04.670922] [133133] [281472848752576] [llm] [INFO] [llm_manager_impl.cpp:68] LLMRuntime init success! 

[2025-03-31 15:05:04.672043] [133133] [281472848752576] [llm] [INFO] [model_deploy_config.cpp:137] ModelDeployConfig::pySonamelibpython3.11.so 

[2025-03-31 15:05:09.700528] [133133] [281472848752576] [llm] [ERROR] [model_deploy_config.cpp:159] Failed to get vocab size from tokenizer wrapper with exception: ValueError: safe_get_tokenizer_from_pretrained failed. Please check the input parameters model_path and kwargs. If the input parameters are valid and the required files exist in model_path, make sure the folder's owner has execute permission. Otherwise, please check the function stack for detailed exception information. 

 

At: 

  /usr/local/Ascend/atb-models/atb_llm/models/base/model_utils.py(207): wrapper 

  /usr/local/Ascend/atb-models/atb_llm/models/internvl/router_internvl.py(45): get_tokenizer 

  /usr/local/Ascend/atb-models/atb_llm/models/base/router.py(142): tokenizer 

  /usr/local/Ascend/atb-models/atb_llm/runner/tokenizer_wrapper.py(20): __init__ 

  /usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py(8): __init__ 

  /usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py(28): get_tokenizer_wrapper 

 

[2025-03-31 15:05:09.700787+08:00] [133133] [133135] [server] [ERROR] [llm_infer_model_instance.cpp:234] : [LLMInferModelInstance::Init] llmManager_ init fail! 

[2025-03-31 15:05:09.700859+08:00] [133133] [133135] [server] [ERROR] [llm_infer_model.cpp:28] : ModelInstance init failed 

LLMInferEngine failed to init LLMInferModels 

[2025-03-31 15:05:09.700921+08:00] [133133] [133135] [server] [ERROR] [llm_infer_engine.cpp:48] : [MIE05E040001] [llm_backend] LLMInferEngine initialize LLMInferModels failed. please check the error stacks for more details 

[2025-03-31 15:05:09.700978][133133][AT3500-16-69][system][start][engine(mindieservice_llm_engine)][fail] 

[2025-03-31 15:05:09.701012+08:00] [133133] [133135] [server] [ERROR] [infer_backend_manager.cpp:272] : [MIE04E060108] [backend_manager] Failed to init engine: mindieservice_llm_engine 

[2025-03-31 15:05:09.701092+08:00] [133133] [133135] [server] [ERROR] [EndPoint endpoint.cpp:50] ERR: Failed to init backendManager! Please check in the mindservice.log, pythonlog.log(default path: mindie-llm/logs) or console output. 

[2025-03-31 15:05:09.701107][133133][AT3500-16-69][system][start][mindie server][fail] 

[2025-03-31 15:05:20.682823][133133][AT3500-16-69][system][start][endpoint][fail] 

[2025-03-31 15:05:20.682893][133133][AT3500-16-69][system][start][mindie server][fail] 

ERR: Failed to init endpoint! Please check the service log or console output. 

Killed 

我要发帖子