MindIE 镜像:1.0.0-800I-A2-py311-openeuler24.03-lts
报错:

[root@AT3500-16-69 mindie-service]# ./bin/mindieservice_daemon
2025-03-31 15:05:04.670824 133135 LLM log default format: [yyyy-mm-dd hh:mm:ss.uuuuuu][processid] [threadid] [llm] [loglevel][file:line] [error code] msg
[2025-03-31 15:05:04.670922] [133133] [281472848752576] [llm] [INFO] [llm_manager_impl.cpp:68] LLMRuntime init success!
[2025-03-31 15:05:04.672043] [133133] [281472848752576] [llm] [INFO] [model_deploy_config.cpp:137] ModelDeployConfig::pySonamelibpython3.11.so
[2025-03-31 15:05:09.700528] [133133] [281472848752576] [llm] [ERROR] [model_deploy_config.cpp:159] Failed to get vocab size from tokenizer wrapper with exception: ValueError: safe_get_tokenizer_from_pretrained failed. Please check the input parameters model_path and kwargs. If the input parameters are valid and the required files exist in model_path, make sure the folder's owner has execute permission. Otherwise, please check the function stack for detailed exception information.
At:
/usr/local/Ascend/atb-models/atb_llm/models/base/model_utils.py(207): wrapper
/usr/local/Ascend/atb-models/atb_llm/models/internvl/router_internvl.py(45): get_tokenizer
/usr/local/Ascend/atb-models/atb_llm/models/base/router.py(142): tokenizer
/usr/local/Ascend/atb-models/atb_llm/runner/tokenizer_wrapper.py(20): __init__
/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py(8): __init__
/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py(28): get_tokenizer_wrapper
[2025-03-31 15:05:09.700787+08:00] [133133] [133135] [server] [ERROR] [llm_infer_model_instance.cpp:234] : [LLMInferModelInstance::Init] llmManager_ init fail!
[2025-03-31 15:05:09.700859+08:00] [133133] [133135] [server] [ERROR] [llm_infer_model.cpp:28] : ModelInstance init failed
LLMInferEngine failed to init LLMInferModels
[2025-03-31 15:05:09.700921+08:00] [133133] [133135] [server] [ERROR] [llm_infer_engine.cpp:48] : [MIE05E040001] [llm_backend] LLMInferEngine initialize LLMInferModels failed. please check the error stacks for more details
[2025-03-31 15:05:09.700978][133133][AT3500-16-69][system][start][engine(mindieservice_llm_engine)][fail]
[2025-03-31 15:05:09.701012+08:00] [133133] [133135] [server] [ERROR] [infer_backend_manager.cpp:272] : [MIE04E060108] [backend_manager] Failed to init engine: mindieservice_llm_engine
[2025-03-31 15:05:09.701092+08:00] [133133] [133135] [server] [ERROR] [EndPoint endpoint.cpp:50] ERR: Failed to init backendManager! Please check in the mindservice.log, pythonlog.log(default path: mindie-llm/logs) or console output.
[2025-03-31 15:05:09.701107][133133][AT3500-16-69][system][start][mindie server][fail]
[2025-03-31 15:05:20.682823][133133][AT3500-16-69][system][start][endpoint][fail]
[2025-03-31 15:05:20.682893][133133][AT3500-16-69][system][start][mindie server][fail]
ERR: Failed to init endpoint! Please check the service log or console output.
Killed
MindIE 镜像:1.0.0-800I-A2-py311-openeuler24.03-lts
报错:
[root@AT3500-16-69 mindie-service]# ./bin/mindieservice_daemon
2025-03-31 15:05:04.670824 133135 LLM log default format: [yyyy-mm-dd hh:mm:ss.uuuuuu][processid] [threadid] [llm] [loglevel][file:line] [error code] msg
[2025-03-31 15:05:04.670922] [133133] [281472848752576] [llm] [INFO] [llm_manager_impl.cpp:68] LLMRuntime init success!
[2025-03-31 15:05:04.672043] [133133] [281472848752576] [llm] [INFO] [model_deploy_config.cpp:137] ModelDeployConfig::pySonamelibpython3.11.so
[2025-03-31 15:05:09.700528] [133133] [281472848752576] [llm] [ERROR] [model_deploy_config.cpp:159] Failed to get vocab size from tokenizer wrapper with exception: ValueError: safe_get_tokenizer_from_pretrained failed. Please check the input parameters model_path and kwargs. If the input parameters are valid and the required files exist in model_path, make sure the folder's owner has execute permission. Otherwise, please check the function stack for detailed exception information.
At:
/usr/local/Ascend/atb-models/atb_llm/models/base/model_utils.py(207): wrapper
/usr/local/Ascend/atb-models/atb_llm/models/internvl/router_internvl.py(45): get_tokenizer
/usr/local/Ascend/atb-models/atb_llm/models/base/router.py(142): tokenizer
/usr/local/Ascend/atb-models/atb_llm/runner/tokenizer_wrapper.py(20): __init__
/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py(8): __init__
/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py(28): get_tokenizer_wrapper
[2025-03-31 15:05:09.700787+08:00] [133133] [133135] [server] [ERROR] [llm_infer_model_instance.cpp:234] : [LLMInferModelInstance::Init] llmManager_ init fail!
[2025-03-31 15:05:09.700859+08:00] [133133] [133135] [server] [ERROR] [llm_infer_model.cpp:28] : ModelInstance init failed
LLMInferEngine failed to init LLMInferModels
[2025-03-31 15:05:09.700921+08:00] [133133] [133135] [server] [ERROR] [llm_infer_engine.cpp:48] : [MIE05E040001] [llm_backend] LLMInferEngine initialize LLMInferModels failed. please check the error stacks for more details
[2025-03-31 15:05:09.700978][133133][AT3500-16-69][system][start][engine(mindieservice_llm_engine)][fail]
[2025-03-31 15:05:09.701012+08:00] [133133] [133135] [server] [ERROR] [infer_backend_manager.cpp:272] : [MIE04E060108] [backend_manager] Failed to init engine: mindieservice_llm_engine
[2025-03-31 15:05:09.701092+08:00] [133133] [133135] [server] [ERROR] [EndPoint endpoint.cpp:50] ERR: Failed to init backendManager! Please check in the mindservice.log, pythonlog.log(default path: mindie-llm/logs) or console output.
[2025-03-31 15:05:09.701107][133133][AT3500-16-69][system][start][mindie server][fail]
[2025-03-31 15:05:20.682823][133133][AT3500-16-69][system][start][endpoint][fail]
[2025-03-31 15:05:20.682893][133133][AT3500-16-69][system][start][mindie server][fail]
ERR: Failed to init endpoint! Please check the service log or console output.
Killed