镜像版本：swr.cn-south-1.myhuaweicloud.com/ascendhub/mindie:2.0.RC2-800I-A2-py311-openeuler24.03-lts
驱动：25.0.rc1
报错日志：
The old environment variable ATB_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
The old environment variable ATB_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable MINDIE_LLM_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
The old environment variable MINDIE_LLM_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_PATH will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_PATH as soon as possible.
The old environment variable ATB_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.
The old environment variable MINDIE_LLM_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.
The old environment variable OCK_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable OCK_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
2025-06-06 09:35:17.340 266 LLM log default format: [yyyy-mm-dd hh:mm:ss.uuuuuu] [processid] [threadid] [llm] [loglevel] [file:line] [status code] msg
[2025-06-06 09:35:17.340] [263] [281473602412512] [llm] [INFO] [llm_manager_impl.cpp:76] LLMRuntime init success!
[2025-06-06 09:35:21.939] [263] [281473602412512] [llm] [ERROR] [model_deploy_config.cpp:102] Failed to get vocab size from tokenizer wrapper with exception: ModuleNotFoundError: No module named 'transformers.models.qwen2_5_vl'
At:
/usr/local/Ascend/atb-models/atb_llm/models/qwen2_vl/config_qwen2_vl.py(17): <module>
<frozen importlib._bootstrap>(241): _call_with_frames_removed
<frozen importlib._bootstrap_external>(940): exec_module
<frozen importlib._bootstrap>(705): _load_unlocked
<frozen importlib._bootstrap>(1150): _find_and_load_unlocked
<frozen importlib._bootstrap>(1176): _find_and_load
/usr/local/Ascend/atb-models/atb_llm/models/qwen2_vl/router_qwen2_vl.py(11): <module>
<frozen importlib._bootstrap>(241): _call_with_frames_removed
<frozen importlib._bootstrap_external>(940): exec_module
<frozen importlib._bootstrap>(705): _load_unlocked
<frozen importlib._bootstrap>(1150): _find_and_load_unlocked
<frozen importlib._bootstrap>(1176): _find_and_load
<frozen importlib._bootstrap>(1204): _gcd_import
/usr/lib64/python3.11/importlib/__init__.py(126): import_module
/usr/local/Ascend/atb-models/atb_llm/models/__init__.py(108): get_model
/usr/local/Ascend/atb-models/atb_llm/runner/tokenizer_wrapper.py(18): __init__
/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py(8): __init__
/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py(28): get_tokenizer_wrapper
[2025-06-06 09:35:21.939] [263] [281473602412512] [llm] [ERROR] [llm_manager_impl.cpp:784] Config manager init exception: ModuleNotFoundError: No module named 'transformers.models.qwen2_5_vl'
At:
/usr/local/Ascend/atb-models/atb_llm/models/qwen2_vl/config_qwen2_vl.py(17): <module>
<frozen importlib._bootstrap>(241): _call_with_frames_removed
<frozen importlib._bootstrap_external>(940): exec_module
<frozen importlib._bootstrap>(705): _load_unlocked
<frozen importlib._bootstrap>(1150): _find_and_load_unlocked
<frozen importlib._bootstrap>(1176): _find_and_load
/usr/local/Ascend/atb-models/atb_llm/models/qwen2_vl/router_qwen2_vl.py(11): <module>
<frozen importlib._bootstrap>(241): _call_with_frames_removed
<frozen importlib._bootstrap_external>(940): exec_module
<frozen importlib._bootstrap>(705): _load_unlocked
<frozen importlib._bootstrap>(1150): _find_and_load_unlocked
<frozen importlib._bootstrap>(1176): _find_and_load
<frozen importlib._bootstrap>(1204): _gcd_import
/usr/lib64/python3.11/importlib/__init__.py(126): import_module
/usr/local/Ascend/atb-models/atb_llm/models/__init__.py(108): get_model
/usr/local/Ascend/atb-models/atb_llm/runner/tokenizer_wrapper.py(18): __init__
/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py(8): __init__
/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py(28): get_tokenizer_wrapper
LLMInferEngine failed to init LLMInferModels
[2025-06-06 09:35:21.940+08:00] [263] [266] [server] [ERROR] [llm_infer_model_instance.cpp:284] : MIE05E040001[llm_backend] [LLMInferModelInstance::Init] llmManager_ init fail!
[2025-06-06 09:35:21.940+08:00] [263] [266] [server] [ERROR] [llm_infer_model.cpp:28] : MIE05E040001[llm_backend] ModelInstance init failed
[2025-06-06 09:35:21.940+08:00] [263] [266] [server] [ERROR] [llm_infer_engine.cpp:41] : MIE05E040001[llm_backend] LLMInferEngine initialize LLMInferModels failed. please check the error stacks for more details
[2025-06-06 09:35:21.940+08:00] [263] [localhost.localdomain] [system] [server] [Start engine(mindieservice_llm_engine)] [fail]
[2025-06-06 09:35:21.940+08:00] [263] [266] [server] [ERROR] [infer_backend_manager.cpp:216] : [MIE04E06011C] [infer_backend_manager] Failed to init engine. backendName is mindieservice_llm_engine
[2025-06-06 09:35:21.940+08:00] [263] [266] [server] [ERROR] [endpoint.cpp:45] : [MIE04E02011C] [endpoint] Failed to init engine! Please check in the env MINDIE_LOG_PATH (default ~/mindie/log) or console output.
[2025-06-06 09:35:21.940+08:00] [263] [localhost.localdomain] [system] [server] [Start mindie server] [fail]
点赞
收藏
回复
分享
举报
已解决
镜像版本：swr.cn-south-1.myhuaweicloud.com/ascendhub/mindie:2.0.RC2-800I-A2-py311-openeuler24.03-lts
驱动：25.0.rc1
报错日志：
The old environment variable ATB_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
The old environment variable ATB_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable MINDIE_LLM_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
The old environment variable MINDIE_LLM_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_PATH will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_PATH as soon as possible.
The old environment variable ATB_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.
The old environment variable MINDIE_LLM_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.
The old environment variable OCK_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable OCK_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
2025-06-06 09:35:17.340 266 LLM log default format: [yyyy-mm-dd hh:mm:ss.uuuuuu] [processid] [threadid] [llm] [loglevel] [file:line] [status code] msg
[2025-06-06 09:35:17.340] [263] [281473602412512] [llm] [INFO] [llm_manager_impl.cpp:76] LLMRuntime init success!
[2025-06-06 09:35:21.939] [263] [281473602412512] [llm] [ERROR] [model_deploy_config.cpp:102] Failed to get vocab size from tokenizer wrapper with exception: ModuleNotFoundError: No module named 'transformers.models.qwen2_5_vl'
At:
/usr/local/Ascend/atb-models/atb_llm/models/qwen2_vl/config_qwen2_vl.py(17): <module>
<frozen importlib._bootstrap>(241): _call_with_frames_removed
<frozen importlib._bootstrap_external>(940): exec_module
<frozen importlib._bootstrap>(705): _load_unlocked
<frozen importlib._bootstrap>(1150): _find_and_load_unlocked
<frozen importlib._bootstrap>(1176): _find_and_load
/usr/local/Ascend/atb-models/atb_llm/models/qwen2_vl/router_qwen2_vl.py(11): <module>
<frozen importlib._bootstrap>(241): _call_with_frames_removed
<frozen importlib._bootstrap_external>(940): exec_module
<frozen importlib._bootstrap>(705): _load_unlocked
<frozen importlib._bootstrap>(1150): _find_and_load_unlocked
<frozen importlib._bootstrap>(1176): _find_and_load
<frozen importlib._bootstrap>(1204): _gcd_import
/usr/lib64/python3.11/importlib/__init__.py(126): import_module
/usr/local/Ascend/atb-models/atb_llm/models/__init__.py(108): get_model
/usr/local/Ascend/atb-models/atb_llm/runner/tokenizer_wrapper.py(18): __init__
/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py(8): __init__
/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py(28): get_tokenizer_wrapper
[2025-06-06 09:35:21.939] [263] [281473602412512] [llm] [ERROR] [llm_manager_impl.cpp:784] Config manager init exception: ModuleNotFoundError: No module named 'transformers.models.qwen2_5_vl'
At:
/usr/local/Ascend/atb-models/atb_llm/models/qwen2_vl/config_qwen2_vl.py(17): <module>
<frozen importlib._bootstrap>(241): _call_with_frames_removed
<frozen importlib._bootstrap_external>(940): exec_module
<frozen importlib._bootstrap>(705): _load_unlocked
<frozen importlib._bootstrap>(1150): _find_and_load_unlocked
<frozen importlib._bootstrap>(1176): _find_and_load
/usr/local/Ascend/atb-models/atb_llm/models/qwen2_vl/router_qwen2_vl.py(11): <module>
<frozen importlib._bootstrap>(241): _call_with_frames_removed
<frozen importlib._bootstrap_external>(940): exec_module
<frozen importlib._bootstrap>(705): _load_unlocked
<frozen importlib._bootstrap>(1150): _find_and_load_unlocked
<frozen importlib._bootstrap>(1176): _find_and_load
<frozen importlib._bootstrap>(1204): _gcd_import
/usr/lib64/python3.11/importlib/__init__.py(126): import_module
/usr/local/Ascend/atb-models/atb_llm/models/__init__.py(108): get_model
/usr/local/Ascend/atb-models/atb_llm/runner/tokenizer_wrapper.py(18): __init__
/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py(8): __init__
/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py(28): get_tokenizer_wrapper
LLMInferEngine failed to init LLMInferModels
[2025-06-06 09:35:21.940+08:00] [263] [266] [server] [ERROR] [llm_infer_model_instance.cpp:284] : MIE05E040001[llm_backend] [LLMInferModelInstance::Init] llmManager_ init fail!
[2025-06-06 09:35:21.940+08:00] [263] [266] [server] [ERROR] [llm_infer_model.cpp:28] : MIE05E040001[llm_backend] ModelInstance init failed
[2025-06-06 09:35:21.940+08:00] [263] [266] [server] [ERROR] [llm_infer_engine.cpp:41] : MIE05E040001[llm_backend] LLMInferEngine initialize LLMInferModels failed. please check the error stacks for more details
[2025-06-06 09:35:21.940+08:00] [263] [localhost.localdomain] [system] [server] [Start engine(mindieservice_llm_engine)] [fail]
[2025-06-06 09:35:21.940+08:00] [263] [266] [server] [ERROR] [infer_backend_manager.cpp:216] : [MIE04E06011C] [infer_backend_manager] Failed to init engine. backendName is mindieservice_llm_engine
[2025-06-06 09:35:21.940+08:00] [263] [266] [server] [ERROR] [endpoint.cpp:45] : [MIE04E02011C] [endpoint] Failed to init engine! Please check in the env MINDIE_LOG_PATH (default ~/mindie/log) or console output.
[2025-06-06 09:35:21.940+08:00] [263] [localhost.localdomain] [system] [server] [Start mindie server] [fail]