环境信息：
910B4服务器
镜像：swr.cn-south-1.myhuaweicloud.com/ascendhub/mindie:2.0.RC2-800I-A2-py311-openeuler24.03-lts
报错信息如下：
The old environment variable ATB_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
The old environment variable ATB_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable MINDIE_LLM_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
The old environment variable MINDIE_LLM_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_PATH will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_PATH as soon as possible.
The old environment variable ATB_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.
The old environment variable MINDIE_LLM_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.
The old environment variable OCK_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable OCK_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
2025-06-04 14:00:04.882 6165 LLM log default format: [yyyy-mm-dd hh:mm:ss.uuuuuu] [processid] [threadid] [llm] [loglevel] [file:line] [status code] msg
[2025-06-04 14:00:04.882] [6163] [281472915791840] [llm] [INFO] [llm_manager_impl.cpp:76] LLMRuntime init success!
[2025-06-04 14:00:10.103] [6163] [281472915791840] [llm] [ERROR] [model_deploy_config.cpp:102] Failed to get vocab size from tokenizer wrapper with exception: ValueError: safe_get_tokenizer_from_pretrained failed. Please check the input parameters model_path and kwargs. If the input parameters are valid and the required files exist in model_path, make sure the folder's owner has execute permission. Otherwise, please check the function stack for detailed exception information.
At:
/usr/local/Ascend/atb-models/atb_llm/models/base/model_utils.py(251): wrapper
/usr/local/Ascend/atb-models/atb_llm/models/base/router.py(330): get_tokenizer
/usr/local/Ascend/atb-models/atb_llm/models/base/router.py(158): tokenizer
/usr/local/Ascend/atb-models/atb_llm/runner/tokenizer_wrapper.py(20): __init__
/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py(8): __init__
/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py(28): get_tokenizer_wrapper
[2025-06-04 14:00:10.104] [6163] [281472915791840] [llm] [ERROR] [llm_manager_impl.cpp:784] Config manager init exception: ValueError: safe_get_tokenizer_from_pretrained failed. Please check the input parameters model_path and kwargs. If the input parameters are valid and the required files exist in model_path, make sure the folder's owner has execute permission. Otherwise, please check the function stack for detailed exception information.
At:
/usr/local/Ascend/atb-models/atb_llm/models/base/model_utils.py(251): wrapper
/usr/local/Ascend/atb-models/atb_llm/models/base/router.py(330): get_tokenizer
/usr/local/Ascend/atb-models/atb_llm/models/base/router.py(158): tokenizer
/usr/local/Ascend/atb-models/atb_llm/runner/tokenizer_wrapper.py(20): __init__
/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py(8): __init__
/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py(28): get_tokenizer_wrapper
LLMInferEngine failed to init LLMInferModels
[2025-06-04 14:00:10.104+08:00] [6163] [6165] [server] [ERROR] [llm_infer_model_instance.cpp:284] : MIE05E040001[llm_backend] [LLMInferModelInstance::Init] llmManager_ init fail!
[2025-06-04 14:00:10.104+08:00] [6163] [6165] [server] [ERROR] [llm_infer_model.cpp:28] : MIE05E040001[llm_backend] ModelInstance init failed
[2025-06-04 14:00:10.104+08:00] [6163] [6165] [server] [ERROR] [llm_infer_engine.cpp:41] : MIE05E040001[llm_backend] LLMInferEngine initialize LLMInferModels failed. please check the error stacks for more details
[2025-06-04 14:00:10.104+08:00] [6163] [54a2b51f27b3] [system] [server] [Start engine(mindieservice_llm_engine)] [fail]
[2025-06-04 14:00:10.104+08:00] [6163] [6165] [server] [ERROR] [infer_backend_manager.cpp:216] : [MIE04E06011C] [infer_backend_manager] Failed to init engine. backendName is mindieservice_llm_engine
[2025-06-04 14:00:10.105+08:00] [6163] [6165] [server] [ERROR] [endpoint.cpp:45] : [MIE04E02011C] [endpoint] Failed to init engine! Please check in the env MINDIE_LOG_PATH (default ~/mindie/log) or console output.
[2025-06-04 14:00:10.105+08:00] [6163] [54a2b51f27b3] [system] [server] [Start mindie server] [fail]
Killed
点赞
收藏
回复
分享
举报
已解决
910B4服务器
镜像：swr.cn-south-1.myhuaweicloud.com/ascendhub/mindie:2.0.RC2-800I-A2-py311-openeuler24.03-lts
报错信息如下：
The old environment variable ATB_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
The old environment variable ATB_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable MINDIE_LLM_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
The old environment variable MINDIE_LLM_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_PATH will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_PATH as soon as possible.
The old environment variable ATB_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.
The old environment variable MINDIE_LLM_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.
The old environment variable OCK_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable OCK_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
2025-06-04 14:00:04.882 6165 LLM log default format: [yyyy-mm-dd hh:mm:ss.uuuuuu] [processid] [threadid] [llm] [loglevel] [file:line] [status code] msg
[2025-06-04 14:00:04.882] [6163] [281472915791840] [llm] [INFO] [llm_manager_impl.cpp:76] LLMRuntime init success!
[2025-06-04 14:00:10.103] [6163] [281472915791840] [llm] [ERROR] [model_deploy_config.cpp:102] Failed to get vocab size from tokenizer wrapper with exception: ValueError: safe_get_tokenizer_from_pretrained failed. Please check the input parameters model_path and kwargs. If the input parameters are valid and the required files exist in model_path, make sure the folder's owner has execute permission. Otherwise, please check the function stack for detailed exception information.
At:
/usr/local/Ascend/atb-models/atb_llm/models/base/model_utils.py(251): wrapper
/usr/local/Ascend/atb-models/atb_llm/models/base/router.py(330): get_tokenizer
/usr/local/Ascend/atb-models/atb_llm/models/base/router.py(158): tokenizer
/usr/local/Ascend/atb-models/atb_llm/runner/tokenizer_wrapper.py(20): __init__
/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py(8): __init__
/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py(28): get_tokenizer_wrapper
[2025-06-04 14:00:10.104] [6163] [281472915791840] [llm] [ERROR] [llm_manager_impl.cpp:784] Config manager init exception: ValueError: safe_get_tokenizer_from_pretrained failed. Please check the input parameters model_path and kwargs. If the input parameters are valid and the required files exist in model_path, make sure the folder's owner has execute permission. Otherwise, please check the function stack for detailed exception information.
At:
/usr/local/Ascend/atb-models/atb_llm/models/base/model_utils.py(251): wrapper
/usr/local/Ascend/atb-models/atb_llm/models/base/router.py(330): get_tokenizer
/usr/local/Ascend/atb-models/atb_llm/models/base/router.py(158): tokenizer
/usr/local/Ascend/atb-models/atb_llm/runner/tokenizer_wrapper.py(20): __init__
/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py(8): __init__
/usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py(28): get_tokenizer_wrapper
LLMInferEngine failed to init LLMInferModels
[2025-06-04 14:00:10.104+08:00] [6163] [6165] [server] [ERROR] [llm_infer_model_instance.cpp:284] : MIE05E040001[llm_backend] [LLMInferModelInstance::Init] llmManager_ init fail!
[2025-06-04 14:00:10.104+08:00] [6163] [6165] [server] [ERROR] [llm_infer_model.cpp:28] : MIE05E040001[llm_backend] ModelInstance init failed
[2025-06-04 14:00:10.104+08:00] [6163] [6165] [server] [ERROR] [llm_infer_engine.cpp:41] : MIE05E040001[llm_backend] LLMInferEngine initialize LLMInferModels failed. please check the error stacks for more details
[2025-06-04 14:00:10.104+08:00] [6163] [54a2b51f27b3] [system] [server] [Start engine(mindieservice_llm_engine)] [fail]
[2025-06-04 14:00:10.104+08:00] [6163] [6165] [server] [ERROR] [infer_backend_manager.cpp:216] : [MIE04E06011C] [infer_backend_manager] Failed to init engine. backendName is mindieservice_llm_engine
[2025-06-04 14:00:10.105+08:00] [6163] [6165] [server] [ERROR] [endpoint.cpp:45] : [MIE04E02011C] [endpoint] Failed to init engine! Please check in the env MINDIE_LOG_PATH (default ~/mindie/log) or console output.
[2025-06-04 14:00:10.105+08:00] [6163] [54a2b51f27b3] [system] [server] [Start mindie server] [fail]
Killed