MindIE服务化拉起DS-R1-Distill-Llama-70B报错Failed to get vocab size from tokenizer wrapper with exception: ModuleNotFoundError:
收藏回复举报
MindIE服务化拉起DS-R1-Distill-Llama-70B报错Failed to get vocab size from tokenizer wrapper with exception: ModuleNotFoundError:
t('forum.solved') 已解决
发表于2025-05-14 15:11:57
0 查看
 

[root@a800-3000 mindie-service]# ./bin/mindieservice_daemon 

The old environment variable ATB_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible. 

The old environment variable ATB_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible. 

The old environment variable MINDIE_LLM_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible. 

The old environment variable MINDIE_LLM_PYTHON_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible. 

The old environment variable MINDIE_LLM_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible. 

The old environment variable MINDIE_LLM_PYTHON_LOG_PATH will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_PATH as soon as possible. 

The old environment variable ATB_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible. 

The old environment variable MINDIE_LLM_PYTHON_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible. 

The old environment variable MINDIE_LLM_PYTHON_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible. 

The old environment variable MINDIE_LLM_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible. 

The old environment variable OCK_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible. 

The old environment variable OCK_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible. 

 

2025-05-14 15:06:58.768 4024 LLM log default format: [yyyy-mm-dd hh:mm:ss.uuuuuu] [processid] [threadid] [llm] [loglevel] [file:line] [status code] msg 

[2025-05-14 15:06:58.768] [4022] [281473240981472] [llm] [INFO] [llm_manager_impl.cpp:76] LLMRuntime init success! 

[2025-05-14 15:06:58.769] [4022] [281473240981472] [llm] [DEBUG] [model_deploy_config.cpp:80] ModelDeployConfig::pySonamelibpython3.11.so 

[2025-05-14 15:06:58.770] [4022] [281473240981472] [llm] [ERROR] [model_deploy_config.cpp:102] Failed to get vocab size from tokenizer wrapper with exception: ModuleNotFoundError: No module named 'mindie_llm' 

[2025-05-14 15:06:58.770] [4022] [281473240981472] [llm] [ERROR] [llm_manager_impl.cpp:784] Config manager init exception: ModuleNotFoundError: No module named 'mindie_llm' 

LLMInferEngine failed to init LLMInferModels[2025-05-14 15:06:58.770+08:00] [4022] [4024] [server] [ERROR] [llm_infer_model_instance.cpp:284] : MIE05E040001[llm_backend] [LLMInferModelInstance::Init] llmManager_ init fail! 

 

[2025-05-14 15:06:58.770+08:00] [4022] [4024] [server] [ERROR] [llm_infer_model.cpp:28] : MIE05E040001[llm_backend] ModelInstance init failed 

[2025-05-14 15:06:58.770+08:00] [4022] [4024] [server] [ERROR] [llm_infer_engine.cpp:41] : MIE05E040001[llm_backend] LLMInferEngine initialize LLMInferModels failed. please check the error stacks for more details 

[2025-05-14 15:06:58.770+08:00] [4022] [a800-3000] [system] [server] [Start engine(mindieservice_llm_engine)] [fail] 

[2025-05-14 15:06:58.770+08:00] [4022] [4024] [server] [ERROR] [infer_backend_manager.cpp:216] : [MIE04E06011C] [infer_backend_manager] Failed to init engine. backendName is mindieservice_llm_engine 

[2025-05-14 15:06:58.770+08:00] [4022] [4024] [server] [ERROR] [endpoint.cpp:45] : [MIE04E02011C] [endpoint] Failed to init engine! Please check in the env MINDIE_LOG_PATH (default ~/mindie/log) or console output. 

[2025-05-14 15:06:58.770+08:00] [4022] [a800-3000] [system] [server] [Start mindie server] [fail] 

[2025-05-14 15:06:58.774+08:00] [4022] [a800-3000] [system] [server] [start endpoint] [fail] 

[2025-05-14 15:06:58.774+08:00] [4022] [a800-3000] [system] [server] [start mindie server] [fail] 

Killed 

我要发帖子