[root@a800-3000 mindie-service]# ./bin/mindieservice_daemon
The old environment variable ATB_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
The old environment variable ATB_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable MINDIE_LLM_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
The old environment variable MINDIE_LLM_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_PATH will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_PATH as soon as possible.
The old environment variable ATB_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.
The old environment variable MINDIE_LLM_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.
The old environment variable OCK_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable OCK_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
2025-05-14 15:06:58.768 4024 LLM log default format: [yyyy-mm-dd hh:mm:ss.uuuuuu] [processid] [threadid] [llm] [loglevel] [file:line] [status code] msg
[2025-05-14 15:06:58.768] [4022] [281473240981472] [llm] [INFO] [llm_manager_impl.cpp:76] LLMRuntime init success!
[2025-05-14 15:06:58.769] [4022] [281473240981472] [llm] [DEBUG] [model_deploy_config.cpp:80] ModelDeployConfig::pySonamelibpython3.11.so
[2025-05-14 15:06:58.770] [4022] [281473240981472] [llm] [ERROR] [model_deploy_config.cpp:102] Failed to get vocab size from tokenizer wrapper with exception: ModuleNotFoundError: No module named 'mindie_llm'
[2025-05-14 15:06:58.770] [4022] [281473240981472] [llm] [ERROR] [llm_manager_impl.cpp:784] Config manager init exception: ModuleNotFoundError: No module named 'mindie_llm'
LLMInferEngine failed to init LLMInferModels[2025-05-14 15:06:58.770+08:00] [4022] [4024] [server] [ERROR] [llm_infer_model_instance.cpp:284] : MIE05E040001[llm_backend] [LLMInferModelInstance::Init] llmManager_ init fail!
[2025-05-14 15:06:58.770+08:00] [4022] [4024] [server] [ERROR] [llm_infer_model.cpp:28] : MIE05E040001[llm_backend] ModelInstance init failed
[2025-05-14 15:06:58.770+08:00] [4022] [4024] [server] [ERROR] [llm_infer_engine.cpp:41] : MIE05E040001[llm_backend] LLMInferEngine initialize LLMInferModels failed. please check the error stacks for more details
[2025-05-14 15:06:58.770+08:00] [4022] [a800-3000] [system] [server] [Start engine(mindieservice_llm_engine)] [fail]
[2025-05-14 15:06:58.770+08:00] [4022] [4024] [server] [ERROR] [infer_backend_manager.cpp:216] : [MIE04E06011C] [infer_backend_manager] Failed to init engine. backendName is mindieservice_llm_engine
[2025-05-14 15:06:58.770+08:00] [4022] [4024] [server] [ERROR] [endpoint.cpp:45] : [MIE04E02011C] [endpoint] Failed to init engine! Please check in the env MINDIE_LOG_PATH (default ~/mindie/log) or console output.
[2025-05-14 15:06:58.770+08:00] [4022] [a800-3000] [system] [server] [Start mindie server] [fail]
[2025-05-14 15:06:58.774+08:00] [4022] [a800-3000] [system] [server] [start endpoint] [fail]
[2025-05-14 15:06:58.774+08:00] [4022] [a800-3000] [system] [server] [start mindie server] [fail]
Killed
[root@a800-3000 mindie-service]# ./bin/mindieservice_daemon
The old environment variable ATB_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
The old environment variable ATB_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable MINDIE_LLM_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
The old environment variable MINDIE_LLM_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_PATH will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_PATH as soon as possible.
The old environment variable ATB_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable MINDIE_LLM_PYTHON_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.
The old environment variable MINDIE_LLM_LOG_TO_FILE will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_FILE as soon as possible.
The old environment variable OCK_LOG_LEVEL will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_LEVEL as soon as possible.
The old environment variable OCK_LOG_TO_STDOUT will be deprecated on 2025/12/31. Please use the new environment variable MINDIE_LOG_TO_STDOUT as soon as possible.
2025-05-14 15:06:58.768 4024 LLM log default format: [yyyy-mm-dd hh:mm:ss.uuuuuu] [processid] [threadid] [llm] [loglevel] [file:line] [status code] msg
[2025-05-14 15:06:58.768] [4022] [281473240981472] [llm] [INFO] [llm_manager_impl.cpp:76] LLMRuntime init success!
[2025-05-14 15:06:58.769] [4022] [281473240981472] [llm] [DEBUG] [model_deploy_config.cpp:80] ModelDeployConfig::pySonamelibpython3.11.so
[2025-05-14 15:06:58.770] [4022] [281473240981472] [llm] [ERROR] [model_deploy_config.cpp:102] Failed to get vocab size from tokenizer wrapper with exception: ModuleNotFoundError: No module named 'mindie_llm'
[2025-05-14 15:06:58.770] [4022] [281473240981472] [llm] [ERROR] [llm_manager_impl.cpp:784] Config manager init exception: ModuleNotFoundError: No module named 'mindie_llm'
LLMInferEngine failed to init LLMInferModels[2025-05-14 15:06:58.770+08:00] [4022] [4024] [server] [ERROR] [llm_infer_model_instance.cpp:284] : MIE05E040001[llm_backend] [LLMInferModelInstance::Init] llmManager_ init fail!
[2025-05-14 15:06:58.770+08:00] [4022] [4024] [server] [ERROR] [llm_infer_model.cpp:28] : MIE05E040001[llm_backend] ModelInstance init failed
[2025-05-14 15:06:58.770+08:00] [4022] [4024] [server] [ERROR] [llm_infer_engine.cpp:41] : MIE05E040001[llm_backend] LLMInferEngine initialize LLMInferModels failed. please check the error stacks for more details
[2025-05-14 15:06:58.770+08:00] [4022] [a800-3000] [system] [server] [Start engine(mindieservice_llm_engine)] [fail]
[2025-05-14 15:06:58.770+08:00] [4022] [4024] [server] [ERROR] [infer_backend_manager.cpp:216] : [MIE04E06011C] [infer_backend_manager] Failed to init engine. backendName is mindieservice_llm_engine
[2025-05-14 15:06:58.770+08:00] [4022] [4024] [server] [ERROR] [endpoint.cpp:45] : [MIE04E02011C] [endpoint] Failed to init engine! Please check in the env MINDIE_LOG_PATH (default ~/mindie/log) or console output.
[2025-05-14 15:06:58.770+08:00] [4022] [a800-3000] [system] [server] [Start mindie server] [fail]
[2025-05-14 15:06:58.774+08:00] [4022] [a800-3000] [system] [server] [start endpoint] [fail]
[2025-05-14 15:06:58.774+08:00] [4022] [a800-3000] [system] [server] [start mindie server] [fail]
Killed