2025-04-10 02:19:20.736697 916427 LLM log default format: [yyyy-mm-dd hh:mm:ss.uuuuuu][processid] [threadid] [llm] [loglevel][file:line] [error code] msg
[2025-04-10 02:19:20.736744] [916425] [281473004531520] [llm] [INFO] [llm_manager_impl.cpp:68] LLMRuntime init success!
[2025-04-10 02:19:20.737808] [916425] [281473004531520] [llm] [INFO] [model_deploy_config.cpp:137] ModelDeployConfig::pySonamelibpython3.10.so
[2025-04-10 02:19:20.741950] [916425] [281473004531520] [llm] [ERROR] [model_deploy_config.cpp:159] Failed to get vocab size from tokenizer wrapper with exception: ModuleNotFoundError: No module named 'atb_llm'
At:
/usr/local/lib/python3.10/dist-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py(3): <module>
<frozen importlib._bootstrap>(241): _call_with_frames_removed
<frozen importlib._bootstrap_external>(883): exec_module
<frozen importlib._bootstrap>(703): _load_unlocked
<frozen importlib._bootstrap>(1006): _find_and_load_unlocked
<frozen importlib._bootstrap>(1027): _find_and_load
/usr/local/lib/python3.10/dist-packages/mindie_llm/modeling/model_wrapper/__init__.py(20): get_tokenizer_wrapper
2025-04-10 02:19:20.736697 916427 LLM log default format: [yyyy-mm-dd hh:mm:ss.uuuuuu][processid] [threadid] [llm] [loglevel][file:line] [error code] msg
[2025-04-10 02:19:20.736744] [916425] [281473004531520] [llm] [INFO] [llm_manager_impl.cpp:68] LLMRuntime init success!
[2025-04-10 02:19:20.737808] [916425] [281473004531520] [llm] [INFO] [model_deploy_config.cpp:137] ModelDeployConfig::pySonamelibpython3.10.so
[2025-04-10 02:19:20.741950] [916425] [281473004531520] [llm] [ERROR] [model_deploy_config.cpp:159] Failed to get vocab size from tokenizer wrapper with exception: ModuleNotFoundError: No module named 'atb_llm'
At:
/usr/local/lib/python3.10/dist-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py(3): <module>
<frozen importlib._bootstrap>(241): _call_with_frames_removed
<frozen importlib._bootstrap_external>(883): exec_module
<frozen importlib._bootstrap>(703): _load_unlocked
<frozen importlib._bootstrap>(1006): _find_and_load_unlocked
<frozen importlib._bootstrap>(1027): _find_and_load
/usr/local/lib/python3.10/dist-packages/mindie_llm/modeling/model_wrapper/__init__.py(20): get_tokenizer_wrapper