mindie-service 部署glm4-9b出现问题
收藏回复举报
mindie-service 部署glm4-9b出现问题
t('forum.solved') 已解决
发表于2025-02-07 18:05:37
0 查看
 这个是报错dui'zhan

[2025-02-07 16:44:44.281376] [2289692] [281472784453632] [llm] [INFO] [llm_manager_impl.cpp:68] LLMRuntime init success! 

[2025-02-07 16:44:44.282480] [2289692] [281472784453632] [llm] [INFO] [model_deploy_config.cpp:137] ModelDeployConfig::pySonamelibpython3.10.so 

[2025-02-07 16:44:49.034220] [2289692] [281472784453632] [llm] [ERROR] [model_deploy_config.cpp:159] Failed to get vocab size from tokenizer wrapper with exception: ValueError: safe_get_tokenizer_from_pretrained failed. Please check the input parameters model_path and kwargs. If the input parameters are valid and the required files exist in model_path, make sure the folder's owner has execute permission. Otherwise, please check the function stack for detailed exception information. 

 

At: 

  /usr/local/Ascend/llm_model/atb_llm/models/base/model_utils.py(207): wrapper 

  /usr/local/Ascend/llm_model/atb_llm/models/base/router.py(308): get_tokenizer 

  /usr/local/Ascend/llm_model/atb_llm/models/base/router.py(142): tokenizer 

  /usr/local/Ascend/llm_model/atb_llm/runner/tokenizer_wrapper.py(20): __init__ 

  /ai/anaconda3/envs/mindie_env/lib/python3.10/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py(8): __init__ 

  /ai/anaconda3/envs/mindie_env/lib/python3.10/site-packages/mindie_llm/modeling/model_wrapper/__init__.py(28): get_tokenizer_wrapper 

本帖最后由 匿名用户2025/02/10 09:57:10 编辑

我要发帖子