MindIE双机部署Qwen3-235B-A22B-Instruct-2507模型报错:Failed to get vocab size from tokenizer wrapper with exception
收藏回复举报
MindIE双机部署Qwen3-235B-A22B-Instruct-2507模型报错:Failed to get vocab size from tokenizer wrapper with exception
t('forum.solved') 已解决
发表于2025-07-30 18:47:47
0 查看

报错信息如下:

 

[2025-07-30 17:45:47.519] [82510] [281473796337632] [llm] [ERROR] [model_deploy_config.cpp:102] Failed to get vocab size from tokenizer wrapper with exception: ValueError: safe_get_tokenizer_from_pretrained failed. Please check the input parameters model_path and kwargs. If the input parameters are valid and the required files exist in model_path, make sure the folder's owner has execute permission. Otherwise, please check the function stack for detailed exception information. 

 

At: 

  /usr/local/Ascend/atb-models/atb_llm/models/base/model_utils.py(251): wrapper 

  /usr/local/Ascend/atb-models/atb_llm/models/qwen2_moe/router_qwen2_moe.py(19): get_tokenizer 

  /usr/local/Ascend/atb-models/atb_llm/models/base/router.py(156): tokenizer 

  /usr/local/Ascend/atb-models/atb_llm/runner/tokenizer_wrapper.py(25): __init__ 

  /usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py(8): __init__ 

  /usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py(28): get_tokenizer_wrapper 

 

[2025-07-30 17:45:47.519] [82510] [281473796337632] [llm] [ERROR] [llm_manager_impl.cpp:785] Config manager init exception: ValueError: safe_get_tokenizer_from_pretrained failed. Please check the input parameters model_path and kwargs. If the input parameters are valid and the required files exist in model_path, make sure the folder's owner has execute permission. Otherwise, please check the function stack for detailed exception information. 

 

At: 

  /usr/local/Ascend/atb-models/atb_llm/models/base/model_utils.py(251): wrapper 

  /usr/local/Ascend/atb-models/atb_llm/models/qwen2_moe/router_qwen2_moe.py(19): get_tokenizer 

  /usr/local/Ascend/atb-models/atb_llm/models/base/router.py(156): tokenizer 

  /usr/local/Ascend/atb-models/atb_llm/runner/tokenizer_wrapper.py(25): __init__ 

  /usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py(8): __init__ 

  /usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py(28): get_tokenizer_wrapper 

 

LLMInferEngine failed to init LLMInferModels 

解决方案:transformers版本升级至4.46.3解决

pip install transformers==4.46.3

我要发帖子