1.0.0-300I-Duo-py311-openeuler24.03-lts推理模型报错
收藏回复举报
1.0.0-300I-Duo-py311-openeuler24.03-lts推理模型报错
t('forum.solved') 已解决
发表于2025-01-13 10:14:42
0 查看

镜像:1.0.0-300I-Duo-py311-openeuler24.03-lts

推理模型:qwen-vl

模型文件与权限没有问题,./mindieservice_daemon 拉起服务,报错信息如下

 

[2025-01-13 10:06:29.771703] [2853] [281461581475776] [llm] [ERROR] [model_deploy_config.cpp:159] Failed to get vocab size from tokenizer wrapper with exception: ValueError: safe_get_tokenizer_from_pretrained failed. Please check the input parameters model_path and kwargs. If the input parameters are valid and the required files exist in model_path, make sure the folder's owner has execute permission. Otherwise, please check the function stack for detailed exception information. 

 

At: 

  /usr/local/Ascend/atb-models/atb_llm/models/base/model_utils.py(207): wrapper 

  /usr/local/Ascend/atb-models/atb_llm/models/qwen/router_qwen.py(92): get_tokenizer 

  /usr/local/Ascend/atb-models/atb_llm/models/base/router.py(142): tokenizer 

  /usr/local/Ascend/atb-models/atb_llm/runner/tokenizer_wrapper.py(20): __init__ 

  /usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/atb/atb_tokenizer_wrapper.py(8): __init__ 

  /usr/local/lib/python3.11/site-packages/mindie_llm/modeling/model_wrapper/__init__.py(28): get_tokenizer_wrapper 

 

我要发帖子