1、版本信息:
硬件设备:Atals 800I A2
驱动固件:24.1.0
系统:openeuler22.03
mindie:2.0.RC2
2、运行报错情况
模型:MiniCPM-V-2_6(mindie models:minicpm_qwen2_v2)
直接推理成功运行;
使用其他模型服务化部署也没有问题
目前只有部署MiniCPM-V-2_6服务化报错;
服务化运行报错:
2025-05-28 16:47:20.327 5139 LLM log default format: [yyyy-mm-dd hh:mm:ss.uuuuuu] [processid] [threadid] [llm] [loglevel] [file:line] [status code] msg
[2025-05-28 16:47:20.327] [5137] [281473600315360] [llm] [INFO] [llm_manager_impl.cpp:76] LLMRuntime init success!
[2025-05-28 16:47:26.494] [5137] [281473600315360] [llm] [ERROR] [model_deploy_config.cpp:102] Failed to get vocab size from tokenizer wrapper with exception: ValueError: Get instance from Minicpmqwen2v2Config fai
led. Please check the input parameters model_path and kwargs. If the input parameters are valid and the required files exist in model_path, make sure the folder's owner has execute permission. Otherwise, please ch
eck the function stack for detailed exception information.
报错信息为Minicpmqwen2v2Config配置文件初始化 token报错;
初步排查为/usr/local/Ascend/atb-models/atb_llm/models/minicpm_qwen2_v2/config_minicpm_qwen2_v2.py
文件,请问需要怎么修改呢
1、版本信息:
硬件设备:Atals 800I A2
驱动固件:24.1.0
系统:openeuler22.03
mindie:2.0.RC2
2、运行报错情况
模型:MiniCPM-V-2_6(mindie models:minicpm_qwen2_v2)
直接推理成功运行;
使用其他模型服务化部署也没有问题
目前只有部署MiniCPM-V-2_6服务化报错;
服务化运行报错:
2025-05-28 16:47:20.327 5139 LLM log default format: [yyyy-mm-dd hh:mm:ss.uuuuuu] [processid] [threadid] [llm] [loglevel] [file:line] [status code] msg
[2025-05-28 16:47:20.327] [5137] [281473600315360] [llm] [INFO] [llm_manager_impl.cpp:76] LLMRuntime init success!
[2025-05-28 16:47:26.494] [5137] [281473600315360] [llm] [ERROR] [model_deploy_config.cpp:102] Failed to get vocab size from tokenizer wrapper with exception: ValueError: Get instance from Minicpmqwen2v2Config fai
led. Please check the input parameters model_path and kwargs. If the input parameters are valid and the required files exist in model_path, make sure the folder's owner has execute permission. Otherwise, please ch
eck the function stack for detailed exception information.
报错信息为Minicpmqwen2v2Config配置文件初始化 token报错;
初步排查为/usr/local/Ascend/atb-models/atb_llm/models/minicpm_qwen2_v2/config_minicpm_qwen2_v2.py
文件,请问需要怎么修改呢