使用 mindie 2.0.RC2 版本运行minicpm2_6 大模型服务化报错
收藏回复举报
使用 mindie 2.0.RC2 版本运行minicpm2_6 大模型服务化报错
t('forum.solved') 已解决
发表于2025-05-28 16:56:55
0 查看

1、版本信息:

硬件设备:Atals 800I A2

驱动固件:24.1.0

系统:openeuler22.03

mindie:2.0.RC2

2、运行报错情况

模型:MiniCPM-V-2_6(mindie models:minicpm_qwen2_v2)

直接推理成功运行;

使用其他模型服务化部署也没有问题

目前只有部署MiniCPM-V-2_6服务化报错;

服务化运行报错:

2025-05-28 16:47:20.327 5139 LLM log default format: [yyyy-mm-dd hh:mm:ss.uuuuuu] [processid] [threadid] [llm] [loglevel] [file:line] [status code] msg

[2025-05-28 16:47:20.327] [5137] [281473600315360] [llm] [INFO] [llm_manager_impl.cpp:76] LLMRuntime init success!

[2025-05-28 16:47:26.494] [5137] [281473600315360] [llm] [ERROR] [model_deploy_config.cpp:102] Failed to get vocab size from tokenizer wrapper with exception: ValueError: Get instance from Minicpmqwen2v2Config fai

led. Please check the input parameters model_path and kwargs. If the input parameters are valid and the required files exist in model_path, make sure the folder's owner has execute permission. Otherwise, please ch

eck the function stack for detailed exception information.

报错信息为Minicpmqwen2v2Config配置文件初始化 token报错;

初步排查为/usr/local/Ascend/atb-models/atb_llm/models/minicpm_qwen2_v2/config_minicpm_qwen2_v2.py

文件,请问需要怎么修改呢

本帖最后由 匿名用户2025/05/29 16:45:46 编辑

我要发帖子