mindie 2.2.RC1开启prefix-cache特性后报错ModuleNotFoundError: No module named ‘atb_llm.models.qwen2_vl.flash_causal_qwen2 vl_v2'
收藏回复举报
mindie 2.2.RC1开启prefix-cache特性后报错ModuleNotFoundError: No module named ‘atb_llm.models.qwen2_vl.flash_causal_qwen2 vl_v2'
t('forum.solved') 已解决
发表于2025-11-26 16:10:35
0 查看
qwen2.5-vl-7b模型,在300I pro设备上按照文档开启prefix cache特性后,
"plugin_params": "{\"plugin_type\":\"prefix_cache\"}",

mindie 2.2.RC1报错:

ModuleNotFoundError: No module named ‘atb_llm.models.qwen2_vl.flash_causal_qwen2 vl_v2'

检查了依赖包,均正常。且未开启该特性之前,模型拉起正常

我要发帖子