mindie 2.0.RC1推理报错 'Failed to enqueue inferRequest. forward fail', 'error_type': 'Incomplete Generation'
收藏回复举报
mindie 2.0.RC1推理报错 'Failed to enqueue inferRequest. forward fail', 'error_type': 'Incomplete Generation'
t('forum.solved') 已解决
发表于2025-05-20 18:26:40
0 查看

问题现象:

mindie 2.0.RC1

模型:deepseek-r1-w8a8

服务化部署之后,推理时输入token到50000会报下面的错,49900就不会报错

{'error': 'Failed to enqueue inferRequest. forward fail', 'error_type': 'Incomplete Generation'} 

我要发帖子