YOLO模型在昇腾310P3上使用batch推理,推理耗时与batch正比关系
收藏回复举报
YOLO模型在昇腾310P3上使用batch推理,推理耗时与batch正比关系
t('forum.solved') 已解决
新人帖
发表于2026-01-21 16:03:26
0 查看
[DEBUG] Setting dynamic batch size to: 1

batchsize is : 1

[DEBUG] Dynamic batch size set successfully

Processing: current_task - Time: 22.1932 ms, FPS: 45.0588

[PERFORMANCE] Batch inference time: 23 ms for 1 images (avg: 23 ms/image)
 

[DEBUG] Setting dynamic batch size to: 4

batchsize is : 4

[DEBUG] Dynamic batch size set successfully

Processing: current_task - Time: 85.6055 ms, FPS: 11.6815

[PERFORMANCE] Batch inference time: 87 ms for 4 images (avg: 21.75 ms/image)
上述为我实验的打印结果,随着设置动态batch的值,其推理时间也成倍的增长,相当于每张图像做单张循环推理。
麻烦解答一下

我要发帖子