[DEBUG] Setting dynamic batch size to: 1
batchsize is : 1
[DEBUG] Dynamic batch size set successfully
Processing: current_task - Time: 22.1932 ms, FPS: 45.0588
[PERFORMANCE] Batch inference time: 23 ms for 1 images (avg: 23 ms/image)
[DEBUG] Setting dynamic batch size to: 4
batchsize is : 4
[DEBUG] Dynamic batch size set successfully
Processing: current_task - Time: 85.6055 ms, FPS: 11.6815
[PERFORMANCE] Batch inference time: 87 ms for 4 images (avg: 21.75 ms/image)
上述为我实验的打印结果,随着设置动态batch的值,其推理时间也成倍的增长,相当于每张图像做单张循环推理。
麻烦解答一下
batchsize is : 1
[DEBUG] Dynamic batch size set successfully
Processing: current_task - Time: 22.1932 ms, FPS: 45.0588
[PERFORMANCE] Batch inference time: 23 ms for 1 images (avg: 23 ms/image)
[DEBUG] Setting dynamic batch size to: 4batchsize is : 4
[DEBUG] Dynamic batch size set successfully
Processing: current_task - Time: 85.6055 ms, FPS: 11.6815
[PERFORMANCE] Batch inference time: 87 ms for 4 images (avg: 21.75 ms/image)
上述为我实验的打印结果,随着设置动态batch的值,其推理时间也成倍的增长,相当于每张图像做单张循环推理。
麻烦解答一下