--batch_num

Function Usage

Sets the number of batches for the inference stage of PTQ.

See Also

This option is mutually exclusive with --calibration_config.

Argument

Argument: number of batches for the inference stage.

Remarks: none.

Default: 1.

Suggestions and Benefits

None

Examples

--batch_num=1

Constraints

This option is used only in PTQ scenarios.