--batch_num

Description

Sets the number of batches for the inference stage of PTQ.

See Also

This option is mutually exclusive with --calibration_config.

Argument

Argument: number of batches for the inference stage.

Restrictions: none.

Default: 1.

Suggestions and Benefits

None

Example

--batch_num=1

Restrictions

This option applies only to PTQ.