DynamicQuantType
Description
Dynamic quantization types
Definition
1 2 3 4 5 | enum atb::infer::DynamicQuantType:int{ DYNAMIC_QUANT_UNDEFINED = 0, DYNAMIC_QUANT_SYMMETRIC, DYNAMIC_QUANT_ASYMMETRIC }; |
Members
Member |
Description |
|---|---|
DYNAMIC_QUANT_UNDEFINED |
Non-dynamic quantization |
DYNAMIC_QUANT_SYMMETRIC |
Symmetric dynamic quantization |
DYNAMIC_QUANT_ASYMMETRIC |
Asymmetric dynamic quantization, which is not supported currently. |
Parent topic: atb/infer_op_params.h