DynamicQuantType

Description

Dynamic quantization types

Definition

enum atb::infer::DynamicQuantType:int{ 
    DYNAMIC_QUANT_UNDEFINED = 0,
    DYNAMIC_QUANT_SYMMETRIC,
    DYNAMIC_QUANT_ASYMMETRIC
};

Members

Member

Description

DYNAMIC_QUANT_UNDEFINED

Non-dynamic quantization

DYNAMIC_QUANT_SYMMETRIC

Symmetric dynamic quantization

DYNAMIC_QUANT_ASYMMETRIC

Asymmetric dynamic quantization, which is not supported currently.