InferReqType enumeration class

Function

InferReqType enumeration class, which indicates the request type.

Format

enum class InferReqType {
    REQ_STAND_INFER = 0,
    REQ_PREFILL = 1,
    REQ_DECODE = 2,
    REQ_FLEX_LOCAL = 3
};

Enumerated Values