GetReqType interface

Function

Obtains the request type.

Format

mindie_llm::InferReqType GetReqType() const;

Parameters

None.

Usage Example

After constructing a request object, set the request type for the request object and obtain the request type.

1
2
3
4

mindie_llm::InferRequestId runtimeReqId(0);
std::shared_ptr<mindie_llm::InferRequest> runtimeRequest(runtimeReqId);
runtimeRequest->SetReqType(mindie_llm::InferReqType::REQ_STAND_INFER);
mindie_llm::InferReqType type = runtimeRequest->GetReqType();

Return Value

enum class InferReqType {

REQ_STAND_INFER = 0,

REQ_PREFILL = 1,

REQ_DECODE = 2

};