IsPrefillReq Interface

Function

Checks whether a request is of the prefill type.

Format

bool IsPrefillReq() const;

Parameters

None

Usage Example

Construct a request object, set the request type for the request object, and finally check whether the request is a prefill request.

1
2
3
4

mindie_llm::InferRequestId runtimeReqId(0);
std::shared_ptr<mindie_llm::InferRequest> runtimeRequest(runtimeReqId);
runtimeRequest->SetReqType(mindie_llm::InferReqType::REQ_STAND_INFER);
bool isPrefill = runtimeRequest->IsPrefillReq();

Return Value

Bool type.