SetSrcBlockTable interface

Function

Sets the block table of the request on the P node.

Format

void SetSrcBlockTable(const std::vector<int64_t> &srcBlockTable);

Parameters

Parameter	Mandatory/Optional	Description	Value
srcBlockTable	Mandatory	Block table on the full inference node.	The element is a vector of the int64_t type, and the element value is greater than or equal to 0.

Usage Example

After a request object is constructed, set the block table of the request on the P node for the request object.

mindie_llm::InferRequestId runtimeReqId(0);
std::shared_ptr<mindie_llm::InferRequest> runtimeRequest(runtimeReqId);
std::vector<int64_t> srcBlockTable{0, 1, 2};
runtimeRequest->SetSrcBlockTable(srcBlockTable);

Return Value

N/A

Parent topic: InferRequest