GetSrcBlockTable interface

Function

Obtains the block table subscript of the request on the P node.

Format

std::vector<int64_t> GetSrcBlockTable() const;

Parameters

None

Usage Example

After a request object is constructed, a block table of the request on the P node is set for the request object, and a block table subscript of the request on the P node is obtained.

1
2
3
4
5

mindie_llm::InferRequestId runtimeReqId(0);
std::shared_ptr<mindie_llm::InferRequest> runtimeRequest(runtimeReqId);
std::vector<int64_t> srcBlockTable{0, 1, 2};
runtimeRequest->SetSrcBlockTable(srcBlockTable);
auto blockTable = runtimeRequest->GetSrcBlockTable();

Return Value

Source block table.