GetPrefillAddr

Function

Obtains the server IP address of the prefill node.

Format

std::string GetPrefillAddr() const;

Parameters

None

Usage Example

After a request object is constructed, set the IP address of the full inference phase for the request object, and then obtain the server IP address of the prefill node.

1
2
3
4
5

mindie_llm::InferRequestId runtimeReqId(0);
std::shared_ptr<mindie_llm::InferRequest> runtimeRequest(runtimeReqId);
std::string prefillAddr= "";
runtimeRequest->SetPrefillAddr(prefillAddr);
std::string addr = runtimeRequest->GetPrefillAddr();

Return Value

Server IP address of the prefill node