SetPrefillAddr

Function

Sets the server IP address of a request on the prefill node.

Format

void SetPrefillAddr(std::string &prefillAddr);

Parameters

Parameter	Mandatory/Optional	Description	Value
prefillAddr	Mandatory	IP address in the full inference phase.	Server IP address, which must be a valid string.

Usage Example

After a request object is constructed, set the IP address of the full inference phase for the request object.

mindie_llm::InferRequestId runtimeReqId(0);
std::shared_ptr<mindie_llm::InferRequest> runtimeRequest(runtimeReqId);
std::string prefillAddr= "";
runtimeRequest->SetPrefillAddr(prefillAddr);

Return Value

None

Parent topic: InferRequest