SetDTarget

Function

Sets the server IP address of the decode node to which a request is sent.

Format

void SetDTarget(std::string &dTarget);

Parameters

Parameter

Mandatory/Optional

Description

Value

dTarget

Mandatory

Set the IP address of the decode node to which a full inference request is sent.

Server IP address, which must be a valid string.

Usage Example

After a request object is constructed, set the IP address of the D node to which a full inference request is sent for the request object.

1
2
3
4
mindie_llm::InferRequestId runtimeReqId(0);
std::shared_ptr<mindie_llm::InferRequest> runtimeRequest(runtimeReqId);
std::string serverIp = "";
runtimeRequest->SetDTarget(serverIp);

Return Value

None