UpdateEngineInfo interface

Function

Delivers an identity switching request.

Format

bool UpdateEngineInfo(std::shared_ptr<mindie_llm::InferRequest> &runtimeRequest, bool isForceRelease);

Parameters

Parameter	Mandatory/Optional	Description	Value
runtimeRequest	Mandatory	Identity switching request.	std::shared_ptr<mindie_llm::InferRequest>.
isForceRelease	Mandatory	Whether to forcibly release connections between nodes.	bool

Usage Example

Construct an LlmManager instance and deliver an identity switching request.

mindie_llm::GetRequestsCallback getRequestCallback;
mindie_llm::SendResponsesCallback sendResponsesCallback;
mindie_llm::ControlSignalCallback stopSignalCallback;
mindie_llm::LlmManagerStatsCallback statsCallback;
mindie_llm::SendStatusResponseCallback sendStatusCallback;
const std::string llmConfigPath;
std::map<std::string, std::string> ipInfo;
std::shared_ptr<mindie_llm::LlmManager> llmManager = std::make_shared<mindie_llm::LlmManager>(llmConfigPath, getRequestCallback, sendResponsesCallback, stopSignalCallback, statsCallback, sendStatusCallback,ipInfo);
std::shared_ptr<mindie_llm::InferRequest> request;
llmManager->UpdateEngineInfo(request, false);

Return Value

Bool type.

Parent topic: LlmManager