GetModelParams

Function

Obtains model parameters.

Format

std::map<std::string, std::string> GetModelParams() const

Parameters

None

Usage Example

Construct an LlmManager instance to obtain model parameters.

1
2
3
4
5
6
7
8
9
mindie_llm::GetRequestsCallback getRequestCallback;
mindie_llm::SendResponsesCallback sendResponsesCallback;
mindie_llm::ControlSignalCallback stopSignalCallback;
mindie_llm::LlmManagerStatsCallback statsCallback;
mindie_llm::SendStatusResponseCallback sendStatusCallback;
const std::string llmConfigPath;
std::map<std::string, std::string> ipInfo;
std::shared_ptr<mindie_llm::LlmManager> llmManager = std::make_shared<mindie_llm::LlmManager>(llmConfigPath, getRequestCallback, sendResponsesCallback, stopSignalCallback, statsCallback, sendStatusCallback,ipInfo);
std::map<std::string, std::string> modelparams = llmManager->GetModelParams();

Return Value

Model parameters in map format