获取maxPositionEmbeddings数值。
uint32_t GetMaxPositionEmbeddings() const
无。
构造一个LlmManager实例,获取maxPositionEmbeddings数值。
1 2 3 4 5 6 7 8 9 | mindie_llm::GetRequestsCallback getRequestCallback; mindie_llm::SendResponsesCallback sendResponsesCallback; mindie_llm::ControlSignalCallback stopSignalCallback; mindie_llm::LlmManagerStatsCallback statsCallback; mindie_llm::SendStatusResponseCallback sendStatusCallback; const std::string llmConfigPath; std::map<std::string, std::string> ipInfo; std::shared_ptr<mindie_llm::LlmManager> llmManager = std::make_shared<mindie_llm::LlmManager>(llmConfigPath, getRequestCallback, sendResponsesCallback, stopSignalCallback, statsCallback, sendStatusCallback,ipInfo); uint32_t maxposition = llmManager->GetMaxPositionEmbeddings(); |
uint32_t类型的maxPositionEmbeddings数值。