init interface
Function
Initializes the LlmManager.
C Prototype
Status Init(uint32_t modelInstanceId, std::set<size_t> npuDeviceIds)
Python Function
init(model_instance_id, npu_device_ids)
Parameters
Parameter |
Mandatory/Optional |
Description |
Value |
|---|---|---|---|
model_instance_id |
Mandatory |
Model instance ID. |
The int type must be within the uint32 range in C++. |
npu_device_ids |
Mandatory |
NPU device IDs. |
Valid set type. |
Usage Example
Pass the model instance ID and the ID of the used NPU to initialize LlmManager.
1 2 3 | model_instance_id = 0 npu_device_ids = set([0,1,2,3]) llm_manager.init(model_instance_id, npu_device_ids) |
Return Value
Status object.
Parent topic: LlmManager