InferRequest
Function
Constructor
C++ Prototype
explicit InferRequest(InferRequestId requestId);
Python Prototype
InferRequest(request_id)
Parameters
Parameter |
Mandatory/Optional |
Description |
Value |
|---|---|---|---|
request_id |
Mandatory |
Request ID |
Valid InferRequestId type. For details, see InferRequestId. |
Usage Example
Initialize and construct an inference request ID and inference request based on the string ID.
1 2 3 | id = '123' request_id = llm_manager_python.InferRequestId(id) infer_request = llm_manager_python.InferRequest(request_id) |
Parent topic: InferRequest