InferRequestId (request_index)

Function

Constructor, which is used to create a request body object based on the value of request_index as the unique sequence number.

C Prototype

explicit InferRequestId(uint64_t requestIndex);

Python Function

InferRequestId(request_index)

Parameters

Parameter

Mandatory/Optional

Description

Value

request_index

Optional

Unique sequence number of an inference request object, which is of the uint64 type.

A valid request sequence number of the int type that complies with the C++ uint64 type range.

Usage Example

Constructor, which is used to construct a request object based on the integer ID.

1
request_id = llm_manager_python.InferRequestId(123)