InferRequestId

Function

  • Default constructor of InferRequestId.
  • Creates a request body object that uses a value of the string type as the unique sequence number based on the value of requestLabel.
  • Creates a request body object that uses a value of the uint64_t type as the unique sequence number based on the value of requestIndex.
  • Initializes the InferRequestId object using the existing InferRequestId.

Format

explicit InferRequestId();
explicit InferRequestId(const std::string requestLabel);
explicit InferRequestId(uint64_t requestIndex);
InferRequestId(const InferRequestId &other)

Parameters

Parameter

Mandatory/Optional

Description

Value

requestLabel

Mandatory

Unique ID of an inference request object, which is a sequence number of the string type.

Valid request sequence number of the string type

requestIndex

Mandatory

Unique sequence number of an inference request object, which is of the uint64_t type.

Valid unique sequence number of the uint64_t type.

other

Mandatory

Existing InferRequestId object.

Valid request InferRequestId object.

Usage Example

Call different constructors to construct the InferRequestId object.

1
2
3
4
mindie_llm::InferRequestId1 runtimeReqId();
mindie_llm::InferRequestId2 runtimeReqId("Req");
mindie_llm::InferRequestId3 runtimeReqId(0);
mindie_llm::InferRequestId4 runtimeReqId2(runtimeReqId);

Return Value

InferRequestId object