SetMaxOutputLen

Function

Sets the maximum output length.

Format

 Status SetMaxOutputLen(uint32_t maxOutputLen)

Parameters

Usage Example

Construct a request object and set the maximum output length for the request object.

1
2
3
4

mindie_llm::InferRequestId runtimeReqId(0);
std::shared_ptr<mindie_llm::InferRequest> runtimeRequest(runtimeReqId);
uint32_t maxOutputLen = 1;
Status ret = runtimeRequest->SetMaxOutputLen(maxOutputLen);

Return Value

Status object.