ModelDataset

Function

This API defines the model data set.

Structure Definition

struct ModelDataset { 
    void* mdlDataPtr; 
    size_t dynamicBatchSize; 
}; 

Parameter Description

Parameter

Input/Output

Description

mdlDataPtr

Input

Memory address of the model data

dynamicBatchSize

Input

Batch size for model inference