Defines the model dataset.
1 2 3 4 | struct ModelDataset { void* mdlDataPtr; size_t dynamicBatchSize; }; |
Parameter |
Input/Output |
Description |
|---|---|---|
mdlDataPtr |
Input |
Memory address of the model dataset data |
dynamicBatchSize |
Input |
Batch size for model inference |