Class Description

It serves as the model abstraction, providing resources and open APIs for model inference. It also supports the inference of ATC-built models with dynamic batches, dynamic image sizes, and dynamic dimension profiles.

For details, see Model Inference.

• The model class involves stream creation, which affects the maximum number of streams that can be created.
• The model class involves resource allocation on the device, which conflicts with the scope of MxDeInit. Therefore, the scope of the model class must be smaller than the scope of MxDeInit.