Single-Model Inference

Preparing an OM Model

Obtain a model and convert the model to obtain an OM model. For details, see CANN ATC Instructions.

Preparing Model Inference Configuration Files

Prepare model inference configuration files by referring to ./inferConfigRepository/ModelSample/ModelConfig.json.

Before starting the service, check all single models and streams inference configuration files in the ./inferConfigRepository directory to ensure that all configuration files and the model and parameter files required by the pipeline file are stored in the corresponding path. (If the default inference configuration file is not required, remove it.)

Parent topic: Preparing a Model and the Corresponding Inference Configuration File