Scenario

This section describes the typical service scenarios of graph build and run. You can perform services as required.

Table 1 Graph build and run

Scenario

Description

Applicability

Graph Build to an Offline Model

Build a graph and save it as an OM offline model. acl APIs load the offline model and perform model inference.

For details, see section "Model Management" in Application Development Guide (C&C++).

All

Compiling and Running a Graph

After a graph is constructed, build and run the graph directly. Use AddGraph to load the graph object. When the graph is running, the following two scenarios are involved based on the called API:

  • Synchronous mode: After the graph is loaded, use RunGraph to run the graph synchronously to obtain the result.
  • Asynchronous mode: After the graph is loaded, use RunGraphWithStreamAsync to run the graph asynchronously to obtain the result.

Atlas inference products : supported

Atlas training products : supported

Atlas A2 training products / Atlas A2 inference products : supported

Atlas A3 training products / Atlas A3 inference products : supported

Atlas 200I/500 A2 inference products : not supported

Graph Build to an Offline Model

In this scenario, a graph is compiled and saved as an OM offline model. Figure 1 shows the process. For details about services, see Graph Build to an Offline Model.

Figure 1 Model build process

Compiling and Running a Graph

Figure 2 shows the workflow of building and running a graph. For details about services, see Graph Build and Run.

Figure 2 Graph compilation and running