RunGraphAsync

Header File/Library File

Header file: #include <ge/ge_api.h>
Library file: libge_runner.so

Function Usage

Asynchronously runs the graph of a specified ID and returns the execution result.

Both this API and RunGraph are used to run the graph of a specified ID and output the result. Specifically:

This API is asynchronous.
The allowed data has the same meaning, but different formats.
You can use the callback function RunAsyncCallback to obtain the compute result of the graph by customizing the function. When the status of the callback function is success, data can be processed.

Prototype

Status RunGraphAsync(uint32_t graph_id, const std::vector<ge::Tensor> &inputs, RunAsyncCallback callback)

Parameters

Parameter	Input/Output	Description
graph_id	Input	ID of the graph to be run.
inputs	Input	Input tensor of the computational graph. When std::vector<Tensor> inputs are used and user inputs enter a data queue, memory must be allocated and copied for each input. A large input size or quantity may result in a performance bottleneck.
callback	Input	Callback function of the current graph. For details, see the RunAsyncCallback description below the table.

Parameter

Input/Output

Description

graph_id

Input

ID of the graph to be run.

inputs

Input

Input tensor of the computational graph.

When std::vector<Tensor> inputs are used and user inputs enter a data queue, memory must be allocated and copied for each input. A large input size or quantity may result in a performance bottleneck.

callback

Input

Callback function of the current graph. For details, see the RunAsyncCallback description below the table.

using Status = uint32_t;
using RunAsyncCallback = std::function<void(Status, std::vector<ge::Tensor> &)>;

Returns

Parameter	Type	Description
-	Status	GE_CLI_GE_NOT_INITIALIZED: GE is not initialized. SUCCESS: The graph is successfully run by using the asynchronous API. FAILED: The graph fails to be run by using the asynchronous API.

Parameter

Type

Description

Status

GE_CLI_GE_NOT_INITIALIZED: GE is not initialized.

SUCCESS: The graph is successfully run by using the asynchronous API.

FAILED: The graph fails to be run by using the asynchronous API.

Restrictions

None

Example

Call AddGraph to load a subgraph.

std::map <AscendString, AscendString> options;
ge::GeSession *session = new GeSession(options);

uint32_t graph_id = 0;
ge::Graph graph;
Status ret = session->AddGraph(graph_id, graph);

Customize RunAsyncCallback to process data as follows:

void CallBack(Status result, std::vector<ge::Tensor> &out_tensor) {
if(result == ge::SUCCESS) {
// Read the out_tensor data and process the data as required.
for(auto &tensor : out_tensor) {
  auto data = tensor.GetData();
  int64_t length = tensor.GetSize();
  }
}
}

Define the input data of the graph: const std::vector<ge::Tensor> &inputs
Call RunGraphAsync(graph_id, inputs, CallBack).

Parent topic: Session