aclmdlLoadFromMem

Applicable Products

Product

Supported

Ascend 950PR / Ascend 950DT

Atlas A3 training products / Atlas A3 inference products

Atlas A2 training products / Atlas A2 inference products

Atlas 200I/500 A2 inference products

Atlas inference products

Atlas training products

Function Usage

Loads OM model file data from memory. The model workspace is managed by the system.

For details about how to obtain the OM model file, see "Command-Line Options > Basic Options > General Options > --mode" in the Ascend Tensor Compiler (ATC).

Prototype

1
aclError aclmdlLoadFromMem(const void *model, size_t modelSize, uint32_t *modelId)

Parameters

Parameter

Input/Output

Description

model

Input

Pointer to the memory address for storing model data.

modelSize

Input

Size of the model data in the memory, in bytes.

modelId

Output

Pointer to the model ID.

Returns the model ID after the model is successfully loaded. The model ID is used for model identification in subsequent operations.

Returns

0 on success; else, failure. For details, see aclError.

Restrictions

In Ascend EP form, allocate memory on the host for the model parameter.

In Ascend RC form, allocate memory on the device for the model parameter.

In Open Ctrl CPU form, allocate memory on the device for the model parameter.

Reference

The aclmdlSetConfigOpt and aclmdlLoadWithConfig APIs are provided for model loading. The caller needs to set the attributes in the configuration object passed to the API call to decide how the model will be loaded and who will manage the memory.