aclmdlExeOMDesc

typedef struct aclmdlExeOMDesc {
    size_t workSize;
    size_t weightSize;
    size_t modelDescSize;
    size_t kernelSize;
    size_t kernelArgsSize;
    size_t staticTaskSize;
    size_t dynamicTaskSize;
    size_t fifoTaskSize;
    size_t reserved[8];
} aclmdlExeOMDesc;

Member

Description

workSize

Workspace size required for model execution, in bytes.

weightSize

Weight memory size required for model execution, in bytes.

modelDescSize

Memory size required for storing the model description information, in bytes.

kernelSize

Memory size required for storing the TBE operator kernel (*.o and *.json files), in bytes.

kernelArgsSize

Memory size required for storing the TBE operator kernel parameters, in bytes.

staticTaskSize

Memory size required for storing the description of a static shape task, in bytes.

dynamicTaskSize

Memory size required for storing the description of a dynamic shape task, in bytes.

fifoTaskSize

Size of the model-level global memory, in bytes.

During inference of a model, if the input of each layer is composed of the output of the previous layer and the results of the previous rounds of inference, the model-level global memory needs to be used to save the input data required by the model for subsequent inference.

reserved

Reserved.