aclmdlExeOMDesc
typedef struct aclmdlExeOMDesc {
size_t workSize;
size_t weightSize;
size_t modelDescSize;
size_t kernelSize;
size_t kernelArgsSize;
size_t staticTaskSize;
size_t dynamicTaskSize;
size_t fifoTaskSize;
size_t reserved[8];
} aclmdlExeOMDesc;
Member |
Description |
|---|---|
workSize |
Workspace size required for model execution, in bytes. |
weightSize |
Weight memory size required for model execution, in bytes. |
modelDescSize |
Memory size required for storing the model description information, in bytes. |
kernelSize |
Memory size required for storing the TBE operator kernel (*.o and *.json files), in bytes. |
kernelArgsSize |
Memory size required for storing the TBE operator kernel parameters, in bytes. |
staticTaskSize |
Memory size required for storing the description of a static shape task, in bytes. |
dynamicTaskSize |
Memory size required for storing the description of a dynamic shape task, in bytes. |
fifoTaskSize |
Size of the model-level global memory, in bytes. During inference of a model, if the input of each layer is composed of the output of the previous layer and the results of the previous rounds of inference, the model-level global memory needs to be used to save the input data required by the model for subsequent inference. |
reserved |
Reserved. |