aclmdlExeOMDesc
1 2 3 4 5 6 7 8 9 10 11 | typedef struct aclmdlExeOMDesc { size_t workSize; size_t weightSize; size_t modelDescSize; size_t kernelSize; size_t kernelArgsSize; size_t staticTaskSize; size_t dynamicTaskSize; size_t fifoTaskSize; size_t reserved[8]; } aclmdlExeOMDesc; |
Member |
Description |
|---|---|
workSize |
Workspace size required for model execution, in bytes |
weightSize |
Weight memory size required for model execution, in bytes |
modelDescSize |
Memory size required for storing the model description information, in bytes |
kernelSize |
Memory size required for storing the TBE operator kernel (*.o and *.json files), in bytes |
kernelArgsSize |
Memory size required for storing the TBE operator kernel parameters, in bytes |
staticTaskSize |
Memory size required for storing the description of a static shape task, in bytes |
dynamicTaskSize |
Memory size required for storing the description of a dynamic shape task, in bytes |
fifoTaskSize |
Size of the model-level global memory, in bytes During inference of a model, if the input of each layer is composed of the output of the previous layer and the results of the previous rounds of inference, the model-level global memory needs to be used to save the input data required by the model for subsequent inference. |
reserved |
Reserved |