aclrtStreamConfigAttr
typedef enum {
ACL_RT_STREAM_WORK_ADDR_PTR = 0,
ACL_RT_STREAM_WORK_SIZE,
ACL_RT_STREAM_FLAG,
ACL_RT_STREAM_PRIORITY,
} aclrtStreamConfigAttr;
Enumeration Item |
Description |
|---|---|
ACL_RT_STREAM_WORK_ADDR_PTR |
Pointer to the workspace required by the model (temporary data during model execution is stored on the device) on a stream. The workspace is managed by the user. This configuration applies to the scenario where multiple models need to share the workspace when they are executed in serial mode on the same stream. In this case, you need to allocate workspace based on the maximum workspace of the models. You can call to query the workspace required by each model. If both ACL_RT_STREAM_WORK_ADDR_PTR and ACL_MDL_WORK_ADDR_PTR (indicating the workspace of a model) in are configured, ACL_MDL_WORK_ADDR_PTR in aclmdlExecConfigAttr is used. |
ACL_RT_STREAM_WORK_SIZE |
Workspace size required for model execution, in bytes. |
ACL_RT_STREAM_FLAG |
Reserved configuration. The default value is 0. |
ACL_RT_STREAM_PRIORITY |
Stream priority. A smaller value indicates a higher priority. The value range is [0, 7]. The default value is 0. |