Attribute Name List

This section provides the attribute names that can be set by calling the SetAttr API. The header file is located in include/ge/ge_api_types.h in the CANN component directory.

Table 1 Attribute names

Attribute Name

Description

Level

_user_stream_label

The label of the target stream (label of the stream to be switched to) for operator execution. Streams with the same label are the same. Its value is of the character string type. The function is controlled by the user.

If the intra-graph multi-stream expression function needs to be enabled during graph execution, you can use _user_stream_label and _user_stream_priority to distribute multiple operators in the graph to different streams for parallel computing, improving resource utilization.

Operator

_user_stream_priority

Priority for switching to the stream indicated by _user_stream_label. Higher-priority streams receive preferential allocation of core resources during Runtime execution. This parameter is currently reserved. The default value 0 is recommended. Its value is of the int type.

If the intra-graph multi-stream expression function needs to be enabled during graph execution, you can use _user_stream_label and _user_stream_priority to distribute multiple operators in the graph to different streams for parallel computing, improving resource utilization.

Operator

_op_aicore_num

Number of Cube Cores in the AI Core used for operator build.

Its value is an integer greater than 0 and less than or equal to the maximum numbers of Cube Cores included in the Ascend AI Processor.

You can view the maximum number of Cube Cores contained in different Ascend AI Processors in the ${INSTALL_DIR}/<arch>-linux/data/platform_config/xxx.ini file. The following information indicates that there are 24 Cube Cores in the Ascend AI Processor:
[SoCInfo]
# Use the default parameter values, which are the maximum values.
ai_core_cnt=24
cube_core_cnt=24
vector_core_cnt=48

Replace ${INSTALL_DIR} with the CANN component directory. For example, if the installation is performed by the root user, the default file storage path is /usr/local/Ascend/cann. <arch> indicates the OS architecture and xxx varies depending on the product.

Applicability:

Atlas A3 training products / Atlas A3 inference products : supported

Atlas A2 training products / Atlas A2 inference products : supported

Atlas inference products : not supported

Atlas training products : not supported

Atlas 200I/500 A2 inference products : not supported

Operator

_op_vectorcore_num

Number of Vector Cores in the AI Core used for operator build.

Its value is an integer greater than 0 and less than or equal to the maximum numbers of Vector Cores included in the Ascend AI Processor.

You can view the maximum number of Vector Cores contained in different Ascend AI Processors in the ${INSTALL_DIR}/<arch>-linux/data/platform_config/xxx.ini file. The following information indicates that there are 48 Vector Cores in the Ascend AI Processor:

[SoCInfo]
# Use the default parameter values, which are the maximum values.
ai_core_cnt=24
cube_core_cnt=24
vector_core_cnt=48

Replace ${INSTALL_DIR} with the CANN component directory. For example, if the installation is performed by the root user, the default file storage path is /usr/local/Ascend/cann. <arch> indicates the OS architecture and xxx varies depending on the product.

Applicability:

Atlas A3 training products / Atlas A3 inference products : supported

Atlas A2 training products / Atlas A2 inference products : supported

Atlas inference products : not supported

Atlas training products : not supported

Atlas 200I/500 A2 inference products : not supported

Operator

_op_exec_never_timeout

Whether the execution of AI Core operators in a static graph is limited by the timeout.

Arguments:

  • true: The operator execution is not limited by timeout and never times out.
  • false: The operator execution is limited by timeout.

You can use the "aclrtSetOpExecuteTimeOutV2" API to set the timeout duration for operator execution.

Restrictions:

If the tiling feature is enabled for AI Core operators, that is, the function controlled by ge.tiling_schedule_optimize in Command-Line Options is enabled for an operator, the operator does not support the never-timeout attribute.

Operator