Function: set_max_op_queue_num

Applicability

Product	Supported (√/x)
Atlas A3 training products / Atlas A3 inference products	√
Atlas A2 training products / Atlas A2 inference products	√
Atlas training products	√
Atlas inference products	√
Atlas 200I/500 A2 inference products	√

Function Usage

Configures the operator cache aging information to save memory and balance calling performance when a single operator is executed using a single-operator model.

For details about the single-operator model, see API Call Sequence.

Prototype

C Prototype

        
             aclError aclopSetMaxOpQueueNum(uint64_t maxOpNum)

Python Function

        
             ret = acl.op.set_max_op_queue_num(max_op_num)

Parameter Description

Parameter	Description
max_op_num	Int, maximum length of the "operator type-single-operator model" mapping queue. If the length reaches the maximum, the mapping information that is not used for a long time and the single-operator model in the cache are deleted. Then, the latest mapping information and the corresponding single-operator model are loaded. When a single-operator is executed in single-operator model mode (except when executed by calling aclopUpdateParams), if this API is not called to configure the maximum length of the mapping queue, the default maximum length is 20000. When aclopUpdateParams is called to execute a single operator, if this API is not called to configure the maximum length of the mapping queue, the operator cache information does not need to be aged.

Parameter

Description

max_op_num

Int, maximum length of the "operator type-single-operator model" mapping queue.

If the length reaches the maximum, the mapping information that is not used for a long time and the single-operator model in the cache are deleted. Then, the latest mapping information and the corresponding single-operator model are loaded.

When a single-operator is executed in single-operator model mode (except when executed by calling aclopUpdateParams), if this API is not called to configure the maximum length of the mapping queue, the default maximum length is 20000.

When aclopUpdateParams is called to execute a single operator, if this API is not called to configure the maximum length of the mapping queue, the operator cache information does not need to be aged.

Return Value Description

Return Value	Description
ret	Int, error code: 0 on success; else, failure.

Parent topic: Single-Operator Model Execution