GetAscendQuantTmpBufferFactorSize

Function

Obtains maxLiveNodeCount and extraBuf. When the fixed space size is used, the maximum number of elements that can be computed by the operator at a time can be calculated based on maxLiveNodeCount and extraBuf. maxLiveNodeCount indicates how many times the temporary space is relative to the data size in a single computation. extraBuf indicates the size of the extra temporary space.

Examples:

• The AscendQuant API needs to be called for operator implementation. You need to reserve space of the currBuff size and use the GetAscendQuantTmpBufferFactorSize API to obtain the output values of maxLiveNodeCount and extraBuf. The maximum number of elements in a single computation of the operator can be calculated as follows:

  currentShapeSize = (currBuff - extraBuf) / maxLiveNodeCount / typeSize

• To implement the operator, two kernel APIs KernelIntf1 and KernelIntf2 need to be called. Two output values (maxLiveNodeCount and extraBuf) of two GetXxxTmpBufferFactorSize API functions (Xxx indicates the two high-level APIs to be called) and the existing temporary space are used to calculate the maximum number of elements in a single computation (currentShapeSize).

  currentShapeSize1 = (currBuff - extraBuf1) / maxLiveNodeCount1 / typeSize

  currentShapeSize2 = (currBuff - extraBuf2) / maxLiveNodeCount2 / typeSize

  currentShapeSize = min(currentShapeSize1, currentShapeSize2)

Note that currBuff indicates the available space for API computation. The space used for purposes such as input and output must be excluded. In addition, the output value of maxLiveNodeCount might be 0. Ensure that the value is not 0 to avoid the division-by-zero error.

Prototype

1

void GetAscendQuantTmpBufferFactorSize(uint32_t& maxLiveNodeCount, uint32_t& extraBuf)

Parameters

Returns

None

Restrictions

If currentShapeSize × typeSize < 256B is obtained based on maxLiveNodeCount and extraBuf, currentShapeSize should be rounded up based on the value of 256B/typeSize.

Example

1
2
3

uint32_t maxLiveNodeCount = 0;
uint32_t extraBuf = 0;
AscendC::GetAscendQuantTmpBufferFactorSize(maxLiveNodeCount, extraBuf);