[object Object]

[object Object][object Object]undefined
[object Object]

A fused operator of [object Object] and [object Object]. It performs a "combine" operation on the output of the [object Object] computation based on specified indices. Compared with , this API introduces the input parameter [object Object] and supports asymmetric quantization scenarios. Select the appropriate API based on your requirements. The input parameters [object Object] and [object Object] are added (but not used currently).

[object Object]

Each operator has calls. First, [object Object] is called to obtain the workspace size required for computation and the executor that contains the operator computation process. Then, [object Object] is called to perform computation.

[object Object]
[object Object]
[object Object]
  • Parameters

    [object Object]
  • Returns:

    [object Object]: status code. For details, see .

    The first-phase API implements input parameter validation. The following errors may be thrown:

    [object Object]
[object Object]
  • Parameters

    [object Object]
  • Returns:

    [object Object]: status code. For details, see .

[object Object]
  • Deterministic computation:

    • [object Object] defaults to non-deterministic implementation. You can call [object Object] to enable deterministic computation.
  • Supported types in the fake-quantization scenario

    The following table describes the supported input and output data type combinations.

    [object Object]undefined
    • In this scenario, [object Object] represents the result of per-channel and per-group offline fusion.
    • In this scenario, [object Object] represents the auxiliary result of offline computation. Its value must be 8×w×scaleOptional8 \times w \times scaleOptional and is accumulated in the first dimension.
    • This scenario supports symmetric quantization and asymmetric quantization. In symmetric quantization, offsetOptional needs to be left empty. In asymmetric quantization, offsetOptional indicates the auxiliary result of offline computation, that is, the result of antiquantOffsetOptional×scaleOptionalantiquantOffsetOptional \times scaleOptional.
    • In this scenario, [object Object] and [object Object] must be null.
[object Object]

The following example is for reference only. For details, see .

[object Object]