[object Object][object Object][object Object]undefined[object Object]

A fused operator of [object Object] and [object Object]. It performs a "combine" operation on the output of the [object Object] computation based on specified indices. Compared with , this API adds the input parameter [object Object] for performance tuning. The first value in the array indicates the expected number of tokens to be processed by each expert. Operator tiling is performed based on this expected value to achieve higher performance. Select the appropriate API as required.

[object Object]

Each operator has calls. First, [object Object] is called to obtain the workspace size required for computation and the executor that contains the operator computation process. Then, [object Object] is called to perform computation.

[object Object]

• Parameters

  [object Object]

• Return

  [object Object] status code. For details, see .

  The first-phase API implements input parameter validation. The following errors may be thrown:

  [object Object]

[object Object]

• Parameters

  [object Object]

• Return

  [object Object] status code. For details, see .

[object Object]

• Deterministic computation:

  • [object Object] defaults to non-deterministic implementation. You can call [object Object] to enable deterministic computation.

• Supported input and output data types in fake-quantization scenarios:

  [object Object]undefined
  • In this scenario, [object Object] represents the result of per-channel and per-group offline fusion.
  • In this scenario, [object Object] represents the auxiliary result of offline computation. Its value must be $8 \times w \times scaleOptional$ and is accumulated in the first dimension.
  • This scenario supports symmetric quantization and asymmetric quantization. During symmetric quantization, [object Object] must be null. During asymmetric quantization, [object Object] represents the auxiliary result of offline computation, which is the result of $antiquantOffsetOptional \times scaleOptional$.
  • In this scenario, [object Object] and [object Object] must be null.

[object Object]

The following example is for reference only. For details, see .