[object Object]

[object Object][object Object]undefined[object Object]

• Description: Searches for the location of the last row processed by each expert in binary search mode during MoE computation.
• Formulas:$$for\: i\: in\: range(numExperts)$$ $$out_{i}=BinarySearch(sortedExperts, i)$$

[object Object]

Each operator has calls. First, [object Object] is called to obtain the workspace size required for computation and the executor that contains the operator computation process. Then, [object Object] is called to perform computation.

[object Object]

• Parameters:

  [object Object]

• Returns

  [object Object]: status code. For details, see .

  The first-phase API implements input parameter verification. The following errors may be thrown.

  [object Object]

[object Object]

• Parameters

  [object Object]

• Returns

  [object Object]: status code. For details, see .

[object Object]

• Deterministic computing:

  • [object Object] defaults to a deterministic implementation.

• The size of the input shape cannot exceed the upper limit of the memory that can be allocated by the device. Otherwise, the program terminates abnormally.

[object Object]

The following example is for reference only. For details, see .