[object Object]

[object Object][object Object]undefined[object Object]

• Description: This operator is used for permutation computation in MoE. It passes tokens and expert labels as [object Object] and sorts the tokens and optional [object Object] based on routingMap after broadcasting them.

• Formula:

  [object Object] indicates the size of the zeroth dimension of [object Object], and [object Object] indicates the size of the first dimension of [object Object]. When [object Object] is set to [object Object]:

  $$expertIndex=arange(tokens\_num).expand(expert\_num,-1)$$ $$sortedIndicesFirst=expertIndex.masked\_select(routingMap.T)$$ $$sortedIndicesOut=argsort(sortedIndicesFirst)$$ $$topK = numOutTokens // tokens\_num$$ $$outToken = topK * tokens\_num$$ $$permuteTokensOut[sortedIndicesOut[i]]=tokens[i//topK]$$

  If [object Object] is not set to [object Object]:

  $$permuteProbsOutOptional=probsOptional.T.masked\_select(routingMap.T)$$

  When [object Object] is set to [object Object]:

  $$capacity = numOutTokens // expert\_num$$ $$outToken = capacity * expert\_num$$ $$sortedIndicesOut = argsort(routingMap.T,dim=-1)[:, :capacity]$$ $$permutedTokensOut = tokens.index\_select(0, sortedIndicesOut)$$

  If [object Object] is not set to [object Object]:

  $$probs\_T\_1D = probsOptional.T.view(-1)$$ $$indices\_dim0 = arange(expert\_num).view(expert\_num, 1)$$ $$indices\_dim1 = sortedIndicesOut.view(expert\_num, capacity)$$ $$indices\_1D = (indices\_dim0 * tokens\_num + indices\_dim1).view(-1)$$ $$permuteProbsOutOptional = probs\_T\_1D.index\_select(0, indices\_1D)$$

[object Object]

Each operator has calls. First, [object Object] is called to obtain the workspace size required for computation and the executor that contains the operator computation process. Then, [object Object] is called to perform computation.

[object Object]

• Parameters:

  [object Object]

• Returns:

  aclnnStatus: status code. For details, see [object Object]aclnn Return Codes[object Object].

  The first-phase API implements input parameter verification. The following errors may be thrown.

  [object Object]

[object Object]

• Parameters:

  [object Object]

• Returns:

  [object Object]: status code. For details, see .

[object Object]

• Deterministic computation:

  • [object Object] defaults to deterministic implementation.

• The values of [object Object] and [object Object] must be less than [object Object]. When [object Object] is set to [object Object], the number of 1s or [object Object] values in each row of [object Object] is fixed and less than [object Object].

[object Object]

The following example is for reference only. For details, see .