[object Object]

[object Object][object Object]undefined[object Object]

• Function: This operator is a part of the cross entropy calculation module in the vocabulary parallel scenario, which solves the problems of GPU memory and computing efficiency in ultra-large vocabulary scenarios. Currently, this operator is used to calculate the loss and softMax results.
• Formula:$$lossOut = log(sum\_exp\_logits) - predicted\_logits$$ $$softMaxOutOptional = exp(vocab\_parallel\_logits -logits\_max.unsqueeze(dim = -1)) \ sum\_exp\_logits.unsqueeze(dim = -1)$$

[object Object]

Each operator has calls. First, aclnnFusedCrossEntropyLossWithMaxSumGetWorkspaceSize is called to obtain the workspace size required for computation and the executor that contains the operator computation process. Then, aclnnFusedCrossEntropyLossWithMaxSum is called to perform computation.

[object Object]

• Parameters

  [object Object]

• Returns

  [object Object]: status code. For details, see .

  The first-phase API implements input parameter verification. The following errors may be thrown.

  [object Object]

[object Object]

• Parameters:

  [object Object]

• Returns

  [object Object]: status code. For details, see .

[object Object]

• Deterministic computation:
  • aclnnFusedCrossEntropyLossWithMaxSum defaults to a deterministic implementation.

[object Object]

The following example is for reference only. For details, see .