[object Object]

[object Object][object Object]undefined[object Object]

• Description: The RmsNorm operator is a normalization operation commonly used in foundation models. Compared with the LayerNorm operator, the RmsNorm operator removes the part of subtracting the mean value. The AddRmsNorm operator integrates the Add operator before RmsNorm to reduce the move-in and move-out operations.
• Formula:$$x_i=x1_{i}+x2_{i}$$ $$\operatorname{RmsNorm}(x_i)=\frac{x_i}{\operatorname{Rms}(\mathbf{x})} gamma_i, \quad \text { where } \operatorname{Rms}(\mathbf{x})=\sqrt{\frac{1}{n} \sum_{i=1}^n x_i^2+epsilon}$$

[object Object]

Each operator has calls. First, [object Object] is called to obtain the input parameters and compute the required workspace size based on the process. Then, [object Object] is called to perform computation.

[object Object]

• Parameters:

  [object Object]
  • [object Object]Atlas inference series products[object Object]:
    • The data types of the [object Object], [object Object], [object Object], [object Object], and [object Object] parameters cannot be BFLOAT16.
    • The [object Object] parameter is invalid in the current product.

• Returns:

  aclnnStatus: status code. For details, see .

  The first-phase API implements input parameter verification. The following errors may be thrown.

  [object Object]

[object Object]

• Parameters:

  [object Object]

• Returns:

  aclnnStatus: status code. For details, see .

[object Object]

• Description of boundary value scenarios:
  • When the input is Inf, the output is Inf.
  • When the input is NaN, the output is NaN.
• Deterministic compute:
  • aclnnAddRmsNorm defaults to a deterministic implementation.

[object Object]

The following example is for reference only. For details, see .