ZInplaceAddLayerNormFusionPass

Description

Reuses the input address x1 of AddLayerNorm as the output address y, input address x2 as the output address x, and converts the operator to InplaceAddLayerNorm.

Restrictions

  • The input types of the AddLayerNorm operator before fusion must be the same.
  • AddLayerNorm does not support being called as a custom operator inserted into the computation graph.

Availability

Atlas A2 training product/Atlas A2 inference product

Atlas A3 training product/Atlas A3 inference product