AddRmsNormFusionGraphPass

Description

Fuses the Add and RmsNorm operators that comply with the graph fusion pattern into the fused operator AddRmsNorm. The output of the Add operator is used as the first input of the RmsNorm operator.

Constraints

• The shape and dtype of the inputs X1 and X2 of the Add operator must be the same.
• The format can only be ND.

Applicable Products

Atlas A2 training products/Atlas A2 inference products

Atlas A3 training products/Atlas A3 inference products

Ascend 950PR/Ascend 950DT