AddRmsNormFusionGraphPass

Description

Fuses the Add and RmsNorm operators that comply with the graph fusion pattern into the fused operator AddRmsNorm. The output of the Add operator is used as the first input of the RmsNorm operator.

Restrictions

• The shape and dtype of the inputs X1 and X2 of the Add operator must be the same.
• The format can only be ND.

Availability

Atlas A2 training product/Atlas A2 inference product

Atlas A3 training product/Atlas A3 inference product

Atlas 350 Accelerator Card