---
title: LayerNormSpecialTrainingFusionPass
description: "该融合规则将Mean/SquaredDifference/Add/Rsqrt/RsqrtGrad/Mul/Sub/AddN算子融合成一个LayerNorm算子和两个LayerNormGrad算子，提高计算性能。如下图所示。"
url: https://www.hiascend.com/document/detail/zh/canncommercial/latest/maintenref/graphubfusionref/atlasrr_30_0057.html
sourcePath: /source/zh/canncommercial/900/maintenref/graphubfusionref/atlasrr_30_0057.html
indexId: 89f5beade50ea11ce1fb38b4e923b56a48db3a39b0038af1d0fea5d339f91ff678
---
# LayerNormSpecialTrainingFusionPass

#### 融合模式

该融合规则将Mean/SquaredDifference/Add/Rsqrt/RsqrtGrad/Mul/Sub/AddN算子融合成一个LayerNorm算子和两个LayerNormGrad算子，提高计算性能。如下图所示。


#### 使用约束

无
