RotaryMulGrad2RotaryPositionEmbeddingGradFusionPass

Description

Fuses the RotaryMulGrad operator into the RotaryPositionEmbeddingGrad operator, as shown in the following fusion.

  • needBackward == true

  • needBackward == false

Restrictions

You are advised not to disable this pattern. Otherwise, the RotaryMulGrad Ascend IR function will be unavailable.

Availability

Atlas 350 Accelerator Card