BatchMatMulDequantElemwiseFusionPass

Description

Fuses BatchMatMul/MatMul, AscendDequant, and Elemwise into the BatchMatMul operator in the quantization scenario. The Elemwise operator is broadcast to MatMul.

Restrictions

• The two inputs of Elemwise must have the same dimensions and both have the batch axis. Elemwise can be broadcast to the MatMul shape only on the batch axis.
• Elemwise supports only the Add and Sub operators.
• The input format of Elemwise must be FRACTAL_NZ.

Availability

Atlas 200I/500 A2 inference product