ReluFusionPass

Description

In the Caffe framework, this fusion matches one of the following specific graph structures. Once matched, it removes the standalone Activation node and converts the activation computation into an inline instruction executed inside the preceding operator.

Structure 1

Structure 2

Restrictions

The input of the Add operator must be Convolution, Activation, FusionBatchNorm, BatchNorm, Pooling, or Eltwise.

The Mode attribute of Activation is set to Relu.

Availability

Atlas 200I/500 A2 inference product

Atlas inference product

Atlas training product

Atlas A2 training product/Atlas A2 inference product

Atlas A3 training product/Atlas A3 inference product