General Description
To improve compute efficiency, the fusion patterns are enabled by default for the underlying operators involved by API callings described in this section. The fusion patterns used by operators are recorded in the fusion_result.json file in the API execution directory. For details about the fields in the file and fusion pattern settings, see "--fusion_switch_file" in CANN ATC Offline Model Compilation Tool User Guide.
For details, see Tensor Operation.
- In multi-thread scenarios, if APIs that support operator preloading are used, you need to use MxInitFromConfig to preload related operator APIs to ensure the correct resource lifetime. For details, see Example of the Preloading File of the Initialization Operator.
Supported Models
- √: supported
- x: not supported
API |
Atlas inference product |
Atlas 800I A2 inference product |
||
|---|---|---|---|---|
Abs |
√ |
√ |
× |
× |
AbsDiff |
√ |
√ |
× |
× |
AbsSum |
× |
√ |
× |
× |
Add |
√ |
√ |
× |
× |
AddWeighted |
√ |
√ |
× |
× |
BackgroundReplace |
× |
√ |
× |
× |
BatchSplit |
√ |
√ |
× |
× |
BitwiseAnd |
√ |
√ |
× |
× |
BitwiseNot |
√ |
√ |
× |
× |
BitwiseOr |
√ |
√ |
× |
× |
BitwiseXor |
√ |
√ |
× |
× |
BlendImageCaption |
× |
√ |
× |
× |
BlendImages |
× |
√ |
× |
× |
Clip |
√ |
√ |
× |
× |
Compare |
√ |
√ |
× |
× |
ConvertTo |
√ |
√ |
× |
× |
Crop |
x |
√ |
x |
x |
CropResize |
x |
√ |
x |
x |
CvtColor |
√ |
√ |
√ |
x |
Divide |
√ |
√ |
× |
× |
Erode |
× |
√ |
× |
× |
Exp |
√ |
√ |
× |
× |
Hstack |
√ |
√ |
× |
× |
Log |
√ |
√ |
× |
× |
Max |
√ |
√ |
× |
× |
Merge |
√ |
√ |
× |
× |
Min |
√ |
√ |
× |
× |
MinMax |
× |
√ |
× |
× |
MinMaxLoc |
× |
√ |
× |
× |
Multiply |
√ |
√ |
× |
× |
Pow |
√ |
√ |
× |
× |
Reduce |
√ |
√ |
× |
× |
Rescale |
√ |
√ |
× |
× |
Resize |
× |
√ |
√ |
× |
ResizePaste |
× |
√ |
× |
× |
Rotate |
× |
√ |
√ |
× |
ScaleAdd |
√ |
√ |
× |
× |
Sort |
√ |
√ |
× |
× |
SortIdx |
√ |
√ |
× |
× |
Split |
√ |
√ |
× |
× |
Sqr |
√ |
√ |
× |
× |
SqrSum |
× |
√ |
× |
× |
Sqrt |
√ |
√ |
× |
× |
Subtract |
√ |
√ |
× |
× |
Sum |
× |
√ |
× |
× |
Threshold |
√ |
√ |
× |
× |
ThresholdBinary |
√ |
√ |
× |
× |
Tile |
× |
√ |
× |
× |
Transpose |
√ |
√ |
× |
× |
Vstack |
√ |
√ |
× |
× |
WarpAffineHiper |
× |
√ |
× |
× |
WarpPerspective |
× |
√ |
× |
× |