Atlas 350 accelerator card

Parameter Configuration

Parameter

Value Range

Remarks

transposeA

false/true

If the value is true, this parameter is not supported in some scenarios. For details, see Description.

transposeB

false/true

-

hasBias

false/true

If the value is true, this parameter is not supported in some scenarios. For details, see Description.

outDataType

ACL_DT_UNDEFINED

-

enAccum

false

-

matmulType

MATMUL_UNDEFINED

-

quantMode

QUANT_UNDEFINED

-

Input

Parameter

Dimension

Data Type

Format

Description

x

[m, k]/[batch, m, k]

float16/bf16

ND

Matrix A for matrix multiplication.

weight

[k, n]/[batch, k, n]

float16/bf16

ND

Weight of matrix B for matrix multiplication.

bias

[1, n]/[n]

float16/bf16/float

ND

Added bias matrix Valid when hasBias is set to true.

Output

Parameter

Dimension

Data Type

Format

Description

output

[m, n]/[batch, m, n]

float16/bf16

ND

Matrix multiplication result.

Description

Figure 1 Combinations of input and output attributes
  • When transposeA is set to true, combinations 2, 5, 8, and 11 are not supported.
  • Combinations 3, 6, 9, and 12 do not support bias addition.