[object Object]

[object Object][object Object]undefined
[object Object]
  • API function: Calculates the size of the space (in the number of elements) required for converting the Matmul operator from the ND format to the NZ format. This API is used only to determine the size required for preprocessing the weight tensor to optimize the execution performance of the Matmul operator. Example:

    • Input [510, 510] float16/bfloat16: This function changes the shape to [512, 512] for better performance.

As a result, the input is interpreted as having 262,144 elements.

  • When the input shape is [510, 270] and the data type INT8, the function reshapes it to [512, 288]. As a result, the input is interpreted as having 147,456 elements.

  • Formula:

    Float16/Bfloat16:result=Align(Shapesize[0],16)Align(Shapesize[1],16)Float16/Bfloat16: result = Align(Shapesize[0], 16) * Align(Shapesize[1], 16) INT8:result=Align(Shapesize[0],16)Align(Shapesize[1],32)INT8: result = Align(Shapesize[0], 16) * Align(Shapesize[1], 32)
[object Object]
[object Object]
[object Object]
  • Parameters:

    [object Object]
  • Returns:

    [object Object]: status code. For details, see .

    The first-phase API implements input parameter verification. The following errors may be thrown:

    [object Object]
[object Object]
  • Deterministic computation:
    • [object Object] defaults to a deterministic implementation.
[object Object]

The following example is for reference only. For details, see .

[object Object]