Matmul Feature Scenarios

In addition to the basic computing capabilities of Matmul described above, you also need to master the basic knowledge and operator implementation of Matmul. In addition, Matmul matrix programming provides processing capabilities and multiple functions applicable to different scenarios. The following table lists the specific scenarios and key APIs or parameters used. For details, see the corresponding sections.

**Table 1** Matmul features
Category	Feature Description	Key API or Parameter
Function implementation	Multi-Core Aligned Tiling	SetDim and EnableMultiCoreSplitK (multi-core K splitting)
	Multi-Core Non-Aligned Tiling	SetTail, SetDim, and EnableMultiCoreSplitK (multi-core K splitting)
	Asynchronous Scenario Processing	Iterate, GetTensorC, and IterateAll
	MatmulCallBackFunc	MatmulCallBackFunc, SetUserDefInfo, and SetSelfDefineData
	Channel Split of Matrix Multiplication Outputs	isEnableChannelSplit in MatmulConfig
	General Matrix-Vector Multiplication	SetAType
	Upper triangular or lower triangular computation	MatmulPolicy template parameters
	Matrix Multiplication with TSCM Inputs	DataCopy
	N-Direction Alignment of Matrix Multiplication Outputs	SetCType
	Partial Output for a Single Matrix Multiplication	isPartialOutput in MatmulConfig
	Independent Running Mechanism of AIC and AIV	enableMixDualMaster in MatmulConfig

**Table 2** Matmul features
Category	Feature Description	Key API or Parameter
Function implementation	Quantization and Dequantization of Matrix Multiplication Outputs	SetDequantType, SetQuantScalar, and SetQuantVector
Function implementation	4:2 Sparse Matrix Multiplication	SetSparse and SetSparseIndex

**Table 3** BatchMatmul feature
Category	Feature Description	Involved API
Function implementation	Basic Functions of Batch Matmul	BatchMatmul in the NORMAL format: IterateBatch and SetBatchInfoForNormal
	Basic Functions of Batch Matmul	BatchMatmul in the BSNGD, SBNGD and BNGS1S2 formats: IterateBatch, SetALayout, SetBLayout, SetCLayout, and SetBatchNum
	Batch Matmul Reusing Bias Matrix	GetMMConfig, IterateBatch, and SetBatchInfoForNormal

Parent topic: Matmul Kernel APIs