The independent running mechanism of AIC and AIV is also called the dual-master mode. In the separation mode, the dual-master mode enables the AIC and AIV to run independently without depending on the message mechanism, thus enhancing the Matmul computation performance. This is different from the MIX mode (including matrix computation and vector computation) that drives the AIC to run using the message mechanism. By default, the dual-master mode is disabled. You can enable it by setting the enableMixDualMaster parameter in MatmulConfig.
When the matrix computation and vector computation code in an operator runs independently and is not driven by the message mechanism, you can enable the dual-master mode to enhance the Matmul computation performance.
For a complete operator example, see operator sample for enabling the active-active mode.
1 2 3 4 5 6 7 8 9 10 |
// Change the template parameter enableMixDualMaster to true to enable the dual-master mode for the Norm template. For the MDL template, use the GetMDLConfig API to obtain the template parameters. constexpr static MatmulConfig MM_CFG = GetNormalConfig(false, false, false, BatchMode::BATCH_LESS_THAN_L1, true, IterateOrder::ORDER_M, ScheduleType::OUTER_PRODUCT, false, true/*enableMixDualMaster*/); Matmul<A_TYPE, B_TYPE, C_TYPE, BIAS_TYPE, MM_CFG> mm; // Regular Matmul computation. REGIST_MATMUL_OBJ(&pipe, GetSysWorkSpacePtr(), mm); mm.SetTensorA(gm_a); mm.SetTensorB(gm_b); mm.SetBias(gm_bias); mm.IterateAll(gm_c); |