kv-bypass
Description
In some scenarios, users want to manage the kvCache process by themselves and do not want to use the ATB to update kv to kvCache.
How to Enable
Set kvCacheCfg to K_BYPASS_V_BYPASS. Do not pass k and v to the input tensor.
Constraints
This function takes effect only when calcType is not set to PA_ENCODER or PREFIX_ENCODER.
Parent topic: Functions