kv-bypass
Description
Applies to the cases where you want to manage the kvCache process by yourself without using the ATB to update kv to kvCache.
How to Enable
Set kvCacheCfg to K_BYPASS_V_BYPASS. Do not pass k and v to the input tensor.
Constraints
This function takes effect only when calcType is not set to PA_ENCODER or PREFIX_ENCODER.
Parent topic: Functions