Description
Calculates the attention score based on the traditional flash attention mechanism that manages kv cache based on the layer ID.
Parent topic: SelfAttentionOperation
Calculates the attention score based on the traditional flash attention mechanism that manages kv cache based on the layer ID.