Operator Context

In the transformer model, matrix multiplication is widely used, especially between query, key, and value and weights. The following figure shows the linear location in the model.

Figure 1 Context of the LinearOperation operator