Norm

原始代码：

norm_q = RMSNorm(dim_head, eps=eps)
query = norm_q(query)

调用class RMSNorm优化后的代码：

from mindiesd import RMSNorm
norm_q = RMSNorm(dim_head, eps=eps)
query = norm_q(query)

父主题： layer层