Rope for one attention module, per the descriptor (llama's initialize_rope, the plain-nn.RoPE archs, or phi3's Su/linear branch).
Rope for one attention module, per the descriptor (llama's initialize_rope, the plain-nn.RoPE archs, or phi3's Su/linear branch).