ML Wiki
Search
Search
Explorer
Tag: positional-encoding
2 items with this tag.
May 02, 2026
Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation
source
architecture
positional-encoding
attention
transformers
Apr 06, 2026
RoPE: Enhanced Transformer with Rotary Position Embedding
source
transformers
attention
positional-encoding