Theoretical Analysis of Positional Encodings in Transformer Models

Kinda disappointing that rope- the most common pe- is given about one sentence in this work and omitted from the analysis.