The Impact of Positional Encoding on Length Generalization in Transformers

arxiv.org

saved by: 0 people
related read on: Is ‘Attention’ the Essence of Intelligence? from the discussion