conftrace_

position encoding

60 papers

Explore in graph

Also known as

PE

Co-occurring keywords · papers mentioning both

large language model (9) rotary position embedding (8) attention mechanism (8) transformer architecture (8) self-attention mechanism (5) length generalization (4) transformer model (4) neural network (4) positional encoding (4) language model (4)

Papers

Segatron: Segment-Aware Transformer for Language Modeling and Understanding AAAI 2021 FLAT: Chinese NER Using Flat-Lattice Transformer ACL 2020 How much Position Information Do Convolutional Neural Networks Encode? ICLR 2020 Learning to Encode Position for Transformer with Continuous Dynamical Model ICML 2020 Self-Attention with Cross-Lingual Position Representation ACL 2020 Open Sesame: Getting inside BERT’s Linguistic Knowledge ACL 2019 Our Neural Machine Translation Systems for WAT 2019 EMNLP 2019 A Position-aware Bidirectional Attention Network for Aspect-level Sentiment Analysis COLING 2018 Self-Attentional Acoustic Models Interspeech 2018 What Are the Invariant Occlusive Components of Image Patches? A Probabilistic Generative Approach NeurIPS 2013