← Keywords

transformer architecture

1555 papers

Explore in graph

Also known as

TTE STTR TGT DIT ENT BERT DETR ROBERTA TA

Co-occurring keywords

attention mechanism (3975) neural machine translation (2310) transformer model (1988) representation learning (6174) language model (4573) neural network (6616) self-attention mechanism (350) multimodal learning (4622) machine translation (2472) large language model (12755)

Papers

Segatron: Segment-Aware Transformer for Language Modeling and Understanding AAAI 2021
Writing Polishment with Simile: Task, Dataset and A Neural Approach AAAI 2021
Humor Knowledge Enriched Transformer for Understanding Multimodal Humor AAAI 2021
*-CFQ: Analyzing the Scalability of Machine Learning on a Compositional Task AAAI 2021
Learning to Truncate Ranked Lists for Information Retrieval AAAI 2021
Attention is not all you need: pure attention loses rank doubly exponentially with depth ICML 2021
Neural Machine Translation with Synchronous Latent Phrase Structure IJCNLP 2021
Dual Reader-Parser on Hybrid Textual and Tabular Evidence for Open Domain Question Answering IJCNLP 2021
H-Transformer-1D: Fast One-Dimensional Hierarchical Attention for Sequences IJCNLP 2021
Explore Better Relative Position Embeddings from Encoding Perspective for Transformer Models EMNLP 2021
Do Transformer Modifications Transfer Across Implementations and Applications? EMNLP 2021
Visual News: Benchmark and Challenges in News Image Captioning EMNLP 2021
When Do You Need Billions of Words of Pretraining Data? ACL 2021
Conversational Multi-Hop Reasoning with Neural Commonsense Knowledge and Symbolic Logic Rules EMNLP 2021
DiscoDVT: Generating Long Text with Discourse-Aware Discrete Variational Transformer EMNLP 2021
Learning Hard Retrieval Decoder Attention for Transformers EMNLP 2021
Writing Style Author Embedding Evaluation EMNLP 2021
HW-TSC’s Submissions to the WMT21 Biomedical Translation Task EMNLP 2021
ConQuest: Contextual Question Paraphrasing through Answer-Aware Synthetic Question Generation EMNLP 2021
Cascaded Head-colliding Attention IJCNLP 2021
Offline Reinforcement Learning as One Big Sequence Modeling Problem NIPS 2021
Associating Objects with Transformers for Video Object Segmentation NIPS 2021
Pay Attention to MLPs NIPS 2021
TokenLearner: Adaptive Space-Time Tokenization for Videos NIPS 2021
Luna: Linear Unified Nested Attention NIPS 2021