← Keywords

transformer architecture

1555 papers

Explore in graph

Also known as

TTE STTR TGT DIT ENT BERT DETR ROBERTA TA

Co-occurring keywords

attention mechanism (3975) neural machine translation (2310) transformer model (1988) representation learning (6174) language model (4573) neural network (6616) self-attention mechanism (350) multimodal learning (4622) machine translation (2472) large language model (12755)

Papers

Select, Extract and Generate: Neural Keyphrase Generation with Layer-wise Coverage Attention ACL 2021
Neural Unification for Logic Reasoning over Natural Language EMNLP 2021
Frequency Effects on Syntactic Rule Learning in Transformers EMNLP 2021
Speechformer: Reducing Information Loss in Direct Speech Translation EMNLP 2021
What’s Hidden in a One-layer Randomly Weighted Transformer? EMNLP 2021
Incorporating Residual and Normalization Layers into Analysis of Masked Language Models EMNLP 2021
Long-Range Modeling of Source Code Files with eWASH: Extended Window Access by Syntax Hierarchy EMNLP 2021
MATE: Multi-view Attention for Table Transformer Efficiency EMNLP 2021
Document Graph for Neural Machine Translation EMNLP 2021
PermuteFormer: Efficient Relative Position Encoding for Long Sequences EMNLP 2021
Pivot Based Transfer Learning for Neural Machine Translation: CFILT IITB @ WMT 2021 Triangular MT EMNLP 2021
Multilingual Machine Translation Systems from Microsoft for WMT21 Shared Task EMNLP 2021
Tencent AI Lab Machine Translation Systems for the WMT21 Biomedical Translation Task EMNLP 2021
Unsupervised Translation of German–Lower Sorbian: Exploring Training and Novel Transfer Methods on a Low-Resource Language EMNLP 2021
Joint Inductive and Transductive Learning for Video Object Segmentation ICCV 2021
ANVITA Machine Translation System for WAT 2021 MultiIndicMT Shared Task ACL 2021
NECTEC’s Participation in WAT-2021 ACL 2021
GX at SemEval-2021 Task 2: BERT with Lemma Information for MCL-WiC Task ACL 2021
Taming Transformers for High-Resolution Image Synthesis CVPR 2021
Modeling Graph Structure via Relative Position for Text Generation from Knowledge Graphs NAACL 2021
Larger-Scale Transformers for Multilingual Masked Language Modeling ACL 2021
BERT Goes Shopping: Comparing Distributional Models for Product Representations ACL 2021
Are Pretrained Convolutions Better than Pretrained Transformers? ACL 2021
G-Transformer for Document-Level Machine Translation ACL 2021
ERNIE-Doc: A Retrospective Long-Document Modeling Transformer ACL 2021