← Keywords

transformer architecture

1555 papers

Explore in graph

Also known as

TTE STTR TGT DIT ENT BERT DETR ROBERTA TA

Co-occurring keywords

attention mechanism (3975) neural machine translation (2310) transformer model (1988) representation learning (6174) language model (4573) neural network (6616) self-attention mechanism (350) multimodal learning (4622) machine translation (2472) large language model (12755)

Papers

Comparison of Grammatical Error Correction Using Back-Translation Models NAACL 2021
CoRT: Complementary Rankings from Transformers NAACL 2021
Multilingual Speech Translation KIT @ IWSLT2021 IJCNLP 2021
System Description for the CommonGen task with the POINTER model IJCNLP 2021
ANVITA Machine Translation System for WAT 2021 MultiIndicMT Shared Task IJCNLP 2021
The Case for Translation-Invariant Self-Attention in Transformer-Based Language Models IJCNLP 2021
Are Pretrained Convolutions Better than Pretrained Transformers? IJCNLP 2021
Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models IJCNLP 2021
Point, Disambiguate and Copy: Incorporating Bilingual Dictionaries for Neural Machine Translation IJCNLP 2021
Glancing Transformer for Non-Autoregressive Neural Machine Translation IJCNLP 2021
More than Text: Multi-modal Chinese Word Segmentation IJCNLP 2021
Selective Knowledge Distillation for Neural Machine Translation IJCNLP 2021
NLP-IIS@UT at SemEval-2021 Task 4: Machine Reading Comprehension using the Long Document Transformer ACL 2021
PENELOPIE: Enabling Open Information Extraction for the Greek Language through Machine Translation EACL 2021
ProFormer: Towards On-Device LSH Projection Based Transformers EACL 2021
UVCE-IIITT@DravidianLangTech-EACL2021: Tamil Troll Meme Classification: You need to Pay more Attention EACL 2021
Modeling Coreference Relations in Visual Dialog EACL 2021
Syntax-BERT: Improving Pre-trained Transformers with Syntax Trees EACL 2021
BERT Prescriptions to Avoid Unwanted Headaches: A Comparison of Transformer Architectures for Adverse Drug Event Detection EACL 2021
Telling BERT’s Full Story: from Local Attention to Global Aggregation EACL 2021
Lightweight Models for Multimodal Sequential Data EACL 2021
Globalizing BERT-based Transformer Architectures for Long Document Summarization EACL 2021
Understanding Guided Image Captioning Performance across Domains EMNLP 2021
Explainable Natural Language to Bash Translation using Abstract Syntax Tree CONLL 2021
Referring Transformer: A One-step Approach to Multi-task Visual Grounding NIPS 2021