conftrace_
← Architectures
Deep Learning › Architectures ›

Transformers

9,294 papers

Papers per year

Papers

Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models ACL 2021
BinaryBERT: Pushing the Limit of BERT Quantization ACL 2021
Are Pretrained Convolutions Better than Pretrained Transformers? ACL 2021
One2Set: Generating Diverse Keyphrases as a Set ACL 2021
Recursive Tree-Structured Self-Attention for Answer Sentence Selection ACL 2021
R2D2: Recursive Transformer based on Differentiable Tree for Interpretable Hierarchical Language Modeling ACL 2021
VisualSparta: An Embarrassingly Simple Approach to Large-scale Text-to-Image Search with Weighted Bag-of-words ACL 2021
Syntax-Enhanced Pre-trained Model ACL 2021
Instantaneous Grammatical Error Correction with Shallow Aggressive Decoding ACL 2021
Focus Attention: Promoting Faithfulness and Diversity in Summarization ACL 2021
Metaphor Generation with Conceptual Mappings ACL 2021
Space Efficient Context Encoding for Non-Task-Oriented Dialogue Generation with Graph Attention Transformer ACL 2021
StructFormer: Joint Unsupervised Induction of Dependency and Constituency Structure from Masked Language Modeling ACL 2021
Discriminative Reranking for Neural Machine Translation ACL 2021
The Case for Translation-Invariant Self-Attention in Transformer-Based Language Models ACL 2021
A Span-based Dynamic Local Attention Model for Sequential Sentence Classification ACL 2021
A Semantics-aware Transformer Model of Relation Linking for Knowledge Base Question Answering ACL 2021
Modeling Task-Aware MIMO Cardinality for Efficient Multilingual Neural Machine Translation ACL 2021
On Orthogonality Constraints for Transformers ACL 2021
Exploring Listwise Evidence Reasoning with T5 for Fact Verification ACL 2021
Training Adaptive Computation for Open-Domain Question Answering with Computational Constraints ACL 2021
An Empirical Study on Adversarial Attack on NMT: Languages and Positions Matter ACL 2021
Learning to Generate Task-Specific Adapters from Task Description ACL 2021
A Simple Recipe for Multilingual Grammatical Error Correction ACL 2021
Hi-Transformer: Hierarchical Interactive Transformer for Efficient and Effective Long Document Modeling ACL 2021