← Architectures
Deep Learning › Architectures ›

Transformers

9294 directly classified papers

Papers per year

Papers

On Layer Normalization in the Transformer Architecture ICML 2020
Sparse Sinkhorn Attention ICML 2020
Improving Transformer Optimization Through Better Initialization ICML 2020
Low-Rank Bottleneck in Multi-head Attention Models ICML 2020
UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training ICML 2020
PowerNorm: Rethinking Batch Normalization in Transformers ICML 2020
Encoding Musical Style with Transformer Autoencoders ICML 2020
Infinite attention: NNGP and NTK for deep attention networks ICML 2020
Attention Forcing for Speech Synthesis INTERSPEECH 2020
MultiSpeech: Multi-Speaker Text to Speech with Transformer INTERSPEECH 2020
Do End-to-End Speech Recognition Models Care About Context? INTERSPEECH 2020
Content Word Aware Neural Machine Translation ACL 2020
Learning Source Phrase Representations for Neural Machine Translation ACL 2020
Rigid Formats Controlled Text Generation ACL 2020
Character-Level Translation with Self-attention ACL 2020
Enhancing Machine Translation with Dependency-Aware Self-Attention ACL 2020
TMT: A Transformer-Based Modal Translator for Improving Multimodal Sequence Representations in Audio Visual Scene-Aware Dialog INTERSPEECH 2020
Speech-XLNet: Unsupervised Acoustic Model Pretraining for Self-Attention Networks INTERSPEECH 2020
SpeechBERT: An Audio-and-Text Jointly Learned Language Model for End-to-End Spoken Question Answering INTERSPEECH 2020
Cross Attention with Monotonic Alignment for Speech Transformer INTERSPEECH 2020
Self-Attention with Cross-Lingual Position Representation ACL 2020
SPECTER: Document-level Representation Learning using Citation-informed Transformers ACL 2020
schuBERT: Optimizing Elements of BERT ACL 2020
How Does Selective Mechanism Improve Self-Attention Networks? ACL 2020
Improving Transformer Models by Reordering their Sublayers ACL 2020