Transformers

Not all parameters are born equal: Attention is mostly what you need EMNLP 2021 Novel Natural Language Summarization of Program Code via Leveraging Multiple Input Representations EMNLP 2021 NP-DRAW: A Non-Parametric Structured Latent Variable Model for Image Generation UAI 2021 NVIDIA NeMo’s Neural Machine Translation Systems for English-German and English-Russian News and Biomedical Tasks at WMT21 EMNLP 2021 Nyströmformer: A Nyström-based Algorithm for Approximating Self-Attention AAAI 2021 OadTR: Online Action Detection With Transformers ICCV 2021 OCHADAI at SMM4H-2021 Task 5: Classifying self-reporting tweets on potential cases of COVID-19 by ensembling pre-trained language models NAACL 2021 OmniNet: Omnidirectional Representations from Transformers ICML 2021 On Attention Redundancy: A Comprehensive Study NAACL 2021 On Biasing Transformer Attention Towards Monotonicity NAACL 2021 On Classifying whether Two Texts are on the Same Side of an Argument EMNLP 2021 On-Device Streaming Transformer-Based End-to-End Speech Recognition Interspeech 2021 One2Set: Generating Diverse Keyphrases as a Set ACL 2021 On Geodesic Distances and Contextual Embedding Compression for Text Classification NAACL 2021 Online Compressive Transformer for End-to-End Speech Recognition Interspeech 2021 On Orthogonality Constraints for Transformers ACL 2021 On Position Embeddings in BERT ICLR 2021 On Pursuit of Designing Multi-modal Transformer for Video Grounding EMNLP 2021 On Scalar Embedding of Relative Positions in Attention Models AAAI 2021 On the application of Transformers for estimating the difficulty of Multiple-Choice Questions from text EACL 2021 On the cross-lingual transferability of multilingual prototypical models across NLU tasks ACL 2021 On the Effects of Transformer Size on In- and Out-of-Domain Calibration EMNLP 2021 On the Language-specificity of Multilingual BERT and the Impact of Fine-tuning EMNLP 2021 On the Limit of English Conversational Speech Recognition Interspeech 2021 On the logistical difficulties and findings of Jopara Sentiment Analysis NAACL 2021