Transformers

Sparsity and Sentence Structure in Encoder-Decoder Attention of Summarization Systems EMNLP 2021 Spatial-Temporal Transformer for Dynamic Scene Graph Generation ICCV 2021 Speech Emotion Recognition Based on Attention Weight Correction Using Word-Level Confidence Measure Interspeech 2021 Speech Emotion Recognition with Multi-Task Learning Interspeech 2021 Speechformer: Reducing Information Loss in Direct Speech Translation EMNLP 2021 SpeechMoE: Scaling to Large Acoustic Models with Dynamic Routing Mixture of Experts Interspeech 2021 Speeding Up Transformer Training By Using Dataset Subsampling - An Exploratory Analysis EMNLP 2021 SPGISpeech: 5,000 Hours of Transcribed Financial Audio for Fully Formatted End-to-End Speech Recognition Interspeech 2021 SpreadsheetCoder: Formula Prediction from Semi-structured Context ICML 2021 SRI-B End-to-End System for Multilingual and Code-Switching ASR Challenges for Low Resource Indian Languages Interspeech 2021 SSAN: Separable Self-Attention Network for Video Representation Learning CVPR 2021 SSTVOS: Sparse Spatiotemporal Transformers for Video Object Segmentation CVPR 2021 Stable, Fast and Accurate: Kernelized Attention with Relative Positional Encoding NeurIPS 2021 STANKER: Stacking Network based on Level-grained Attention-masked BERT for Rumor Detection on Social Media EMNLP 2021 STAR: A Structure-Aware Lightweight Transformer for Real-Time Image Enhancement ICCV 2021 Stochastic Attention Head Removal: A Simple and Effective Method for Improving Transformer Based ASR Models Interspeech 2021 Stochastic Transformer Networks With Linear Competing Units: Application To End-to-End SL Translation ICCV 2021 Streaming End-to-End ASR Based on Blockwise Non-Autoregressive Models Interspeech 2021 Streaming Transformer for Hardware Efficient Voice Trigger Detection and False Trigger Mitigation Interspeech 2021 Stretch-VST: Getting Flexible With Visual Stories ACL 2021 StructFormer: Joint Unsupervised Induction of Dependency and Constituency Structure from Masked Language Modeling ACL 2021 Structural Adapters in Pretrained Language Models for AMR-to-Text Generation EMNLP 2021 Structural Encoding and Pre-training Matter: Adapting BERT for Table-Based Fact Verification EACL 2021 Structural Guidance for Transformer Language Models ACL 2021 Structure-aware Fine-tuning of Sequence-to-sequence Transformers for Transition-based AMR Parsing EMNLP 2021