Transformers

RoR: Read-over-Read for Long Document Machine Reading Comprehension EMNLP 2021 ROSITA: Refined BERT cOmpreSsion with InTegrAted techniques AAAI 2021 RSTNet: Captioning With Adaptive Attention on Visual and Non-Visual Words CVPR 2021 Sarcasm and Sentiment Detection in Arabic language A Hybrid Approach Combining Embeddings and Rule-based Features EACL 2021 SarcasmDet at Sarcasm Detection Task 2021 in Arabic using AraBERT Pretrained Model EACL 2021 Saying No is An Art: Contextualized Fallback Responses for Unanswerable Dialogue Queries ACL 2021 Scalable Normalizing Flows for Permutation Invariant Densities ICML 2021 Scalable Vision Transformers With Hierarchical Pooling ICCV 2021 Scale-Localized Abstract Reasoning CVPR 2021 Scaling Local Self-Attention for Parameter Efficient Visual Backbones CVPR 2021 Scaling Sparsemax Based Channel Selection for Speech Recognition with ad-hoc Microphone Arrays Interspeech 2021 Scaling Vision with Sparse Mixture of Experts NeurIPS 2021 Scatterbrain: Unifying Sparse and Low-rank Attention NeurIPS 2021 Scene Text Telescope: Text-Focused Scene Image Super-Resolution CVPR 2021 SCOUTER: Slot Attention-Based Classifier for Explainable Image Recognition ICCV 2021 SCRIPT: Self-Critic PreTraining of Transformers NAACL 2021 Searching for Efficient Transformers for Language Modeling NeurIPS 2021 Searching the Search Space of Vision Transformer NeurIPS 2021 SE-Conformer: Time-Domain Speech Enhancement Using Conformer Interspeech 2021 Seeing Out of the Box: End-to-End Pre-Training for Vision-Language Representation Learning CVPR 2021 Segatron: Segment-Aware Transformer for Language Modeling and Understanding AAAI 2021 SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers NeurIPS 2021 Segmenter: Transformer for Semantic Segmentation ICCV 2021 Segmenting Transparent Objects in the Wild with Transformer IJCAI 2021 Select, Extract and Generate: Neural Keyphrase Generation with Layer-wise Coverage Attention ACL 2021