Pretraining

Few-Shot Learning of an Interleaved Text Summarization Model by Pretraining with Synthetic Data EACL 2021 Few-Shot Question Answering by Pretraining Span Selection ACL 2021 FII FUNNY at SemEval-2021 Task 7: HaHackathon: Detecting and rating Humor and Offense SemEval 2021 Filling the Gaps in Ancient Akkadian Texts: A Masked Language Modelling Approach EMNLP 2021 Forty Years of Speech and Language Processing: From Bayes Decision Rule to Deep Learning Interspeech 2021 Fused Acoustic and Text Encoding for Multimodal Bilingual Pretraining and Speech Translation ICML 2021 GAIA: A Transfer Learning System of Object Detection That Fits Your Needs CVPR 2021 Generalization in data-driven models of primary visual cortex ICLR 2021 Glyph Enhanced Chinese Character Pre-Training for Lexical Sememe Prediction EMNLP 2021 Graph-Based Asynchronous Event Processing for Rapid Object Recognition ICCV 2021 GraphCodeBERT: Pre-training Code Representations with Data Flow ICLR 2021 GraPPa: Grammar-Augmented Pre-Training for Table Semantic Parsing ICLR 2021 GTA: Graph Truncated Attention for Retrosynthesis AAAI 2021 GX at SemEval-2021 Task 2: BERT with Lemma Information for MCL-WiC Task SemEval 2021 Hate Speech Detection Based on Sentiment Knowledge Sharing ACL 2021 HMM-Free Encoder Pre-Training for Streaming RNN Transducer Interspeech 2021 How could Neural Networks understand Programs? ICML 2021 How much pretraining data do language models need to learn syntax? EMNLP 2021 IIITH at SemEval-2021 Task 7: Leveraging transformer-based humourous and offensive text detection architectures using lexical and hurtlex features and task adaptive pretraining SemEval 2021 Implicit Premise Generation with Discourse-aware Commonsense Knowledge Models EMNLP 2021 Improving Abstractive Dialogue Summarization with Hierarchical Pretraining and Topic Segment EMNLP 2021 Improving Math Word Problems with Pre-trained Knowledge and Hierarchical Reasoning EMNLP 2021 Improving Neural Machine Translation by Bidirectional Training EMNLP 2021 Improving Neural RST Parsing Model with Silver Agreement Subtrees NAACL 2021 Improving Perceptual Quality by Phone-Fortified Perceptual Loss Using Wasserstein Distance for Speech Enhancement Interspeech 2021