Pretraining

Mitigating Toxic Degeneration with Empathetic Data: Exploring the Relationship Between Toxicity and Empathy NAACL 2022 Mixed-modality Representation Learning and Pre-training for Joint Table-and-Text Retrieval in OpenQA EMNLP 2022 Mixed-Phoneme BERT: Improving BERT with Mixed Phoneme and Sup-Phoneme Representations for Text to Speech Interspeech 2022 Modular and Parameter-Efficient Multimodal Fusion with Prompting ACL 2022 Momentum Contrastive Pre-training for Question Answering EMNLP 2022 MonoByte: A Pool of Monolingual Byte-level Language Models COLING 2022 Multi-Lingual Acquisition on Multimodal Pre-training for Cross-modal Retrieval NeurIPS 2022 Multilinguals at SemEval-2022 Task 11: Complex NER in Semantically Ambiguous Settings for Low Resource Languages SemEval 2022 MWP-BERT: Numeracy-Augmented Pre-training for Math Word Problem Solving NAACL 2022 Natural Language to Code Translation with Execution EMNLP 2022 NCUEE-NLP@SMM4H’22: Classification of Self-reported Chronic Stress on Twitter Using Ensemble Pre-trained Transformer Models COLING 2022 NODE-GAM: Neural Generalized Additive Model for Interpretable Deep Learning ICLR 2022 ObjectFormer for Image Manipulation Detection and Localization CVPR 2022 OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework ICML 2022 OmniTab: Pretraining with Natural and Synthetic Data for Few-shot Table-based Question Answering NAACL 2022 One size does not fit all: Investigating strategies for differentially-private learning across NLP tasks EMNLP 2022 On Masked Language Models for Contextual Link Prediction ACL 2022 On the Role of Pre-trained Language Models in Word Ordering: A Case Study with BART COLING 2022 On the Use of Bert for Automated Essay Scoring: Joint Learning of Multi-Scale Essay Representation NAACL 2022 OpenPrompt: An Open-source Framework for Prompt-learning ACL 2022 P2P: Tuning Pre-trained Image Models for Point Cloud Analysis with Point-to-Pixel Prompting NeurIPS 2022 Parameter-Efficient Tuning Makes a Good Classification Head EMNLP 2022 PASTA: Table-Operations Aware Fact Verification via Sentence-Table Cloze Pre-training EMNLP 2022 Patch-Level Representation Learning for Self-Supervised Vision Transformers CVPR 2022 PEVL: Position-enhanced Pre-training and Prompt Tuning for Vision-language Models EMNLP 2022