Pretraining

“Nothing Abnormal”: Disambiguating Medical Reports via Contrastive Knowledge Infusion AAAI 2023 N-Shot Benchmarking of Whisper on Diverse Arabic Speech Recognition Interspeech 2023 OmniMAE: Single Model Masked Pretraining on Images and Videos CVPR 2023 On Conditional and Compositional Language Model Differentiable Prompting IJCAI 2023 On Efficient Transformer-Based Image Pre-training for Low-Level Vision IJCAI 2023 One-Line-of-Code Data Mollification Improves Optimization of Likelihood-based Generative Models NeurIPS 2023 On Enhancing Fine-Tuning for Pre-trained Language Models EMNLP 2023 On Pre-training Language Model for Antibody ICLR 2023 On “Scientific Debt” in NLP: A Case for More Rigour in Language Model Pre-Training Research ACL 2023 On the Connection between Pre-training Data Diversity and Fine-tuning Robustness NeurIPS 2023 On the Difference of BERT-style and CLIP-style Text Encoders ACL 2023 On the Importance and Applicability of Pre-Training for Federated Learning ICLR 2023 Open-Category Human-Object Interaction Pre-Training via Language Modeling Framework CVPR 2023 OpenMapFlow: A Library for Rapid Map Creation with Machine Learning and Remote Sensing Data AAAI 2023 OpenRT: An Open-source Framework for Reasoning Over Tabular Data ACL 2023 Open Vocabulary Semantic Segmentation With Patch Aligned Contrastive Learning CVPR 2023 OPERA: Omni-Supervised Representation Learning with Hierarchical Supervisions ICCV 2023 Paparazzi: A Deep Dive into the Capabilities of Language and Vision Models for Grounding Viewpoint Descriptions EACL 2023 Parameter-Efficient Cross-lingual Transfer of Vision and Language Models via Translation-based Alignment EMNLP 2023 Parameter-Efficient Prompt Tuning Makes Generalized and Calibrated Neural Text Retrievers EMNLP 2023 Patton: Language Model Pretraining on Text-Rich Networks ACL 2023 PeCo: Perceptual Codebook for BERT Pre-training of Vision Transformers AAAI 2023 Peeling the Onion: Hierarchical Reduction of Data Redundancy for Efficient Vision Transformer Training AAAI 2023 PEER: Pre-training ELECTRA Extended by Ranking ACL 2023 Personality-aware Training based Speaker Adaptation for End-to-end Speech Recognition Interspeech 2023