Pretraining

Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning? ICLR 2023 Automated De-Identification of Arabic Medical Records EMNLP 2023 Automatic Evaluation of Generative Models with Instruction Tuning EMNLP 2023 Automatic Pronunciation Assessment - A Review EMNLP 2023 Automatic Table Union Search with Tabular Representation Learning ACL 2023 Automatic Transcription of Handwritten Old Occitan Language EMNLP 2023 A View From Somewhere: Human-Centric Face Representations ICLR 2023 Battle of the Backbones: A Large-Scale Comparison of Pretrained Models across Computer Vision Tasks NeurIPS 2023 BEATs: Audio Pre-Training with Acoustic Tokenizers ICML 2023 Benchmarking Self-Supervised Learning on Diverse Pathology Datasets CVPR 2023 Beneath the Surface: Unveiling Harmful Memes with Multimodal Reasoning Distilled from Large Language Models EMNLP 2023 BERTastic at SemEval-2023 Task 3: Fine-Tuning Pretrained Multilingual Transformers Does Order Matter? SemEval 2023 BEST: BERT Pre-training for Sign Language Recognition with Coupling Tokenization AAAI 2023 Better Pre-Training by Reducing Representation Confusion EACL 2023 Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning ACL 2023 BGL: GPU-Efficient GNN Training by Optimizing Graph Data I/O and Preprocessing NSDI 2023 Biomedical Language Models are Robust to Sub-optimal Tokenization ACL 2023 BIOptimus: Pre-training an Optimal Biomedical Language Model with Curriculum Learning for Named Entity Recognition ACL 2023 BioT5: Enriching Cross-modal Integration in Biology with Chemical Knowledge and Natural Language Associations EMNLP 2023 Black-Box Tuning of Vision-Language Models with Effective Gradient Approximation EMNLP 2023 Blessing of Class Diversity in Pre-training AISTATS 2023 BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editing NeurIPS 2023 BLOOM+1: Adding Language Support to BLOOM for Zero-Shot Prompting ACL 2023 Boosting Low-Data Instance Segmentation by Unsupervised Pre-Training With Saliency Prompt CVPR 2023 Bootstrapping Small & High Performance Language Models with Unmasking-Removal Training Policy EMNLP 2023