Pretraining

The Emergence of Essential Sparsity in Large Pre-trained Models: The Weights that Matter NeurIPS 2023 The MAKE-NMTVIZ System Description for the WMT23 Literary Task EMNLP 2023 The MALACH Corpus: Results with End-to-End Architectures and Pretraining Interspeech 2023 The student becomes the master: Outperforming GPT3 on Scientific Factual Error Correction EMNLP 2023 TinyCLIP: CLIP Distillation via Affinity Mimicking and Weight Inheritance ICCV 2023 TinyMIM: An Empirical Study of Distilling MIM Pre-Trained Models CVPR 2023 TOPLight: Lightweight Neural Networks With Task-Oriented Pretraining for Visible-Infrared Recognition CVPR 2023 Towards a Holistic Understanding of Mathematical Questions with Contrastive Pre-training AAAI 2023 Towards Anytime Fine-tuning: Continually Pre-trained Language Models with Hypernetwork Prompts EMNLP 2023 Towards Artistic Image Aesthetics Assessment: A Large-Scale Dataset and a New Method CVPR 2023 Towards a Unified Theoretical Understanding of Non-contrastive Learning via Rank Differential Mechanism ICLR 2023 Towards Inadequately Pre-trained Models in Transfer Learning ICCV 2023 Towards Parameter-Efficient Integration of Pre-Trained Language Models In Temporal Video Grounding ACL 2023 Towards Understanding Omission in Dialogue Summarization ACL 2023 Towards Universal Fake Image Detectors That Generalize Across Generative Models CVPR 2023 Train Once and Explain Everywhere: Pre-training Interpretable Graph Neural Networks NeurIPS 2023 TRIP: Accelerating Document-level Multilingual Pre-training via Triangular Document-level Pre-training on Parallel Data Triplets EMNLP 2023 TrOCR: Transformer-Based Optical Character Recognition with Pre-trained Models AAAI 2023 TSTR: Target Similarity Tuning Meets the Real World EMNLP 2023 Tuning Pre-trained Model via Moment Probing ICCV 2023 UFAL-ULD at BLP-2023 Task 1: Violence Detection in Bangla Text EMNLP 2023 UL2: Unifying Language Learning Paradigms ICLR 2023 Uncovering Hidden Consequences of Pre-training Objectives in Sequence-to-Sequence Models ACL 2023 Understanding Spoken Language Development of Children with ASD Using Pre-trained Speech Embeddings Interspeech 2023 UniFormerV2: Unlocking the Potential of Image ViTs for Video Understanding ICCV 2023