Pretraining

Fully Few-shot Class-incremental Audio Classification Using Expandable Dual-embedding Extractor Interspeech 2024 G2D: From Global to Dense Radiography Representation Learning via Vision-Language Pre-training NeurIPS 2024 Gender and Language Identification in Multilingual Models of Speech: Exploring the Genericity and Robustness of Speech Representations Interspeech 2024 Get rich quick: exact solutions reveal how unbalanced initializations promote rapid feature learning NeurIPS 2024 Getting the most out of your tokenizer for pre-training and domain adaptation ICML 2024 GLID: Pre-training a Generalist Encoder-Decoder Vision Model CVPR 2024 Global and Local Hierarchical Prompt Tuning Framework for Multi-level Implicit Discourse Relation Recognition COLING 2024 Gradient-based Parameter Selection for Efficient Fine-Tuning CVPR 2024 Gradients of Functions of Large Matrices NeurIPS 2024 Gradual Optimization Learning for Conformational Energy Minimization ICLR 2024 GraSAME: Injecting Token-Level Structural Information to Pretrained Language Models via Graph-guided Self-Attention Mechanism NAACL 2024 GTSinger: A Global Multi-Technique Singing Corpus with Realistic Music Scores for All Singing Tasks NeurIPS 2024 GV-Rep: A Large-Scale Dataset for Genetic Variant Representation Learning NeurIPS 2024 HAMiSoN-Ensemble at ClimateActivism 2024: Ensemble of RoBERTa, Llama 2, and Multi-task for Stance Detection EACL 2024 Harnessing small projectors and multiple views for efficient vision pretraining NeurIPS 2024 HEST-1k: A Dataset For Spatial Transcriptomics and Histology Image Analysis NeurIPS 2024 HGPrompt: Bridging Homogeneous and Heterogeneous Graphs for Few-Shot Prompt Learning AAAI 2024 Historical Test-time Prompt Tuning for Vision Foundation Models NeurIPS 2024 How Much Context Does My Attention-Based ASR System Need? Interspeech 2024 How to Trade Off the Quantity and Capacity of Teacher Ensemble: Learning Categorical Distribution to Stochastically Employ a Teacher for Distillation AAAI 2024 How Well Do Supervised 3D Models Transfer to Medical Imaging Tasks? ICLR 2024 HumVI: A Multilingual Dataset for Detecting Violent Incidents Impacting Humanitarian Aid EMNLP 2024 HybridBERT - Making BERT Pretraining More Efficient Through Hybrid Mixture of Attention Mechanisms NAACL 2024 HyperBERT: Mixing Hypergraph-Aware Layers with Language Models for Node Classification on Text-Attributed Hypergraphs EMNLP 2024 i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data NAACL 2024