knowledge distillation

BabyLM Challenge: Experimenting with Self-Distillation and Reverse-Distillation for Language Model Pre-Training on Constrained Datasets CoNLL 2024 Bad Actor, Good Advisor: Exploring the Role of Large Language Models in Fake News Detection AAAI 2024 BAM! Just Like That: Simple and Efficient Parameter Upcycling for Mixture of Experts NeurIPS 2024 Bayes Conditional Distribution Estimation for Knowledge Distillation Based on Conditional Mutual Information ICLR 2024 Bellman Optimal Stepsize Straightening of Flow-Matching Models ICLR 2024 Benchmarking Diffusion Models for Machine Translation EACL 2024 Beyond Dirichlet-based Models: When Bayesian Neural Networks Meet Evidential Deep Learning UAI 2024 Beyond Full Fine-tuning: Harnessing the Power of LoRA for Multi-Task Instruction Tuning COLING 2024 BiDM: Pushing the Limit of Quantization for Diffusion Models NeurIPS 2024 BioT5+: Towards Generalized Biological Understanding with IUPAC Integration and Multi-task Tuning ACL 2024 BitDistiller: Unleashing the Potential of Sub-4-Bit LLMs via Self-Distillation ACL 2024 BitsFusion: 1.99 bits Weight Quantization of Diffusion Model NeurIPS 2024 Bi-ViT: Pushing the Limit of Vision Transformer Quantization AAAI 2024 BMRetriever: Tuning Large Language Models as Better Biomedical Text Retrievers EMNLP 2024 BOLD: Boolean Logic Deep Learning NeurIPS 2024 BoNBoN Alignment for Large Language Models and the Sweetness of Best-of-n Sampling NeurIPS 2024 Boosting Image Restoration via Priors from Pre-trained Models CVPR 2024 Boosting Residual Networks with Group Knowledge AAAI 2024 Boosting Scientific Concepts Understanding: Can Analogy from Teacher Models Empower Student Models? EMNLP 2024 Boosting Self-Supervision for Single-View Scene Completion via Knowledge Distillation CVPR 2024 Boosting Vision-Language Models with Transduction NeurIPS 2024 Bootstrapping Chest CT Image Understanding by Distilling Knowledge from X-ray Expert Models CVPR 2024 Bootstrapping Cognitive Agents with a Large Language Model AAAI 2024 Bootstrapping SparseFormers from Vision Foundation Models CVPR 2024 BPKD: Boundary Privileged Knowledge Distillation for Semantic Segmentation WACV 2024