Knowledge Distillation

Accurate Knowledge Distillation via n-best Reranking NAACL 2024 Accurate Retraining-free Pruning for Pretrained Encoder-based Language Models ICLR 2024 A Closer Look at Claim Decomposition NAACL 2024 Active Object Detection with Knowledge Aggregation and Distillation from Large Models CVPR 2024 ADAM: Dense Retrieval Distillation with Adaptive Dark Examples ACL 2024 Adapters Mixup: Mixing Parameter-Efficient Adapters to Enhance the Adversarial Robustness of Fine-tuned Pre-trained Text Classifiers EMNLP 2024 Adapt Your Teacher: Improving Knowledge Distillation for Exemplar-Free Continual Learning WACV 2024 A Deep Dive into the Trade-Offs of Parameter-Efficient Preference Alignment Techniques ACL 2024 Advancing Large Language Model Attribution through Self-Improving EMNLP 2024 Adversarial Distillation Based on Slack Matching and Attribution Region Alignment CVPR 2024 Adversarial Moment-Matching Distillation of Large Language Models NeurIPS 2024 A Dynamic GCN with Cross-Representation Distillation for Event-Based Learning AAAI 2024 A Good Learner can Teach Better: Teacher-Student Collaborative Knowledge Distillation ICLR 2024 AIST AIRC Systems for the WMT 2024 Shared Tasks EMNLP 2024 A Kernel Perspective on Distillation-based Collaborative Learning NeurIPS 2024 Aligning Large Language Models by On-Policy Self-Judgment ACL 2024 Aligning Logits Generatively for Principled Black-Box Knowledge Distillation CVPR 2024 Align-to-Distill: Trainable Attention Alignment for Knowledge Distillation in Neural Machine Translation COLING 2024 All-in-One Image Coding for Joint Human-Machine Vision with Multi-Path Aggregation NeurIPS 2024 Amalgamating Multi-Task Models with Heterogeneous Architectures AAAI 2024 AM-RADIO: Agglomerative Vision Foundation Model Reduce All Domains Into One CVPR 2024 AMR-Evol: Adaptive Modular Response Evolution Elicits Better Knowledge Distillation for Large Language Models in Code Generation EMNLP 2024 An Empirical Study of Multilingual Reasoning Distillation for Question Answering EMNLP 2024 An Emulator for Fine-tuning Large Language Models using Small Language Models ICLR 2024 An Image-enhanced Molecular Graph Representation Learning Framework IJCAI 2024