← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

A Toolbox for Modelling Engagement with Educational Videos AAAI 2024
A Unified Self-Distillation Framework for Multimodal Sentiment Analysis with Uncertain Missing Modalities AAAI 2024
Incremental pre-training from smaller language models ACL 2024
Multistage Collaborative Knowledge Distillation from a Large Language Model for Semi-Supervised Sequence Generation ACL 2024
Privileged Prior Information Distillation for Image Matting AAAI 2024
Small But Funny: A Feedback-Driven Approach to Humor Distillation ACL 2024
D2LLM: Decomposed and Distilled Large Language Models for Semantic Search ACL 2024
No Head Left Behind – Multi-Head Alignment Distillation for Transformers AAAI 2024
Benchmarking Diffusion Models for Machine Translation EACL 2024
Cooperative Knowledge Distillation: A Learner Agnostic Approach AAAI 2024
MTA4DPR: Multi-Teaching-Assistants Based Iterative Knowledge Distillation for Dense Passage Retrieval EMNLP 2024
Out of Thin Air: Exploring Data-Free Adversarial Robustness Distillation AAAI 2024
AIST AIRC Systems for the WMT 2024 Shared Tasks EMNLP 2024
Self-Distillation Regularized Connectionist Temporal Classification Loss for Text Recognition: A Simple Yet Effective Approach AAAI 2024
Let All Be Whitened: Multi-Teacher Distillation for Efficient Visual Retrieval AAAI 2024
ICLEF: In-Context Learning with Expert Feedback for Explainable Style Transfer ACL 2024
EnOF-SNN: Training Accurate Spiking Neural Networks via Enhancing the Output Feature NIPS 2024
Improving Personalized Sentiment Representation with Knowledge-enhanced and Parameter-efficient Layer Normalization COLING 2024
Is Modularity Transferable? A Case Study through the Lens of Knowledge Distillation COLING 2024
Impartial Adversarial Distillation: Addressing Biased Data-Free Knowledge Distillation via Adaptive Constrained Optimization AAAI 2024
Minimal Distillation Schedule for Extreme Language Model Compression EACL 2024
LLMR: Knowledge Distillation with a Large Language Model-Induced Reward COLING 2024
Mixture-of-LoRAs: An Efficient Multitask Tuning Method for Large Language Models COLING 2024
MoDE-CoTD: Chain-of-Thought Distillation for Complex Reasoning Tasks with Mixture of Decoupled LoRA-Experts COLING 2024
Shared-Adapters: A Novel Transformer-based Parameter Efficient Transfer Learning Approach For Children’s Automatic Speech Recognition INTERSPEECH 2024