← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Understanding the Gains from Repeated Self-Distillation NIPS 2024
Mod-Squad: Designing Mixtures of Experts As Modular Multi-Task Learners CVPR 2023
Merging Generated and Retrieved Knowledge for Open-Domain QA EMNLP 2023
LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models EMNLP 2023
PromptMix: A Class Boundary Augmentation Method for Large Language Model Distillation EMNLP 2023
Dialogue Chain-of-Thought Distillation for Commonsense-aware Conversational Agents EMNLP 2023
Personalized Distillation: Empowering Open-Sourced LLMs with Adaptive Learning for Code Generation EMNLP 2023
FedID: Federated Interactive Distillation for Large-Scale Pretraining Language Models EMNLP 2023
CRaSh: Clustering, Removing, and Sharing Enhance Fine-tuning without Full Large Language Model EMNLP 2023
UDAPDR: Unsupervised Domain Adaptation via LLM Prompting and Distillation of Rerankers EMNLP 2023
Select, Prompt, Filter: Distilling Large Language Models for Summarizing Conversations EMNLP 2023
Multi-Task Knowledge Distillation with Embedding Constraints for Scholarly Keyphrase Boundary Classification EMNLP 2023
Text Representation Distillation via Information Bottleneck Principle EMNLP 2023
Let GPT be a Math Tutor: Teaching Math Word Problem Solvers with Customized Exercise Generation EMNLP 2023
FreeAL: Towards Human-Free Active Learning in the Era of Large Language Models EMNLP 2023
Is ChatGPT Good at Search? Investigating Large Language Models as Re-Ranking Agents EMNLP 2023
Exploring the Impact of Model Scaling on Parameter-Efficient Tuning EMNLP 2023
H2O Open Ecosystem for State-of-the-art Large Language Models EMNLP 2023
Adapters: A Unified Library for Parameter-Efficient and Modular Transfer Learning EMNLP 2023
A Comparative Analysis of Task-Agnostic Distillation Methods for Compressing Transformer Language Models EMNLP 2023
Multi-teacher Distillation for Multilingual Spelling Correction EMNLP 2023
Adapter-TST: A Parameter Efficient Method for Multiple-Attribute Text Style Transfer EMNLP 2023
NovaCOMET: Open Commonsense Foundation Models with Symbolic Knowledge Distillation EMNLP 2023
Cometoid: Distilling Strong Reference-based Machine Translation Metrics into Even Stronger Quality Estimation Metrics EMNLP 2023
Collaborative Generative AI: Integrating GPT-k for Efficient Editing in Text-to-Image Generation EMNLP 2023