conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Distilling Instruction-following Abilities of Large Language Models with Task-aware Curriculum Planning EMNLP 2024
AdaMoE: Token-Adaptive Routing with Null Experts for Mixture-of-Experts Language Models EMNLP 2024
PromptKD: Distilling Student-Friendly Knowledge for Generative Language Models via Prompt Tuning EMNLP 2024
DAdEE: Unsupervised Domain Adaptation in Early Exit PLMs EMNLP 2024
Self-Distillation for Model Stacking Unlocks Cross-Lingual NLU in 200+ Languages EMNLP 2024
Learning from Imperfect Data: Towards Efficient Knowledge Distillation of Autoregressive Language Models for Text-to-SQL EMNLP 2024
Learning to Plan for Retrieval-Augmented Large Language Models from Knowledge Graphs EMNLP 2024
TS-Align: A Teacher-Student Collaborative Framework for Scalable Iterative Finetuning of Large Language Models EMNLP 2024
Fine-tuning Smaller Language Models for Question Answering over Financial Documents EMNLP 2024
LLMs-as-Instructors: Learning from Errors Toward Automating Model Improvement EMNLP 2024
Temperature-Centric Investigation of Speculative Decoding with Knowledge Distillation EMNLP 2024
DLoRA: Distributed Parameter-Efficient Fine-Tuning Solution for Large Language Model EMNLP 2024
“Seeing the Big through the Small”: Can LLMs Approximate Human Judgment Distributions on NLI from a Few Explanations? EMNLP 2024
Capturing Minds, Not Just Words: Enhancing Role-Playing Language Models with Personality-Indicative Data EMNLP 2024
Student Data Paradox and Curious Case of Single Student-Tutor Model: Regressive Side Effects of Training LLMs for Personalized Learning EMNLP 2024
PracticalDG: Perturbation Distillation on Vision-Language Models for Hybrid Domain Generalization CVPR 2024
Orchestrate Latent Expertise: Advancing Online Continual Learning with Multi-Level Supervision and Reverse Self-Distillation CVPR 2024
Distilling Vision-Language Models on Millions of Videos CVPR 2024
Bootstrapping SparseFormers from Vision Foundation Models CVPR 2024
Visual Program Distillation: Distilling Tools and Programmatic Reasoning into Vision-Language Models CVPR 2024
CapsFusion: Rethinking Image-Text Data at Scale CVPR 2024
LoRAExit: Empowering Dynamic Modulation of LLMs in Resource-limited Settings using Low-rank Adapters EMNLP 2024
PLaD: Preference-based Large Language Model Distillation with Pseudo-Preference Pairs ACL 2024
Multimodal Machine Translation for Low-Resource Indic Languages: A Chain-of-Thought Approach Using Large Language Models EMNLP 2024
Hybrid Distillation from RBMT and NMT: Helsinki-NLP’s Submission to the Shared Task on Translation into Low-Resource Languages of Spain EMNLP 2024