knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

BLADE: Enhancing Black-Box Large Language Models with Small Domain-Specific Models AAAI 2025

CoTD-PO: Chain-of-Thought Distillation with Preference Optimization EMNLP 2025

Model-based Large Language Model Customization as Service EMNLP 2025

Improving Reasoning Capabilities in Small Models through Mixture-of-layers Distillation with Stepwise Attention on Key Information EMNLP 2025

EMO: Embedding Model Distillation via Intra-Model Relation and Optimal Transport Alignments EMNLP 2025

UnCo: Uncertainty-Driven Collaborative Framework of Large and Small Models for Grounded Multimodal NER EMNLP 2025

ToDi: Token-wise Distillation via Fine-Grained Divergence Control EMNLP 2025

Judging Quality Across Languages: A Multilingual Approach to Pretraining Data Filtering with Language Models EMNLP 2025

LATTE: Learning to Think with Vision Specialists EMNLP 2025

Agentic-R1: Distilled Dual-Strategy Reasoning EMNLP 2025

Skip-Thinking: Chunk-wise Chain-of-Thought Distillation Enable Smaller Language Models to Reason Better and Faster EMNLP 2025

QCRD: Quality-guided Contrastive Rationale Distillation for Large Language Models EMNLP 2025

Logits-Based Finetuning EMNLP 2025

PPC-GPT: Federated Task-Specific Compression of Large Language Models via Pruning and Chain-of-Thought Distillation EMNLP 2025

RECALL: REpresentation-aligned Catastrophic-forgetting ALLeviation via Hierarchical Model Merging EMNLP 2025

Membership and Memorization in LLM Knowledge Distillation EMNLP 2025

AcT2I: Evaluating and Improving Action Depiction in Text-to-Image Models EMNLP 2025

Comprehensive and Efficient Distillation for Lightweight Sentiment Analysis Models EMNLP 2025

Balcony: A Lightweight Approach to Dynamic Inference of Generative Language Models EMNLP 2025

HypER: Literature-grounded Hypothesis Generation and Distillation with Provenance EMNLP 2025

FISTAPruner: Layer-wise Post-training Pruning for Large Language Models EMNLP 2025

StepER: Step-wise Knowledge Distillation for Enhancing Reasoning Ability in Multi-Step Retrieval-Augmented Language Models EMNLP 2025

Structured Moral Reasoning in Language Models: A Value-Grounded Evaluation Framework EMNLP 2025

When Big Models Train Small Ones: Label-Free Model Parity Alignment for Efficient Visual Question Answering using Small VLMs EMNLP 2025

PAP2PAT: Benchmarking Outline-Guided Long-Text Patent Generation with Patent-Paper Pairs ACL 2025