← Keywords

model compression

3283 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3680) large language model (12755) neural network (6616) efficient computing (779) neural network optimization (1293) transfer learning (5442) convolutional neural network (4216) neural network pruning (265) language model (4573) parameter efficiency (415)

Papers

Staged Knowledge Distillation Through Least-to-Most Prompting: Optimizing Teacher Guidance via Difficulty-Aware Training EMNLP 2025
Align Attention Heads Before Merging Them: An Effective Way for Converting MHA to GQA EMNLP 2025
What Makes a Good Dataset for Knowledge Distillation? CVPR 2025
FlexGS: Train Once, Deploy Everywhere with Many-in-One Flexible 3D Gaussian Splatting CVPR 2025
WAVE: Weight Templates for Adaptive Initialization of Variable-sized Models CVPR 2025
FractalLLM: Lossless Self-Speculative Decoding with Layer Embedded Self-Compression EMNLP 2025
Text Embedding Knows How to Quantize Text-Guided Diffusion Models ICCV 2025
EfficientQAT: Efficient Quantization-Aware Training for Large Language Models ACL 2025
Thinking with DistilQwen: A Tale of Four Distilled Reasoning and Reward Model Series EMNLP 2025
QSpec: Speculative Decoding with Complementary Quantization Schemes EMNLP 2025
DRAMA: Diverse Augmentation from Large Language Models to Smaller Dense Retrievers ACL 2025
FREE: Fast and Robust Vision Language Models with Early Exits ACL 2025
Large Language Models Are Overparameterized Text Encoders NAACL 2025
On Explaining Knowledge Distillation: Measuring and Visualising the Knowledge Transfer Process WACV 2025
As easy as PIE: understanding when pruning causes language models to disagree NAACL 2025
RankAdaptor: Hierarchical Rank Allocation for Efficient Fine-Tuning Pruned LLMs via Performance Model NAACL 2025
MT2ST: Adaptive Multi-Task to Single-Task Learning ACL 2025
Revisiting Disparity from Dual-Pixel Images: Physics-Informed Lightweight Depth Estimation WACV 2025
Efficient Speech Translation through Model Compression and Knowledge Distillation ACL 2025
How Much Knowledge Can You Pack into a LoRA Adapter without Harming LLM? NAACL 2025
DadmaTools V2: an Adapter-Based Natural Language Processing Toolkit for the Persian Language COLING 2025
QPruner: Probabilistic Decision Quantization for Structured Pruning in Large Language Models NAACL 2025
SWITCH: Studying with Teacher for Knowledge Distillation of Large Language Models NAACL 2025
Towards compact and efficient Slovak summarization models ACL 2025
Pretraining Context Compressor for Large Language Models with Embedding-Based Memory ACL 2025