language model compression

First-Order Error Matters: Accurate Compensation for Quantized Large Language Models AAAI 2026 Beyond Dynamic Quantization: An Efficient Static Hierarchical Mix-precision Framework for Near-Lossless LLM Compression EMNLP 2025 LRQ: Optimizing Post-Training Quantization for Large Language Models by Learning Low-Rank Weight-Scaling Matrices NAACL 2025 On the Generalization vs Fidelity Paradox in Knowledge Distillation ACL 2025 QCRD: Quality-guided Contrastive Rationale Distillation for Large Language Models EMNLP 2025 Towards General-Domain Word Sense Disambiguation: Distilling Large Language Model into Compact Disambiguator EMNLP 2025 Generation, Distillation and Evaluation of Motivational Interviewing-Style Reflections with a Foundational Language Model EACL 2024 GKT: A Novel Guidance-Based Knowledge Transfer Framework For Efficient Cloud-edge Collaboration LLM Deployment ACL 2024 mALBERT: Is a Compact Multilingual BERT Model Still Worth It? COLING 2024 VE-KD: Vocabulary-Expansion Knowledge-Distillation for Training Smaller Domain-Specific Language Models EMNLP 2024 f-Divergence Minimization for Sequence-Level Knowledge Distillation ACL 2023 Less is More: Task-aware Layer-wise Distillation for Language Model Compression ICML 2023 Retrieval-based Knowledge Transfer: An Effective Approach for Extreme Large Language Model Compression EMNLP 2023 From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model Compression AAAI 2022 Multi-Granularity Structural Knowledge Distillation for Language Model Compression ACL 2022 Numerical Optimizations for Weighted Low-rank Estimation on Language Models EMNLP 2022 Prompting to Distill: Boosting Data-Free Knowledge Distillation via Reinforced Prompt IJCAI 2022 Distilling Linguistic Context for Language Model Compression EMNLP 2021 HRKD: Hierarchical Relational Knowledge Distillation for Cross-domain Language Model Compression EMNLP 2021 MATE-KD: Masked Adversarial TExt, a Companion to Knowledge Distillation ACL 2021 Meta-KD: A Meta Knowledge Distillation Framework for Language Model Compression across Domains ACL 2021 Contrastive Distillation on Intermediate Representations for Language Model Compression EMNLP 2020 Distill BERT to Traditional Models in Chinese Machine Reading Comprehension (Student Abstract) AAAI 2020 TextBrewer: An Open-Source Knowledge Distillation Toolkit for Natural Language Processing ACL 2020 TinyBERT: Distilling BERT for Natural Language Understanding EMNLP 2020