← Application Areas
Machine Learning › Application Areas ›

Model Compression

1503 directly classified papers

Papers per year

Papers

Pit One Against Many: Leveraging Attention-head Embeddings for Parameter-efficient Multi-head Attention EMNLP 2023
Variator: Accelerating Pre-trained Models with Plug-and-Play Compression Modules EMNLP 2023
Mixture-of-Linguistic-Experts Adapters for Improving and Interpreting Pre-trained Language Models EMNLP 2023
Dynamic Low-rank Estimation for Transformer-based Language Models EMNLP 2023
Democratizing LLMs: An Exploration of Cost-Performance Trade-offs in Self-Refined Open-Source Models EMNLP 2023
Parameter Efficient Multi-task Fine-tuning by Learning to Transfer Token-wise Prompts EMNLP 2023
Small Pre-trained Language Models Can be Fine-tuned as Large Models via Over-Parameterization ACL 2023
Parameter-Efficient Fine-Tuning without Introducing New Latency ACL 2023
Lifting the Curse of Capacity Gap in Distilling Language Models ACL 2023
Mixture-of-Domain-Adapters: Decoupling and Injecting Domain Knowledge to Pre-trained Language Models’ Memories ACL 2023
Matching Pairs: Attributing Fine-Tuned Models to their Pre-Trained Large Language Models ACL 2023
DSEE: Dually Sparsity-embedded Efficient Tuning of Pre-trained Language Models ACL 2023
AD-KD: Attribution-Driven Knowledge Distillation for Language Model Compression ACL 2023
GreenKGC: A Lightweight Knowledge Graph Completion Method ACL 2023
f-Divergence Minimization for Sequence-Level Knowledge Distillation ACL 2023
Bridging the Gap between Decision and Logits in Decision-based Knowledge Distillation for Pre-trained Language Models ACL 2023
A Systematic Study of Knowledge Distillation for Natural Language Generation with Pseudo-Target Training ACL 2023
NarrowBERT: Accelerating Masked Language Model Pretraining and Inference ACL 2023
Cost-effective Distillation of Large Language Models ACL 2023
Neural Architecture Search for Parameter-Efficient Fine-tuning of Large Pre-trained Language Models ACL 2023
Retrieval-based Knowledge Transfer: An Effective Approach for Extreme Large Language Model Compression EMNLP 2023
Co-training and Co-distillation for Quality Improvement and Compression of Language Models EMNLP 2023
NASH: A Simple Unified Framework of Structured Pruning for Accelerating Encoder-Decoder Language Models EMNLP 2023
Black-Box Tuning of Vision-Language Models with Effective Gradient Approximation EMNLP 2023
The Cost of Compression: Investigating the Impact of Compression on Parametric Knowledge in Language Models EMNLP 2023