← Keywords

model compression

3283 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3680) large language model (12755) neural network (6616) efficient computing (779) neural network optimization (1293) transfer learning (5442) convolutional neural network (4216) neural network pruning (265) language model (4573) parameter efficiency (415)

Papers

Memory-Efficient LLM Training with Online Subspace Descent NIPS 2024
FM-Delta: Lossless Compression for Storing Massive Fine-tuned Foundation Models NIPS 2024
SeTAR: Out-of-Distribution Detection with Selective Low-Rank Approximation NIPS 2024
SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention NIPS 2024
CoMERA: Computing- and Memory-Efficient Training via Rank-Adaptive Tensor Optimization NIPS 2024
Understanding and Minimising Outlier Features in Transformer Training NIPS 2024
Parameter Competition Balancing for Model Merging NIPS 2024
Provable and Efficient Dataset Distillation for Kernel Ridge Regression NIPS 2024
Low Precision Local Training is Enough for Federated Learning NIPS 2024
Stepping Forward on the Last Mile NIPS 2024
Agile-Quant: Activation-Guided Quantization for Faster Inference of LLMs on the Edge AAAI 2024
Exploring Post-training Quantization in LLMs from Comprehensive Study to Low Rank Compensation AAAI 2024
MERGE: Fast Private Text Generation AAAI 2024
Impartial Adversarial Distillation: Addressing Biased Data-Free Knowledge Distillation via Adaptive Constrained Optimization AAAI 2024
Understanding the Role of the Projector in Knowledge Distillation AAAI 2024
What Makes Quantization for Large Language Model Hard? An Empirical Study from the Lens of Perturbation AAAI 2024
Effective Data Distillation for Tabular Datasets (Student Abstract) AAAI 2024
DoRA: Enhancing Parameter-Efficient Fine-Tuning with Dynamic Rank Distribution ACL 2024
Smaller Language Models are capable of selecting Instruction-Tuning Training Data for Larger Language Models ACL 2024
PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM Inference ACL 2024
Light-PEFT: Lightening Parameter-Efficient Fine-Tuning via Early Pruning ACL 2024
DistillMIKE: Editing Distillation of Massive In-Context Knowledge Editing in Large Language Models ACL 2024
Unlocking Efficiency in Large Language Model Inference: A Comprehensive Survey of Speculative Decoding ACL 2024
IntactKV: Improving Large Language Model Quantization by Keeping Pivot Tokens Intact ACL 2024
Critical Learning Periods: Leveraging Early Training Dynamics for Efficient Data Pruning ACL 2024