model compression

3283 papers

Explore in graph

Also known as

MC

Co-occurring keywords

knowledge distillation (3680) large language model (12755) neural network (6616) efficient computing (779) neural network optimization (1293) transfer learning (5442) convolutional neural network (4216) neural network pruning (265) language model (4573) parameter efficiency (415)

Papers

LoNAS: Elastic Low-Rank Adapters for Efficient Large Language Models COLING 2024

EfficientSAM: Leveraged Masked Image Pretraining for Efficient Segment Anything CVPR 2024

Is Modularity Transferable? A Case Study through the Lens of Knowledge Distillation COLING 2024

Efficient Audio Captioning with Encoder-Level Knowledge Distillation INTERSPEECH 2024

PRoLoRA: Partial Rotation Empowers More Parameter-Efficient LoRA ACL 2024

NACL: A General and Effective KV Cache Eviction Framework for LLM at Inference Time ACL 2024

ALGM: Adaptive Local-then-Global Token Merging for Efficient Semantic Segmentation with Plain Vision Transformers CVPR 2024

LLMCBench: Benchmarking Large Language Model Compression for Efficient Deployment NIPS 2024

Learn To Unlearn for Deep Neural Networks: Minimizing Unlearning Interference With Gradient Projection WACV 2024

SHViT: Single-Head Vision Transformer with Memory Efficient Macro Design CVPR 2024

SVFT: Parameter-Efficient Fine-Tuning with Singular Vectors NIPS 2024

Unlocking Data-free Low-bit Quantization with Matrix Decomposition for KV Cache Compression ACL 2024

To Distill or Not to Distill? On the Robustness of Robust Knowledge Distillation ACL 2024

Dual-Space Knowledge Distillation for Large Language Models EMNLP 2024

Pruning Foundation Models for High Accuracy without Retraining EMNLP 2024

UniPTS: A Unified Framework for Proficient Post-Training Sparsity CVPR 2024

Transforming Vision Transformer: Towards Efficient Multi-Task Asynchronous Learner NIPS 2024

CE-NAS: An End-to-End Carbon-Efficient Neural Architecture Search Framework NIPS 2024

On the Impact of Calibration Data in Post-training Quantization and Pruning ACL 2024

Low-Rank Approximation for Sparse Attention in Multi-Modal LLMs CVPR 2024

Expanding Sparse Tuning for Low Memory Usage NIPS 2024

Task-agnostic Distillation of Encoder-Decoder Language Models COLING 2024

Rethinking Pruning Large Language Models: Benefits and Pitfalls of Reconstruction Error Minimization EMNLP 2024

MoDULA: Mixture of Domain-Specific and Universal LoRA for Multi-Task Learning EMNLP 2024

UPS: Unified Projection Sharing for Lightweight Single-Image Super-resolution and Beyond NIPS 2024