model compression

KV Cache is 1 Bit Per Channel: Efficient Large Language Model Inference with Coupled Quantization NeurIPS 2024 KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization NeurIPS 2024 LaMDA: Large Model Fine-Tuning via Spectrally Decomposed Low-Dimensional Adaptation EMNLP 2024 Language-Specific Pruning for Efficient Reduction of Large Language Models COLING 2024 Layer-Adaptive State Pruning for Deep State Space Models NeurIPS 2024 Layer Attack Unlearning: Fast and Accurate Machine Unlearning via Layer Level Attack and Knowledge Distillation AAAI 2024 Layer Compression of Deep Networks with Straight Flows AAAI 2024 LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding ACL 2024 Learning from Imperfect Data: Towards Efficient Knowledge Distillation of Autoregressive Language Models for Text-to-SQL EMNLP 2024 Learning from Offline Foundation Features with Tensor Augmentations NeurIPS 2024 Learning Low-Rank Tensor Cores with Probabilistic ℓ0-Regularized Rank Selection for Model Compression IJCAI 2024 Learning Performance Maximizing Ensembles with Explainability Guarantees AAAI 2024 Learning To Compose SuperWeights for Neural Parameter Allocation Search WACV 2024 Learning to Merge Tokens via Decoupled Embedding for Efficient Vision Transformers NeurIPS 2024 Learn To Unlearn for Deep Neural Networks: Minimizing Unlearning Interference With Gradient Projection WACV 2024 LEMON: Reviving Stronger and Smaller LMs from Larger LMs with Linear Parameter Fusion ACL 2024 Less is Fed More: Sparsity Reduces Feature Distortion in Federated Learning EMNLP 2024 Let All Be Whitened: Multi-Teacher Distillation for Efficient Visual Retrieval AAAI 2024 Leveraging Normalization Layer in Adapters with Progressive Learning and Adaptive Distillation for Cross-Domain Few-Shot Learning AAAI 2024 LiDAR-PTQ: Post-Training Quantization for Point Cloud 3D Object Detection ICLR 2024 LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPS NeurIPS 2024 LightHGNN: Distilling Hypergraph Neural Networks into MLPs for 100x Faster Inference ICLR 2024 Light-PEFT: Lightening Parameter-Efficient Fine-Tuning via Early Pruning ACL 2024 Lightweight Audio Segmentation for Long-form Speech Translation Interspeech 2024 Lightweight Transducer Based on Frame-Level Criterion Interspeech 2024