Model Compression

Extremely efficient online query encoding for dense retrieval NAACL 2024 Fairness-Aware Structured Pruning in Transformers AAAI 2024 FALCON: FLOP-Aware Combinatorial Optimization for Neural Network Pruning AISTATS 2024 FanLoRA: Fantastic LoRAs and Where to Find Them in Large Language Model Fine-tuning EMNLP 2024 Fast Randomized Low-Rank Adaptation of Pre-trained Language Models with PAC Regularization ACL 2024 Fast Streaming Transducer ASR Prototyping via Knowledge Distillation with Whisper EMNLP 2024 Federated Modality-Specific Encoders and Multimodal Anchors for Personalized Brain Tumor Segmentation AAAI 2024 FedLFC: Towards Efficient Federated Multilingual Modeling with LoRA-based Language Family Clustering NAACL 2024 FedMef: Towards Memory-efficient Federated Dynamic Pruning CVPR 2024 FedP3: Federated Personalized and Privacy-friendly Network Pruning under Model Heterogeneity ICLR 2024 FFN-SkipLLM: A Hidden Gem for Autoregressive Decoding with Adaptive Feed Forward Skipping EMNLP 2024 FIARSE: Model-Heterogeneous Federated Learning via Importance-Aware Submodel Extraction NeurIPS 2024 Finding Lottery Tickets in Vision Models via Data-driven Spectral Foresight Pruning CVPR 2024 Finding Transformer Circuits With Edge Pruning NeurIPS 2024 Fixed and Adaptive Simultaneous Machine Translation Strategies Using Adapters ACL 2024 FlattenQuant: Breaking through the Inference Compute-bound for Large Language Models with Per-tensor Quantization COLING 2024 FlowerFormer: Empowering Neural Architecture Encoding using a Flow-aware Graph Transformer CVPR 2024 FM-Delta: Lossless Compression for Storing Massive Fine-tuned Foundation Models NeurIPS 2024 From Reading to Compressing: Exploring the Multi-document Reader for Prompt Compression EMNLP 2024 Further Compressing Distilled Language Models via Frequency-aware Partial Sparse Coding of Embeddings CoNLL 2024 Generation Meets Verification: Accelerating Large Language Model Inference with Smart Parallel Auto-Correct Decoding ACL 2024 Global-Pruner: A Stable and Efficient Pruner for Retraining-Free Pruning of Encoder-Based Language Models CoNLL 2024 Gradient-Guided Knowledge Distillation for Object Detectors WACV 2024 Graph Lottery Ticket Automated ICLR 2024 Graph-Structured Speculative Decoding ACL 2024