Model Compression

Fast Matrix Multiplications for Lookup Table-Quantized LLMs EMNLP 2024 Federated Model Heterogeneous Matryoshka Representation Learning NeurIPS 2024 FedHCA2: Towards Hetero-Client Federated Multi-Task Learning CVPR 2024 FedLPS: Heterogeneous Federated Learning for Multiple Tasks with Local Parameter Sharing AAAI 2024 FedMef: Towards Memory-efficient Federated Dynamic Pruning CVPR 2024 FedMut: Generalized Federated Learning via Stochastic Mutation AAAI 2024 Fill In The Gaps: Model Calibration and Generalization with Synthetic Data EMNLP 2024 Find the Lady: Permutation and Re-synchronization of Deep Neural Networks AAAI 2024 Fluctuation-Based Adaptive Structured Pruning for Large Language Models AAAI 2024 FM-Delta: Lossless Compression for Storing Massive Fine-tuned Foundation Models NeurIPS 2024 FouRA: Fourier Low-Rank Adaptation NeurIPS 2024 G-Adapter: Towards Structure-Aware Parameter-Efficient Transfer Learning for Graph Transformer Networks AAAI 2024 Generalizability of Mixture of Domain-Specific Adapters from the Lens of Signed Weight Directions and its Application to Effective Model Pruning ACL 2024 Generalized Large-Scale Data Condensation via Various Backbone and Statistical Matching CVPR 2024 Ghost Noise for Regularizing Deep Neural Networks AAAI 2024 GLiNER: Generalist Model for Named Entity Recognition using Bidirectional Transformer NAACL 2024 Gold Panning in Vocabulary: An Adaptive Method for Vocabulary Expansion of Domain-Specific LLMs EMNLP 2024 GPT vs RETRO: Exploring the Intersection of Retrieval and Parameter-Efficient Fine-Tuning EMNLP 2024 Group and Shuffle: Efficient Structured Orthogonal Parametrization NeurIPS 2024 HashReID: Dynamic Network With Binary Codes for Efficient Person Re-Identification WACV 2024 Heterogeneous LoRA for Federated Fine-tuning of On-Device Foundation Models EMNLP 2024 Hollowed Net for On-Device Personalization of Text-to-Image Diffusion Models NeurIPS 2024 How Sparse Can We Prune A Deep Network: A Fundamental Limit Perspective NeurIPS 2024 HydraViT: Stacking Heads for a Scalable ViT NeurIPS 2024 Impartial Adversarial Distillation: Addressing Biased Data-Free Knowledge Distillation via Adaptive Constrained Optimization AAAI 2024