Model Compression

Democratizing LLMs: An Exploration of Cost-Performance Trade-offs in Self-Refined Open-Source Models EMNLP 2023 DepGraph: Towards Any Structural Pruning CVPR 2023 DEPN: Detecting and Editing Privacy Neurons in Pretrained Language Models EMNLP 2023 Discrete Key-Value Bottleneck ICML 2023 Distill or Annotate? Cost-Efficient Fine-Tuning of Compact Models ACL 2023 DistilXLSR: A Light Weight Cross-Lingual Speech Representation Model Interspeech 2023 DSEE: Dually Sparsity-embedded Efficient Tuning of Pre-trained Language Models ACL 2023 Dynamic Low-rank Estimation for Transformer-based Language Models EMNLP 2023 Dynamic Structure Pruning for Compressing CNNs AAAI 2023 Efficient Distributed Inference of Deep Neural Networks via Restructuring and Pruning AAAI 2023 Efficient Latency-Aware CNN Depth Compression via Two-Stage Dynamic Programming ICML 2023 Efficient Multilingual Language Model Compression through Vocabulary Trimming EMNLP 2023 Efficient On-Device Training via Gradient Filtering CVPR 2023 EMQ: Evolving Training-free Proxies for Automated Mixed Precision Quantization ICCV 2023 Energy and Carbon Considerations of Fine-Tuning BERT EMNLP 2023 Enhancing Scalability of Pre-trained Language Models via Efficient Parameter Sharing EMNLP 2023 Equivalent Transformation and Dual Stream Network Construction for Mobile Image Super-Resolution CVPR 2023 ESL-SNNs: An Evolutionary Structure Learning Strategy for Spiking Neural Networks AAAI 2023 Evaluating Parameter-Efficient Finetuning Approaches for Pre-trained Models on the Financial Domain EMNLP 2023 Extracting Low-/High- Frequency Knowledge from Graph Neural Networks and Injecting It into MLPs: An Effective GNN-to-MLP Distillation Framework AAAI 2023 Fair Scratch Tickets: Finding Fair Sparse Networks Without Weight Training CVPR 2023 FaLA: Fast Linear Adaptation for Replacing Backbone Models on Edge Devices EMNLP 2023 Fast and Accurate Binary Neural Networks Based on Depth-Width Reshaping AAAI 2023 Fast as CHITA: Neural Network Pruning with Combinatorial Optimization ICML 2023 f-Divergence Minimization for Sequence-Level Knowledge Distillation ACL 2023