Model Compression

Binarized Diffusion Model for Image Super-Resolution NeurIPS 2024 BiPFT: Binary Pre-trained Foundation Transformer with Low-Rank Estimation of Binarization Residual Polynomials AAAI 2024 BitDelta: Your Fine-Tune May Only Be Worth One Bit NeurIPS 2024 BitDistiller: Unleashing the Potential of Sub-4-Bit LLMs via Self-Distillation ACL 2024 BitsFusion: 1.99 bits Weight Quantization of Diffusion Model NeurIPS 2024 Bi-ViT: Pushing the Limit of Vision Transformer Quantization AAAI 2024 Block Transformer: Global-to-Local Language Modeling for Fast Inference NeurIPS 2024 BMRS: Bayesian Model Reduction for Structured Pruning NeurIPS 2024 BOLD: Boolean Logic Deep Learning NeurIPS 2024 Breaking ReLU Barrier: Generalized MoEfication for Dense Pretrained Models EMNLP 2024 Building on Efficient Foundations: Effective Training of LLMs with Structured Feedforward Layers NeurIPS 2024 Building Variable-Sized Models via Learngene Pool AAAI 2024 BVT-IMA: Binary Vision Transformer with Information-Modified Attention AAAI 2024 Change Is the Only Constant: Dynamic LLM Slicing based on Layer Redundancy EMNLP 2024 Cherry on Top: Parameter Heterogeneity and Quantization in Large Language Models NeurIPS 2024 CHESS: Optimizing LLM Inference via Channel-Wise Thresholding and Selective Sparsification EMNLP 2024 ChunkAttention: Efficient Self-Attention with Prefix-Aware KV Cache and Two-Phase Partition ACL 2024 CIDR: A Cooperative Integrated Dynamic Refining Method for Minimal Feature Removal Problem AAAI 2024 CleanGen: Mitigating Backdoor Attacks for Generation Tasks in Large Language Models EMNLP 2024 Clockwork Diffusion: Efficient Generation With Model-Step Distillation CVPR 2024 CoDi: Conditional Diffusion Distillation for Higher-Fidelity and Faster Image Generation CVPR 2024 CoMERA: Computing- and Memory-Efficient Training via Rank-Adaptive Tensor Optimization NeurIPS 2024 Compact Language Models via Pruning and Knowledge Distillation NeurIPS 2024 Compressed 3D Gaussian Splatting for Accelerated Novel View Synthesis CVPR 2024 Compressing Large Language Models using Low Rank and Low Precision Decomposition NeurIPS 2024