Model Compression

TinyNeRF: Towards 100 x Compression of Voxel Radiance Fields AAAI 2023 TIPS: Topologically Important Path Sampling for Anytime Neural Networks ICML 2023 Towards Fully Quantized Neural Networks For Speech Enhancement Interspeech 2023 Towards Robust Pruning: An Adaptive Knowledge-Retention Pruning Strategy for Language Models EMNLP 2023 Towards Understanding and Improving Knowledge Distillation for Neural Machine Translation ACL 2023 Traversing Between Modes in Function Space for Fast Ensembling ICML 2023 Ultra Dual-Path Compression For Joint Echo Cancellation And Noise Suppression Interspeech 2023 Understanding Int4 Quantization for Language Models: Latency Speedup, Composability, and Failure Cases ICML 2023 Understanding Neural Network Binarization with Forward and Backward Proximal Quantizers NeurIPS 2023 Unified Data-Free Compression: Pruning and Quantization without Fine-Tuning ICCV 2023 Unlearning Bias in Language Models by Partitioning Gradients ACL 2023 UPop: Unified and Progressive Pruning for Compressing Vision-Language Transformers ICML 2023 UPSCALE: Unconstrained Channel Pruning ICML 2023 Variator: Accelerating Pre-trained Models with Plug-and-Play Compression Modules EMNLP 2023 Why Random Pruning Is All We Need to Start Sparse ICML 2023 Winning Both the Accuracy of Floating Point Activation and the Simplicity of Integer Arithmetic ICLR 2023 X-Pruner: eXplainable Pruning for Vision Transformers CVPR 2023 YANMTT: Yet Another Neural Machine Translation Toolkit ACL 2023 You Only Condense Once: Two Rules for Pruning Condensed Datasets NeurIPS 2023 3DAC: Learning Attribute Compression for Point Clouds CVPR 2022 8-bit Optimizers via Block-wise Quantization ICLR 2022 Accelerating Inference and Language Model Fusion of Recurrent Neural Network Transducers via End-to-End 4-bit Quantization Interspeech 2022 Accelerating Inference for Pretrained Language Models by Unified Multi-Perspective Early Exiting COLING 2022 AdapLeR: Speeding up Inference by Adaptive Length Reduction ACL 2022 Adaptable Adapters NAACL 2022