Model Compression

VeriCompress: A Tool to Streamline the Synthesis of Verified Robust Compressed Neural Networks from Scratch AAAI 2024 Visual Editing with LLM-based Tool Chaining: An Efficient Distillation Approach for Real-Time Applications EMNLP 2024 VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models EMNLP 2024 Weight-Inherited Distillation for Task-Agnostic BERT Compression NAACL 2024 What Makes a Good Prune? Maximal Unstructured Pruning for Maximal Cosine Similarity ICLR 2024 What Makes Quantization for Large Language Model Hard? An Empirical Study from the Lens of Perturbation AAAI 2024 When Compression Meets Model Compression: Memory-Efficient Double Compression for Large Language Models EMNLP 2024 WOUAF: Weight Modulation for User Attribution and Fingerprinting in Text-to-Image Diffusion Models CVPR 2024 WRP: Weight Recover Prune for Structured Sparsity ACL 2024 X-Adapter: Adding Universal Compatibility of Plugins for Upgraded Diffusion Model CVPR 2024 XC-Cache: Cross-Attending to Cached Context for Efficient LLM Inference EMNLP 2024 xCOMET-lite: Bridging the Gap Between Efficiency and Quality in Learned MT Evaluation Metrics EMNLP 2024 xRAG: Extreme Context Compression for Retrieval-augmented Generation with One Token NeurIPS 2024 ZipCache: Accurate and Efficient KV Cache Quantization with Salient Token Identification NeurIPS 2024 $\rm A^2Q$: Aggregation-Aware Quantization for Graph Neural Networks ICLR 2023 A2Q: Accumulator-Aware Quantization with Guaranteed Overflow Avoidance ICCV 2023 Aambela at BLP-2023 Task 2: Enhancing BanglaBERT Performance for Bangla Sentiment Analysis Task with In Task Pretraining and Adversarial Weight Perturbation EMNLP 2023 A Binary Keyword Spotting System with Error-Diffusion Based Feature Binarization Interspeech 2023 A Comparative Analysis of Task-Agnostic Distillation Methods for Compressing Transformer Language Models EMNLP 2023 Adapter-tuning with Effective Token-dependent Representation Shift for Automatic Speech Recognition Interspeech 2023 Adapting Language Models to Compress Contexts EMNLP 2023 Adaptive Contrastive Knowledge Distillation for BERT Compression ACL 2023 Adaptive Data-Free Quantization CVPR 2023 Adaptive Neural Network Quantization For Lightweight Speaker Verification Interspeech 2023 Adaptive Smoothing Gradient Learning for Spiking Neural Networks ICML 2023