Model Compression

NOLA: Compressing LoRA using Linear Combination of Random Basis ICLR 2024 NoMAD-Attention: Efficient LLM Inference on CPUs Through Multiply-add-free Attention NeurIPS 2024 Normalized Narrow Jump To Conclusions: Normalized Narrow Shortcuts for Parameter Efficient Early Exit Transformer Prediction EMNLP 2024 Norm Tweaking: High-Performance Low-Bit Quantization of Large Language Models AAAI 2024 Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models ACL 2024 NVRC: Neural Video Representation Compression NeurIPS 2024 NYU CTF Bench: A Scalable Open-Source Benchmark Dataset for Evaluating LLMs in Offensive Security NeurIPS 2024 OneBit: Towards Extremely Low-bit Large Language Models NeurIPS 2024 One-pass Multiple Conformer and Foundation Speech Systems Compression and Quantization Using An All-in-one Neural Model Interspeech 2024 On Giant's Shoulders: Effortless Weak to Strong by Dynamic Logits Fusion NeurIPS 2024 Online Stabilization of Spiking Neural Networks ICLR 2024 On the Impact of Calibration Data in Post-training Quantization and Pruning ACL 2024 On the Intractability to Synthesize Factual Inconsistencies in Summarization EACL 2024 On the Robustness of Neural Models for Full Sentence Transformation NAACL 2024 On the social bias of speech self-supervised models Interspeech 2024 On the Way to Lossless Compression of Language Transformers: Exploring Cross-Domain Properties of Quantization COLING 2024 Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs EMNLP 2024 Order of Magnitude Speedups for LLM Membership Inference EMNLP 2024 Out of Thin Air: Exploring Data-Free Adversarial Robustness Distillation AAAI 2024 OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Models AAAI 2024 Papilusion at DAGPap24: Paper or Illusion? Detecting AI-generated Scientific Papers ACL 2024 Parameter-Efficient Adapter Based on Pre-trained Models for Speech Translation Interspeech 2024 Parameter-Efficient Fine-Tuning: Is There An Optimal Subset of Parameters to Tune? EACL 2024 Parameter-Efficient Fine-Tuning of LLaMA for the Clinical Domain NAACL 2024 Parameter-Efficient Fine-Tuning with Discrete Fourier Transform ICML 2024