model quantization

Fast Matrix Multiplications for Lookup Table-Quantized LLMs EMNLP 2024 Fed-QSSL: A Framework for Personalized Federated Learning under Bitwidth and Data Heterogeneity AAAI 2024 FlattenQuant: Breaking through the Inference Compute-bound for Large Language Models with Per-tensor Quantization COLING 2024 How Does Quantization Affect Multilingual LLMs? EMNLP 2024 Incremental Randomized Smoothing Certification ICLR 2024 InfantCryNet: A Data-driven Framework for Intelligent Analysis of Infant Cries ACML 2024 Instance-Aware Group Quantization for Vision Transformers CVPR 2024 IntactKV: Improving Large Language Model Quantization by Keeping Pivot Tokens Intact ACL 2024 Lisbon Computational Linguists at SemEval-2024 Task 2: Using a Mistral-7B Model and Data Augmentation SemEval 2024 LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit EMNLP 2024 LLM-QAT: Data-Free Quantization Aware Training for Large Language Models ACL 2024 LoftQ: LoRA-Fine-Tuning-aware Quantization for Large Language Models ICLR 2024 LoQT: Low-Rank Adapters for Quantized Pretraining NeurIPS 2024 Med-DANet V2: A Flexible Dynamic Architecture for Efficient Medical Volumetric Segmentation WACV 2024 MobileNVC: Real-Time 1080p Neural Video Compression on a Mobile Device WACV 2024 MobileQuant: Mobile-friendly Quantization for On-device Language Models EMNLP 2024 Nearest is Not Dearest: Towards Practical Defense against Quantization-conditioned Backdoor Attacks CVPR 2024 Network Memory Footprint Compression Through Jointly Learnable Codebooks and Mappings ICLR 2024 NoMAD-Attention: Efficient LLM Inference on CPUs Through Multiply-add-free Attention NeurIPS 2024 Norm Tweaking: High-Performance Low-Bit Quantization of Large Language Models AAAI 2024 OneBit: Towards Extremely Low-bit Large Language Models NeurIPS 2024 One-pass Multiple Conformer and Foundation Speech Systems Compression and Quantization Using An All-in-one Neural Model Interspeech 2024 Prefixing Attention Sinks can Mitigate Activation Outliers for Large Language Model Quantization EMNLP 2024 Proofread: Fixes All Errors with One Tap ACL 2024 PTMQ: Post-training Multi-Bit Quantization of Neural Networks AAAI 2024