quantization

Accelerating Linear Recurrent Neural Networks for the Edge with Unstructured Sparsity ICML 2025 any4: Learned 4-bit Numeric Representation for LLMs ICML 2025 BlockDialect: Block-wise Fine-grained Mixed Format Quantization for Energy-Efficient LLM Inference ICML 2025 Cache Me If You Must: Adaptive Key-Value Quantization for Large Language Models ICML 2025 Can Compressed LLMs Truly Act? An Empirical Evaluation of Agentic Capabilities in LLM Compression ICML 2025 DiscQuant: A Quantization Method for Neural Networks Inspired by Discrepancy Theory COLT 2025 EvoPress: Accurate Dynamic Model Compression via Evolutionary Search ICML 2025 FlatQuant: Flatness Matters for LLM Quantization ICML 2025 GANQ: GPU-Adaptive Non-Uniform Quantization for Large Language Models ICML 2025 GPTAQ: Efficient Finetuning-Free Quantization for Asymmetric Calibration ICML 2025 GuidedQuant: Large Language Model Quantization via Exploiting End Loss Guidance ICML 2025 Layer-wise Quantization for Quantized Optimistic Dual Averaging ICML 2025 LBI-FL: Low-Bit Integerized Federated Learning with Temporally Dynamic Bit-Width Allocation ICML 2025 LoCoDL: Communication-Efficient Distributed Learning with Local Training and Compression ICLR 2025 LowRA: Accurate and Efficient LoRA Fine-Tuning of LLMs under 2 Bits ICML 2025 LRA-QViT: Integrating Low-Rank Approximation and Quantization for Robust and Efficient Vision Transformers ICML 2025 Massive Values in Self-Attention Modules are the Key to Contextual Knowledge Understanding ICML 2025 Matryoshka Quantization ICML 2025 Merge-Friendly Post-Training Quantization for Multi-Target Domain Adaptation ICML 2025 Mind the Gap: A Practical Attack on GGUF Quantization ICML 2025 Modulated Diffusion: Accelerating Generative Modeling with Modulated Quantization ICML 2025 MoEQuant: Enhancing Quantization for Mixture-of-Experts Large Language Models via Expert-Balanced Sampling and Affinity Guidance ICML 2025 Multimodal Medical Code Tokenizer ICML 2025 MxMoE: Mixed-precision Quantization for MoE with Accuracy and Performance Co-Design ICML 2025 NestQuant: nested lattice quantization for matrix products and LLMs ICML 2025