conftrace_

memory optimization

114 papers

Explore in graph

Co-occurring keywords

model compression (3302) large language model (13587) memory efficiency (261) kv cache (74) inference optimization (219) inference efficiency (248) efficient inference (233) edge computing (210) deep neural network (1803) efficient computing (781)

Papers

Rotate, Clip, and Partition: Towards W2A4KV4 Quantization by Integrating Rotation and Learnable Non-uniform Quantizer EMNLP 2025
Accurate KV Cache Quantization with Outlier Tokens Tracing ACL 2025
Q-MiniSAM2: A Quantization-based Benchmark for Resource-Efficient Video Segmentation IJCAI 2025
QSpec: Speculative Decoding with Complementary Quantization Schemes EMNLP 2025
Learning Hierarchical Line Buffer for Image Processing ICCV 2025
Attractor-based Closed List Search: Sparsifying the Closed List for Efficient Memory-Constrained Planning IJCAI 2025
SpindleKV: A Novel KV Cache Reduction Method Balancing Both Shallow and Deep Layers ACL 2025
Mixture of Weight-shared Heterogeneous Group Attention Experts for Dynamic Token-wise KV Optimization EMNLP 2025
Cost-Optimal Grouped-Query Attention for Long-Context Modeling EMNLP 2025
LightThinker: Thinking Step-by-Step Compression EMNLP 2025
MEET: Towards Memory-Efficient Temporal Sparse Deep Neural Networks CVPR 2025
LeanK: Learnable K Cache Channel Pruning for Efficient Decoding EMNLP 2025
MoDification: Mixture of Depths Made Easy NAACL 2025
LLM in a flash: Efficient Large Language Model Inference with Limited Memory ACL 2024
Fast and Memory-Efficient Video Diffusion Using Streamlined Inference NIPS 2024
Reducing Transformer Key-Value Cache Size with Cross-Layer Attention NIPS 2024
SpeedLoader: An I/O efficient scheme for heterogeneous and distributed LLM operation NIPS 2024
DISCO: Distributed Inference With Sparse Communications WACV 2024
Layer-wise Importance Matters: Less Memory for Better Performance in Parameter-efficient Fine-tuning of Large Language Models EMNLP 2024
InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management OSDI 2024
Thinking Forward: Memory-Efficient Federated Finetuning of Language Models NIPS 2024
FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precision NIPS 2024
PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM Inference ACL 2024
LLMem: Estimating GPU Memory Usage for Fine-Tuning Pre-Trained LLMs IJCAI 2024
Beam-search SIEVE for low-memory speech recognition INTERSPEECH 2024