Co-occurring keywords
Papers
MicroAdam: Accurate Adaptive Optimization with Low Space Overhead and Provable Convergence
NIPS 2024
Unlocking Data-free Low-bit Quantization with Matrix Decomposition for KV Cache Compression
ACL 2024
The Ups and Downs of Large Language Model Inference with Vocabulary Trimming by Language Heuristics
NAACL 2024
KV Cache is 1 Bit Per Channel: Efficient Large Language Model Inference with Coupled Quantization
NIPS 2024
ChunkAttention: Efficient Self-Attention with Prefix-Aware KV Cache and Two-Phase Partition
ACL 2024