throughput

BanditSpec: Adaptive Speculative Decoding via Bandit Algorithms ICML 2025 Compress then Serve: Serving Thousands of LoRA Adapters with Little Overhead ICML 2025 Hymba: A Hybrid-head Architecture for Small Language Models ICLR 2025 PipeOffload: Improving Scalability of Pipeline Parallelism with Memory Optimization ICML 2025 QoS-Efficient Serving of Multiple Mixture-of-Expert LLMs Using Partial Runtime Reconfiguration ICML 2025 ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference ICML 2025 Gated Linear Attention Transformers with Hardware-Efficient Training ICML 2024 InferCept: Efficient Intercept Support for Augmented Large Language Model Inference ICML 2024 KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache ICML 2024 MuxServe: Flexible Spatial-Temporal Multiplexing for Multiple LLM Serving ICML 2024 Orthcatter: High-throughput In-band OFDM Backscatter with Over-the-Air Code Division NSDI 2024 Probabilistic Routing for Graph-Based Approximate Nearest Neighbor Search ICML 2024 Scaling Beyond the GPU Memory Limit for Large Mixture-of-Experts Model Training ICML 2024 Simple linear attention language models balance the recall-throughput tradeoff ICML 2024 OpenLoRa: Validating LoRa Implementations through an Extensible and Open-sourced Framework NSDI 2023 AmphiLight: Direct Air-Water Communication with Laser Light NSDI 2020 Scalog: Seamless Reconfiguration and Total Order in a Scalable Shared Log NSDI 2020 Many-to-Many Beam Alignment in Millimeter Wave Networks NSDI 2019