inference throughput

ArcLight: A Lightweight LLM Inference Architecture for Many-Core CPUs ACL 2026 MUTANT: A Recipe for Multilingual Tokenizer Design ACL 2026 SpecCache: Speculative KV Cache Reuse for Efficient RAG Serving ACL 2026 DVAGen: Dynamic Vocabulary Augmented Generation EMNLP 2025 ECHO-LLaMA: Efficient Caching for High-Performance LLaMA Training EMNLP 2025 Relaxed Recursive Transformers: Effective Parameter Sharing with Layer-wise LoRA ICLR 2025 Token Cropr: Faster ViTs for Quite a Few Tasks CVPR 2025 Block Transformer: Global-to-Local Language Modeling for Fast Inference NeurIPS 2024 EEE-QA: Exploring Effective and Efficient Question-Answer Representations COLING 2024 On Efficient Language and Vision Assistants for Visually-Situated Natural Language Understanding: What Matters in Reading and Reasoning EMNLP 2024 MUX-PLMs: Data Multiplexing for High-throughput Language Models EMNLP 2023 Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline NeurIPS 2023 DataMUX: Data Multiplexing for Neural Networks NeurIPS 2022 Beyond Distillation: Task-level Mixture-of-Experts for Efficient Inference EMNLP 2021 Boosting the Throughput and Accelerator Utilization of Specialized CNN Inference Beyond Increasing Batch Size ICML 2021