conftrace_

inference throughput

13 papers

Explore in graph

Co-occurring keywords

efficient computing (781) model compression (3302) model efficiency (206) data multiplexing (5) neural network (6616) batch inference (10) kv cache (74) pre-trained language model (1515) inference efficiency (248) inference optimization (219)

Papers

ArcLight: A Lightweight LLM Inference Architecture for Many-Core CPUs ACL 2026
MUTANT: A Recipe for Multilingual Tokenizer Design ACL 2026
SpecCache: Speculative KV Cache Reuse for Efficient RAG Serving ACL 2026
ECHO-LLaMA: Efficient Caching for High-Performance LLaMA Training EMNLP 2025
DVAGen: Dynamic Vocabulary Augmented Generation EMNLP 2025
Token Cropr: Faster ViTs for Quite a Few Tasks CVPR 2025
On Efficient Language and Vision Assistants for Visually-Situated Natural Language Understanding: What Matters in Reading and Reasoning EMNLP 2024
EEE-QA: Exploring Effective and Efficient Question-Answer Representations COLING 2024
Block Transformer: Global-to-Local Language Modeling for Fast Inference NIPS 2024
MUX-PLMs: Data Multiplexing for High-throughput Language Models EMNLP 2023
DataMUX: Data Multiplexing for Neural Networks NIPS 2022
Boosting the Throughput and Accelerator Utilization of Specialized CNN Inference Beyond Increasing Batch Size ICML 2021
Beyond Distillation: Task-level Mixture-of-Experts for Efficient Inference EMNLP 2021