batch inference

Attention-aware Inference Optimizations for Large Vision-Language Models with Memory-efficient Decoding CVPR 2026 BatchGen: An Architecture for Scalable and Efficient Batch Inference OSDI 2026 Scaling LLM Speculative Decoding: Non-Autoregressive Forecasting in Large-Batch Scenarios AAAI 2026 XiaoM at SemEval-2026 Task 7: A Qwen-based System for Accurate Retrieval of Everyday Knowledge Across Diverse Languages and Cultures SemEval 2026 DVAGen: Dynamic Vocabulary Augmented Generation EMNLP 2025 M-Ped: Multi-Prompt Ensemble Decoding for Large Language Models EMNLP 2025 TETRIS: Optimal Draft Token Selection for Batch Speculative Decoding ACL 2025 Block Transformer: Global-to-Local Language Modeling for Fast Inference NeurIPS 2024 LoraRetriever: Input-Aware LoRA Retrieval and Composition for Mixed Tasks in the Wild ACL 2024 RevMUX: Data Multiplexing with Reversible Adapters for Efficient LLM Batch Inference EMNLP 2024 Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model ICML 2024 Batch Prompting: Efficient Inference with Large Language Model APIs EMNLP 2023 SHEPHERD: Serving DNNs in the Wild NSDI 2023 HW-TSC’s Submission for the WMT22 Efficiency Task EMNLP 2022