batch processing

SPADE: Signal-Aware DAG Scheduling and Dynamic Provisioning for Data Processing Clusters OSDI 2026 Are Optimal Algorithms Still Optimal? Rethinking Sorting in LLM-Based Pairwise Ranking with Batching and Caching ACL 2025 Batched Self-Consistency Improves LLM Relevance Assessment and Ranking EMNLP 2025 LLM as Effective Streaming Processor: Bridging Streaming-Batch Mismatches with Group Position Encoding ACL 2025 OneBatchPAM: A Fast and Frugal K-Medoids Algorithm AAAI 2025 BASS: Batched Attention-optimized Speculative Sampling ACL 2024 Batched Low-Rank Adaptation of Foundation Models ICLR 2024 SpecExec: Massively Parallel Speculative Decoding For Interactive LLM Inference on Consumer Devices NeurIPS 2024 FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU ICML 2023 Mitigating the Burden of Redundant Datasets via Batch-Wise Unique Samples and Frequency-Aware Losses ACL 2023 An Architecture for Accelerated Large-Scale Inference of Transformer-Based Language Models NAACL 2021 Boosting the Throughput and Accelerator Utilization of Specialized CNN Inference Beyond Increasing Batch Size ICML 2021 Scaling Deep Contrastive Learning Batch Size under Memory Limited Setup ACL 2021 Whiz: Data-Driven Analytics Execution NSDI 2021 A Streaming Approach For Efficient Batched Beam Search EMNLP 2020 Streaming Batch Gradient Tracking for Neural Network Training (Student Abstract) AAAI 2020 Scalable Distributed DL Training: Batching Communication and Computation AAAI 2019 Shenango: Achieving High CPU Efficiency for Latency-sensitive Datacenter Workloads NSDI 2019 Fast Neural Machine Translation Implementation ACL 2018 Deep Speech 2 : End-to-End Speech Recognition in English and Mandarin ICML 2016 Incremental Clustering: The Case for Extra Clusters NeurIPS 2014