conftrace_

batch processing

19 papers

Explore in graph

Co-occurring keywords

large language model (13587) memory optimization (114) speculative decoding (111) language model inference (18) batched processing (3) batched inference (3) token generation (47) streaming algorithm (131) clustering algorithm (206) model compression (3302)

Papers

Are Optimal Algorithms Still Optimal? Rethinking Sorting in LLM-Based Pairwise Ranking with Batching and Caching ACL 2025
Batched Self-Consistency Improves LLM Relevance Assessment and Ranking EMNLP 2025
LLM as Effective Streaming Processor: Bridging Streaming-Batch Mismatches with Group Position Encoding ACL 2025
OneBatchPAM: A Fast and Frugal K-Medoids Algorithm AAAI 2025
BASS: Batched Attention-optimized Speculative Sampling ACL 2024
SpecExec: Massively Parallel Speculative Decoding For Interactive LLM Inference on Consumer Devices NIPS 2024
Mitigating the Burden of Redundant Datasets via Batch-Wise Unique Samples and Frequency-Aware Losses ACL 2023
FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU ICML 2023
Boosting the Throughput and Accelerator Utilization of Specialized CNN Inference Beyond Increasing Batch Size ICML 2021
Whiz: Data-Driven Analytics Execution NSDI 2021
An Architecture for Accelerated Large-Scale Inference of Transformer-Based Language Models NAACL 2021
Scaling Deep Contrastive Learning Batch Size under Memory Limited Setup ACL 2021
Streaming Batch Gradient Tracking for Neural Network Training (Student Abstract) AAAI 2020
A Streaming Approach For Efficient Batched Beam Search EMNLP 2020
Scalable Distributed DL Training: Batching Communication and Computation AAAI 2019
Shenango: Achieving High CPU Efficiency for Latency-sensitive Datacenter Workloads NSDI 2019
Fast Neural Machine Translation Implementation ACL 2018
Deep Speech 2 : End-to-End Speech Recognition in English and Mandarin ICML 2016
Incremental Clustering: The Case for Extra Clusters NIPS 2014