inference latency

Faster Speculative Decoding via Effective Draft Decoder with Pruned Candidate Tree ACL 2025 FiRST: Finetuning Router-Selective Transformers for Input-Adaptive Latency Reduction EMNLP 2025 FlowSE: Efficient and High-Quality Speech Enhancement via Flow Matching Interspeech 2025 HERMES: temporal-coHERent long-forM understanding with Episodes and Semantics ICCV 2025 H-Tuning: Toward Low-Cost and Efficient ECG-based Cardiovascular Disease Detection with Pre-Trained Models ICML 2025 IPR: Intelligent Prompt Routing with User-Controlled Quality-Cost Trade-offs EMNLP 2025 LeanQuant: Accurate and Scalable Large Language Model Quantization with Loss-error-aware Grid ICLR 2025 LLM Evaluate: An Industry-Focused Evaluation Tool for Large Language Models COLING 2025 Mixture of Lookup Experts ICML 2025 Multi-view-guided Passage Reranking with Large Language Models EMNLP 2025 Nearly Zero-Cost Protection Against Mimicry by Personalized Diffusion Models CVPR 2025 NTPP: Generative Speech Language Modeling for Dual-Channel Spoken Dialogue via Next-Token-Pair Prediction ICML 2025 Oracle-MoE: Locality-preserving Routing in the Oracle Space for Memory-constrained Large Language Model Inference ICML 2025 polybasic Speculative Decoding Through a Theoretical Perspective ICML 2025 ProCut: LLM Prompt Compression via Attribution Estimation EMNLP 2025 SAFENUDGE: Safeguarding Large Language Models in Real-time with Tunable Safety-Performance Trade-offs EMNLP 2025 Scaling Inference-Efficient Language Models ICML 2025 SelectLLM: Query-Aware Efficient Selection Algorithm for Large Language Models ACL 2025 Semi-Clairvoyant Scheduling of Speculative Decoding Requests to Minimize LLM Inference Latency IJCAI 2025 SkyLLM: Cross-LLM-APIs Federation for Cost-effective Query Processing ACL 2025 Small Encoders Can Rival Large Decoders in Detecting Groundedness ACL 2025 SPvR: Structured Pruning via Ranking UAI 2025 TokenSkip: Controllable Chain-of-Thought Compression in LLMs EMNLP 2025 Too Helpful, Too Harmless, Too Honest or Just Right? EMNLP 2025 TTD-SQL: Tree-Guided Token Decoding for Efficient and Schema-Aware SQL Generation EMNLP 2025