conftrace_

latency reduction

77 papers

Explore in graph

Co-occurring keywords

model compression (3302) large language model (13587) inference efficiency (248) simultaneous translation (136) streaming speech recognition (40) speech recognition (1226) edge computing (210) inference optimization (219) throughput optimization (46) language model (4599)

Papers

SchemaRAG: Dynamic Large Schema Reduction for LLM-driven Structured Information Extraction ACL 2026
PipeDiT: Accelerating Diffusion Transformers in Video Generation with Task Pipelining and Model Decoupling AAAI 2026
Training-Free ANN-to-SNN Conversion for High-Performance Spiking Transformers AAAI 2026
SlimInfer: Accelerating Long-Context LLM Inference via Dynamic Token Pruning AAAI 2026
Benchmarking the Energy Savings with Speculative Decoding Strategies EACL 2026
Dissecting and Streamlining the Interactive Loop of Mobile Cloud Gaming NSDI 2025
Self-Clocked Round-Robin Packet Scheduling NSDI 2025
Investigating Omission as a Latency Reduction Strategy in Simultaneous Speech Translation AACL 2025
Accurate Sublayer Pruning for Large Language Models by Exploiting Latency and Tunability Information IJCAI 2025
A Multi-Task Supervised Compression Model for Split Computing WACV 2025
DeepCompress-ViT: Rethinking Model Compression to Enhance Efficiency of Vision Transformers at the Edge CVPR 2025
Quaff: Quantized Parameter-Efficient Fine-Tuning under Outlier Spatial Stability Hypothesis ACL 2025
SeqPO-SiMT: Sequential Policy Optimization for Simultaneous Machine Translation ACL 2025
Principles and Methodologies for Serial Performance Optimization OSDI 2025
Lightweight Safety Guardrails Using Fine-tuned BERT Embeddings COLING 2025
Speculative Decoding for Multi-Sample Inference EMNLP 2025
Efficient Inference for Large Language Models –Algorithm, Model, and System EMNLP 2025
NeuroViG - Integrating Event Cameras for Resource-Efficient Video Grounding WACV 2025
Investigating Omission as a Latency Reduction Strategy in Simultaneous Speech Translation IJCNLP 2025
Kamino: Efficient VM Allocation at Scale with Latency-Driven Cache-Aware Scheduling OSDI 2025
ECC-SNN: Cost-Effective Edge-Cloud Collaboration for Spiking Neural Networks IJCAI 2025
InfiniSST: Simultaneous Translation of Unbounded Speech with Large Language Model ACL 2025
KV-Latent: Dimensional-level KV Cache Reduction with Frequency-aware Rotary Positional Embedding ACL 2025
Beyond Text-Visual Attention: Exploiting Visual Cues for Effective Token Pruning in VLMs ICCV 2025
Semantic Agreement Enables Efficient Open-Ended LLM Cascades EMNLP 2025