conftrace_

latency reduction

77 papers

Explore in graph

Co-occurring keywords

model compression (3302) large language model (13587) inference efficiency (248) simultaneous translation (136) streaming speech recognition (40) speech recognition (1226) edge computing (210) inference optimization (219) throughput optimization (46) language model (4599)

Papers

Self-Clocked Round-Robin Packet Scheduling NSDI 2025
SIRIUS : Contexual Sparisty with Correction for Efficient LLMs NIPS 2024
Self-Refining Diffusion Samplers: Enabling Parallelization via Parareal Iterations NIPS 2024
Real-time Core-Periphery Guided ViT with Smart Data Layout Selection on Mobile Devices NIPS 2024
MOSEL: Inference Serving Using Dynamic Modality Selection EMNLP 2024
Extremely efficient online query encoding for dense retrieval NAACL 2024
wav2vec-S: Adapting Pre-trained Speech Models for Streaming ACL 2024
MiLoRA: Efficient Mixture of Low-Rank Adaptation for Large Language Models Fine-tuning EMNLP 2024
Efficient LLM Scheduling by Learning to Rank NIPS 2024
Hairpin: Rethinking Packet Loss Recovery in Edge-based Interactive Video Streaming NSDI 2024
Approximate Caching for Efficiently Serving Text-to-Image Diffusion Models NSDI 2024
ConvoCache: Smart Re-Use of Chatbot Responses INTERSPEECH 2024
MiniCache: KV Cache Compression in Depth Dimension for Large Language Models NIPS 2024
Personalized Predictive ASR for Latency Reduction in Voice Assistants INTERSPEECH 2023
Speculative Decoding with Big Little Decoder NIPS 2023
ShRing: Networking with Shared Receive Rings OSDI 2023
Attention as a Guide for Simultaneous Speech Translation ACL 2023
Goodtriever: Adaptive Toxicity Mitigation with Retrieval-augmented Models EMNLP 2023
Practical Network Acceleration With Tiny Sets CVPR 2023
eZNS: An Elastic Zoned Namespace for Commodity ZNS SSDs OSDI 2023
AlignAtt: Using Attention-based Audio-Translation Alignments as a Guide for Simultaneous Speech Translation INTERSPEECH 2023
Enabling High Quality Real-Time Communications with Adaptive Frame-Rate NSDI 2023
Language Model Based Target Token Importance Rescaling for Simultaneous Neural Machine Translation ACL 2023
Scaling Neural Face Synthesis to High FPS and Low Latency by Neural Caching WACV 2023
Spike-Based Anytime Perception WACV 2023