conftrace_

inference latency

72 papers

Explore in graph

Co-occurring keywords

model compression (3302) large language model (13587) efficient computing (781) neural network (6616) knowledge distillation (3725) model efficiency (206) inference efficiency (248) spiking neural network (331) neural network optimization (1293) neural machine translation (2310)

Papers

BILLY: Steering Large Language Models via Merging Persona Vectors for Creative Generation EACL 2026
RoBSA: RoPE-based Blockwise Sparse Multi-head Latent Attention ACL 2026
RouteMoA: Dynamic Routing without Pre-Inference Boosts Efficient Mixture-of-Agents ACL 2026
EnViT: Enhancing the Performance of Early-Exit Vision Transformers via Exit-Aware Structured Dropout-Enabled Self-Distillation AAAI 2026
Task-aware Block Pruning with Output Distribution Signals for Large Language Models EACL 2026
NADIR: Differential Attention Flow for Non-Autoregressive Transliteration in Indic Languages AAAI 2026
Rethinking Visual Token Reduction in LVLMs Under Cross-Modal Misalignment AAAI 2026
RAG-R1:Incentivizing the Search and Reasoning Capabilities of LLMs Through Multi-Query Parallelism AAAI 2026
SkyLLM: Cross-LLM-APIs Federation for Cost-effective Query Processing ACL 2025
Semi-Clairvoyant Scheduling of Speculative Decoding Requests to Minimize LLM Inference Latency IJCAI 2025
Small Encoders Can Rival Large Decoders in Detecting Groundedness ACL 2025
EXIT: Context-Aware Extractive Compression for Enhancing Retrieval-Augmented Generation ACL 2025
Nearly Zero-Cost Protection Against Mimicry by Personalized Diffusion Models CVPR 2025
HERMES: temporal-coHERent long-forM understanding with Episodes and Semantics ICCV 2025
FiRST: Finetuning Router-Selective Transformers for Input-Adaptive Latency Reduction EMNLP 2025
IPR: Intelligent Prompt Routing with User-Controlled Quality-Cost Trade-offs EMNLP 2025
Multi-view-guided Passage Reranking with Large Language Models EMNLP 2025
zFLoRA: Zero-Latency Fused Low-Rank Adapters EMNLP 2025
Too Helpful, Too Harmless, Too Honest or Just Right? EMNLP 2025
Accelerated Test-Time Scaling with Model-Free Speculative Sampling EMNLP 2025
ProCut: LLM Prompt Compression via Attribution Estimation EMNLP 2025
TTD-SQL: Tree-Guided Token Decoding for Efficient and Schema-Aware SQL Generation EMNLP 2025
Faster Speculative Decoding via Effective Draft Decoder with Pruned Candidate Tree ACL 2025
SelectLLM: Query-Aware Efficient Selection Algorithm for Large Language Models ACL 2025
SAFENUDGE: Safeguarding Large Language Models in Real-time with Tunable Safety-Performance Trade-offs EMNLP 2025