conftrace_

inference acceleration

244 papers

Explore in graph

Co-occurring keywords

model compression (3302) large language model (13587) speculative decoding (111) diffusion model (3751) model acceleration (80) efficient computing (781) language model (4599) inference optimization (219) knowledge distillation (3725) neural network optimization (1293)

Papers

HATA: Trainable and Hardware-Efficient Hash-Aware Top-k Attention for Scalable Large Model Inference ACL 2025
CORAL: Learning Consistent Representations across Multi-step Training with Lighter Speculative Drafter ACL 2025
Speculative Sampling via Exponential Races ACL 2025
Weight-Aware Activation Sparsity with Constrained Bayesian Optimization Scheduling for Large Language Models EMNLP 2025
Video Compression Commander: Plug-and-Play Inference Acceleration for Video Large Language Models EMNLP 2025
Speculative Streaming: Efficient and Scalable Speculative Decoding with Multi-Stream Attention EMNLP 2025
FractalLLM: Lossless Self-Speculative Decoding with Layer Embedded Self-Compression EMNLP 2025
Stop Looking for “Important Tokens” in Multimodal Language Models: Duplication Matters More EMNLP 2025
Efficient Unstructured Pruning of Mamba State-Space Models for Resource-Constrained Environments EMNLP 2025
DynPose: Largely Improving the Efficiency of Human Pose Estimation by a Simple Dynamic Framework CVPR 2025
Boosting Multimodal Large Language Models with Visual Tokens Withdrawal for Rapid Inference AAAI 2025
ST3: Accelerating Multimodal Large Language Model by Spatial-Temporal Visual Token Trimming AAAI 2025
Adaptive Guidance: Training-free Acceleration of Conditional Diffusion Models AAAI 2025
ImagePiece: Content-aware Re-tokenization for Efficient Image Recognition AAAI 2025
Apollo-Forecast: Overcoming Aliasing and Inference Speed Challenges in Language Models for Time Series Forecasting AAAI 2025
Prompt Compression with Context-Aware Sentence Encoding for Fast and Improved LLM Inference AAAI 2025
FastDraft: How to Train Your Draft ACL 2025
IAM: Efficient Inference through Attention Mapping between Different-scale LLMs ACL 2025
CLaSp: In-Context Layer Skip for Self-Speculative Decoding ACL 2025
Unifying Mixture of Experts and Multi-Head Latent Attention for Efficient Language Models EMNLP 2025
HookMoE: A learnable performance compensation strategy of Mixture-of-Experts for LLM inference acceleration EMNLP 2025
Cacheback: Speculative Decoding With Nothing But Cache EMNLP 2025
EEdit : Rethinking the Spatial and Temporal Redundancy for Efficient Image Editing ICCV 2025
SemShareKV: Efficient KVCache Sharing for Semantically Similar Prompts via Token-Level LSH Matching AACL 2025
Revisiting Token Pruning for Object Detection and Instance Segmentation WACV 2024