conftrace_

inference efficiency

248 papers

Explore in graph

Co-occurring keywords

model compression (3302) large language model (13587) knowledge distillation (3725) inference optimization (219) kv cache (74) efficient computing (781) language model (4599) inference acceleration (244) attention mechanism (4001) neural network (6616)

Papers

ShortV: Efficient Multimodal Large Language Models by Freezing Visual Tokens in Ineffective Layers ICCV 2025
Lookahead Q-Cache: Achieving More Consistent KV Cache Eviction via Pseudo Query EMNLP 2025
VFlowOpt: A Token Pruning Framework for LMMs with Visual Information Flow-Guided Optimization ICCV 2025
Cost-Optimal Grouped-Query Attention for Long-Context Modeling EMNLP 2025
Adaptive Guidance: Training-free Acceleration of Conditional Diffusion Models AAAI 2025
Qua2SeDiMo: Quantifiable Quantization Sensitivity of Diffusion Models AAAI 2025
Reasoning under Uncertainty: Efficient LLM Inference via Unsupervised Confidence Dilution and Convergent Adaptive Sampling EMNLP 2025
Efficient Inference for Large Language Models –Algorithm, Model, and System EMNLP 2025
zFLoRA: Zero-Latency Fused Low-Rank Adapters EMNLP 2025
Spectral Scaling Laws in Language Models: emphHow Effectively Do Feed-Forward Networks Use Their Latent Space? EMNLP 2025
CENTAUR: Bridging the Impossible Trinity of Privacy, Efficiency, and Performance in Privacy-Preserving Transformer Inference ACL 2025
An Empirical Study of Iterative Refinements for Non-autoregressive Translation ACL 2025
500xCompressor: Generalized Prompt Compression for Large Language Models ACL 2025
RMoA: Optimizing Mixture-of-Agents through Diversity Maximization and Residual Compensation ACL 2025
TACO-RL: Task Aware Prompt Compression Optimization with Reinforcement Learning ACL 2025
FLRC: Fine-grained Low-Rank Compressor for Efficient LLM Inference EMNLP 2025
LightThinker: Thinking Step-by-Step Compression EMNLP 2025
LVPruning: An Effective yet Simple Language-Guided Vision Token Pruning Approach for Multi-modal Large Language Models NAACL 2025
IG-Pruning: Input-Guided Block Pruning for Large Language Models EMNLP 2025
Token Cropr: Faster ViTs for Quite a Few Tasks CVPR 2025
MLWQ: Efficient Small Language Model Deployment via Multi-Level Weight Quantization EMNLP 2025
Faster and Better LLMs via Latency-Aware Test-Time Scaling EMNLP 2025
MoDification: Mixture of Depths Made Easy NAACL 2025
Efficient Unstructured Pruning of Mamba State-Space Models for Resource-Constrained Environments EMNLP 2025
Generative Prompt Internalization NAACL 2025