conftrace_

inference efficiency

248 papers

Explore in graph

Co-occurring keywords

model compression (3302) large language model (13587) knowledge distillation (3725) inference optimization (219) kv cache (74) efficient computing (781) language model (4599) inference acceleration (244) attention mechanism (4001) neural network (6616)

Papers

UniICL: An Efficient ICL Framework Unifying Compression, Selection, and Generation ACL 2025
KV-Latent: Dimensional-level KV Cache Reduction with Frequency-aware Rotary Positional Embedding ACL 2025
FlashBack: Efficient Retrieval-Augmented Language Modeling for Fast Inference ACL 2025
Position-Aware Depth Decay Decoding (D3): Boosting Large Language Model Inference Efficiency ACL 2025
RMoA: Optimizing Mixture-of-Agents through Diversity Maximization and Residual Compensation ACL 2025
AMXFP4: Taming Activation Outliers with Asymmetric Microscaling Floating-Point for 4-bit LLM Inference ACL 2025
Offloaded Reasoning: Efficient Inference for Large Language Models via Modular Reasoning and Refinement EMNLP 2025
Tree-Structured Non-Autoregressive Decoding for Sequence-to-Sequence Text Generation EMNLP 2025
TACO-RL: Task Aware Prompt Compression Optimization with Reinforcement Learning ACL 2025
PrAd: Prompt Adaptive Tuning for Decoder-only Language Models EMNLP 2025
Parallel Continuous Chain-of-Thought with Jacobi Iteration EMNLP 2025
Squeezed Attention: Accelerating Long Context Length LLM Inference ACL 2025
PHLoRA: data-free Post-hoc Low-Rank Adapter extraction from full-rank checkpoint AACL 2025
ETA: Efficiency through Thinking Ahead, A Dual Approach to Self-Driving with Large Models ICCV 2025
Exploiting Activation Sparsity with Dense to Dynamic-k Mixture-of-Experts Conversion NIPS 2024
MagR: Weight Magnitude Reduction for Enhancing Post-Training Quantization NIPS 2024
SIRIUS : Contexual Sparisty with Correction for Efficient LLMs NIPS 2024
Adaptive Depth Networks with Skippable Sub-Paths NIPS 2024
KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization NIPS 2024
Cascade Speculative Drafting for Even Faster LLM Inference NIPS 2024
Faster and Lighter LLMs: A Survey on Current Challenges and Way Forward IJCAI 2024
Multi-Task Inference: Can Large Language Models Follow Multiple Instructions at Once? ACL 2024
FastFiD: Improve Inference Efficiency of Open Domain Question Answering via Sentence Selection ACL 2024
Revisiting Convolution-free Transformer for Speech Recognition INTERSPEECH 2024
QUIK: Towards End-to-end 4-Bit Inference on Generative Large Language Models EMNLP 2024