conftrace_

inference acceleration

244 papers

Explore in graph

Co-occurring keywords

model compression (3302) large language model (13587) speculative decoding (111) diffusion model (3751) model acceleration (80) efficient computing (781) language model (4599) inference optimization (219) knowledge distillation (3725) neural network optimization (1293)

Papers

UltraEval: A Lightweight Platform for Flexible and Comprehensive Evaluation for LLMs ACL 2024
Learning-to-Cache: Accelerating Diffusion Transformer via Layer Caching NIPS 2024
Speculative Decoding via Early-exiting for Faster LLM Inference with Thompson Sampling Control Mechanism ACL 2024
Wino Vidi Vici: Conquering Numerical Instability of 8-Bit Winograd Convolution for Accurate Inference Acceleration on Edge WACV 2024
Fast Context-Biasing for CTC and Transducer ASR models with CTC-based Word Spotter INTERSPEECH 2024
FasterVD: On Acceleration of Video Diffusion Models IJCAI 2024
Speculative Contrastive Decoding ACL 2024
AFPQ: Asymmetric Floating Point Quantization for LLMs ACL 2024
Towards More Accurate Diffusion Model Acceleration with A Timestep Tuner CVPR 2024
Faster Diffusion: Rethinking the Role of the Encoder for Diffusion Model Inference NIPS 2024
Inevitable Trade-off between Watermark Strength and Speculative Sampling Efficiency for Language Models NIPS 2024
PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM Inference ACL 2024
Optimized Speculative Sampling for GPU Hardware Accelerators EMNLP 2024
FIRST: Faster Improved Listwise Reranking with Single Token Decoding EMNLP 2024
FFN-SkipLLM: A Hidden Gem for Autoregressive Decoding with Adaptive Feed Forward Skipping EMNLP 2024
SpecHub: Provable Acceleration to Multi-Draft Speculative Decoding EMNLP 2024
A Training Data Recipe to Accelerate A* Search with Language Models EMNLP 2024
Pruning Foundation Models for High Accuracy without Retraining EMNLP 2024
QEFT: Quantization for Efficient Fine-Tuning of LLMs EMNLP 2024
UniFL: Improve Latent Diffusion Model via Unified Feedback Learning NIPS 2024
Accelerating Blockwise Parallel Language Models with Draft Refinement NIPS 2024
Cascade Speculative Drafting for Even Faster LLM Inference NIPS 2024
Generation Meets Verification: Accelerating Large Language Model Inference with Smart Parallel Auto-Correct Decoding ACL 2024
Graph-Structured Speculative Decoding ACL 2024
Attention-Driven Training-Free Efficiency Enhancement of Diffusion Models CVPR 2024