inference acceleration

A Theoretical Perspective for Speculative Decoding Algorithm NeurIPS 2024 A Training Data Recipe to Accelerate A* Search with Language Models EMNLP 2024 Attention-Driven Training-Free Efficiency Enhancement of Diffusion Models CVPR 2024 Block Transformer: Global-to-Local Language Modeling for Fast Inference NeurIPS 2024 Cache Me if You Can: Accelerating Diffusion Models through Block Caching CVPR 2024 Cascade Speculative Drafting for Even Faster LLM Inference NeurIPS 2024 ConsistentEE: A Consistent and Hardness-Guided Early Exiting Method for Accelerating Language Models Inference AAAI 2024 Context-Aware Assistant Selection for Improved Inference Acceleration with Large Language Models EMNLP 2024 Decoding at the Speed of Thought: Harnessing Parallel Decoding of Lexical Units for LLMs COLING 2024 DEED: Dynamic Early Exit on Decoder for Accelerating Encoder-Decoder Transformer Models NAACL 2024 DeltaDEQ: Exploiting Heterogeneous Convergence for Accelerating Deep Equilibrium Iterations NeurIPS 2024 DistillSpec: Improving Speculative Decoding via Knowledge Distillation ICLR 2024 Draft on the Fly: Adaptive Self-Speculative Decoding using Cosine Similarity EMNLP 2024 Draft & Verify: Lossless Large Language Model Acceleration via Self-Speculative Decoding ACL 2024 DynaMo: Accelerating Language Model Inference with Dynamic Multi-Token Sampling NAACL 2024 EAGLE-2: Faster Inference of Language Models with Dynamic Draft Trees EMNLP 2024 F³-Pruning: A Training-Free and Generalized Pruning Strategy towards Faster and Finer Text-to-Video Synthesis AAAI 2024 Fast Context-Biasing for CTC and Transducer ASR models with CTC-based Word Spotter Interspeech 2024 Faster Diffusion: Rethinking the Role of the Encoder for Diffusion Model Inference NeurIPS 2024 FasterVD: On Acceleration of Video Diffusion Models IJCAI 2024 Fast yet Safe: Early-Exiting with Risk Control NeurIPS 2024 FFN-SkipLLM: A Hidden Gem for Autoregressive Decoding with Adaptive Feed Forward Skipping EMNLP 2024 FIRST: Faster Improved Listwise Reranking with Single Token Decoding EMNLP 2024 Fluctuation-Based Adaptive Structured Pruning for Large Language Models AAAI 2024 Generation Meets Verification: Accelerating Large Language Model Inference with Smart Parallel Auto-Correct Decoding ACL 2024