conftrace_

inference acceleration

244 papers

Explore in graph

Co-occurring keywords

model compression (3302) large language model (13587) speculative decoding (111) diffusion model (3751) model acceleration (80) efficient computing (781) language model (4599) inference optimization (219) knowledge distillation (3725) neural network optimization (1293)

Papers

SOI: Scaling Down Computational Complexity by Estimating Partial States of the Model NIPS 2024
DeltaDEQ: Exploiting Heterogeneous Convergence for Accelerating Deep Equilibrium Iterations NIPS 2024
The Mamba in the Llama: Distilling and Accelerating Hybrid Models NIPS 2024
2DQuant: Low-bit Post-Training Quantization for Image Super-Resolution NIPS 2024
Decoding at the Speed of Thought: Harnessing Parallel Decoding of Lexical Units for LLMs COLING 2024
REST: Retrieval-Based Speculative Decoding NAACL 2024
DynaMo: Accelerating Language Model Inference with Dynamic Multi-Token Sampling NAACL 2024
ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization NIPS 2024
Plug-and-Play Diffusion Distillation CVPR 2024
DEED: Dynamic Early Exit on Decoder for Accelerating Encoder-Decoder Transformer Models NAACL 2024
Cache Me if You Can: Accelerating Diffusion Models through Block Caching CVPR 2024
Lossless Acceleration of Large Language Model via Adaptive N-gram Parallel Decoding NAACL 2024
Fluctuation-Based Adaptive Structured Pruning for Large Language Models AAAI 2024
ConsistentEE: A Consistent and Hardness-Guided Early Exiting Method for Accelerating Language Models Inference AAAI 2024
Unlocking Data-free Low-bit Quantization with Matrix Decomposition for KV Cache Compression ACL 2024
LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding ACL 2024
F³-Pruning: A Training-Free and Generalized Pruning Strategy towards Faster and Finer Text-to-Video Synthesis AAAI 2024
Make Some Noise: Unlocking Language Model Parallel Inference Capability through Noisy Training EMNLP 2024
Ouroboros: Generating Longer Drafts Phrase by Phrase for Faster Speculative Decoding EMNLP 2024
Draft on the Fly: Adaptive Self-Speculative Decoding using Cosine Similarity EMNLP 2024
Draft & Verify: Lossless Large Language Model Acceleration via Self-Speculative Decoding ACL 2024
SS1: Accelerating Inference with Fast and Expressive Sketch Structured Transform NIPS 2024
Investigating Acceleration of LLaMA Inference by Enabling Intermediate Layer Decoding via Instruction Tuning with ‘LITE’ NAACL 2024
Speculative Decoding with CTC-based Draft Model for LLM Inference Acceleration NIPS 2024
UltraSparseBERT: 99% Conditionally Sparse Language Modelling ACL 2024