conftrace_

inference acceleration

244 papers

Explore in graph

Co-occurring keywords

model compression (3302) large language model (13587) speculative decoding (111) diffusion model (3751) model acceleration (80) efficient computing (781) language model (4599) inference optimization (219) knowledge distillation (3725) neural network optimization (1293)

Papers

Fast yet Safe: Early-Exiting with Risk Control NIPS 2024
A Theoretical Perspective for Speculative Decoding Algorithm NIPS 2024
Context-Aware Assistant Selection for Improved Inference Acceleration with Large Language Models EMNLP 2024
SinSR: Diffusion-Based Image Super-Resolution in a Single Step CVPR 2024
MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention NIPS 2024
EAGLE-2: Faster Inference of Language Models with Dynamic Draft Trees EMNLP 2024
Kangaroo: Lossless Self-Speculative Decoding for Accelerating LLMs via Double Early Exiting NIPS 2024
Block Transformer: Global-to-Local Language Modeling for Fast Inference NIPS 2024
AsyncDiff: Parallelizing Diffusion Models by Asynchronous Denoising NIPS 2024
Sequoia: Scalable and Robust Speculative Decoding NIPS 2024
Search for Efficient Large Language Models NIPS 2024
Leap-of-Thought: Accelerating Transformers via Dynamic Token Routing EMNLP 2023
Dynamic Sparsity Is Channel-Level Sparsity Learner NIPS 2023
ReDi: Efficient Learning-Free Diffusion Inference via Trajectory Retrieval ICML 2023
Accelerating Transformer Inference for Translation via Parallel Decoding ACL 2023
Attend, Select and Eliminate: Accelerating Multi-turn Response Selection with Dual-attention-based Content Elimination ACL 2023
SGFormer: Simplifying and Empowering Transformers for Large-Graph Representations NIPS 2023
SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models ICML 2023
On Distillation of Guided Diffusion Models CVPR 2023
Algorithm-Hardware Co-Design for Efficient Brain-Inspired Hyperdimensional Learning on Edge (Extended Abstract) IJCAI 2023
DeepPCR: Parallelizing Sequential Operations in Neural Networks NIPS 2023
Adaptive Sparse ViT: Towards Learnable Adaptive Token Pruning by Fully Exploiting Self-Attention IJCAI 2023
Embedding Recycling for Language Models EACL 2023
Task-Agnostic Structured Pruning of Speech Representation Models INTERSPEECH 2023
Accelerating Transducers through Adjacent Token Merging INTERSPEECH 2023