conftrace_

inference optimization

219 papers

Explore in graph

Co-occurring keywords

large language model (13587) model compression (3302) efficient computing (781) kv cache (74) speculative decoding (111) language model (4599) inference efficiency (248) inference acceleration (244) efficient inference (233) memory efficiency (261)

Papers

BADGE: Speeding Up BERT Inference after Deployment via Block-wise Bypasses and Divergence-based Early Exiting ACL 2023
Optimizing Dynamic Neural Networks with Brainstorm OSDI 2023
AutoDiffusion: Training-Free Optimization of Time Steps and Architectures for Automated Diffusion Model Acceleration ICCV 2023
Scissorhands: Exploiting the Persistence of Importance Hypothesis for LLM KV Cache Compression at Test Time NIPS 2023
Towards Optimal Caching and Model Selection for Large Model Inference NIPS 2023
ZipLM: Inference-Aware Structured Pruning of Language Models NIPS 2023
Who Says Elephants Can’t Run: Bringing Large Scale MoE Models into Cloud Scale Production EMNLP 2022
MLink: Linking Black-Box Models for Collaborative Multi-Model Inference AAAI 2022
Sparsifying Transformer Models with Trainable Representation Pooling ACL 2022
Better Intermediates Improve CTC Inference INTERSPEECH 2022
Ekya: Continuous Learning of Video Analytics Models on Edge Compute Servers NSDI 2022
Fast Vocabulary Transfer for Language Model Compression EMNLP 2022
DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale ICML 2022
FalCon: Fine-Grained Feature Map Sparsity Computing With Decomposed Convolutions for Inference Optimization WACV 2022
AdapLeR: Speeding up Inference by Adaptive Length Reduction ACL 2022
LeeBERT: Learned Early Exit for BERT with cross-level optimization ACL 2021
FastSeq: Make Sequence Generation Faster ACL 2021
IrEne: Interpretable Energy Prediction for Transformers ACL 2021
TenTrans High-Performance Inference Toolkit for WMT2021 Efficiency Task EMNLP 2021
HW-TSC’s Participation in the WMT 2021 Efficiency Shared Task EMNLP 2021
Beyond Distillation: Task-level Mixture-of-Experts for Efficient Inference EMNLP 2021
RepVGG: Making VGG-Style ConvNets Great Again CVPR 2021
Efficient Machine Translation with Model Pruning and Quantization EMNLP 2021
LightSeq: A High Performance Inference Library for Transformers NAACL 2021
A Root of a Problem: Optimizing Single-Root Dependency Parsing EMNLP 2021