conftrace_

inference optimization

219 papers

Explore in graph

Co-occurring keywords

large language model (13587) model compression (3302) efficient computing (781) kv cache (74) speculative decoding (111) language model (4599) inference efficiency (248) inference acceleration (244) efficient inference (233) memory efficiency (261)

Papers

Neural Speed Reading Audited EMNLP 2020
Learning Fast and Robust Target Models for Video Object Segmentation CVPR 2020
Nimble: Lightweight and Parallel GPU Task Scheduling for Deep Learning NIPS 2020
Inference Stage Optimization for Cross-scenario 3D Human Pose Estimation NIPS 2020
Early Exiting BERT for Efficient Document Ranking EMNLP 2020
High Performance Depthwise and Pointwise Convolutions on Mobile Devices AAAI 2020
Efficient Inference For Neural Machine Translation EMNLP 2020
Losing Heads in the Lottery: Pruning Transformer Attention in Neural Machine Translation EMNLP 2020
Balanced Sparsity for Efficient DNN Inference on GPU AAAI 2019
Adaptive Ensemble Prediction for Deep Neural Networks based on Confidence Level AISTATS 2019
Simulation-Based Approach to Efficient Commonsense Reasoning in Very Large Knowledge Bases AAAI 2019
Approximated Oracle Filter Pruning for Destructive CNN Width Optimization ICML 2019
OpenNMT System Description for WNMT 2018: 800 words/sec on a single-core CPU ACL 2018
Unifying and Merging Well-trained Deep Neural Networks for Inference Stage IJCAI 2018
Clipper: A Low-Latency Online Prediction Serving System NSDI 2017
More Is Less: A More Complicated Network With Less Inference Complexity CVPR 2017
Towards Compact and Fast Neural Machine Translation Using a Combined Method EMNLP 2017
Inference by Learning: Speeding-up Graphical Model Optimization via a Coarse-to-Fine Cascade of Pruning Classifiers NIPS 2014
Generating Efficient MCMC Kernels from Probabilistic Programs AISTATS 2014