conftrace_

inference optimization

236 papers

Explore in graph

Co-occurring keywords · papers mentioning both

large language model (96) model compression (76) efficient computing (27) kv cache (25) speculative decoding (24) language model (18) inference efficiency (18) inference acceleration (17) memory efficiency (16) efficient inference (15)

Papers

Adaptive Ensemble Prediction for Deep Neural Networks based on Confidence Level AISTATS 2019 Approximated Oracle Filter Pruning for Destructive CNN Width Optimization ICML 2019 Balanced Sparsity for Efficient DNN Inference on GPU AAAI 2019 Simulation-Based Approach to Efficient Commonsense Reasoning in Very Large Knowledge Bases AAAI 2019 OpenNMT System Description for WNMT 2018: 800 words/sec on a single-core CPU ACL 2018 Unifying and Merging Well-trained Deep Neural Networks for Inference Stage IJCAI 2018 Clipper: A Low-Latency Online Prediction Serving System NSDI 2017 More Is Less: A More Complicated Network With Less Inference Complexity CVPR 2017 Towards Compact and Fast Neural Machine Translation Using a Combined Method EMNLP 2017 Generating Efficient MCMC Kernels from Probabilistic Programs AISTATS 2014 Inference by Learning: Speeding-up Graphical Model Optimization via a Coarse-to-Fine Cascade of Pruning Classifiers NeurIPS 2014