conftrace_

inference efficiency

248 papers

Explore in graph

Co-occurring keywords

model compression (3302) large language model (13587) knowledge distillation (3725) inference optimization (219) kv cache (74) efficient computing (781) language model (4599) inference acceleration (244) attention mechanism (4001) neural network (6616)

Papers

LayerConnect: Hypernetwork-Assisted Inter-Layer Connector to Enhance Parameter Efficiency COLING 2022
Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time ICML 2022
Model Cascading: Towards Jointly Improving Efficiency and Accuracy of NLP Systems EMNLP 2022
Speeding up Transformer Decoding via an Attention Refinement Network COLING 2022
ABC: Attention with Bounded-memory Control ACL 2022
SkipBERT: Efficient Inference with Shallow Layer Skipping ACL 2022
Finetuning Pretrained Transformers into RNNs EMNLP 2021
Direction is what you need: Improving Word Embedding Compression in Large Language Models ACL 2021
Selective Feature Compression for Efficient Activity Recognition Inference ICCV 2021
MOOD: Multi-Level Out-of-Distribution Detection CVPR 2021
DeRF: Decomposed Radiance Fields CVPR 2021
FATNN: Fast and Accurate Ternary Neural Networks ICCV 2021
Bag of Tricks for Optimizing Transformer Efficiency EMNLP 2021
Efficient Inference for Multilingual Neural Machine Translation EMNLP 2021
AdapterDrop: On the Efficiency of Adapters in Transformers EMNLP 2021
Softmax Tree: An Accurate, Fast Classifier When the Number of Classes Is Large EMNLP 2021
Improving Neural Network Efficiency via Post-Training Quantization With Adaptive Floating-Point ICCV 2021
I-BERT: Integer-only BERT Quantization ICML 2021
Almost Free Semantic Draft for Neural Machine Translation NAACL 2021
A User-Adaptive Layer Selection Framework for Very Deep Sequential Recommender Models AAAI 2021
Dynamic Routing Networks WACV 2021
Exploring Sparsity in Image Super-Resolution for Efficient Inference CVPR 2021
The Right Tool for the Job: Matching Model and Instance Complexities ACL 2020
Losing Heads in the Lottery: Pruning Transformer Attention in Neural Machine Translation EMNLP 2020
FastFormers: Highly Efficient Transformer Models for Natural Language Understanding EMNLP 2020