conftrace_

inference acceleration

244 papers

Explore in graph

Co-occurring keywords

model compression (3302) large language model (13587) speculative decoding (111) diffusion model (3751) model acceleration (80) efficient computing (781) language model (4599) inference optimization (219) knowledge distillation (3725) neural network optimization (1293)

Papers

Length-Adaptive Distillation: Customizing Small Language Model for Dynamic Token Pruning EMNLP 2023
NASH: A Simple Unified Framework of Structured Pruning for Accelerating Encoder-Decoder Language Models EMNLP 2023
SpeechNet: Weakly Supervised, End-to-End Speech Recognition at Industrial Scale EMNLP 2022
FFM: A Frame Filtering Mechanism To Accelerate Inference Speed For Conformer In Speech Recognition INTERSPEECH 2022
COST-EFF: Collaborative Optimization of Spatial and Temporal Efficiency with Slenderized Multi-exit Language Models EMNLP 2022
Speed Up Object Detection on Gigapixel-Level Images With Patch Arrangement CVPR 2022
Finding the Task-Optimal Low-Bit Sub-Distribution in Deep Neural Networks ICML 2022
QueryDet: Cascaded Sparse Query for Accelerating High-Resolution Small Object Detection CVPR 2022
Transkimmer: Transformer Learns to Layer-wise Skim ACL 2022
SkipBERT: Efficient Inference with Shallow Layer Skipping ACL 2022
Block-Skim: Efficient Question Answering for Transformer AAAI 2022
Bayesian Multinomial Logistic Normal Models through Marginally Latent Matrix-T Processes JMLR 2022
Revisiting Locality Sensitive Hashing for Vocabulary Selection in Fast Neural Machine Translation EMNLP 2022
Accelerating Inference for Pretrained Language Models by Unified Multi-Perspective Early Exiting COLING 2022
To Fold or Not to Fold: a Necessary and Sufficient Condition on Batch-Normalization Layers Folding IJCAI 2022
FastSeq: Make Sequence Generation Faster IJCNLP 2021
Guiding Non-Autoregressive Neural Machine Translation Decoding with Reordering Information AAAI 2021
Accelerating BERT Inference for Sequence Labeling via Early-Exit ACL 2021
RMSMP: A Novel Deep Neural Network Quantization Framework With Row-Wise Mixed Schemes and Multiple Precisions ICCV 2021
Towards Efficient Graph Convolutional Networks for Point Cloud Handling ICCV 2021
CascadeBERT: Accelerating Inference of Pre-trained Language Models via Calibrated Complete Models Cascade EMNLP 2021
Partially Non-Autoregressive Image Captioning AAAI 2021
ReCU: Reviving the Dead Weights in Binary Neural Networks ICCV 2021
Consistent Accelerated Inference via Confident Adaptive Transformers EMNLP 2021
Bi-GCN: Binary Graph Convolutional Network CVPR 2021