inference acceleration

Sampling-free Inference for Ab-Initio Potential Energy Surface Networks ICLR 2023 SGFormer: Simplifying and Empowering Transformers for Large-Graph Representations NeurIPS 2023 SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models ICML 2023 Task-Agnostic Structured Pruning of Speech Representation Models Interspeech 2023 Accelerating Inference for Pretrained Language Models by Unified Multi-Perspective Early Exiting COLING 2022 Bayesian Multinomial Logistic Normal Models through Marginally Latent Matrix-T Processes JMLR 2022 Block-Skim: Efficient Question Answering for Transformer AAAI 2022 COST-EFF: Collaborative Optimization of Spatial and Temporal Efficiency with Slenderized Multi-exit Language Models EMNLP 2022 FFM: A Frame Filtering Mechanism To Accelerate Inference Speed For Conformer In Speech Recognition Interspeech 2022 Finding the Task-Optimal Low-Bit Sub-Distribution in Deep Neural Networks ICML 2022 Graph-less Neural Networks: Teaching Old MLPs New Tricks Via Distillation ICLR 2022 QueryDet: Cascaded Sparse Query for Accelerating High-Resolution Small Object Detection CVPR 2022 Revisiting Locality Sensitive Hashing for Vocabulary Selection in Fast Neural Machine Translation EMNLP 2022 SkipBERT: Efficient Inference with Shallow Layer Skipping ACL 2022 SpeechNet: Weakly Supervised, End-to-End Speech Recognition at Industrial Scale EMNLP 2022 Speed Up Object Detection on Gigapixel-Level Images With Patch Arrangement CVPR 2022 To Fold or Not to Fold: a Necessary and Sufficient Condition on Batch-Normalization Layers Folding IJCAI 2022 Transkimmer: Transformer Learns to Layer-wise Skim ACL 2022 Accelerating BERT Inference for Sequence Labeling via Early-Exit ACL 2021 A Global Past-Future Early Exit Method for Accelerating Inference of Pre-trained Language Models NAACL 2021 BERxiT: Early Exiting for BERT with Better Fine-Tuning and Extension to Regression EACL 2021 Bi-GCN: Binary Graph Convolutional Network CVPR 2021 CascadeBERT: Accelerating Inference of Pre-trained Language Models via Calibrated Complete Models Cascade EMNLP 2021 Consistent Accelerated Inference via Confident Adaptive Transformers EMNLP 2021 FSR: Accelerating the Inference Process of Transducer-Based Models by Applying Fast-Skip Regularization Interspeech 2021