training efficiency

Trainable Weight Averaging: Efficient Training by Optimizing Historical Solutions ICLR 2023 DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale ICML 2022 Feeding What You Need by Understanding What You Learned ACL 2022 Online Convolutional Re-Parameterization CVPR 2022 Privacy for Free: How does Dataset Condensation Help Privacy? ICML 2022 Toward Low-Cost End-to-End Spoken Language Understanding Interspeech 2022 When To Prune? A Policy Towards Early Structural Pruning CVPR 2022 CPT: Efficient Deep Neural Network Training via Cyclic Precision ICLR 2021 Curriculum Learning for Vision-and-Language Navigation NeurIPS 2021 Efficient Combination of Rematerialization and Offloading for Training DNNs NeurIPS 2021 Hyperparameter Power Impact in Transformer Language Model Training EMNLP 2021 Selecting Informative Contexts Improves Language Model Fine-tuning ACL 2021 Shortformer: Better Language Modeling using Shorter Inputs ACL 2021 Speed up Training with Variable Length Inputs by Efficient Batching Strategies Interspeech 2021 When Attention Meets Fast Recurrence: Training Language Models with Reduced Compute EMNLP 2021 Drawing Early-Bird Tickets: Toward More Efficient Training of Deep Networks ICLR 2020 Efficient Adversarial Training With Transferable Adversarial Examples CVPR 2020 Instance Selection for GANs NeurIPS 2020 Multi-Precision Policy Enforced Training (MuPPET) : A Precision-Switching Strategy for Quantised Fixed-Point Training of CNNs ICML 2020 Neural Language Modeling for Named Entity Recognition COLING 2020 Norm-Based Curriculum Learning for Neural Machine Translation ACL 2020 Small-GAN: Speeding up GAN Training using Core-Sets ICML 2020 The Lower The Simpler: Simplifying Hierarchical Recurrent Models NAACL 2019 CytonMT: an Efficient Neural Machine Translation Open-source Toolkit Implemented in C++ EMNLP 2018 Boosting Neural Machine Translation IJCNLP 2017