efficient training

Dynamic Stashing Quantization for Efficient Transformer Training EMNLP 2023 EfficientTrain: Exploring Generalized Curriculum Learning for Training Visual Backbones ICCV 2023 Efficient Training of Language Models using Few-Shot Learning ICML 2023 Hyperblock Floating Point: Generalised Quantization Scheme for Gradient and Inference Computation WACV 2023 Influence Scores at Scale for Efficient Language Data Sampling EMNLP 2023 No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language Models NeurIPS 2023 Peeling the Onion: Hierarchical Reduction of Data Redundancy for Efficient Vision Transformer Training AAAI 2023 Self-Supervised Dataset Pruning for Efficient Training in Audio Anti-spoofing Interspeech 2023 An Efficient Training Approach for Very Large Scale Face Recognition CVPR 2022 Automated Progressive Learning for Efficient Training of Vision Transformers CVPR 2022 Early-Bird GCNs: Graph-Network Co-optimization towards More Efficient GCN Training and Inference via Drawing Early-Bird Lottery Tickets AAAI 2022 Efficient Sharpness-aware Minimization for Improved Training of Neural Networks ICLR 2022 Efficient Training of Neural Transducer for Speech Recognition Interspeech 2022 Efficient yet Competitive Speech Translation: FBK@IWSLT2022 ACL 2022 Layer Freezing & Data Sieving: Missing Pieces of a Generic Framework for Sparse Training NeurIPS 2022 NLP From Scratch Without Large-Scale Pretraining: A Simple and Efficient Framework ICML 2022 Tempo: Accelerating Transformer-Based Model Training through Memory Footprint Reduction NeurIPS 2022 Blocking-based Neighbor Sampling for Large-scale Graph Neural Networks IJCAI 2021 GRAD-MATCH: Gradient Matching based Data Subset Selection for Efficient Deep Model Training ICML 2021 How far can we get with one GPU in 100 hours? CoAStaL at MultiIndicMT Shared Task ACL 2021 Improving Privacy Guarantee and Efficiency of Latent Dirichlet Allocation Model Training Under Differential Privacy EMNLP 2021 Marginal Utility Diminishes: Exploring the Minimum Knowledge for BERT Knowledge Distillation ACL 2021 Accelerating Training of Transformer-Based Language Models with Progressive Layer Dropping NeurIPS 2020 FracTrain: Fractionally Squeezing Bit Savings Both Temporally and Spatially for Efficient DNN Training NeurIPS 2020 High-contrast “gaudy” images improve the training of deep neural network models of visual cortex NeurIPS 2020