conftrace_

training efficiency

60 papers

Explore in graph

Co-occurring keywords

model compression (3302) curriculum learning (633) large language model (13587) efficient computing (781) neural network optimization (1293) transformer architecture (1560) language model (4599) data efficiency (125) training optimization (27) neural machine translation (2310)

Papers

Dataset Decomposition: Faster LLM Training with Variable Sequence Length Curriculum NIPS 2024
Color-Oriented Redundancy Reduction in Dataset Distillation NIPS 2024
Data Pruning via Moving-one-Sample-out NIPS 2023
Efficient NLP Model Finetuning via Multistage Data Filtering IJCAI 2023
Learning to Boost Training by Periodic Nowcasting Near Future Weights ICML 2023
KAKURENBO: Adaptively Hiding Samples in Deep Neural Network Training NIPS 2023
EfficientTrain: Exploring Generalized Curriculum Learning for Training Visual Backbones ICCV 2023
Quick Back-Translation for Unsupervised Machine Translation EMNLP 2023
Towards Memory- and Time-Efficient Backpropagation for Training Spiking Neural Networks ICCV 2023
Mitigating the Burden of Redundant Datasets via Batch-Wise Unique Samples and Frequency-Aware Losses ACL 2023
When To Prune? A Policy Towards Early Structural Pruning CVPR 2022
Privacy for Free: How does Dataset Condensation Help Privacy? ICML 2022
DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale ICML 2022
Online Convolutional Re-Parameterization CVPR 2022
Toward Low-Cost End-to-End Spoken Language Understanding INTERSPEECH 2022
Feeding What You Need by Understanding What You Learned ACL 2022
Selecting Informative Contexts Improves Language Model Fine-tuning ACL 2021
Curriculum Learning for Vision-and-Language Navigation NIPS 2021
Efficient Combination of Rematerialization and Offloading for Training DNNs NIPS 2021
Hyperparameter Power Impact in Transformer Language Model Training EMNLP 2021
Shortformer: Better Language Modeling using Shorter Inputs ACL 2021
When Attention Meets Fast Recurrence: Training Language Models with Reduced Compute EMNLP 2021
Speed up Training with Variable Length Inputs by Efficient Batching Strategies INTERSPEECH 2021
Small-GAN: Speeding up GAN Training using Core-Sets ICML 2020
Neural Language Modeling for Named Entity Recognition COLING 2020