conftrace_

convergence speed

33 papers

Explore in graph

Co-occurring keywords · papers mentioning both

neural network training (4) stochastic gradient descent (4) neural network optimization (3) vanishing gradient (2) bounding box regression (2) acoustic echo cancellation (2) adaptive filter (2) parameter-efficient fine-tuning (2) partial differential equation (2) weight initialization (2)

Papers

A Gradient Based Strategy for Hamiltonian Monte Carlo Hyperparameter Optimization ICML 2021 Exploiting Curriculum Learning in Unsupervised Neural Machine Translation EMNLP 2021 Projected GANs Converge Faster NeurIPS 2021 ReZero is all you need: fast convergence at large depth UAI 2021 Federated Accelerated Stochastic Gradient Descent NeurIPS 2020 MomentumRNN: Integrating Momentum into Recurrent Neural Networks NeurIPS 2020 Provable Benefit of Orthogonal Initialization in Optimizing Deep Linear Networks ICLR 2020 Uncertainty-Aware Curriculum Learning for Neural Machine Translation ACL 2020