neural network training

MTAdam: Automatic Balancing of Multiple Training Loss Terms EMNLP 2021 On the Convergence of Step Decay Step-Size for Stochastic Optimization NeurIPS 2021 On the Periodic Behavior of Neural Network Training with Batch Normalization and Weight Decay NeurIPS 2021 Optimal Gradient Checkpoint Search for Arbitrary Computation Graphs CVPR 2021 Proof of Learning (PoLe): Empowering Machine Learning with Consensus Building on Blockchains (Demo) AAAI 2021 ReCU: Reviving the Dead Weights in Binary Neural Networks ICCV 2021 Rethink the Connections among Generalization, Memorization, and the Spectral Bias of DNNs IJCAI 2021 Slot Machines: Discovering Winning Combinations of Random Weights in Neural Networks ICML 2021 Stochastic Anderson Mixing for Nonconvex Stochastic Optimization NeurIPS 2021 Structural Credit Assignment in Neural Networks using Reinforcement Learning NeurIPS 2021 Teaching with Commentaries ICLR 2021 TensorHive: Management of Exclusive GPU Access for Distributed Machine Learning Workloads JMLR 2021 The Energy and Carbon Footprint of Training End-to-End Speech Recognizers Interspeech 2021 THOR, Trace-based Hardware-driven Layer-Oriented Natural Gradient Descent Computation AAAI 2021 Towards Understanding Learning in Neural Networks with Linear Teachers ICML 2021 Training Neural Networks is ER-complete NeurIPS 2021 Understanding the effects of data parallelism and sparsity on neural network training ICLR 2021 Whitening and Second Order Optimization Both Make Information in the Dataset Unusable During Training, and Can Reduce or Prevent Generalization ICML 2021 Adaptive Convolutional ReLUs AAAI 2020 Coded Sequential Matrix Multiplication For Straggler Mitigation NeurIPS 2020 Curriculum Learning by Dynamic Instance Hardness NeurIPS 2020 Decoupled Greedy Learning of CNNs ICML 2020 Deep F-Measure Maximization for End-to-End Speech Understanding Interspeech 2020 Distributed Stochastic Gradient Descent with Event-Triggered Communication AAAI 2020 Dynamical mean-field theory for stochastic gradient descent in Gaussian mixture classification NeurIPS 2020