neural network training

KOALA: A Kalman Optimization Algorithm with Loss Adaptivity AAAI 2022 Learning by Competition of Self-Interested Reinforcement Learning Agents AAAI 2022 Learning Rates as a Function of Batch Size: A Random Matrix Theory Approach to Neural Network Training JMLR 2022 Looking Beyond GPUs for DNN Scheduling on Multi-Tenant Clusters OSDI 2022 Masked Training of Neural Networks with Partial Gradients AISTATS 2022 MultiplexNet: Towards Fully Satisfied Logical Constraints in Neural Networks AAAI 2022 Non-Vacuous Generalisation Bounds for Shallow Neural Networks ICML 2022 Online Knowledge Distillation by Temporal-Spatial Boosting WACV 2022 Optimization-Based Separations for Neural Networks COLT 2022 Overparameterization of Deep ResNet: Zero Loss and Mean-field Analysis JMLR 2022 Principal Components Bias in Over-parameterized Linear Models, and its Manifestation in Deep Neural Networks JMLR 2022 Proof of Learning: Towards a Practical Blockchain Consensus Mechanism Using Directed Guiding Gradients (Student Abstract) AAAI 2022 Random Sharpness-Aware Minimization NeurIPS 2022 SAPipe: Staleness-Aware Pipeline for Data Parallel DNN Training NeurIPS 2022 Scaled ReLU Matters for Training Vision Transformers AAAI 2022 Secure Quantized Training for Deep Learning ICML 2022 SynthMap: a generative model for synthesis of 3D datasets for quantitative MRI parameter mapping of myelin water fraction MIDL 2022 Towards Understanding the Condensation of Neural Networks at Initial Training NeurIPS 2022 When Hardness of Approximation Meets Hardness of Learning JMLR 2022 AC-GC: Lossy Activation Compression with Guaranteed Convergence NeurIPS 2021 Adaptive Proximal Gradient Methods for Structured Neural Networks NeurIPS 2021 An Empirical Study of Training Self-Supervised Vision Transformers ICCV 2021 An Online Method for A Class of Distributionally Robust Optimization with Non-convex Objectives NeurIPS 2021 Asynchronous Optimization Methods for Efficient Training of Deep Neural Networks with Guarantees AAAI 2021 ATP: In-network Aggregation for Multi-tenant Learning NSDI 2021