Neural Network Optimization

The Implicit Bias of Minima Stability: A View from Function Space NeurIPS 2021 The Lipschitz Constant of Self-Attention ICML 2021 The LOB Recreation Model: Predicting the Limit Order Book from TAQ History Using an Ordinary Differential Equation Recurrent Neural Network AAAI 2021 The Power of Factorial Powers: New Parameter settings for (Stochastic) Optimization ACML 2021 The Recurrent Neural Tangent Kernel ICLR 2021 The Successful Ingredients of Policy Gradient Algorithms IJCAI 2021 THOR, Trace-based Hardware-driven Layer-Oriented Natural Gradient Descent Computation AAAI 2021 Tilting the playing field: Dynamical loss functions for machine learning ICML 2021 Time Adaptive Recurrent Neural Network CVPR 2021 TIMERS: Document-level Temporal Relation Extraction ACL 2021 Towards a Unified Game-Theoretic View of Adversarial Perturbations and Robustness NeurIPS 2021 Towards Deeper Deep Reinforcement Learning with Spectral Normalization NeurIPS 2021 Towards Gradient-based Bilevel Optimization with Non-convex Followers and Beyond NeurIPS 2021 Towards Improving the Consistency, Efficiency, and Flexibility of Differentiable Neural Architecture Search CVPR 2021 Towards Memory-Efficient Neural Networks via Multi-Level In Situ Generation ICCV 2021 Towards Sample Efficient Agents through Algorithmic Alignment (Student Abstract) AAAI 2021 Towards Scalable Complete Verification of Relu Neural Networks via Dependency-based Branching IJCAI 2021 Towards Understanding the Spectral Bias of Deep Learning IJCAI 2021 Towards Understanding Why Lookahead Generalizes Better Than SGD and Beyond NeurIPS 2021 Training Neural Networks with Fixed Sparse Masks NeurIPS 2021 Training Recurrent Neural Networks via Forward Propagation Through Time ICML 2021 Training Spiking Neural Networks with Accumulated Spiking Flow AAAI 2021 Train simultaneously, generalize better: Stability of gradient-based minimax learners ICML 2021 Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer NeurIPS 2021 UASNet: Uncertainty Adaptive Sampling Network for Deep Stereo Matching ICCV 2021