conftrace_

gradient flow

142 papers

Explore in graph

Also known as

GF

Co-occurring keywords

neural network (6616) gradient descent (1144) optimal transport (948) implicit bia (107) relu network (143) neural network optimization (1293) stochastic gradient descent (1091) convergence analysis (395) variational inference (2069) wasserstein distance (417)

Papers

High-dimensional limit theorems for SGD: Effective dynamics and critical scaling NIPS 2022
Learning single-index models with shallow neural networks NIPS 2022
Toward Equation of Motion for Deep Neural Networks: Continuous-time Gradient Descent and Discretization Error Analysis NIPS 2022
On Transportation of Mini-batches: A Hierarchical Approach ICML 2022
Implicit Bias of Gradient Descent on Reparametrized Models: On Equivalence to Mirror Descent NIPS 2022
Do Residual Neural Networks discretize Neural Ordinary Differential Equations? NIPS 2022
Winning the Lottery Ahead of Time: Efficient Early Network Pruning ICML 2022
Convergence beyond the over-parameterized regime using Rayleigh quotients NIPS 2022
Old can be Gold: Better Gradient Flow can Make Vanilla-GCNs Great Again NIPS 2022
The Interplay Between Implicit Bias and Benign Overfitting in Two-Layer Linear Networks JMLR 2022
Data-Enabled Gradient Flow as Feedback Controller: Regulation of Linear Dynamical Systems to Minimizers of Unknown Functions L4DC 2022
Existence, Stability and Scalability of Orthogonal Convolutional Neural Networks JMLR 2022
Distributed Stochastic Gradient Descent: Nonconvexity, Nonsmoothness, and Convergence to Local Minima JMLR 2022
Distributionally Robust Optimization with Data Geometry NIPS 2022
You Only Need One Model for Open-domain Question Answering EMNLP 2022
On Margin Maximization in Linear and ReLU Networks NIPS 2022
From Gradient Flow on Population Loss to Learning with Stochastic Gradient Descent NIPS 2022
On the Effective Number of Linear Regions in Shallow Univariate ReLU Networks: Convergence Guarantees and Implicit Bias NIPS 2022
Mean-field Analysis of Piecewise Linear Solutions for Wide ReLU Networks JMLR 2022
Mirrorless Mirror Descent: A Natural Derivation of Mirror Descent AISTATS 2021
Improving Gradient Flow with Unrolled Highway Expectation Maximization AAAI 2021
Model, sample, and epoch-wise descents: exact solution of gradient flow in the random feature model NIPS 2021
Implicit Bias of SGD for Diagonal Linear Networks: a Provable Benefit of Stochasticity NIPS 2021
Learning Node Representations Using Stationary Flow Prediction on Large Payment and Cash Transaction Networks ICML 2021
On the Implicit Bias of Initialization Shape: Beyond Infinitesimal Mirror Descent ICML 2021