conftrace_

gradient descent

1144 papers

Explore in graph

Also known as

GD

Co-occurring keywords

neural network (6616) neural network optimization (1293) convex optimization (1321) non-convex optimization (547) convergence rate (607) stochastic optimization (1060) convergence analysis (395) stochastic gradient descent (1091) nonconvex optimization (316) implicit bia (107)

Papers

Which Features are Learnt by Contrastive Learning? On the Role of Simplicity Bias in Class Collapse and Feature Suppression ICML 2023
Linear CNNs Discover the Statistical Structure of the Dataset Using Only the Most Dominant Frequencies ICML 2023
Gradient Descent Monotonically Decreases the Sharpness of Gradient Flow Solutions in Scalar Networks and Beyond ICML 2023
Gradient Descent Finds the Global Optima of Two-Layer Physics-Informed Neural Networks ICML 2023
On the Dynamics Under the Unhinged Loss and Beyond JMLR 2023
3D Shape Reconstruction of Semi-Transparent Worms CVPR 2023
Low Tensor Rank Learning of Neural Dynamics NIPS 2023
SVD-NAS: Coupling Low-Rank Approximation and Neural Architecture Search WACV 2023
Lightweight Projective Derivative Codes for Compressed Asynchronous Gradient Descent ICML 2022
Deep Networks on Toroids: Removing Symmetries Reveals the Structure of Flat Regions in the Landscape Geometry ICML 2022
Constrained Gradient Descent: A Powerful and Principled Evasion Attack Against Neural Networks ICML 2022
Modality Competition: What Makes Joint Training of Multi-modal Network Fail in Deep Learning? (Provably) ICML 2022
Gradient Descent on Neurons and its Link to Approximate Second-order Optimization ICML 2022
Understanding Gradient Descent on the Edge of Stability in Deep Learning ICML 2022
Towards Understanding Sharpness-Aware Minimization ICML 2022
Generalized Federated Learning via Sharpness Aware Minimization ICML 2022
On the difficulty of learning chaotic dynamics with RNNs NIPS 2022
An Initial Alignment between Neural Network and Target is Needed for Gradient Descent to Learn ICML 2022
Implicit Bias of Gradient Descent on Reparametrized Models: On Equivalence to Mirror Descent NIPS 2022
The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns via Spotlights of Attention ICML 2022
Reverse-mode differentiation in arbitrary tensor network format: with application to supervised learning JMLR 2022
A Simple Guard for Learned Optimizers ICML 2022
Nesterov Accelerated Shuffling Gradient Method for Convex Optimization ICML 2022
Differentiable Stereopsis: Meshes From Multiple Views Using Differentiable Rendering CVPR 2022
Dataset Distillation by Matching Training Trajectories CVPR 2022