gradient descent

The Implicit Bias of Gradient Descent toward Collaboration between Layers: A Dynamic Analysis of Multilayer Perceptions NeurIPS 2024 The Sample Complexity of Gradient Descent in Stochastic Convex Optimization NeurIPS 2024 Three-Way Trade-Off in Multi-Objective Learning: Optimization, Generalization and Conflict-Avoidance JMLR 2024 Tight Convergence Rate Bounds for Optimization Under Power Law Spectral Conditions JMLR 2024 Toward Global Convergence of Gradient EM for Over-Paramterized Gaussian Mixture Models NeurIPS 2024 Towards a Theoretical Understanding of the 'Reversal Curse' via Training Dynamics NeurIPS 2024 Towards Lossless Dataset Distillation via Difficulty-Aligned Trajectory Matching ICLR 2024 Towards Unbiased Exploration in Partial Label Learning JMLR 2024 TrAct: Making First-layer Pre-Activations Trainable NeurIPS 2024 Training Integrable Parameterizations of Deep Neural Networks in the Infinite-Width Limit JMLR 2024 Transformers Implement Functional Gradient Descent to Learn Non-Linear Functions In Context ICML 2024 Transformers Provably Learn Sparse Token Selection While Fully-Connected Nets Cannot ICML 2024 Understanding and Improving Training-free Loss-based Diffusion Guidance NeurIPS 2024 Understanding Surprising Generalization Phenomena in Deep Learning AAAI 2024 Unified Gradient-Based Machine Unlearning with Remain Geometry Enhancement NeurIPS 2024 Unleashing the Denoising Capability of Diffusion Prior for Solving Inverse Problems NeurIPS 2024 Unraveling the Gradient Descent Dynamics of Transformers NeurIPS 2024 Unveil Benign Overfitting for Transformer in Vision: Training Dynamics, Convergence, and Generalization NeurIPS 2024 User-level Differentially Private Stochastic Convex Optimization: Efficient Algorithms with Optimal Rates AISTATS 2024 VeLoRA: Memory Efficient Training using Rank-1 Sub-Token Projections NeurIPS 2024 When can transformers reason with abstract symbols? ICLR 2024 Why Do You Grok? A Theoretical Analysis on Grokking Modular Addition ICML 2024 3D Shape Reconstruction of Semi-Transparent Worms CVPR 2023 Accelerating Inverse Learning via Intelligent Localization with Exploratory Sampling AAAI 2023 AdaTask: A Task-Aware Adaptive Learning Rate Approach to Multi-Task Learning AAAI 2023