gradient descent

Large Stepsize Gradient Descent for Non-Homogeneous Two-Layer Networks: Margin Improvement and Fast Optimization NeurIPS 2024 Learning Hierarchical Polynomials with Three-Layer Neural Networks ICLR 2024 Learning Low-Rank Tensor Cores with Probabilistic ℓ0-Regularized Rank Selection for Model Compression IJCAI 2024 Learning Multi-Agent Communication from Graph Modeling Perspective ICLR 2024 Learning Pseudo-Contractive Denoisers for Inverse Problems ICML 2024 Learning sum of diverse features: computational hardness and efficient gradient-based training for ridge combinations COLT 2024 Learning Ultrametric Trees for Optimal Transport Regression AAAI 2024 LoRA Training in the NTK Regime has No Spurious Local Minima ICML 2024 Matching the Statistical Query Lower Bound for k-Sparse Parity Problems with Sign Stochastic Gradient Descent NeurIPS 2024 Mechanics of Next Token Prediction with Self-Attention AISTATS 2024 Memory-Efficient LLM Training with Online Subspace Descent NeurIPS 2024 MetaDiff: Meta-Learning with Conditional Diffusion for Few-Shot Learning AAAI 2024 Minimizing UCB: a Better Local Search Strategy in Local Bayesian Optimization NeurIPS 2024 Mirror and Preconditioned Gradient Descent in Wasserstein Space NeurIPS 2024 Mitigating Privacy Risk in Membership Inference by Convex-Concave Loss ICML 2024 Model Based Inference of Synaptic Plasticity Rules NeurIPS 2024 MomentumSMoE: Integrating Momentum into Sparse Mixture of Experts NeurIPS 2024 Nesterov acceleration despite very noisy gradients NeurIPS 2024 Neural collapse vs. low-rank bias: Is deep neural collapse really optimal? NeurIPS 2024 Neural Network-Based Score Estimation in Diffusion Models: Optimization and Generalization ICLR 2024 Neural Redshift: Random Networks are not Random Functions CVPR 2024 Newton Losses: Using Curvature Information for Learning with Differentiable Algorithms NeurIPS 2024 Nonparametric Teaching of Implicit Neural Representations ICML 2024 Non-stationary Projection-Free Online Learning with Dynamic and Adaptive Regret Guarantees AAAI 2024 Offline Model-Based Optimization via Policy-Guided Gradient Search AAAI 2024