learning dynamics

The Influence of Learning Rule on Representation Dynamics in Wide Neural Networks ICLR 2023 Transformers learn through gradual rank increase NeurIPS 2023 Unraveling Feature Extraction Mechanisms in Neural Networks EMNLP 2023 A Few More Examples May Be Worth Billions of Parameters EMNLP 2022 Better Supervisory Signals by Observing Learning Paths ICLR 2022 Characterizing Datapoints via Second-Split Forgetting NeurIPS 2022 Convergence Rates of Non-Convex Stochastic Gradient Descent Under a Generic Lojasiewicz Condition and Local Smoothness ICML 2022 Data Augmentation as Feature Manipulation ICML 2022 Exact learning dynamics of deep linear networks with prior knowledge NeurIPS 2022 Learning dynamics of deep linear networks with multiple pathways NeurIPS 2022 On Last-Iterate Convergence Beyond Zero-Sum Games ICML 2022 On the Dynamics of Gender Learning in Speech Translation NAACL 2022 The Neural Race Reduction: Dynamics of Abstraction in Gated Networks ICML 2022 Uncoupled Learning Dynamics with $O(\log T)$ Swap Regret in Multiplayer Games NeurIPS 2022 Wide Neural Networks Forget Less Catastrophically ICML 2022 Beyond Variance Reduction: Understanding the True Impact of Baselines on Policy Optimization ICML 2021 Curriculum Learning by Optimizing Learning Dynamics AISTATS 2021 Decentralized No-regret Learning Algorithms for Extensive-form Correlated Equilibria (Extended Abstract) IJCAI 2021 Deep Learning Through the Lens of Example Difficulty NeurIPS 2021 Follow-the-Regularized-Leader Routes to Chaos in Routing Games ICML 2021 Learning in Markets: Greed Leads to Chaos but Following the Price is Right IJCAI 2021 Neural Mechanics: Symmetry and Broken Conservation Laws in Deep Learning Dynamics ICLR 2021 Noether’s Learning Dynamics: Role of Symmetry Breaking in Neural Networks NeurIPS 2021 Online Optimization in Games via Control Theory: Connecting Regret, Passivity and Poincaré Recurrence ICML 2021 Spherical Motion Dynamics: Learning Dynamics of Normalized Neural Network using SGD and Weight Decay NeurIPS 2021