second-order optimization

Second-order forward-mode optimization of recurrent neural networks for neuroscience NeurIPS 2024 Sketched Newton Value Iteration for Large-Scale Markov Decision Processes AAAI 2024 SOUL: Unlocking the Power of Second-Order Optimization for LLM Unlearning EMNLP 2024 The Challenges of the Nonlinear Regime for Physics-Informed Neural Networks NeurIPS 2024 The Iterative Optimal Brain Surgeon: Faster Sparse Recovery by Leveraging Second-Order Information NeurIPS 2024 Transformers Learn to Achieve Second-Order Convergence Rates for In-Context Linear Regression NeurIPS 2024 VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models EMNLP 2024 A Computationally Efficient Sparsified Online Newton Method NeurIPS 2023 A Mini-Block Fisher Method for Deep Neural Networks AISTATS 2023 Curvature-Aware Training for Coordinate Networks ICCV 2023 Eva: Practical Second-order Optimization with Kronecker-vectorized Approximation ICLR 2023 Fisher-Legendre (FishLeg) optimization of deep neural networks ICLR 2023 Kronecker-Factored Approximate Curvature for Modern Neural Network Architectures NeurIPS 2023 Krylov–Bellman boosting: Super-linear policy evaluation in general state spaces AISTATS 2023 Learning the Positions in CountSketch ICLR 2023 MARS: A Second-Order Reduction Algorithm for High-Dimensional Sparse Precision Matrices Estimation JMLR 2023 Optimal Shrinkage for Distributed Second-Order Optimization ICML 2023 Samples With Low Loss Curvature Improve Data Efficiency CVPR 2023 Second-Order Optimization with Lazy Hessians ICML 2023 Simplifying Momentum-based Positive-definite Submanifold Optimization with Applications to Deep Learning ICML 2023 Sketchy: Memory-efficient Adaptive Regularization with Frequent Directions NeurIPS 2023 Adaptive Second Order Coresets for Data-efficient Machine Learning ICML 2022 Chaotic Dynamics are Intrinsic to Neural Network Training with SGD NeurIPS 2022 Combining (Second-Order) Graph-Based and Headed-Span-Based Projective Dependency Parsing ACL 2022 Enhancing Adversarial Training With Second-Order Statistics of Weights CVPR 2022