Neural Network Optimization

Learning to Boost Training by Periodic Nowcasting Near Future Weights ICML 2023 Learning to Generalize Provably in Learning to Optimize AISTATS 2023 Learning Trajectories are Generalization Indicators NeurIPS 2023 Learning with Auxiliary Activation for Memory-Efficient Training ICLR 2023 LECO: Improving Early Exiting via Learned Exits and Comparison-based Exiting Mechanism ACL 2023 Leveraging the two-timescale regime to demonstrate convergence of neural networks NeurIPS 2023 Linear Convergence of Gradient Descent For Finite Width Over-parametrized Linear Networks With General Initialization AISTATS 2023 Linear Regularizers Enforce the Strict Saddle Property AAAI 2023 Local Temperature Beam Search: Avoid Neural Text DeGeneration via Enhanced Calibration ACL 2023 LOFT: Finding Lottery Tickets through Filter-wise Training AISTATS 2023 Lon-eå at SemEval-2023 Task 11: A Comparison of Activation Functions for Soft and Hard Label Prediction SemEval 2023 Lookaround Optimizer: k steps around, 1 step average NeurIPS 2023 Loss Landscapes are All You Need: Neural Network Generalization Can Be Explained Without the Implicit Bias of Gradient Descent ICLR 2023 Lottery Pools: Winning More by Interpolating Tickets without Increasing Training or Inference Cost AAAI 2023 Lottery Tickets in Evolutionary Optimization: On Sparse Backpropagation-Free Trainability ICML 2023 Low Complexity Homeomorphic Projection to Ensure Neural-Network Solution Feasibility for Optimization over (Non-)Convex Set ICML 2023 Low-Light Image Enhancement Network Based on Multi-Scale Feature Complementation AAAI 2023 Low-Variance Gradient Estimation in Unrolled Computation Graphs with ES-Single ICML 2023 Machine learning detects terminal singularities NeurIPS 2023 Making Scalable Meta Learning Practical NeurIPS 2023 Maximal Initial Learning Rates in Deep ReLU Networks ICML 2023 Max-Margin Token Selection in Attention Mechanism NeurIPS 2023 MCR-Data2vec 2.0: Improving Self-supervised Speech Pre-training via Model-level Consistency Regularization Interspeech 2023 Measuring the Instability of Fine-Tuning ACL 2023 Mechanic: A Learning Rate Tuner NeurIPS 2023