neural network optimization

Phase diagram of early training dynamics in deep neural networks: effect of the learning rate, depth, and width NeurIPS 2023 PICProp: Physics-Informed Confidence Propagation for Uncertainty Quantification NeurIPS 2023 Polarity Is All You Need to Learn and Transfer Faster ICML 2023 Pre-RMSNorm and Pre-CRMSNorm Transformers: Equivalent and Efficient Pre-LN Transformers NeurIPS 2023 Primal and Dual Analysis of Entropic Fictitious Play for Finite-sum Problems ICML 2023 Principled Weight Initialisation for Input-Convex Neural Networks NeurIPS 2023 Probabilistic Weight Fixing: Large-scale training of neural network weight uncertainties for quantisation. NeurIPS 2023 Progress measures for grokking via mechanistic interpretability ICLR 2023 Pruning Parameterization With Bi-Level Optimization for Efficient Semantic Segmentation on the Edge CVPR 2023 Rapid Network Adaptation: Learning to Adapt Neural Networks Using Test-Time Feedback ICCV 2023 Rebalancing Batch Normalization for Exemplar-Based Class-Incremental Learning CVPR 2023 Regret Guarantees for Online Deep Control L4DC 2023 Reinforcement Learning for Branch-and-Bound Optimisation Using Retrospective Trajectories AAAI 2023 REPAIR: REnormalizing Permuted Activations for Interpolation Repair ICLR 2023 Reparameterization through Spatial Gradient Scaling ICLR 2023 Re-parameterizing Your Optimizers rather than Architectures ICLR 2023 Resilient Binary Neural Network AAAI 2023 Rethinking skip connection model as a learnable Markov chain ICLR 2023 Rethinking the Visual Cues in Audio-Visual Speaker Extraction Interspeech 2023 REVISITING PRUNING AT INITIALIZATION THROUGH THE LENS OF RAMANUJAN GRAPH ICLR 2023 Revisiting Token Dropping Strategy in Efficient BERT Pretraining ACL 2023 RLEKF: An Optimizer for Deep Potential with Ab Initio Accuracy AAAI 2023 Robust Generalization Against Photon-Limited Corruptions via Worst-Case Sharpness Minimization CVPR 2023 SAM operates far from home: eigenvalue regularization as a dynamical phenomenon ICML 2023 SAMP: A Model Inference Toolkit of Post-Training Quantization for Text Processing via Self-Adaptive Mixed-Precision EMNLP 2023