Neural Network Optimization

MLP Can Be A Good Transformer Learner CVPR 2024 Model Balancing Helps Low-data Training and Fine-tuning EMNLP 2024 MogaNet: Multi-order Gated Aggregation Network ICLR 2024 More is Better: when Infinite Overparameterization is Optimal and Overfitting is Obligatory ICLR 2024 MSA-DPCRN: A Multi-Scale Asymmetric Dual-Path Convolution Recurrent Network with Attentional Feature Fusion for Acoustic Echo Cancellation Interspeech 2024 Navigate Beyond Shortcuts: Debiased Learning Through the Lens of Neural Collapse CVPR 2024 Neglected Hessian component explains mysteries in sharpness regularization NeurIPS 2024 Nesterov acceleration despite very noisy gradients NeurIPS 2024 Neural Characteristic Activation Analysis and Geometric Parameterization for ReLU Networks NeurIPS 2024 Neural Echos: Depthwise Convolutional Filters Replicate Biological Receptive Fields WACV 2024 Neural Fine-Tuning Search for Few-Shot Learning ICLR 2024 Neural Network Approximation for Pessimistic Offline Reinforcement Learning AAAI 2024 Neural Network-Based Score Estimation in Diffusion Models: Optimization and Generalization ICLR 2024 Neural Networks with Sparse Activation Induced by Large Bias: Tighter Analysis with Bias-Generalized NTK JMLR 2024 Neural Time-Reversed Generalized Riccati Equation AAAI 2024 Neuron Specialization: Leveraging Intrinsic Task Modularity for Multilingual Machine Translation EMNLP 2024 Neuro-Visualizer: A Novel Auto-Encoder-Based Loss Landscape Visualization Method With an Application in Knowledge-Guided Machine Learning ICML 2024 NeurRev: Train Better Sparse Neural Network Practically via Neuron Revitalization ICLR 2024 Newton Losses: Using Curvature Information for Learning with Differentiable Algorithms NeurIPS 2024 N-gram-Based Preprocessing for Sandhi Reversion in Vedic Sanskrit EMNLP 2024 Noisy Interpolation Learning with Shallow Univariate ReLU Networks ICLR 2024 Non-asymptotic Analysis of Biased Adaptive Stochastic Approximation NeurIPS 2024 Non-asymptotic Convergence of Training Transformers for Next-token Prediction NeurIPS 2024 Normalization and effective learning rates in reinforcement learning NeurIPS 2024 Normalized Narrow Jump To Conclusions: Normalized Narrow Shortcuts for Parameter Efficient Early Exit Transformer Prediction EMNLP 2024