Neural Network Optimization

Benign Oscillation of Stochastic Gradient Descent with Large Learning Rate ICLR 2024 Benign Overfitting and Grokking in ReLU Networks for XOR Cluster Data ICLR 2024 Benign overfitting in leaky ReLU networks with moderate input dimension NeurIPS 2024 Beyond Attention: Breaking the Limits of Transformer Context Length with Recurrent Memory AAAI 2024 Beyond Fine-tuning: Unleashing the Potential of Continuous Pretraining for Clinical LLMs. EMNLP 2024 Beyond Slow Signs in High-fidelity Model Extraction NeurIPS 2024 Beyond Stationarity: Convergence Analysis of Stochastic Softmax Policy Gradient Methods ICLR 2024 Beyond the Limits: A Survey of Techniques to Extend the Context Length in Large Language Models IJCAI 2024 Bias of Stochastic Gradient Descent or the Architecture: Disentangling the Effects of Overparameterization of Neural Networks ICML 2024 Bilevel Optimization under Unbounded Smoothness: A New Algorithm and Convergence Analysis ICLR 2024 BMRS: Bayesian Model Reduction for Structured Pruning NeurIPS 2024 Boosting CTC-based ASR using inter-layer attention-based CTC loss Interspeech 2024 Boosting Generalization in Parametric PDE Neural Solvers through Adaptive Conditioning NeurIPS 2024 Bounded and Uniform Energy-based Out-of-distribution Detection for Graphs ICML 2024 BranchNorm: Robustly Scaling Extremely Deep Transformers ACL 2024 Bridging the Empirical-Theoretical Gap in Neural Network Formal Language Learning Using Minimum Description Length ACL 2024 Building on Efficient Foundations: Effective Training of LLMs with Structured Feedforward Layers NeurIPS 2024 CAILA: Concept-Aware Intra-Layer Adapters for Compositional Zero-Shot Learning WACV 2024 Can Learned Optimization Make Reinforcement Learning Less Difficult? NeurIPS 2024 Can LLMs Learn from Previous Mistakes? Investigating LLMs’ Errors to Boost for Reasoning ACL 2024 Can we get the best of both Binary Neural Networks and Spiking Neural Networks for Efficient Computer Vision? ICLR 2024 Catapults in SGD: spikes in the training loss and their impact on generalization through feature learning ICML 2024 Catch-Up Mix: Catch-Up Class for Struggling Filters in CNN AAAI 2024 CATT: Character-based Arabic Tashkeel Transformer ACL 2024 Causality-enhanced Discreted Physics-informed Neural Networks for Predicting Evolutionary Equations IJCAI 2024