conftrace_
← Optimization & Theory
Machine Learning › Optimization & Theory ›

Neural Network Optimization

3,648 papers

Papers per year

2
5
40
414
386
'05
'10
'15
'20
'25

Papers

Symmetric Dot-Product Attention for Efficient Training of BERT Language Models ACL 2024
Batch-ICL: Effective, Efficient, and Order-Agnostic In-Context Learning ACL 2024
Exploiting Positional Bias for Query-Agnostic Generative Content in Search ACL 2024
BranchNorm: Robustly Scaling Extremely Deep Transformers ACL 2024
AdaLomo: Low-memory Optimization with Adaptive Learning Rate ACL 2024
Progressive Tuning: Towards Generic Sentiment Abilities for Large Language Models ACL 2024
Found in the middle: Calibrating Positional Attention Bias Improves Long Context Utilization ACL 2024
CATT: Character-based Arabic Tashkeel Transformer ACL 2024
HGP-NLP at BioLaySumm: Leveraging LoRA for Lay Summarization of Biomedical Research Articles using Seq2Seq Transformers ACL 2024
An Eye Opener Regarding Task-Based Text Gradient Saliency ACL 2024
Fine-tuning after Prompting: an Explainable Way for Classification ACL 2024
UWB at WASSA-2024 Shared Task 2: Cross-lingual Emotion Detection ACL 2024
Mechanics of Next Token Prediction with Self-Attention AISTATS 2024
Adaptive Quasi-Newton and Anderson Acceleration Framework with Explicit Global (Accelerated) Convergence Rates AISTATS 2024
Enhancing Hypergradients Estimation: A Study of Preconditioning and Reparameterization AISTATS 2024
Diagonalisation SGD: Fast & Convergent SGD for Non-Differentiable Models via Reparameterisation and Smoothing AISTATS 2024
Implicit Regularization in Deep Tucker Factorization: Low-Rankness via Structured Sparsity AISTATS 2024
Spectrum Extraction and Clipping for Implicitly Linear Layers AISTATS 2024
Implicit Bias in Noisy-SGD: With Applications to Differentially Private Training AISTATS 2024
Taming Nonconvex Stochastic Mirror Descent with General Bregman Divergence AISTATS 2024
Leveraging Continuous Time to Understand Momentum When Training Diagonal Linear Networks AISTATS 2024
On the Impact of Overparameterization on the Training of a Shallow Neural Network in High Dimensions AISTATS 2024
The effect of Leaky ReLUs on the training and generalization of overparameterized networks AISTATS 2024
Understanding the Generalization Benefits of Late Learning Rate Decay AISTATS 2024
A Cubic-regularized Policy Newton Algorithm for Reinforcement Learning AISTATS 2024