conftrace_
← Optimization & Theory
Deep Learning › Optimization & Theory ›

Theory

1,082 papers

Papers per year

4
2
97
81
'10
'15
'20
'25

Papers

Softmax Bottleneck Makes Language Models Unable to Represent Multi-mode Word Distributions ACL 2022
ODE Transformer: An Ordinary Differential Equation-Inspired Model for Sequence Generation ACL 2022
Probing for the Usage of Grammatical Number ACL 2022
Emergent Structures and Training Dynamics in Large Language Models ACL 2022
On Isotropy Calibration of Transformer Models ACL 2022
Embedded Ensembles: infinite width limit and operating regimes AISTATS 2022
A Random Matrix Perspective on Mixtures of Nonlinearities in High Dimensions AISTATS 2022
A Spectral Perspective of DNN Robustness to Label Noise AISTATS 2022
How and When Random Feedback Works: A Case Study of Low-Rank Matrix Factorization AISTATS 2022
Faster Single-loop Algorithms for Minimax Optimization without Strong Concavity AISTATS 2022
On the equivalence of Oja’s algorithm and GROUSE AISTATS 2022
Vanishing Curvature in Randomly Initialized Deep ReLU Networks AISTATS 2022
Convex Analysis of the Mean Field Langevin Dynamics AISTATS 2022
On the Implicit Bias of Gradient Descent for Temporal Extrapolation AISTATS 2022
3DeformRS: Certifying Spatial Deformations on Point Clouds CVPR 2022
Evading the Simplicity Bias: Training a Diverse Set of Models Discovers Solutions With Superior OOD Generalization CVPR 2022
Eigencontours: Novel Contour Descriptors Based on Low-Rank Approximation CVPR 2022
Understanding Uncertainty Maps in Vision With Statistical Testing CVPR 2022
Towards Better Understanding Attribution Methods CVPR 2022
OoD-Bench: Quantifying and Understanding Two Dimensions of Out-of-Distribution Generalization CVPR 2022
Can Neural Nets Learn the Same Model Twice? Investigating Reproducibility and Double Descent From the Decision Boundary Perspective CVPR 2022
Demystifying the Neural Tangent Kernel From a Practical Perspective: Can It Be Trusted for Neural Architecture Search Without Training? CVPR 2022
How Much More Data Do I Need? Estimating Requirements for Downstream Tasks CVPR 2022
Language Model Decomposition: Quantifying the Dependency and Correlation of Language Models EMNLP 2022
Exploring Mode Connectivity for Pre-trained Language Models EMNLP 2022