Optimization & Theory

On the Convergence of Decentralized Adaptive Gradient Methods ACML 2022 On the Convergence of mSGD and AdaGrad for Stochastic Optimization ICLR 2022 On the difficulty of learning chaotic dynamics with RNNs NeurIPS 2022 On the Double Descent of Random Features Models Trained with SGD NeurIPS 2022 On the Effectiveness of Iterative Learning Control L4DC 2022 On the Effective Number of Linear Regions in Shallow Univariate ReLU Networks: Convergence Guarantees and Implicit Bias NeurIPS 2022 On the equivalence of Oja’s algorithm and GROUSE AISTATS 2022 On the expressivity of bi-Lipschitz normalizing flows ACML 2022 On the generalization of learning algorithms that do not converge NeurIPS 2022 On the Impact of Spurious Correlation for Out-of-Distribution Detection AAAI 2022 On the Implicit Bias of Gradient Descent for Temporal Extrapolation AISTATS 2022 On the Importance of Data Size in Probing Fine-tuned Models ACL 2022 On the Interpretability of Regularisation for Neural Networks Through Model Gradient Similarity NeurIPS 2022 On the Locality of Attention in Direct Speech Translation ACL 2022 On the non-universality of deep learning: quantifying the cost of symmetry NeurIPS 2022 On the Optimization Landscape of Neural Collapse under MSE Loss: Global Optimality with Unconstrained Features ICML 2022 On the Parameterization and Initialization of Diagonal State Space Models NeurIPS 2022 On the Pitfalls of Analyzing Individual Neurons in Language Models ICLR 2022 On the Practical Robustness of the Nesterov’s Accelerated Quasi-Newton Method AAAI 2022 On the SDEs and Scaling Rules for Adaptive Gradient Algorithms NeurIPS 2022 On the Sensitivity and Stability of Model Interpretations in NLP ACL 2022 On the Spectral Bias of Convolutional Neural Tangent and Gaussian Process Kernels NeurIPS 2022 On the Symmetries of Deep Learning Models and their Internal Representations NeurIPS 2022 On the Theoretical Properties of Noise Correlation in Stochastic Optimization NeurIPS 2022 OoD-Bench: Quantifying and Understanding Two Dimensions of Out-of-Distribution Generalization CVPR 2022