Neural Networks

The CLRS Algorithmic Reasoning Benchmark ICML 2022 The computational and learning benefits of Daleian neural networks NeurIPS 2022 The Convex Geometry of Backpropagation: Neural Network Gradient Flows Converge to Extreme Points of the Dual Convex Program ICLR 2022 The Devil Is in the Pose: Ambiguity-Free 3D Rotation-Invariant Learning via Pose-Aware Convolution CVPR 2022 The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns via Spotlights of Attention ICML 2022 The Grammar-Learning Trajectories of Neural Language Models ACL 2022 The Hidden Convex Optimization Landscape of Regularized Two-Layer ReLU Networks: an Exact Characterization of Optimal Solutions ICLR 2022 The Interplay Between Implicit Bias and Benign Overfitting in Two-Layer Linear Networks JMLR 2022 The lack of theory is painful: Modeling Harshness in Peer Review Comments AACL 2022 The merged-staircase property: a necessary and nearly sufficient condition for SGD learning of sparse functions on two-layer neural networks COLT 2022 The Neural Covariance SDE: Shaped Infinite Depth-and-Width Networks at Initialization NeurIPS 2022 The Neural Race Reduction: Dynamics of Abstraction in Gated Networks ICML 2022 Theoretical analysis of deep neural networks for temporally dependent observations NeurIPS 2022 Theoretically Provable Spiking Neural Networks NeurIPS 2022 The Paradox of the Compositionality of Natural Language: A Neural Machine Translation Case Study ACL 2022 The role of optimization geometry in single neuron learning AISTATS 2022 The Role of Permutation Invariance in Linear Mode Connectivity of Neural Networks ICLR 2022 The Sample Complexity of One-Hidden-Layer Neural Networks NeurIPS 2022 The Separation Capacity of Random Neural Networks JMLR 2022 The SIGTYP 2022 Shared Task on the Prediction of Cognate Reflexes NAACL 2022 The trade-offs of model size in large recommendation models : 100GB to 10MB Criteo-tb DLRM model NeurIPS 2022 The Uncanny Similarity of Recurrence and Depth ICLR 2022 The Untapped Potential of Off-the-Shelf Convolutional Neural Networks WACV 2022 Tighter Sparse Approximation Bounds for ReLU Neural Networks ICLR 2022 Tight Neural Network Verification via Semidefinite Relaxations and Linear Reformulations AAAI 2022