Theory

Beyond Lipschitz Smoothness: A Tighter Analysis for Nonconvex Optimization ICML 2023 Beyond Positive Scaling: How Negation Impacts Scaling Trends of Language Models ACL 2023 Can Infinitely Wide Deep Nets Help Small-data Multi-label Learning? ACML 2023 Certification of Distributional Individual Fairness NeurIPS 2023 Certifying Ensembles: A General Certification Theory with S-Lipschitzness ICML 2023 Complex-valued Neurons Can Learn More but Slower than Real-valued Neurons via Gradient Descent NeurIPS 2023 Critical Initialization of Wide and Deep Neural Networks using Partial Jacobians: General Theory and Applications NeurIPS 2023 Deconstructing Data Reconstruction: Multiclass, Weight Decay and General Losses NeurIPS 2023 Deep learning with kernels through RKHM and the Perron-Frobenius operator NeurIPS 2023 Deep linear networks can benignly overfit when shallow ones do JMLR 2023 Demystifying Oversmoothing in Attention-Based Graph Neural Networks NeurIPS 2023 Differentiable Sampling of Categorical Distributions Using the CatLog-Derivative Trick NeurIPS 2023 Diffusion Models are Minimax Optimal Distribution Estimators ICML 2023 Dropout Training is Distributionally Robust Optimal JMLR 2023 Effective Minkowski Dimension of Deep Nonparametric Regression: Function Approximation and Statistical Theories ICML 2023 Efficient Global Robustness Certification of Neural Networks via Interleaving Twin-Network Encoding (Extended Abstract) IJCAI 2023 Emergent Asymmetry of Precision and Recall for Measuring Fidelity and Diversity of Generative Models in High Dimensions ICML 2023 Emergent Inabilities? Inverse Scaling Over the Course of Pretraining EMNLP 2023 Energy Transformer NeurIPS 2023 Experimental Observations of the Topology of Convolutional Neural Network Activations AAAI 2023 Exploring Geometry of Blind Spots in Vision models NeurIPS 2023 Exploring the Relationship Between Architectural Design and Adversarially Robust Generalization CVPR 2023 Fast Convergence in Learning Two-Layer Neural Networks with Separable Data AAAI 2023 Feature learning in deep classifiers through Intermediate Neural Collapse ICML 2023 Feature selection and low test error in shallow low-rotation ReLU networks ICLR 2023