Optimization & Theory

Global Convergence Analysis of Local SGD for Two-layer Neural Network without Overparameterization NeurIPS 2023 Global Convergence of Over-parameterized Deep Equilibrium Models AISTATS 2023 Global Convergence of Sub-gradient Method for Robust Matrix Recovery: Small Initialization, Noisy Measurements, and Over-parameterization JMLR 2023 Global optimality for Euclidean CCCP under Riemannian convexity ICML 2023 Global optimality of Elman-type RNNs in the mean-field regime ICML 2023 Global Vision Transformer Pruning With Hessian-Aware Saliency CVPR 2023 GOHSP: A Unified Framework of Graph and Optimization-Based Heterogeneous Structured Pruning for Vision Transformer AAAI 2023 Gold Doesn’t Always Glitter: Spectral Removal of Linear and Nonlinear Guarded Attribute Information EACL 2023 Gold-YOLO: Efficient Object Detector via Gather-and-Distribute Mechanism NeurIPS 2023 GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints EMNLP 2023 Gradient-based Gradual Pruning for Language-Specific Multilingual Neural Machine Translation EMNLP 2023 Gradient Descent Converges Linearly for Logistic Regression on Separable Data ICML 2023 Gradient Descent Finds the Global Optima of Two-Layer Physics-Informed Neural Networks ICML 2023 Gradient Descent in Neural Networks as Sequential Learning in Reproducing Kernel Banach Space ICML 2023 Gradient Descent Monotonically Decreases the Sharpness of Gradient Flow Solutions in Scalar Networks and Beyond ICML 2023 Gradient Descent with Linearly Correlated Noise: Theory and Applications to Differential Privacy NeurIPS 2023 Graph Neural Networks are Inherently Good Generalizers: Insights by Bridging GNNs and MLPs ICLR 2023 Graph Structure Learning via Lottery Hypothesis at Scale ACML 2023 Greedy Poisson Rejection Sampling NeurIPS 2023 GreenKGC: A Lightweight Knowledge Graph Completion Method ACL 2023 GWQ: Group-Wise Quantization Framework for Neural Networks ACML 2023 H3T: Efficient Integration of Memory Optimization and Parallelism for Large-scale Transformer Training NeurIPS 2023 HadSkip: Homotopic and Adaptive Layer Skipping of Pre-trained Language Models for Efficient Inference EMNLP 2023 HALOC: Hardware-Aware Automatic Low-Rank Compression for Compact Neural Networks AAAI 2023 HalOmi: A Manually Annotated Benchmark for Multilingual Hallucination and Omission Detection in Machine Translation EMNLP 2023