random initialization

Gradient Span Algorithms Make Predictable Progress in High Dimension JMLR 2026 Deep Linear Network Training Dynamics from Random Initialization: Data, Width, Depth, and Hyperparameter Transfer ICML 2025 Implicit Regularization for Tubal Tensor Factorizations via Gradient Descent ICML 2025 Learning Gaussian Multi-Index Models with Gradient Flow: Time Complexity and Directional Convergence AISTATS 2025 Sparse Training from Random Initialization: Aligning Lottery Ticket Masks using Weight Symmetry ICML 2025 Alternating minimization for generalized rank one matrix sensing: Sharp predictions from a random initialization ALT 2024 On the Impacts of the Random Initialization in the Neural Tangent Kernel Theory NeurIPS 2024 A General Framework For Proving The Equivariant Strong Lottery Ticket Hypothesis ICLR 2023 Online Stochastic Gradient Descent with Arbitrary Initialization Solves Non-smooth, Non-convex Phase Retrieval JMLR 2023 Rank-1 Matrix Completion with Gradient Descent and Small Random Initialization NeurIPS 2023 A Johnson-Lindenstrauss Framework for Randomly Initialized CNNs ICLR 2022 A proof of convergence for the gradient descent optimization method with random initializations in the training of neural networks with ReLU activation for piecewise linear target functions JMLR 2022 A Random CNN Sees Objects: One Inductive Bias of CNN and Its Applications AAAI 2022 Deep Limits and a Cut-Off Phenomenon for Neural Networks JMLR 2022 Effects of Data Geometry in Early Deep Learning NeurIPS 2022 On the Complementarity between Pre-Training and Random-Initialization for Resource-Rich Machine Translation COLING 2022 Peek-a-Boo: What (More) is Disguised in a Randomly Weighted Neural Network, and How to Find It Efficiently ICLR 2022 Robust Binary Models by Pruning Randomly-initialized Networks NeurIPS 2022 Vanishing Curvature in Randomly Initialized Deep ReLU Networks AISTATS 2022 On the Random Conjugate Kernel and Neural Tangent Kernel ICML 2021 Pruning Randomly Initialized Neural Networks with Iterative Randomization NeurIPS 2021 Reservoir Transformers ACL 2021 Training BatchNorm and Only BatchNorm: On the Expressive Power of Random Features in CNNs ICLR 2021 Batch normalization provably avoids ranks collapse for randomly initialised deep networks NeurIPS 2020 Fast is better than free: Revisiting adversarial training ICLR 2020