Skip to content
conftrace_

rank deficiency

5 papers

Explore in graph

Co-occurring keywords · papers mentioning both

neural network optimization (3) neural network (2) neural network hessian (1) optimization layer (1) linear dependence (1) linear network (1) eigenvalue dynamics (1) stochastic differential equation (1) deep linear network (1) small language model (1)

Papers

Investigating ReLoRA: Effects on the Learning Dynamics of Small Language Models EMNLP 2025 SGD vs GD: Rank Deficiency in Linear Networks NeurIPS 2024 Beyond NaN: Resiliency of Optimization Layers in the Face of Infeasibility AAAI 2023 Rank Diminishing in Deep Neural Networks NeurIPS 2022 Analytic Insights into Structure and Rank of Neural Network Hessian Maps NeurIPS 2021