conftrace_

rank deficiency

5 papers

Explore in graph

Co-occurring keywords

neural network optimization (1293) neural network (6616) eigenvalue dynamics (1) stochastic differential equation (181) deep linear network (25) small language model (204) network rank (1) second-order derivative (3) neural network hessian (1) optimization layer (2)

Papers

Investigating ReLoRA: Effects on the Learning Dynamics of Small Language Models EMNLP 2025
SGD vs GD: Rank Deficiency in Linear Networks NIPS 2024
Beyond NaN: Resiliency of Optimization Layers in the Face of Infeasibility AAAI 2023
Rank Diminishing in Deep Neural Networks NIPS 2022
Analytic Insights into Structure and Rank of Neural Network Hessian Maps NIPS 2021