David Leo Wright Hall
4 papers · 2024–2026 · 2 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓
🌍
Conference Polyglot · Bronze
🌉
Interdisciplinary Bridge · Bronze
Top co-authors
Research topics
Keywords
stochastic optimization
(1)
transformer architecture
(1)
neural network optimization
(1)
loss landscape
(1)
model interpretability
(1)
gradient descent
(1)
lyapunov exponent
(1)
spectral analysis
(1)
neural ordinary differential equation
(1)
language model
(1)
learning rate schedule
(1)
language model pretraining
(1)
text extraction
(1)
large language model
(1)
pretraining data
(1)
hessian estimation
(1)
second-order optimizer
(1)
pretraining loss
(1)
html extraction
(1)
token yield
(1)
Papers
Beyond a Single Extractor: Re-thinking HTML-to-Text Extraction for LLM Pre-training
EACL 2026
Neural ODE Transformers: Analyzing Internal Dynamics and Adaptive Fine-tuning
ICLR 2025
Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape View
ICLR 2025
Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training
ICLR 2024