Shane Bergsma
26 papers · 2005–2025 · 7 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓+2 more ↓ Show less ↑
🏃 Academic Marathon · Ultra 🌉 Interdisciplinary Bridge · Bronze 🗺️ Taxonomy Completionist (20) 🌍 Conference Polyglot · Silver 🔥 Unstoppable · Silver
💎
Century Club · Bronze
⚡
Prolific Year · Productive
Top co-authors
Research topics
Machine Learning
(4)
Deep Learning
(3)
Optimization & Theory · Deep Learning
(3)
Artificial Intelligence
(2)
Data Science & Analytics
(2)
Core AI
(2)
Core Methods
(2)
Methods
(2)
Optimization & Theory · Machine Learning
(2)
Natural Language Processing
(1)
Application Areas
(1)
Architectures
(1)
Generation
(1)
Learning Types
(1)
Models
(1)
Keywords
probabilistic forecasting
(2)
neural network optimization
(2)
neural network
(2)
time series
(2)
autoregressive model
(2)
training dynamics
(1)
sparse training
(1)
sparse neural network
(1)
sparsity level
(1)
model scaling
(1)
learning rate schedule
(1)
transformer training
(1)
model sparsity
(1)
gradient noise scale
(1)
per-example gradient
(1)
layer normalization
(1)
batch size schedule
(1)
batch size
(1)
gradient propagation
(1)
error accumulation
(1)
Papers
Straight to Zero: Why Linearly Decaying the Learning Rate to Zero Works Best for LLMs
ICLR 2025
Normalization Layer Per-Example Gradients are Sufficient to Predict Gradient Noise Scale in Transformers
NeurIPS 2024
Sparse maximal update parameterization: A holistic approach to sparse training dynamics
NeurIPS 2024
SutraNets: Sub-series Autoregressive Networks for Long-Sequence, Probabilistic Forecasting
NeurIPS 2023
C2FAR: Coarse-to-Fine Autoregressive Networks for Precise Probabilistic Forecasting
NeurIPS 2022
I’m a Belieber: Social Roles via Self-identification and Conceptual Attributes
ACL 2014
Broadly Improving User Classification via Communication-Based Name and Location Clustering on Twitter
NAACL 2013
Explicit and Implicit Syntactic Features for Text Classification
ACL 2013
Using Conceptual Class Attributes to Characterize Social Media Users
ACL 2013
Stylometric Analysis of Scientific Articles
NAACL 2012
Joint Training of Dependency Parsing Filters through Latent Support Vector Machines
ACL 2011
Using Large Monolingual and Bilingual Corpora to Improve Coordination Disambiguation
ACL 2011
Creating Robust Supervised Classifiers via Web-Scale N-Gram Data
ACL 2010
Fast and Accurate Arc Filtering for Dependency Parsing
COLING 2010
Improved Natural Language Learning via Variance-Regularization Support Vector Machines
CoNLL 2010
Predicting the Semantic Compositionality of Prefix Verbs
EMNLP 2010
Using Web-scale N-grams to Improve Base NP Parsing Performance
COLING 2010
A Ranking Approach to Stress Prediction for Letter-to-Phoneme Conversion
ACL 2009
Glen, Glenda or Glendale: Unsupervised and Semi-supervised Learning of English Noun Gender
CoNLL 2009
Discriminative Learning of Selectional Preference from Unlabeled Text
EMNLP 2008
Distributional Identification of Non-Referential Pronouns
ACL 2008
Alignment-Based Discriminative String Similarity
ACL 2007
Automatic Answer Typing for How-Questions
NAACL 2007
Learning Noun Phrase Query Segmentation
EMNLP 2007
Bootstrapping Path-Based Pronoun Resolution
ACL 2006
An Expectation Maximization Approach to Pronoun Resolution
CoNLL 2005