Bobby He
10 papers · 2020–2025 · 4 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓+4 more ↓ Show less ↑
🗺️ Taxonomy Completionist (24) 🏃 Academic Marathon · Sprint 🌍 Conference Polyglot · Bronze 🌉 Interdisciplinary Bridge · Bronze 🧬 Topic Evolution
👑
Triple Crown
🗃️
Keyword Collector
(53)
🔥
Unstoppable · Bronze
💎
Century Club · Bronze
Venues
Top co-authors
Research topics
Deep Learning
(9)
Machine Learning
(9)
Architectures
(7)
Optimization & Theory · Machine Learning
(6)
Core Methods
(4)
Optimization & Theory · Deep Learning
(3)
Learning Types · Deep Learning
(2)
Techniques
(2)
Artificial Intelligence
(1)
Knowledge & Reasoning
(1)
Application Areas
(1)
Core AI
(1)
Learning Types · Machine Learning
(1)
Representation
(1)
Keywords
neural network optimization
(2)
model quantization
(1)
uncertainty quantification
(1)
image classification
(1)
neural tangent kernel
(1)
ensemble learning
(1)
representation learning
(1)
self-supervised learning
(1)
attention mechanism
(1)
knowledge distillation
(1)
transformer architecture
(1)
gaussian process
(1)
covariance matrix
(1)
gradient descent
(1)
signal propagation
(1)
eigenvalue decay
(1)
posterior predictive
(1)
state space model
(1)
deep neural network
(1)
model compression
(1)
Papers
The Directionality of Optimization Trajectories in Neural Networks
ICLR 2025
Recurrent Distance Filtering for Graph Representation Learning
ICML 2024
Simplifying Transformer Blocks
ICLR 2024
Understanding and Minimising Outlier Features in Transformer Training
NeurIPS 2024
Deep Transformers without Shortcuts: Modifying Self-attention for Faithful Signal Propagation
ICLR 2023
The Shaped Transformer: Attention Models in the Infinite Depth-and-Width Limit
NeurIPS 2023
Exploring the Gap between Collapsed & Whitened Features in Self-Supervised Learning
ICML 2022
Feature Kernel Distillation
ICLR 2022
Stable ResNet
AISTATS 2021
Bayesian Deep Ensembles via the Neural Tangent Kernel
NeurIPS 2020