conftrace_

Vimal Thilak

4 papers · 2024–2025 · 3 conferences · across top CS/AI conferences

Achievements

Jump to papers ↓

🧭 Keyword Pioneer 🌍 Conference Polyglot (3) 🐝 Cross-Pollinator (12) 🌉 Interdisciplinary Bridge

Conferences

ICLR (2) ICML (1) NIPS (1)

Top co-authors

Omid Saremi (3) Etai Littwin (3) Preetum Nakkiran (3) Joshua M. Susskind (3) Chen Huang (2) Harshay Shah (1) Hanlin Goh (1) Alaaeldin El-Nouby (1) Noam Razin (1) Hattie Zhou (1)

Keywords

representation learning (1) feature learning (1) self-supervised learning (1) implicit bia (1) masked autoencoder (1) joint embedding predictive architecture (1) latent space prediction (1)

Papers

Parameters vs FLOPs: Scaling Laws for Optimal Sparsity for Mixture-of-Experts Language Models ICML 2025 How JEPA Avoids Noisy Features: The Implicit Bias of Deep Linear Self Distillation Networks NIPS 2024 LiDAR: Sensing Linear Probing Performance in Joint Embedding SSL Architectures ICLR 2024 Vanishing Gradients in Reinforcement Finetuning of Language Models ICLR 2024