David So
7 papers · 2019–2023 · 3 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓+1 more ↓ Show less ↑
π Interdisciplinary Bridge π Conference Polyglot (3) π£ Hot Topic Early Bird π Cross-Pollinator (13) πΊοΈ Taxonomy Completionist (15)
π§
Keyword Pioneer
Conferences
ICML (3)
NIPS (3)
EMNLP (1)
Top co-authors
Keywords
neural architecture search
(4)
transformer architecture
(4)
evolutionary algorithm
(3)
language model
(2)
efficient computing
(2)
neural architecture
(1)
gradient descent
(1)
learning algorithm
(1)
scaling law
(1)
sequence model
(1)
weight averaging
(1)
feed-forward network
(1)
multilayer perceptron
(1)
evolutionary search
(1)
prompt tuning
(1)
model efficiency
(1)
algorithm discovery
(1)
layer normalization
(1)
gating mechanism
(1)
emergent abilities
(1)
Papers
Transcending Scaling Laws with 0.1% Extra Compute
EMNLP 2023
EvoPrompting: Language Models for Code-Level Neural Architecture Search
NIPS 2023
Brainformers: Trading Simplicity for Efficiency
ICML 2023
Searching for Efficient Transformers for Language Modeling
NIPS 2021
Pay Attention to MLPs
NIPS 2021
AutoML-Zero: Evolving Machine Learning Algorithms From Scratch
ICML 2020
The Evolved Transformer
ICML 2019