Aidan N Gomez
5 papers · 2017–2022 · 2 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓+1 more ↓ Show less ↑
🌍 Conference Polyglot · Bronze 🏃 Academic Marathon · Sprint 🌉 Interdisciplinary Bridge · Bronze 🗺️ Taxonomy Completionist (14) 🐣 Hot Topic Early Bird
🧭
Keyword Pioneer
Venues
Top co-authors
Research topics
Deep Learning
(4)
Architectures
(4)
Machine Learning
(3)
Optimization & Theory · Machine Learning
(2)
Techniques
(2)
Artificial Intelligence
(1)
Natural Language Processing
(1)
Application Areas
(1)
Applications
(1)
Core Methods
(1)
Learning Paradigms · Artificial Intelligence
(1)
Learning Paradigms · Machine Learning
(1)
Learning Types
(1)
Models
(1)
Optimization & Theory · Deep Learning
(1)
Keywords
transformer architecture
(1)
sample efficiency
(1)
autoregressive transformer
(1)
self-attention mechanism
(1)
curriculum learning
(1)
attention mechanism
(1)
machine translation
(1)
nonparametric model
(1)
gradient computation
(1)
convolutional neural network
(1)
memory efficiency
(1)
data selection
(1)
tabular data
(1)
protein language model
(1)
residual network
(1)
training acceleration
(1)
deep learning architecture
(1)
generalization loss
(1)
redundant data
(1)
neural network
(1)
Papers
Prioritized Training on Points that are Learnable, Worth Learning, and not yet Learnt
ICML 2022
Tranception: Protein Fitness Prediction with Autoregressive Transformers and Inference-time Retrieval
ICML 2022
Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learning
NeurIPS 2021
Attention is All you Need
NeurIPS 2017
The Reversible Residual Network: Backpropagation Without Storing Activations
NeurIPS 2017