Joan Puigcerver
14 papers · 2020–2024 · 5 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓+8 more ↓ Show less ↑
πΊοΈ Taxonomy Completionist (29) π£ Hot Topic Early Bird π Conference Polyglot Β· Silver π Interdisciplinary Bridge Β· Bronze π Triple Crown
π₯
Mega-Team Β· Squad
π€
Dynamic Duo
(10)
π
Keyword Champion
(2)
π
Century Club Β· Bronze
β
The Questioner
π₯
Unstoppable Β· Bronze
ποΈ
Keyword Collector
(63)
β‘
Prolific Year Β· Productive
Venues
Top co-authors
Research topics
Deep Learning
(11)
Machine Learning
(11)
Architectures
(8)
Artificial Intelligence
(5)
Application Areas
(5)
Learning Types Β· Machine Learning
(5)
Computer Vision
(4)
Learning Types Β· Deep Learning
(4)
Core AI Β· Artificial Intelligence
(3)
Optimization & Theory
(3)
Analysis
(2)
Core AI Β· Computer Vision
(2)
Core Methods
(2)
Learning Paradigms
(2)
Techniques
(2)
Keywords
mixture of expert
(4)
vision transformer
(4)
model scaling
(3)
transfer learning
(3)
sparse model
(2)
image classification
(2)
parameter efficiency
(2)
sparse mixture of expert
(2)
visual question answering
(1)
zero-shot learning
(1)
representation learning
(1)
convex optimization
(1)
domain generalization
(1)
model robustness
(1)
model selection
(1)
contrastive learning
(1)
model adaptation
(1)
image captioning
(1)
out-of-distribution generalization
(1)
few-shot learning
(1)
Papers
From Sparse to Soft Mixtures of Experts
ICLR 2024
Fast, Differentiable and Sparse Top-k: a Convex Analysis Perspective
ICML 2023
PaLI: A Jointly-Scaled Multilingual Language-Image Model
ICLR 2023
Patch nβ Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution
NeurIPS 2023
Scaling Vision Transformers to 22 Billion Parameters
ICML 2023
Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints
ICLR 2023
Sparsity-Constrained Optimal Transport
ICLR 2023
Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Experts
NeurIPS 2022
On the Adversarial Robustness of Mixture of Experts
NeurIPS 2022
Which Model To Transfer? Finding the Needle in the Growing Haystack
CVPR 2022
On Robustness and Transferability of Convolutional Neural Networks
CVPR 2021
Scalable Transfer Learning with Expert Models
ICLR 2021
Scaling Vision with Sparse Mixture of Experts
NeurIPS 2021
Big Transfer (BiT): General Visual Representation Learning
ECCV 2020