Basil Mustafa
16 papers · 2021–2024 · 5 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓+6 more ↓ Show less ↑
πΊοΈ Taxonomy Completionist (32) π£ Hot Topic Early Bird π Conference Polyglot Β· Silver π Interdisciplinary Bridge Β· Silver π₯ Mega-Team Β· Squad
π₯
Mega-Team Β· Squad
π€
Dynamic Duo
(11)
π
Keyword Champion
(2)
β‘
Prolific Year Β· Productive
π
Century Club Β· Bronze
ποΈ
Keyword Collector
(64)
Venues
Top co-authors
Research topics
Machine Learning
(15)
Deep Learning
(13)
Artificial Intelligence
(8)
Learning Types Β· Machine Learning
(8)
Architectures
(7)
Core AI Β· Artificial Intelligence
(7)
Learning Types Β· Deep Learning
(6)
Computer Vision
(5)
Application Areas
(4)
Core Methods
(4)
Optimization & Theory
(4)
Techniques
(4)
Models
(3)
Natural Language Processing
(2)
Core AI Β· Computer Vision
(2)
Keywords
contrastive learning
(6)
image classification
(6)
vision transformer
(4)
vision-language model
(4)
multimodal learning
(4)
mixture of expert
(3)
visual question answering
(3)
model scaling
(3)
image retrieval
(2)
few-shot learning
(2)
zero-shot learning
(2)
parameter efficiency
(2)
zero-shot classification
(2)
image-text pre-training
(2)
representation learning
(2)
image captioning
(2)
contrastive loss
(2)
multilingual retrieval
(1)
in-context learning
(1)
self-supervised learning
(1)
Papers
From Sparse to Soft Mixtures of Experts
ICLR 2024
On Scaling Up a Multilingual Vision and Language Model
CVPR 2024
CLIPPO: Image-and-Language Understanding From Pixels Only
CVPR 2023
Massively Scaling Heteroscedastic Classifiers
ICLR 2023
PaLI: A Jointly-Scaled Multilingual Language-Image Model
ICLR 2023
Patch nβ Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution
NeurIPS 2023
Scaling Vision Transformers to 22 Billion Parameters
ICML 2023
Sigmoid Loss for Language Image Pre-Training
ICCV 2023
Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints
ICLR 2023
Three Towers: Flexible Contrastive Learning with Pretrained Image Models
NeurIPS 2023
LiT: Zero-Shot Transfer With Locked-Image Text Tuning
CVPR 2022
Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Experts
NeurIPS 2022
Big Self-Supervised Models Advance Medical Image Classification
ICCV 2021
Correlated Input-Dependent Label Noise in Large-Scale Image Classification
CVPR 2021
Scalable Transfer Learning with Expert Models
ICLR 2021
Scaling Vision with Sparse Mixture of Experts
NeurIPS 2021