Songhao Piao
4 papers · 2019–2022 · 4 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓
🌍
Conference Polyglot · Bronze
🐣
Hot Topic Early Bird
🌉
Interdisciplinary Bridge · Bronze
🗺️
Taxonomy Completionist
(11)
🧭
Keyword Pioneer
Venues
Top co-authors
Research topics
Keywords
transformer architecture
(1)
image classification
(1)
vision transformer
(1)
visual question answering
(1)
self-supervised learning
(1)
question answering
(1)
multimodal learning
(1)
machine reading comprehension
(1)
text understanding
(1)
vision-language model
(1)
transformer network
(1)
image-text retrieval
(1)
pre-trained language model
(1)
image tokenization
(1)
unified model
(1)
bidirectional encoder
(1)
autoregressive modeling
(1)
masked image modeling
(1)
pseudo-masked language model
(1)
unified language model
(1)
Papers
BEiT: BERT Pre-Training of Image Transformers
ICLR 2022
VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts
NeurIPS 2022
UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training
ICML 2020
Inspecting Unification of Encoding and Matching with Transformer: A Case Study of Machine Reading Comprehension
EMNLP 2019