Songhao Piao
4 papers · 2019–2022 · 4 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓+1 more ↓ Show less ↑
🌉 Interdisciplinary Bridge 🧭 Keyword Pioneer 🐣 Hot Topic Early Bird 🌍 Conference Polyglot (4) 🐝 Cross-Pollinator (13)
📈
Trend Setter
Conferences
EMNLP (1)
ICLR (1)
ICML (1)
NIPS (1)
Top co-authors
Keywords
transformer architecture
(1)
visual question answering
(1)
question answering
(1)
multimodal learning
(1)
machine reading comprehension
(1)
text understanding
(1)
vision-language model
(1)
transformer network
(1)
image-text retrieval
(1)
pretrained language model
(1)
unified model
(1)
bidirectional encoder
(1)
autoregressive modeling
(1)
pseudo-masked language model
(1)
unified language model
(1)
fusion encoder
(1)
Papers
VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts
NIPS 2022
BEiT: BERT Pre-Training of Image Transformers
ICLR 2022
UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training
ICML 2020
Inspecting Unification of Encoding and Matching with Transformer: A Case Study of Machine Reading Comprehension
EMNLP 2019