Hangbo Bao
11 papers · 2019–2023 · 6 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓+3 more ↓ Show less ↑
🐣 Hot Topic Early Bird 🌍 Conference Polyglot · Silver 🌉 Interdisciplinary Bridge · Silver 🗺️ Taxonomy Completionist (23) 🧭 Keyword Pioneer
🤝
Dynamic Duo
(11)
💎
Century Club · Bronze
🔥
Unstoppable · Bronze
Top co-authors
Research topics
Deep Learning
(9)
Architectures
(7)
Machine Learning
(6)
Natural Language Processing
(5)
Application Areas
(4)
Techniques
(4)
Artificial Intelligence
(3)
Core AI · Artificial Intelligence
(3)
Learning Types · Deep Learning
(3)
Computer Vision
(2)
Core AI · Computer Vision
(2)
Core Methods
(2)
Generation
(2)
Learning Types · Machine Learning
(2)
Models
(2)
Keywords
self-supervised learning
(2)
model compression
(2)
vision-language model
(2)
pre-trained language model
(2)
image classification
(2)
multimodal learning
(2)
masked image modeling
(2)
knowledge distillation
(2)
transformer architecture
(2)
visual question answering
(1)
text summarization
(1)
transfer learning
(1)
pseudo labeling
(1)
machine reading comprehension
(1)
transformer network
(1)
question answering
(1)
foundation model
(1)
language model
(1)
text understanding
(1)
attention mechanism
(1)
Papers
Corrupted Image Modeling for Self-Supervised Visual Pre-Training
ICLR 2023
Image as a Foreign Language: BEiT Pretraining for Vision and Vision-Language Tasks
CVPR 2023
Attention Temperature Matters in Abstractive Summarization Distillation
ACL 2022
BEiT: BERT Pre-Training of Image Transformers
ICLR 2022
THE-X: Privacy-Preserving Transformer Inference with Homomorphic Encryption
ACL 2022
VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts
NeurIPS 2022
Learning to Sample Replacements for ELECTRA Pre-Training
ACL 2021
MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers
ACL 2021
MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers
NeurIPS 2020
UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training
ICML 2020
Inspecting Unification of Encoding and Matching with Transformer: A Case Study of Machine Reading Comprehension
EMNLP 2019