Zihang Dai
23 papers · 2016–2022 · 7 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓+9 more ↓ Show less ↑
πΊοΈ Taxonomy Completionist (47) π Conference Polyglot Β· Silver π Academic Marathon Β· Sprint π Interdisciplinary Bridge Β· Bronze π£ Hot Topic Early Bird
π§¬
Topic Evolution
π
Grand Slam
π
Renaissance Researcher
(5)
π₯
Unstoppable Β· Bronze
β‘
Prolific Year Β· Productive
π
Conference Pioneer
π
Century Club Β· Bronze
π
Trend Setter
ποΈ
Keyword Collector
(99)
Top co-authors
Research topics
Deep Learning
(18)
Machine Learning
(16)
Natural Language Processing
(10)
Learning Types Β· Machine Learning
(9)
Learning Types Β· Deep Learning
(9)
Architectures
(8)
Artificial Intelligence
(7)
Application Areas
(7)
Generation
(7)
Core AI
(6)
Core Methods
(6)
Models
(5)
Resources & Methods
(3)
Computer Vision
(2)
Analysis
(2)
Keywords
language modeling
(5)
transformer architecture
(5)
language model
(4)
image classification
(3)
semi-supervised learning
(3)
efficient computing
(3)
vision transformer
(2)
text classification
(2)
sequence modeling
(2)
sparse attention
(2)
neural network
(2)
data augmentation
(2)
knowledge distillation
(2)
image captioning
(2)
recurrent neural network
(2)
self-supervised learning
(1)
visual question answering
(1)
matrix factorization
(1)
domain adaptation
(1)
neural machine translation
(1)
Papers
SimVLM: Simple Visual Language Model Pretraining with Weak Supervision
ICLR 2022
Transformer Quality in Linear Time
ICML 2022
CoAtNet: Marrying Convolution and Attention for All Data Sizes
NeurIPS 2021
Combiner: Full Attention Transformer with Sparse Computation Cost
NeurIPS 2021
Meta Pseudo Labels
CVPR 2021
Pay Attention to MLPs
NeurIPS 2021
Searching for Efficient Transformers for Language Modeling
NeurIPS 2021
A Mutual Information Maximization Perspective of Language Representation Learning
ICLR 2020
Funnel-Transformer: Filtering out Sequential Redundancy for Efficient Language Processing
NeurIPS 2020
Unsupervised Data Augmentation for Consistency Training
NeurIPS 2020
Characterizing and Avoiding Negative Transfer
CVPR 2019
Fast and Simple Mixture of Softmaxes with BPE and Hybrid-LightRNN for Language Generation
AAAI 2019
Re-examination of the Role of Latent Variables in Sequence Modeling
NeurIPS 2019
Transformer-XL: Attentive Language Models beyond a Fixed-Length Context
ACL 2019
XLNet: Generalized Autoregressive Pretraining for Language Understanding
NeurIPS 2019
Breaking the Softmax Bottleneck: A High-Rank RNN Language Model
ICLR 2018
From Credit Assignment to Entropy Regularization: Two New Algorithms for Neural Sequence Prediction
ACL 2018
Large-scale Cloze Test Dataset Created by Teachers
EMNLP 2018
SwitchOut: an Efficient Data Augmentation Algorithm for Neural Machine Translation
EMNLP 2018
An Interpretable Knowledge Transfer Model for Knowledge Base Completion
ACL 2017
Controllable Invariance through Adversarial Feature Learning
NeurIPS 2017
Good Semi-supervised Learning That Requires a Bad GAN
NeurIPS 2017
CFO: Conditional Focused Neural Question Answering with Large-scale Knowledge Bases
ACL 2016