Payal Bajaj
10 papers · 2017–2023 · 6 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓+2 more ↓ Show less ↑
🌉 Interdisciplinary Bridge · Bronze 🌍 Conference Polyglot · Silver 🏃 Academic Marathon · Sprint 🗺️ Taxonomy Completionist (24) 🐣 Hot Topic Early Bird
💎
Century Club · Bronze
📈
Trend Setter
Top co-authors
Research topics
Machine Learning
(7)
Deep Learning
(5)
Learning Types · Machine Learning
(5)
Artificial Intelligence
(4)
Natural Language Processing
(4)
Resources & Methods
(4)
Techniques
(3)
Architectures
(2)
Core Methods
(2)
Learning Paradigms
(2)
Learning Types · Deep Learning
(2)
Knowledge & Reasoning
(1)
Application Areas
(1)
Bayesian & Probabilistic · Artificial Intelligence
(1)
Bayesian & Probabilistic · Machine Learning
(1)
Keywords
replaced token detection
(2)
cross-lingual language model
(2)
cross-lingual transfer
(2)
continual learning
(1)
multi-task learning
(1)
probabilistic modeling
(1)
adversarial learning
(1)
embedding learning
(1)
self-supervised learning
(1)
static analysis
(1)
masked language model
(1)
multimodal learning
(1)
toxicity detection
(1)
weak supervision
(1)
low-dimensional embedding
(1)
structure learning
(1)
generative model
(1)
knowledge graph embedding
(1)
language model
(1)
link prediction
(1)
Papers
Magneto: A Foundation Transformer
ICML 2023
Model-Generated Pretraining Signals Improves Zero-Shot Generalization of Text-to-Text Transformers
ACL 2023
Performance and Risk Trade-offs for Multi-word Text Prediction at Scale
EACL 2023
On the Representation Collapse of Sparse Mixture of Experts
NeurIPS 2022
Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators
ICLR 2022
XLM-E: Cross-lingual Language Model Pre-training via ELECTRA
ACL 2022
COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining
NeurIPS 2021
Language Scaling for Universal Suggested Replies Model
NAACL 2021
Embedding Logical Queries on Knowledge Graphs
NeurIPS 2018
Inferring Generative Model Structure with Static Analysis
NeurIPS 2017