Saksham Singhal
14 papers · 2021–2024 · 9 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓+6 more ↓ Show less ↑
🐝 Cross-Pollinator (11) 🌉 Interdisciplinary Bridge 🧭 Keyword Pioneer 🌍 Conference Polyglot (9) 🌈 Renaissance Researcher (5)
🌉
Interdisciplinary Bridge
🧭
Keyword Pioneer
🤝
Dynamic Duo
(12)
⚡
Prolific Year
(6)
🗃️
Keyword Collector
(59)
💎
Century Club
(14)
Conferences
ACL (3)
EMNLP (3)
NIPS (2)
ACML (1)
COLING (1)
CVPR (1)
ICML (1)
IJCNLP (1)
NAACL (1)
Top co-authors
Keywords
cross-lingual language model
(5)
cross-lingual transfer
(5)
transformer architecture
(3)
machine translation
(2)
foundation model
(2)
data augmentation
(2)
zero-shot learning
(2)
consistency regularization
(2)
multilingual model
(2)
knowledge distillation
(2)
question answering
(2)
multimodal learning
(2)
in-context learning
(1)
transfer learning
(1)
multilingual nlp
(1)
image generation
(1)
contrastive learning
(1)
image captioning
(1)
visual question answering
(1)
named entity recognition
(1)
Papers
On the Adaptation of Unlimiformer for Decoder-Only Transformers
COLING 2024
Magneto: A Foundation Transformer
ICML 2023
Image as a Foreign Language: BEiT Pretraining for Vision and Vision-Language Tasks
CVPR 2023
Language Is Not All You Need: Aligning Perception with Language Models
NIPS 2023
Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning
ACL 2023
On the Representation Collapse of Sparse Mixture of Experts
NIPS 2022
XLM-E: Cross-lingual Language Model Pre-training via ELECTRA
ACL 2022
Bootstrapping a high quality multilingual multimodal
dataset for Bletchley
ACML 2022
mT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs
EMNLP 2021
Allocating Large Vocabulary Capacity for Cross-Lingual Language Model Pre-Training
EMNLP 2021
Multilingual Machine Translation Systems from Microsoft for WMT21 Shared Task
EMNLP 2021
Consistency Regularization for Cross-Lingual Fine-Tuning
ACL 2021
Consistency Regularization for Cross-Lingual Fine-Tuning
IJCNLP 2021
InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training
NAACL 2021