Saksham Singhal
13 papers · 2021–2024 · 8 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓+5 more ↓ Show less ↑
πΊοΈ Taxonomy Completionist (30) π Conference Polyglot Β· Silver π£ Hot Topic Early Bird π Interdisciplinary Bridge Β· Bronze π§ Keyword Pioneer
π€
Dynamic Duo
(11)
π
Trend Setter
β‘
Prolific Year Β· Productive
π
Century Club Β· Bronze
ποΈ
Keyword Collector
(61)
Top co-authors
Research topics
Natural Language Processing
(9)
Deep Learning
(8)
Machine Learning
(8)
Resources & Methods
(7)
Architectures
(6)
Learning Types Β· Machine Learning
(5)
Techniques
(5)
Artificial Intelligence
(4)
Applications
(4)
Learning Types Β· Deep Learning
(3)
Application Areas
(2)
Core AI
(2)
Core Methods
(2)
Learning Paradigms
(2)
Models
(2)
Keywords
cross-lingual language model
(5)
cross-lingual transfer
(4)
transformer architecture
(3)
machine translation
(2)
multimodal learning
(2)
question answering
(2)
foundation model
(2)
vision-language model
(2)
zero-shot learning
(2)
knowledge distillation
(2)
transfer learning
(1)
multilingual nlp
(1)
data augmentation
(1)
in-context learning
(1)
image generation
(1)
contrastive learning
(1)
image captioning
(1)
visual question answering
(1)
named entity recognition
(1)
embedding learning
(1)
Papers
On the Adaptation of Unlimiformer for Decoder-Only Transformers
COLING 2024
Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning
ACL 2023
Image as a Foreign Language: BEiT Pretraining for Vision and Vision-Language Tasks
CVPR 2023
Language Is Not All You Need: Aligning Perception with Language Models
NeurIPS 2023
Magneto: A Foundation Transformer
ICML 2023
Bootstrapping a high quality multilingual multimodal
dataset for Bletchley
ACML 2022
On the Representation Collapse of Sparse Mixture of Experts
NeurIPS 2022
XLM-E: Cross-lingual Language Model Pre-training via ELECTRA
ACL 2022
Allocating Large Vocabulary Capacity for Cross-Lingual Language Model Pre-Training
EMNLP 2021
Consistency Regularization for Cross-Lingual Fine-Tuning
ACL 2021
InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training
NAACL 2021
mT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs
EMNLP 2021
Multilingual Machine Translation Systems from Microsoft for WMT21 Shared Task
EMNLP 2021