Naman Goyal
25 papers · 2017–2024 · 10 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓+9 more ↓ Show less ↑
🗺️ Taxonomy Completionist (47) 🏃 Academic Marathon · Sprint 🌍 Conference Polyglot · Gold 🌉 Interdisciplinary Bridge · Bronze 🐣 Hot Topic Early Bird
🌟
Keyword Trendsetter Combo
(3)
👥
Mega-Team · Squad
🤝
Dynamic Duo
(10)
🧭
Keyword Pioneer
📈
Trend Setter
⚡
Prolific Year · Productive
🔥
Unstoppable · Bronze
🗃️
Keyword Collector
(102)
💎
Century Club · Bronze
Venues
Top co-authors
Research topics
Deep Learning
(15)
Machine Learning
(13)
Natural Language Processing
(13)
Artificial Intelligence
(10)
Resources & Methods
(10)
Architectures
(8)
Core AI
(8)
Learning Types · Machine Learning
(8)
Applications
(7)
Learning Types · Deep Learning
(7)
Application Areas
(6)
Generation
(4)
Learning Paradigms
(3)
Models
(3)
Optimization & Theory
(3)
Keywords
low-resource language
(7)
machine translation
(4)
cross-lingual transfer
(4)
multilingual language model
(4)
large language model
(3)
multilingual model
(3)
neural machine translation
(3)
neural network
(2)
representation learning
(2)
language model
(2)
denoising autoencoder
(2)
masked language modeling
(2)
many-to-many translation
(2)
masked language model
(2)
transformer architecture
(2)
transfer learning
(2)
multilingual machine translation
(2)
domain adaptation
(2)
multilingual nlp
(1)
natural language inference
(1)
Papers
The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variants
ACL 2024
Don’t forget the nullspace! Nullspace occupancy as a mechanism for out of distribution failure
ICLR 2023
Scaling Laws for Generative Mixed-Modal Language Models
ICML 2023
Text-To-4D Dynamic Scene Generation
ICML 2023
XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Models
EMNLP 2023
Efficient Large Scale Language Modeling with Mixtures of Experts
EMNLP 2022
Few-shot Learning with Multilingual Generative Language Models
EMNLP 2022
Lifting the Curse of Multilinguality by Pre-training Modular Transformers
NAACL 2022
On the Role of Bidirectionality in Language Model Pre-Training
EMNLP 2022
XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale
Interspeech 2022
Adapting High-resource NMT Models to Translate Low-resource Related Languages without Parallel Data
ACL 2021
BASE Layers: Simplifying Training of Large, Sparse Models
ICML 2021
Better Fine-Tuning by Reducing Representational Collapse
ICLR 2021
Beyond English-Centric Multilingual Machine Translation
JMLR 2021
Findings of the WMT 2021 Shared Task on Large-Scale Multilingual Machine Translation
EMNLP 2021
FST: the FAIR Speech Translation System for the IWSLT21 Multilingual Shared Task
ACL 2021
Larger-Scale Transformers for Multilingual Masked Language Modeling
ACL 2021
Multilingual Translation from Denoising Pre-Training
ACL 2021
Recipes for Building an Open-Domain Chatbot
EACL 2021
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension
ACL 2020
Facebook AI’s WMT20 News Translation Task Submission
EMNLP 2020
Findings of the WMT 2020 Shared Task on Parallel Corpus Filtering and Alignment
EMNLP 2020
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
NeurIPS 2020
Unsupervised Cross-lingual Representation Learning at Scale
ACL 2020
LearningToQuestion at SemEval 2017 Task 3: Ranking Similar Questions by Learning to Rank Using Rich Features
SemEval 2017