Orhan Firat

BIG-Bench Extra Hard ACL 2025 When Scaling Meets LLM Finetuning: The Effect of Data, Model and Finetuning Method ICLR 2024 Scaling Sign Language Translation NIPS 2024 Binarized Neural Machine Translation NIPS 2023 Order Matters in the Presence of Dataset Imbalance for Multilingual Learning NIPS 2023 MADLAD-400: A Multilingual And Document-Level Large Audited Dataset NIPS 2023 UniMax: Fairer and More Effective Language Sampling for Large-Scale Multilingual Pretraining ICLR 2023 Interactive-Chain-Prompting: Ambiguity Resolution for Crosslingual Conditional Generation with Interaction AACL 2023 Interactive-Chain-Prompting: Ambiguity Resolution for Crosslingual Conditional Generation with Interaction IJCNLP 2023 The Unreasonable Effectiveness of Few-shot Learning for Machine Translation ICML 2023 Scaling Laws for Multilingual Neural Machine Translation ICML 2023 Block-State Transformers NIPS 2023 PaLM: Scaling Language Modeling with Pathways JMLR 2023 The Devil Is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluation EMNLP 2023 GATITOS: Using a New Multilingual Lexicon for Low-resource Machine Translation EMNLP 2023 Multilingual Mix: Example Interpolation Improves Multilingual Neural Machine Translation ACL 2022 Do Current Multi-Task Optimization Methods in Deep Learning Even Help? NIPS 2022 Multilingual Document-Level Translation Enables Zero-Shot Transfer From Sentences to Documents ACL 2022 A Loss Curvature Perspective on Training Instabilities of Deep Learning Models ICLR 2022 Scaling Laws for Neural Machine Translation ICLR 2022 Data Scaling Laws in NMT: The Effect of Noise and Architecture ICML 2022 GLaM: Efficient Scaling of Language Models with Mixture-of-Experts ICML 2022 Examining Scaling and Transfer of Language Model Architectures for Machine Translation ICML 2022 XTREME-S: Evaluating Cross-lingual Speech Representations INTERSPEECH 2022 Harnessing Multilinguality in Unsupervised Machine Translation for Rare Languages NAACL 2021 A Large-Scale Study of Machine Translation in Turkic Languages EMNLP 2021 XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation EMNLP 2021 Beyond Distillation: Task-level Mixture-of-Experts for Efficient Inference EMNLP 2021 Evaluating Multiway Multilingual NMT in the Turkic Languages EMNLP 2021 Explicit Alignment Objectives for Multilingual Bidirectional Encoders NAACL 2021 Towards Continual Learning for Multilingual Machine Translation via Vocabulary Substitution NAACL 2021 GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding ICLR 2021 Share or Not? Learning to Schedule Language-Specific Capacity for Multilingual Translation ICLR 2021 Gradient Vaccine: Investigating and Improving Multi-task Optimization in Massively Multilingual Models ICLR 2021 Complete Multilingual Neural Machine Translation EMNLP 2020 XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalisation ICML 2020 Leveraging Monolingual Data with Self-Supervision for Multilingual Neural Machine Translation ACL 2020 Evaluating the Cross-Lingual Effectiveness of Massively Multilingual Neural Machine Translation AAAI 2020 Towards End-to-End In-Image Neural Machine Translation EMNLP 2020 On the Discrepancy between Density Estimation and Sequence Generation EMNLP 2020 Investigating Multilingual NMT Representations at Scale EMNLP 2019 Non-Parametric Adaptation for Neural Machine Translation NAACL 2019 GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism NIPS 2019 Findings of the First Shared Task on Machine Translation Robustness ACL 2019 Simple, Scalable Adaptation for Neural Machine Translation IJCNLP 2019 Investigating Multilingual NMT Representations at Scale IJCNLP 2019 Massively Multilingual Neural Machine Translation NAACL 2019 Simple, Scalable Adaptation for Neural Machine Translation EMNLP 2019 On the Importance of Word Boundaries in Character-level Neural Machine Translation EMNLP 2019 Training Deeper Neural Machine Translation Models with Transparent Attention EMNLP 2018 The Best of Both Worlds: Combining Recent Advances in Neural Machine Translation ACL 2018 Revisiting Character-Based Neural Machine Translation with Capacity and Compression EMNLP 2018 Nematus: a Toolkit for Neural Machine Translation EACL 2017 Multi-Way, Multilingual Neural Machine Translation with a Shared Attention Mechanism NAACL 2016 Zero-Resource Translation with Multi-Lingual Neural Machine Translation EMNLP 2016