Orhan Firat

BIG-Bench Extra Hard ACL 2025 Scaling Sign Language Translation NeurIPS 2024 When Scaling Meets LLM Finetuning: The Effect of Data, Model and Finetuning Method ICLR 2024 Binarized Neural Machine Translation NeurIPS 2023 Block-State Transformers NeurIPS 2023 GATITOS: Using a New Multilingual Lexicon for Low-resource Machine Translation EMNLP 2023 Interactive-Chain-Prompting: Ambiguity Resolution for Crosslingual Conditional Generation with Interaction IJCNLP 2023 MADLAD-400: A Multilingual And Document-Level Large Audited Dataset NeurIPS 2023 Order Matters in the Presence of Dataset Imbalance for Multilingual Learning NeurIPS 2023 PaLM: Scaling Language Modeling with Pathways JMLR 2023 Scaling Laws for Multilingual Neural Machine Translation ICML 2023 The Devil Is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluation EMNLP 2023 The Unreasonable Effectiveness of Few-shot Learning for Machine Translation ICML 2023 UniMax: Fairer and More Effective Language Sampling for Large-Scale Multilingual Pretraining ICLR 2023 A Loss Curvature Perspective on Training Instabilities of Deep Learning Models ICLR 2022 Data Scaling Laws in NMT: The Effect of Noise and Architecture ICML 2022 Do Current Multi-Task Optimization Methods in Deep Learning Even Help? NeurIPS 2022 Examining Scaling and Transfer of Language Model Architectures for Machine Translation ICML 2022 GLaM: Efficient Scaling of Language Models with Mixture-of-Experts ICML 2022 Multilingual Document-Level Translation Enables Zero-Shot Transfer From Sentences to Documents ACL 2022 Multilingual Mix: Example Interpolation Improves Multilingual Neural Machine Translation ACL 2022 Scaling Laws for Neural Machine Translation ICLR 2022 XTREME-S: Evaluating Cross-lingual Speech Representations Interspeech 2022 A Large-Scale Study of Machine Translation in Turkic Languages EMNLP 2021 Beyond Distillation: Task-level Mixture-of-Experts for Efficient Inference EMNLP 2021 Evaluating Multiway Multilingual NMT in the Turkic Languages EMNLP 2021 Explicit Alignment Objectives for Multilingual Bidirectional Encoders NAACL 2021 Gradient Vaccine: Investigating and Improving Multi-task Optimization in Massively Multilingual Models ICLR 2021 GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding ICLR 2021 Harnessing Multilinguality in Unsupervised Machine Translation for Rare Languages NAACL 2021 Share or Not? Learning to Schedule Language-Specific Capacity for Multilingual Translation ICLR 2021 Towards Continual Learning for Multilingual Machine Translation via Vocabulary Substitution NAACL 2021 XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation EMNLP 2021 Complete Multilingual Neural Machine Translation EMNLP 2020 Evaluating the Cross-Lingual Effectiveness of Massively Multilingual Neural Machine Translation AAAI 2020 Leveraging Monolingual Data with Self-Supervision for Multilingual Neural Machine Translation ACL 2020 On the Discrepancy between Density Estimation and Sequence Generation EMNLP 2020 Towards End-to-End In-Image Neural Machine Translation EMNLP 2020 XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalisation ICML 2020 Findings of the First Shared Task on Machine Translation Robustness ACL 2019 GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism NeurIPS 2019 Investigating Multilingual NMT Representations at Scale EMNLP 2019 Massively Multilingual Neural Machine Translation NAACL 2019 Non-Parametric Adaptation for Neural Machine Translation NAACL 2019 On the Importance of Word Boundaries in Character-level Neural Machine Translation EMNLP 2019 Simple, Scalable Adaptation for Neural Machine Translation EMNLP 2019 Revisiting Character-Based Neural Machine Translation with Capacity and Compression EMNLP 2018 The Best of Both Worlds: Combining Recent Advances in Neural Machine Translation ACL 2018 Training Deeper Neural Machine Translation Models with Transparent Attention EMNLP 2018 Nematus: a Toolkit for Neural Machine Translation EACL 2017 Multi-Way, Multilingual Neural Machine Translation with a Shared Attention Mechanism NAACL 2016 Zero-Resource Translation with Multi-Lingual Neural Machine Translation EMNLP 2016