EMNLP 2023

2,732 papers

The Devil Is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluation

Patrick Fernandes, Daniel Deutsch, Mara Finkelstein, Parker Riley, Andre Martins

A Benchmark for Evaluating Machine Translation Metrics on Dialects without Standard Orthography

Noëmi Aepli, Chantal Amrhein, Florian Schottmann, Rico Sennrich

One Wide Feedforward Is All You Need

Telmo Pires, António Vilarinho Lopes, Yannick Assogba, Hendra Setiawan

Automating Behavioral Testing in Machine Translation

Javier Ferrando, Matthias Sperber, Hendra Setiawan, Dominic Telaar, Saša Hasan

Training and Meta-Evaluating Machine Translation Evaluation Metrics at the Paragraph Level

Daniel Deutsch, Juraj Juraska, Mara Finkelstein, Markus Freitag

Trained MT Metrics Learn to Cope with Machine-translated References

Jannis Vamvas, Tobias Domhan, Sony Trenous, Rico Sennrich, Eva Hasler

IOL Research Machine Translation Systems for WMT23 Low-Resource Indic Language Translation Shared Task

Wenbo Zhang

IACS-LRILT: Machine Translation for Low-Resource Indic Languages

Dhairya Suman, Atanu Mandal, Santanu Pal, Sudip Naskar

NITS-CNLP Low-Resource Neural Machine Translation Systems of English-Manipuri Language Pair

Kshetrimayum Boynao Singh, Ningthoujam Avichandra Singh, Loitongbam Sanayai Meetei, Sivaji Bandyopadhyay, Thoudam Doren Singh

MUNI-NLP Systems for Low-resource Indic Machine Translation

Edoardo Signoroni, Pavel Rychlý

Low-Resource Machine Translation Systems for Indic Languages

Ivana Kvapilíková, Ondřej Bojar

Machine Translation Advancements for Low-Resource Indian Languages in WMT23: CFILT-IITB’s Effort for Bridging the Gap

Pranav Gaikwad, Meet Doshi, Sourabh Deoghare, Pushpak Bhattacharyya

NICT-AI4B’s Submission to the Indic MT Shared Task in WMT 2023

Raj Dabre, Jay Gala, Pranjal A. Chitale

GUIT-NLP’s Submission to Shared Task: Low Resource Indic Language Translation

Mazida Akhtara Ahmed, Kuwali Talukdar, Parvez Aziz Boruah, Shikhar Kumar Sarma, Kishore Kashyap

Neural Machine Translation for English - Manipuri and English - Assamese

Goutam Agrawal, Rituraj Das, Anupam Biswas, Dalton Meitei Thounaojam

HW-TSC’s Participation in the WMT 2023 Automatic Post Editing Shared Task

Jiawei Yu, Min Zhang, Zhao Yanqing, Xiaofeng Zhao, Yuang Li

VARCO-MT: NCSOFT’s WMT’23 Terminology Shared Task Submission

Geon Woo Park, Junghwa Lee, Meiying Ren, Allison Shindell, Yeonsoo Lee

OPUS-CAT Terminology Systems for the WMT23 Terminology Shared Task

Tommi Nieminen

Domain Terminology Integration into Machine Translation: Leveraging Large Language Models

Yasmin Moslem, Gianfranco Romani, Mahdi Molaei, John D. Kelleher, Rejwanul Haque

Lingua Custodia’s Participation at the WMT 2023 Terminology Shared Task

Jingshu Liu, Mariam Nakhlé, Gaëtan Caillout, Raheel Qadar

Terminology-Aware Translation with Constrained Decoding and Large Language Model Prompting

Nikolay Bogoychev, Pinzhen Chen

KnowComp Submission for WMT23 Word-Level AutoCompletion Task

Yi Wu, Haochen Shi, Weiqi Wang, Yangqiu Song

PRHLT’s Submission to WLAC 2023

Angel Navarro, Miguel Domingo, Francisco Casacuberta

SJTU-MTLAB’s Submission to the WMT23 Word-Level Auto Completion Task

Xingyu Chen, Rui Wang

IOL Research’s Submission for WMT 2023 Quality Estimation Shared Task

Zeyu Yan

MMT’s Submission for the WMT 2023 Quality Estimation Shared Task

Yulong Wu, Viktor Schlegel, Daniel Beck, Riza Batista-Navarro

SurreyAI 2023 Submission for the Quality Estimation Shared Task

Archchana Sindhujan, Diptesh Kanojia, Constantin Orasan, Tharindu Ranasinghe

Scaling up CometKiwi: Unbabel-IST 2023 Submission for the Quality Estimation Shared Task

Ricardo Rei, Nuno M. Guerreiro, José Pombal, Daan van Stigt, Marcos Treviso

HW-TSC 2023 Submission for the Quality Estimation Shared Task

Yuang Li, Chang Su, Ming Zhu, Mengyao Piao, Xinglin Lyu

Unify Word-level and Span-level Tasks: NJUNLP’s Participation for the WMT2023 Quality Estimation Shared Task

Xiang Geng, Zhejian Lai, Yu Zhang, Shimin Tao, Hao Yang

Empowering a Metric with LLM-assisted Named Entity Annotation: HW-TSC’s Submission to the WMT23 Metrics Shared Task

Zhanglin Wu, Yilun Liu, Min Zhang, Xiaofeng Zhao, Junhao Zhu

Semantically-Informed Regressive Encoder Score

Vasiliy Viskov, George Kokush, Daniil Larionov, Steffen Eger, Alexander Panchenko

Evaluating Metrics for Document-context Evaluation in Machine Translation

Vikas Raunak, Tom Kocmi, Matt Post

Quality Estimation Using Minimum Bayes Risk

Subhajit Naskar, Daniel Deutsch, Markus Freitag

MEE4 and XLsim : IIIT HYD’s Submissions’ for WMT23 Metrics Shared Task

Ananya Mukherjee, Manish Shrivastava

Metric Score Landscape Challenge (MSLC23): Understanding Metrics’ Performance on a Wider Landscape of Translation Quality

Chi-kiu Lo, Samuel Larkin, Rebecca Knowles

GEMBA-MQM: Detecting Translation Quality Error Spans with GPT-4

Tom Kocmi, Christian Federmann

MetricX-23: The Google Submission to the WMT 2023 Metrics Shared Task

Juraj Juraska, Mara Finkelstein, Daniel Deutsch, Aditya Siddhant, Mehdi Mirzazadeh

Cometoid: Distilling Strong Reference-based Machine Translation Metrics into Even Stronger Quality Estimation Metrics

Thamme Gowda, Tom Kocmi, Marcin Junczys-Dowmunt

eBLEU: Unexpectedly Good Machine Translation Evaluation Using Simple Word Embeddings

Muhammad ElNokrashy, Tom Kocmi

Embed_Llama: Using LLM Embeddings for the Metrics Shared Task

Sören Dreano, Derek Molloy, Noel Murphy

Tokengram_F, a Fast and Accurate Token-based chrF++ Derivative

Sören Dreano, Derek Molloy, Noel Murphy

Challenging the State-of-the-art Machine Translation Metrics from a Linguistic Perspective

Eleftherios Avramidis, Shushen Manakhimova, Vivien Macketanz, Sebastian Möller

ACES: Translation Accuracy Challenge Sets at WMT 2023

Chantal Amrhein, Nikita Moghe, Liane Guillou

Findings of the WMT 2023 Shared Task on Low-Resource Indic Language Translation

Santanu Pal, Partha Pakray, Sahinur Rahman Laskar, Lenin Laitonjam, Vanlalmuansangi Khenglawt

Findings of the WMT 2023 Shared Task on Automatic Post-Editing

Pushpak Bhattacharyya, Rajen Chatterjee, Markus Freitag, Diptesh Kanojia, Matteo Negri

Findings of the WMT 2023 Shared Task on Machine Translation with Terminologies

Kirill Semenov, Vilém Zouhar, Tom Kocmi, Dongdong Zhang, Wangchunshu Zhou

Findings of the Word-Level AutoCompletion Shared Task in WMT 2023

Lemao Liu, Francisco Casacuberta, George Foster, Guoping Huang, Philipp Koehn

Findings of the WMT 2023 Shared Task on Quality Estimation

Frédéric Blain, Chrysoula Zerva, Ricardo Rei, Nuno M. Guerreiro, Diptesh Kanojia

Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not Innocent

Markus Freitag, Nitika Mathur, Chi-kiu Lo, Eleftherios Avramidis, Ricardo Rei

There’s No Data like Better Data: Using QE Metrics for MT Data Filtering

Jan-Thorsten Peter, David Vilar, Daniel Deutsch, Mara Finkelstein, Juraj Juraska

Towards Better Evaluation for Formality-Controlled English-Japanese Machine Translation

Edison Marrese-Taylor, Pin Chen Wang, Yutaka Matsuo

The Gender-GAP Pipeline: A Gender-Aware Polyglot Pipeline for Gender Characterisation in 55 Languages

Benjamin Muller, Belen Alastruey, Prangthip Hansanti, Elahe Kalbassi, Christophe Ropers

Visual Prediction Improves Zero-Shot Cross-Modal Machine Translation

Tosho Hirasawa, Emanuele Bugliarello, Desmond Elliott, Mamoru Komachi

Bridging the Gap between Position-Based and Content-Based Self-Attention for Neural Machine Translation

Felix Schmidt, Mattia Di Gangi

A Closer Look at Transformer Attention for Multilingual Translation

Jingyi Zhang, Gerard de Melo, Hongfei Xu, Kehai Chen

Towards Effective Disambiguation for Machine Translation with Large Language Models

Vivek Iyer, Pinzhen Chen, Alexandra Birch

Machine Translation with Large Language Models: Prompting, Few-shot Learning, and Fine-tuning with QLoRA

Xuan Zhang, Navid Rajabi, Kevin Duh, Philipp Koehn

Identifying Context-Dependent Translations for Evaluation Set Production

Rachel Wicks, Matt Post

Large Language Models Effectively Leverage Document-level Context for Literary Translation, but Critical Errors Persist

Marzena Karpinska, Mohit Iyyer

ChatGPT MT: Competitive for High- (but Not Low-) Resource Languages

Nathaniel Robinson, Perez Ogayo, David R. Mortensen, Graham Neubig

Document-Level Language Models for Machine Translation

Frithjof Petrick, Christian Herold, Pavel Petrushkov, Shahram Khadivi, Hermann Ney

A Sentence Alignment Approach to Document Alignment and Multi-faceted Filtering for Curating Parallel Sentence Pairs from Web-crawled Data

Steinthor Steingrimsson

A Fast Method to Filter Noisy Parallel Data WMT2023 Shared Task on Parallel Data Curation

Nguyen-Hoang Minh-Cong, Nguyen Van Vinh, Nguyen Le-Minh

KnowComp Submission for WMT23 Sign Language Translation Task

Baixuan Xu, Haochen Shi, Tianshi Zheng, Qing Zong, Weiqi Wang

TTIC’s Submission to WMT-SLT 23

Marcelo Sandoval-Castaneda, Yanhong Li, Bowen Shi, Diane Brentari, Karen Livescu

Machine Translation for Nko: Tools, Corpora, and Baseline Results

Moussa Doumbouya, Baba Mamadi Diané, Solo Farabado Cissé, Djibrila Diané, Abdoulaye Sow

TJUNLP:System Description for the WMT23 Literary Task in Chinese to English Translation Direction

Shaolin Zhu, Deyi Xiong

HW-TSC’s Submissions to the WMT23 Discourse-Level Literary Translation Shared Task

Yuhao Xie, Zongyao Li, Zhanglin Wu, Daimeng Wei, Xiaoyu Chen

DUTNLP System for the WMT2023 Discourse-Level Literary Translation

Anqi Zhao, Kaiyu Huang, Hao Yu, Degen Huang

The MAKE-NMTVIZ System Description for the WMT23 Literary Task

Fabien Lopez, Gabriela González, Damien Hansen, Mariam Nakhlé, Behnoosh Namdarzadeh

MAX-ISI System at WMT23 Discourse-Level Literary Translation Task

Li An, Linghao Jin, Xuezhe Ma

Investigating Techniques for a Deeper Understanding of Neural Machine Translation (NMT) Systems through Data Filtering and Fine-tuning Strategies

Lichao Zhu, Maria Zimina, Maud Bénard, Behnoosh Namdar, Nicolas Ballier

The Path to Continuous Domain Adaptation Improvements by HW-TSC for the WMT23 Biomedical Translation Shared Task

Zhanglin Wu, Daimeng Wei, Zongyao Li, Zhengzhe Yu, Shaojun Li

Biomedical Parallel Sentence Retrieval Using Large Language Models

Sheema Firdous, Sadaf Abdul Rauf

Test Suites Task: Evaluation of Gender Fairness in MT with MuST-SHE and INES

Beatrice Savoldi, Marco Gaido, Matteo Negri, Luisa Bentivogli

IIIT HYD’s Submission for WMT23 Test-suite Task

Ananya Mukherjee, Manish Shrivastava

Linguistically Motivated Evaluation of the 2023 State-of-the-art Machine Translation: Can ChatGPT Outperform NMT?

Shushen Manakhimova, Eleftherios Avramidis, Vivien Macketanz, Ekaterina Lapshinova-Koltunski, Sergei Bagdasarov

Multifaceted Challenge Set for Evaluating Machine Translation Performance

Xiaoyu Chen, Daimeng Wei, Zhanglin Wu, Ting Zhu, Hengchao Shang

RoCS-MT: Robustness Challenge Set for Machine Translation

Rachel Bawden, Benoît Sagot

GTCOM and DLUT’s Neural Machine Translation Systems for WMT23

Hao Zong

IOL Research Machine Translation Systems for WMT23 General Machine Translation Shared Task

Wenbo Zhang

Achieving State-of-the-Art Multilingual Translation Model with Minimal Data and Parameters

Hui Zeng

UvA-MT’s Participation in the WMT 2023 General Translation Shared Task

Di Wu, Shaomu Tan, David Stap, Ali Araabi, Christof Monz

Treating General MT Shared Task as a Multi-Domain Adaptation Problem: HW-TSC’s Submission to the WMT23 General MT Shared Task

Zhanglin Wu, Daimeng Wei, Zongyao Li, Zhengzhe Yu, Shaojun Li

Exploring Prompt Engineering with GPT Language Models for Document-Level Machine Translation: Insights and Findings

Yangjian Wu, Gang Hu

MUNI-NLP Submission for Czech-Ukrainian Translation Task at WMT23

Pavel Rychlý, Yuliia Teslia

AIST AIRC Submissions to the WMT23 Shared Task

Matīss Rikters, Makoto Miwa

PROMT Systems for WMT23 Shared General Translation Task

Alexander Molchanov, Vladislav Kovalenko

Yishu: Yishu at WMT2023 Translation Task

Luo Min, Yixin Tan, Qiulin Chen

KYB General Machine Translation Systems for WMT23

Ben Li, Yoko Matsuzaki, Shivam Kalkar

SKIM at WMT 2023 General Translation Task

Keito Kudo, Takumi Ito, Makoto Morishita, Jun Suzuki

CUNI at WMT23 General Translation Task: MT and a Genetic Algorithm

Josef Jon, Martin Popel, Ondřej Bojar

NAIST-NICT WMT’23 General MT Task Submission

Hiroyuki Deguchi, Kenji Imamura, Yuto Nishida, Yusuke Sakai, Justin Vasselli

Samsung R&D Institute Philippines at WMT 2023

Jan Christian Blaise Cruz

Findings of the WMT 2023 Shared Task on Parallel Data Curation

Steve Sloto, Brian Thompson, Huda Khayrallah, Tobias Domhan, Thamme Gowda

Findings of the Second WMT Shared Task on Sign Language Translation (WMT-SLT23)

Mathias Müller, Malihe Alikhani, Eleftherios Avramidis, Richard Bowden, Annelies Braffort

Findings of the WMT 2023 Shared Task on Discourse-Level Literary Translation: A Fresh Orb in the Cosmos of LLMs

Longyue Wang, Zhaopeng Tu, Yan Gu, Siyou Liu, Dian Yu

Findings of the WMT 2023 Biomedical Translation Shared Task: Evaluation of ChatGPT 3.5 as a Comparison System

Mariana Neves, Antonio Jimeno Yepes, Aurélie Névéol, Rachel Bawden, Giorgio Maria Di Nunzio

Findings of the 2023 Conference on Machine Translation (WMT23): LLMs Are Here but Not Quite There Yet

Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, Ondřej Bojar, Anton Dvorkovich