EMNLP 2024

2,910 papers

The Bangla/Bengali Seed Dataset Submission to the WMT24 Open Language Data Initiative Shared Task

Firoz Ahmed, Nitin Venkateswaran, Sarah Moeller

Expanding the FLORES+ Multilingual Benchmark with Translations for Aragonese, Aranese, Asturian, and Valencian

Juan Antonio Pérez-Ortiz, Felipe Sánchez-Martínez, Víctor M. Sánchez-Cartagena, Miquel Esplà-Gomis, Aaron Galiano Jimenez

HW-TSC’s Participation in the WMT 2024 QEAPE Task

Jiawei Yu, Xiaofeng Zhao, Min Zhang, Zhao Yanqing, Yuang Li

HW-TSC 2024 Submission for the Quality Estimation Shared Task

Weiqiao Shan, Ming Zhu, Yuang Li, Mengyao Piao, Xiaofeng Zhao

TMU-HIT’s Submission for the WMT24 Quality Estimation Shared Task: Is GPT-4 a Good Evaluator for Machine Translation?

Ayako Sato, Kyotaro Nakajima, Hwichan Kim, Zhousi Chen, Mamoru Komachi

Machine Translation Metrics Are Better in Evaluating Linguistic Errors on LLMs than on Encoder-Decoder Systems

Eleftherios Avramidis, Shushen Manakhimova, Vivien Macketanz, Sebastian Möller

Evaluating WMT 2024 Metrics Shared Task Submissions on AfriMTE (the African Challenge Set)

Jiayi Wang, David Ifeoluwa Adelani, Pontus Stenetorp

MetricX-24: The Google Submission to the WMT 2024 Metrics Shared Task

Juraj Juraska, Daniel Deutsch, Mara Finkelstein, Markus Freitag

MSLC24: Further Challenges for Metrics on a Wide Landscape of Translation Quality

Rebecca Knowles, Samuel Larkin, Chi-kiu Lo

chrF-S: Semantics Is All You Need

Ananya Mukherjee, Manish Shrivastava

MetaMetrics-MT: Tuning Meta-Metrics for Machine Translation via Human Preference Calibration

David Anugraha, Garry Kuwanto, Lucky Susanto, Derry Tanti Wijaya, Genta Winata

Killing Two Flies with One Stone: An Attempt to Break LLMs Using English-Icelandic Idioms and Proper Names

Bjarki Ármannsson, Hinrik Hafsteinsson, Atli Jasonarson, Steinþór Steingrímsson

A Test Suite of Prompt Injection Attacks for LLM-based Machine Translation

Antonio Valerio Miceli Barone, Zhifan Sun

IsoChronoMeter: A Simple and Effective Isochronic Translation Evaluation Metric

Nikolai Rozanov, Vikentiy Pankov, Dmitrii Mukhutdinov, Dima Vypirailenko

Investigating the Linguistic Performance of Large Language Models in Machine Translation

Shushen Manakhimova, Vivien Macketanz, Eleftherios Avramidis, Ekaterina Lapshinova-Koltunski, Sergei Bagdasarov

Domain Dynamics: Evaluating Large Language Models in English-Hindi Translation

Soham Bhattacharjee, Baban Gain, Asif Ekbal

The GenderQueer Test Suite

Steinunn Rut Friðriksdóttir

WMT24 Test Suite: Gender Resolution in Speaker-Listener Dialogue Roles

Hillary Dawkins, Isar Nejadgholi, Chi-kiu Lo

CoST of breaking the LLMs

Ananya Mukherjee, Saumitra Yadav, Manish Shrivastava

Occiglot at WMT24: European Open-source Large Language Models Evaluated on Translation

Eleftherios Avramidis, Annika Grützner-Zahn, Manuel Brack, Patrick Schramowski, Pedro Ortiz Suarez

AIST AIRC Systems for the WMT 2024 Shared Tasks

Matīss Rikters, Makoto Miwa

SCIR-MT’s Submission for WMT24 General Machine Translation Task

Baohang Li, Zekai Ye, Yichong Huang, Xiaocheng Feng, Bing Qin

NTTSU at WMT2024 General Translation Task

Minato Kondo, Ryo Fukuda, Xiaotian Wang, Katsuki Chousa, Masato Nishimura

IKUN for WMT24 General MT Task: LLMs Are Here for Multilingual Machine Translation

Baohao Liao, Christian Herold, Shahram Khadivi, Christof Monz

Cogs in a Machine, Doing What They’re Meant to Do – the AMI Submission to the WMT24 General Translation Task

Atli Jasonarson, Hinrik Hafsteinsson, Bjarki Ármannsson, Steinþór Steingrímsson

From General LLM to Translation: How We Dramatically Improve Translation Quality Using Human Evaluation Data for LLM Finetuning

Denis Elshin, Nikolay Karpachev, Boris Gruzdev, Ilya Golovanov, Georgy Ivanov

CUNI at WMT24 General Translation Task: LLMs, (Q)LoRA, CPO and Model Merging

Miroslav Hrabal, Josef Jon, Martin Popel, Nam Luu, Danil Semin

DLUT and GTCOM’s Neural Machine Translation Systems for WMT24

Hao Zong, Chao Bei, Huan Liu, Conghu Yuan, Wentao Chen

Document-level Translation with LLM Reranking: Team-J at WMT 2024 General Translation Task

Keito Kudo, Hiroyuki Deguchi, Makoto Morishita, Ryo Fujii, Takumi Ito

TSU HITS’s Submissions to the WMT 2024 General Machine Translation Shared Task

Vladimir Mynka, Nikolay Mikhaylovskiy

Tower v2: Unbabel-IST 2024 Submission for the General MT Shared Task

Ricardo Rei, José Pombal, Nuno M. Guerreiro, João Alves, Pedro Henrique Martins

UvA-MT’s Participation in the WMT24 General Translation Shared Task

Shaomu Tan, Di Wu, David Stap, Seth Aycock, Christof Monz

CycleGN: A Cycle Consistent Approach for Neural Machine Translation

Sören Dreano, Derek Molloy, Noel Murphy

Choose the Final Translation from NMT and LLM Hypotheses Using MBR Decoding: HW-TSC’s Submission to the WMT24 General MT Shared Task

Zhanglin Wu, Daimeng Wei, Zongyao Li, Hengchao Shang, Jiaxin Guo

IOL Research Machine Translation Systems for WMT24 General Machine Translation Shared Task

Wenbo Zhang

MSLC24 Submissions to the General Machine Translation Task

Samuel Larkin, Chi-kiu Lo, Rebecca Knowles

Findings of the WMT 2024 Biomedical Translation Shared Task: Test Sets on Abstract Level

Mariana Neves, Cristian Grozea, Philippe Thomas, Roland Roller, Rachel Bawden

Results of the WAT/WMT 2024 Shared Task on Patent Translation

Shohei Higashiyama

Findings of the WMT 2024 Shared Task of the Open Language Data Initiative

Laurie Burchell, Jean Maillard, Antonios Anastasopoulos, Christian Federmann, Philipp Koehn

Findings of the Quality Estimation Shared Task at WMT 2024: Are LLMs Closing the Gap in QE?

Chrysoula Zerva, Frédéric Blain, José G. C. de Souza, Diptesh Kanojia, Sourabh Deoghare

Are LLMs Breaking MT Metrics? Results of the WMT24 Metrics Shared Task

Markus Freitag, Nitika Mathur, Daniel Deutsch, Chi-kiu Lo, Eleftherios Avramidis

Findings of the WMT24 General Machine Translation Shared Task: The LLM Era Is Here but MT Is Not Solved Yet

Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, Ondřej Bojar, Anton Dvorkovich

Summarization-Based Document IDs for Generative Retrieval with Language Models

Alan Li, Daniel Cheng, Phillip Keung, Jungo Kasai, Noah A. Smith

ARMADA: Attribute-Based Multimodal Data Augmentation

Xiaomeng Jin, Jeonghwan Kim, Yu Zhou, Kuan-Hao Huang, Te-Lin Wu

Blocks Architecture (BloArk): Efficient, Cost-Effective, and Incremental Dataset Architecture for Wikipedia Revision History

Lingxi Li, Zonghai Yao, Sunjae Kwon, Hong Yu

Wikimedia data for AI: a review of Wikimedia datasets for NLP tasks and AI-assisted editing

Isaac Johnson, Lucie-Aimée Kaffee, Miriam Redi

Embedded Topic Models Enhanced by Wikification

Takashi Shibuya, Takehito Utsuro

The Rise of AI-Generated Content in Wikipedia

Creston Brooks, Samuel Eggert, Denis Peskoff

HOAXPEDIA: A Unified Wikipedia Hoax Articles Dataset

Hsuvas Borkakoty, Luis Espinosa-Anke

WikiBias as an Extrapolation Corpus for Bias Detection

K. Salas-Jimenez, Francisco Fernando Lopez-Ponce, Sergio-luis Ojeda-trueba, Gemma Bel-Enguix

Retrieval Evaluation for Long-Form and Knowledge-Intensive Image–Text Article Composition

Jheng-Hong Yang, Carlos Lassance, Rafael S. Rezende, Krishna Srinivasan, Stéphane Clinchant

Uncovering Differences in Persuasive Language in Russian versus English Wikipedia

Bryan Li, Aleksey Panasyuk, Chris Callison-Burch

Multi-Label Field Classification for Scientific Documents using Expert and Crowd-sourced Knowledge

Rebecca Gelles, James Dunham

BordIRlines: A Dataset for Evaluating Cross-lingual Retrieval Augmented Generation

Bryan Li, Samar Haider, Fiona Luo, Adwait Agashe, Chris Callison-Burch

AI-Tutor: Interactive Learning of Ancient Knowledge from Low-Resource Languages

Siddhartha Dalal, Rahul Aditya, Vethavikashini Chithrra Raghuram, Prahlad Koratamaddi

Are Large Language Models State-of-the-art Quality Estimators for Machine Translation of User-generated Content?

Shenbin Qian, Constantin Orasan, Diptesh Kanojia, Félix do Carmo

Machine Translation Of Marathi Dialects: A Case Study Of Kadodi

Raj Dabre, Mary Dabre, Teresa Pereira

An Empirical Study of Multilingual Vocabulary for Neural Machine Translation Models

Kenji Imamura, Masao Utiyama

Measuring and Modifying the Readability of English Texts with GPT-4

Sean Trott, Pamela Rivière

Evaluating the Simplification of Brazilian Legal Rulings in LLMs Using Readability Scores as a Target

Antonio Flavio Paula, Celso Camilo-Junior

EASSE-DE & EASSE-multi: Easier Automatic Sentence Simplification Evaluation for German & Multiple Languages

Regina Stodden

SciGisPy: a Novel Metric for Biomedical Text Simplification via Gist Inference Score

Chen Lyu, Gabriele Pergola

Lexical Complexity Prediction and Lexical Simplification for Catalan and Spanish: Resource Creation, Quality Assessment, and Ethical Considerations

Horacio Saggion, Stefan Bott, Sandra Szasz, Nelson Pérez, Saúl Calderón

Difficult for Whom? A Study of Japanese Lexical Complexity

Adam Nohejl, Akio Hayakawa, Yusuke Ide, Taro Watanabe

Society of Medical Simplifiers

Chen Lyu, Gabriele Pergola

Considering Human Interaction and Variability in Automatic Text Simplification

Jenia Kim, Stefan Leijnen, Lisa Beinborn

Cochrane-auto: An Aligned Dataset for the Simplification of Biomedical Abstracts

Jan Bakker, Jaap Kamps

Images Speak Volumes: User-Centric Assessment of Image Generation for Accessible Communication

Miriam Anschütz, Tringa Sylaj, Georg Groh

CompLex-ZH: A New Dataset for Lexical Complexity Prediction in Mandarin and Cantonese

Le Qiu, Shanyue Guo, Tak-sum Wong, Emmanuele Chersoni, John Lee

OtoBERT: Identifying Suffixed Verbal Forms in Modern Hebrew Literature

Avi Shmidman, Shaltiel Shmidman

MultiLS: An End-to-End Lexical Simplification Framework

Kai North, Tharindu Ranasinghe, Matthew Shardlow, Marcos Zampieri

Domain-Expanded ASTE: Rethinking Generalization in Aspect Sentiment Triplet Extraction

Yew Ken Chia, Hui Chen, Guizhen Chen, Wei Han, Sharifah Mahani Aljunied

EHDChat: A Knowledge-Grounded, Empathy-Enhanced Language Model for Healthcare Interactions

Shenghan Wu, Wynne Hsu, Mong Li Lee

Principles for AI-Assisted Social Influence and Their Application to Social Mediation

Ian Perera, Alex Memory, Vera A. Kazakova, Bonnie J. Dorr, Brodie Mather

”So, are you a different person today?” Analyzing Bias in Questions during Parole Hearings

Wassiliki Siskou, Ingrid Espinoza

Balancing Transparency and Accuracy: A Comparative Analysis of Rule-Based and Deep Learning Models in Political Bias Classification

Manuel Nunez Martinez, Sonja Schmer-Galunder, Zoey Liu, Sangpil Youm, Chathuri Jayaweera

Leveraging Large Language Models for Code-Mixed Data Augmentation in Sentiment Analysis

Linda Zeng

Redefining Proactivity for Information Seeking Dialogue

Jing Yang Lee, Seokhwan Kim, Kartik Mehta, Jiun-Yu Kao, Yu-Hsiang Lin

RecomMind: Movie Recommendation Dialogue with Seeker’s Internal State

Takashi Kodama, Hirokazu Kiyomaru, Yin Jou Huang, Sadao Kurohashi

Personality Differences Drive Conversational Dynamics: A High-Dimensional NLP Approach

Julia R. Fischer, Nilam Ram

Should We Respect LLMs? A Cross-Lingual Study on the Influence of Prompt Politeness on LLM Performance

Ziqi Yin, Hao Wang, Kaito Horio, Daisuke Kawahara, Satoshi Sekine

Observing the Southern US Culture of Honor Using Large-Scale Social Media Analysis

Juho Kim, Michael Guerzhoy

CogErgLLM: Exploring Large Language Model Systems Design Perspective Using Cognitive Ergonomics

Azmine Toushik Wasi, Mst Rafia Islam

Individuation in Neural Models with and without Visual Grounding

Alexey Tikhonov, Lisa Bylinina, Ivan P. Yamshchikov

Categorical Syllogisms Revisited: A Review of the Logical Reasoning Abilities of LLMs for Analyzing Categorical Syllogisms

Shi Zong, Jimmy Lin

The Grid: A semi-automated tool to support expert-driven modeling

Allegra A. Beal Cohen, Maria Alexeeva, Keith Alcock, Mihai Surdeanu

Benchmarking Automated Theorem Proving with Large Language Models

Vanessa Lama, Catherine Ma, Tirthankar Ghosal

Exploring Scientific Hypothesis Generation with Mamba

Miaosen Chai, Emily Herron, Erick Cervantes, Tirthankar Ghosal

Personalized-ABA: Personalized Treatment Plan Generation for Applied Behavior Analysis using Natural Language Processing

Aman Kumar, Mareiko Au, Raj Semlawat, Malavica Sridhar, Hitesh Gurnani

Learning the Bitter Lesson: Empirical Evidence from 20 Years of CVPR Proceedings

Mojtaba Yousefi, Jack Collins

Why So Serious: Humor and its Association with Treatment Measurements Process and Outcome

Matan Kenigsbuch, Natalie Shapira

The Moral Foundations Weibo Corpus

Renjie Cao, Miaoyan Hu, Jiahan Wei, Baha Ihnaini

LLMs and NLP for Generalized Learning in AI-Enhanced Educational Videos and Powering Curated Videos with Generative Intelligence

Naina Chaturvedi

Dreaming with ChatGPT: Unraveling the Challenges of LLMs Dream Generation

Harel Berger, Hadar King, Omer David

Hypothesis Generation with Large Language Models

Yangqiaoyu Zhou, Haokun Liu, Tejes Srivastava, Hongyuan Mei, Chenhao Tan

Soft Measures for Extracting Causal Collective Intelligence

Maryam Berijanian, Spencer Dork, Kuldeep Singh, Michael Riley Millikan, Ashlin Riggs

RACER: An LLM-powered Methodology for Scalable Analysis of Semi-structured Mental Health Interviews

Satpreet Harcharan Singh, Kevin Jiang, Kanchan Bhasin, Ashutosh Sabharwal, Nidal Moukaddam

SCITUNE: Aligning Large Language Models with Human-Curated Scientific Multimodal Instructions

Sameera Horawalavithana, Sai Munikoti, Ian Stewart, Henry Kvinge, Karl Pazdernik

GCD-TM: Graph-Driven Community Detection for Topic Modelling in Psychiatry Texts

Anusuya Krishnan, Isaias Mehari Ghebrehiwet

Two-Stage Graph-Augmented Summarization of Scientific Documents

Rezvaneh Rezapour, Yubin Ge, Kanyao Han, Ray Jeong, Jana Diesner