EMNLP 2024

2,910 papers

Measuring the Groundedness of Legal Question-Answering Systems

Dietrich Trautmann, Natalia Ostapuk, Quentin Grail, Adrian Pol, Guglielmo Bonifazi

Algorithm for Automatic Legislative Text Consolidation

Matias Etcheverry, Thibaud Real, Pauline Chavallard

Attributed Question Answering for Preconditions in the Dutch Law

Felicia Redelaar, Romy Van Drie, Suzan Verberne, Maaike De Boer

Enhancing Contract Negotiations with LLM-Based Legal Document Comparison

Savinay Narendra, Kaushal Shetty, Adwait Ratnaparkhi

Towards an Automated Pointwise Evaluation Metric for Generated Long-Form Legal Summaries

Shao Min Tan, Quentin Grail, Lee Quartey

Automated Anonymization of Parole Hearing Transcripts

Abed Itani, Wassiliki Siskou, Annette Hautli-Janisz

Information Extraction for Planning Court Cases

Drish Mali, Rubash Mali, Claire Barale

The CLC-UKET Dataset: Benchmarking Case Outcome Prediction for the UK Employment Tribunal

Huiyuan Xie, Felix Steffek, Joana De Faria, Christine Carter, Jonathan Rutherford

Rethinking Legal Judgement Prediction in a Realistic Scenario in the Era of Large Language Models

Shubham Kumar Nigam, Aniket Deroy, Subhankar Maity, Arnab Bhattacharya

Quebec Automobile Insurance Question-Answering With Retrieval-Augmented Generation

David Beauchemin, Richard Khoury, Zachary Gagnon

uOttawa at LegalLens-2024: Transformer-based Classification Experiments

Nima Meghdadi, Diana Inkpen

Enhancing Legal Expertise in Large Language Models through Composite Model Integration: The Development and Evaluation of Law-Neo

Zhihao Liu, Yanzhen Zhu, Mengyuan Lu

Summarizing Long Regulatory Documents with a Multi-Step Pipeline

Mika Sie, Ruby Beek, Michiel Bots, Sjaak Brinkkemper, Albert Gatt

LeGen: Complex Information Extraction from Legal sentences using Generative Models

Chaitra C R, Sankalp Kulkarni, Sai Rama Akash Varma Sagi, Shashank Pandey, Rohit Yalavarthy

Findings of the 2nd Shared Task on Multi-lingual Multi-task Information Retrieval at MRL 2024

Francesco Tinner, Raghav Mantri, Mammad Hajili, Chiamaka Chukwuneke, Dylan Massey

CUNI and LMU Submission to the MRL 2024 Shared Task on Multi-lingual Multi-task Information Retrieval

Katharina Hämmerl, Andrei-Alexandru Manea, Gianluca Vico, Jindřich Helcl, Jindřich Libovický

McGill NLP Group Submission to the MRL 2024 Shared Task: Ensembling Enhances Effectiveness of Multilingual Small LMs

Senyu Li, Hao Yu, Jessica Ojo, David Ifeoluwa Adelani

MLT-DR: Multi-Lingual/Task Demonstration RetrievalAn Attempt towards Generalized Retriever for In-Context Learning

Kazuma Hashimoto, Arjun Reddy Akula, Karthik Raman, Michael Bendersky

Detecting and Translating Language Ambiguity with Multilingual LLMs

Behrang Mehrparvar, Sandro Pezzelle

Generalization Measures for Zero-Shot Cross-Lingual Transfer

Saksham Bassi, Duygu Ataman, Kyunghyun Cho

Language Bias in Multilingual Information Retrieval: The Nature of the Beast and Mitigation Methods

Jinrui Yang, Fan Jiang, Timothy Baldwin

Unsupervised Text Representation Learning via Instruction-Tuning for Zero-Shot Dense Retrieval

Qiuhai Zeng, Zimeng Qiu, Dae Yon Hwang, XIN HE, William M. Campbell

Bridging the Bosphorus: Advancing Turkish Large Language Models through Strategies for Low-Resource Language Adaptation and Benchmarking

Emre Can Acikgoz, Mete Erdogan, Deniz Yuret

Leveraging LLMs for Translating and Classifying Mental Health Data

Konstantinos Skianis, A. Seza Doğruöz, John Pavlopoulos

Community OSCAR: A Community Effort for Multilingual Web Data

Manuel Brack, Malte Ostendorff, Pedro Ortiz Suarez, Jose Javier Saiz, Iñaki Lacunza Castilla

Evaluating Multilingual Long-Context Models for Retrieval and Reasoning

Ameeta Agrawal, Andy Dang, Sina Bagheri Nezhad, Rhitabrat Pokharel, Russell Scheinberg

Leveraging Adapters for Improved Cross-lingual Transfer for Low-Resource Creole MT

Marcell Fekete, Ernests Lavrinovics, Nathaniel Romney Robinson, Heather Lent, Raj Dabre

Mitigating the Linguistic Gap with Phonemic Representations for Robust Cross-lingual Transfer

Haeji Jung, Changdae Oh, Jooeon Kang, Jimin Sohn, Kyungwoo Song

[RETRACTED] Vikhr: Constructing a State-of-the-art Bilingual Open-Source Instruction-Following Large Language Model for Russian

Aleksandr Nikolich, Konstantin Korolev, Sergei Bratchikov, Igor Kiselev, Artem Shelmanov

Towards Cross-Linguistic Semantic Grounding using Dictionary Graph Analysis

Ethan Eschrich, Zoey Liu

Parameter-efficient Adaptation of Multilingual Multimodal Models for Low-resource ASR

Abhishek Gupta, Amruta Parulekar, Sameep Chattopadhyay, Preethi Jyothi

Cross-Lingual Named Entity Recognition for Low-Resource Languages: A Hindi-Nepali Case Study Using Multilingual BERT Models

Dipendra Yadav, Sumaiya Suravee, Tobias Strauß, Kristina Yordanova

Jina-ColBERT-v2: A General-Purpose Multilingual Late Interaction Retriever

Rohan Jha, Bo Wang, Michael Günther, Georgios Mastrapas, Saba Sturua

Gender-specific Machine Translation with Large Language Models

Eduardo Sánchez, Pierre Andrews, Pontus Stenetorp, Mikel Artetxe, Marta R. Costa-jussà

Recipe for Zero-shot POS Tagging: Is It Useful in Realistic Scenarios?

Zeno Vandenbulcke, Lukas Vermeire, Miryam de Lhoneux

Modeling Bilingual Sentence Processing: Evaluating RNN and Transformer Architectures for Cross-Language Structural Priming

Demi Zhang, Bushi Xiao, Chao Gao, Sangpil Youm, Bonnie J Dorr

Language and Task Arithmetic with Parameter-Efficient Layers for Zero-Shot Summarization

Alexandra Chronopoulou, Jonas Pfeiffer, Joshua Maynez, Xinyi Wang, Sebastian Ruder

Tagengo: A Multilingual Chat Dataset

Peter Devine

Are You Sure? Rank Them Again: Repeated Ranking For Better Preference Datasets

Peter Devine

An Efficient Approach for Studying Cross-Lingual Transfer in Multilingual Language Models

Fahim Faisal, Antonios Anastasopoulos

Adapting Open-Source Generative Large Language Models for Low-Resource Languages: A Case Study for Turkish

Cagri Toraman

What an Elegant Bridge: Multilingual LLMs are Biased Similarly in Different Languages

Viktor Mihaylov, Aleksandar Shtedritski

SambaLingo: Teaching Large Language Models New Languages

Zoltan Csaki, Bo Li, Jonathan Lingjie Li, Qiantong Xu, Pian Pawakapan

Towards a new Benchmark for Emotion Detection in NLP: A Unifying Framework of Recent Corpora

Anna Koufakou, Elijah Nieves, John Peller

OmniDialog: A Multimodal Benchmark for Generalization Across Text, Visual, and Audio Modalities

Anton Razzhigaev, Maxim Kurkin, Elizaveta Goncharova, Irina Abdullaeva, Anastasia Lysenko

Investigating the Generalizability of Pretrained Language Models across Multiple Dimensions: A Case Study of NLI and MRC

Ritam Dutt, Sagnik Ray Choudhury, Varun Venkat Rao, Carolyn Rose, V.G.Vinod Vydiswaran

CHIE: Generative MRC Evaluation for in-context QA with Correctness, Helpfulness, Irrelevancy, and Extraneousness Aspects

Wannaphong Phatthiyaphaibun, Surapon Nonesung, Peerat Limkonchotiwat, Can Udomcharoenchaikit, Jitkapat Sawatphol

Is artificial intelligence still intelligence? LLMs generalize to novel adjective-noun pairs, but don’t mimic the full human distribution

Hayley Ross, Kathryn Davidson, Najoung Kim

Beyond the Numbers: Transparency in Relation Extraction Benchmark Creation and Leaderboards

Varvara Arzt, Allan Hanbury

MultiPragEval: Multilingual Pragmatic Evaluation of Large Language Models

Dojun Park, Jiwoo Lee, Seohyun Park, Hyeyun Jeong, Youngeun Koo

MLissard: Multilingual Long and Simple Sequential Reasoning Benchmarks

Mirelle Candida Bueno, Roberto Lotufo, Rodrigo Frassetto Nogueira

MMLU-SR: A Benchmark for Stress-Testing Reasoning Capability of Large Language Models

Wentian Wang, Sarthak Jain, Paul Kantor, Jacob Feldman, Lazaros Gallos

Automated test generation to evaluate tool-augmented LLMs as conversational AI agents

Samuel Arcadinho, David Oliveira Aparicio, Mariana S. C. Almeida

The SlayQA benchmark of social reasoning: testing gender-inclusive generalization with neopronouns

Bastian Bunzeck, Sina Zarrieß

From Language to Pixels: Task Recognition and Task Learning in LLMs

Janek Falkenstein, Carolin M. Schuster, Alexander H. Berger, Georg Groh

Evaluating the fairness of task-adaptive pretraining on unlabeled test data before few-shot text classification

Kush Dubey

Generative Approaches to Event Extraction: Survey and Outlook

Étienne Simon, Helene Olsen, Huiling You, Samia Touileb, Lilja Øvrelid

A Comprehensive Survey on Document-Level Information Extraction

Hanwen Zheng, Sijia Wang, Lifu Huang

Reasoning and Tools for Human-Level Forecasting

Elvis Hsieh, Preston Fu, Jonathan Chen

MUMOSA, Interactive Dashboard for MUlti-MOdal Situation Awareness

Stephanie M. Lukin, Shawn Bowser, Reece Suchocki, Douglas Summers-Stay, Francis Ferraro

DEGREEˆ2: Efficient Extraction of Multiple Events Using Language Models

Philip Blair, Kfir Bar

An Incremental Clustering Baseline for Event Detection on Twitter

Marjolaine Ray, Qi Wang, Frédérique Mélanie-Becquet, Thierry Poibeau, Béatrice Mazoyer

BERTrend: Neural Topic Modeling for Emerging Trends Detection

Allaa Boutaleb, Jérôme Picault, Guillaume Grosjean

Fact or Fiction? Improving Fact Verification with Knowledge Graphs through Simplified Subgraph Retrievals

Tobias Aanderaa Opsahl

FactGenius: Combining Zero-Shot Prompting and Fuzzy Relation Mining to Improve Fact Verification with Knowledge Graphs

Sushant Gautam, Roxana Pop

RAGAR, Your Falsehood Radar: RAG-Augmented Reasoning for Political Fact-Checking using Multimodal Large Language Models

Mohammed Abdul Khaliq, Paul Yu-Chun Chang, Mingyang Ma, Bernhard Pflugfelder, Filip Miletić

Contrastive Learning to Improve Retrieval for Real-World Fact Checking

Aniruddh Sriram, Fangyuan Xu, Eunsol Choi, Greg Durrett

Claim Check-Worthiness Detection: How Well do LLMs Grasp Annotation Guidelines?

Laura Majer, Jan Šnajder

AMREx: AMR for Explainable Fact Verification

Chathuri Jayaweera, Sangpil Youm, Bonnie J Dorr

Question-Based Retrieval using Atomic Units for Enterprise RAG

Vatsal Raina, Mark Gales

Fast Evidence Extraction for Grounded Language Model Outputs

Pranav Mani, Davis Liang, Zachary Chase Lipton

Improving Explainable Fact-Checking via Sentence-Level Factual Reasoning

Francielle Vargas, Isadora Salles, Diego Alves, Ameeta Agrawal, Thiago A. S. Pardo

Streamlining Conformal Information Retrieval via Score Refinement

Yotam Intrator, Regev Cohen, Ori Kelner, Roman Goldenberg, Ehud Rivlin

Numerical Claim Detection in Finance: A New Financial Dataset, Weak-Supervision Model, and Market Analysis

Agam Shah, Arnav Hiray, Pratvi Shah, Arkaprabha Banerjee, Anushka Singh

Enhancing Fact Verification with Causal Knowledge Graphs and Transformer-Based Retrieval for Deductive Reasoning

Fiona Anting Tan, Jay Desai, Srinivasan H. Sengamedu

AIC CTU system at AVeriTeC: Re-framing automated fact-checking as a simple RAG task

Herbert Ullrich, Tomáš Mlynář, Jan Drchal

HerO at AVeriTeC: The Herd of Open Large Language Models for Verifying Real-World Claims

Yejun Yoon, Jaeyoon Jung, Seunghyun Yoon, Kunwoo Park

GProofT: A Multi-dimension Multi-round Fact Checking Framework Based on Claim Fact Extraction

Jiayu Liu, Junhao Tang, Hanwen Wang, Baixuan Xu, Haochen Shi

Exploring Retrieval Augmented Generation For Real-world Claim Verification

Omar Adjali

InFact: A Strong Baseline for Automated Fact-Checking

Mark Rothermel, Tobias Braun, Marcus Rohrbach, Anna Rohrbach

SK_DU Team: Cross-Encoder based Evidence Retrieval and Question Generation with Improved Prompt for the AVeriTeC Shared Task

Shrikant Malviya, Stamos Katsigiannis

Evidence-backed Fact Checking using RAG and Few-Shot In-Context Learning with LLMs

Ronit Singal, Pransh Patwa, Parth Patwa, Aman Chadha, Amitava Das

Zero-Shot Learning and Key Points Are All You Need for Automated Fact-Checking

Mohammad Ghiasvand Mohammadkhani, Ali Ghiasvand Mohammadkhani, Hamid Beigy

FZI-WIM at AVeriTeC Shared Task: Real-World Fact-Checking with Question Answering

Jin Liu, Steffen Thoma, Achim Rettinger

Dunamu-ml’s Submissions on AVERITEC Shared Task

Heesoo Park, Dongjun Lee, Jaehyuk Kim, Choongwon Park, Changhwa Park

Improving Evidence Retrieval on Claim Verification Pipeline through Question Enrichment

Svetlana Churina, Anab Maulana Barik, Saisamarth Rajesh Phaye

UHH at AVeriTeC: RAG for Fact-Checking with Real-World Claims

Özge Sevgili, Irina Nikishina, Seid Muhie Yimam, Martin Semmann, Chris Biemann

RAG-Fusion Based Information Retrieval for Fact-Checking

Yuki Momii, Tetsuya Takiguchi, Yasuo Ariki

Retrieving Semantics for Fact-Checking: A Comparative Approach using CQ (Claim to Question) & AQ (Answer to Question)

Nicolò Urbani, Sandip Modha, Gabriella Pasi

Multi-hop Evidence Pursuit Meets the Web: Team Papelo at FEVER 2024

Christopher Malon

The Automated Verification of Textual Claims (AVeriTeC) Shared Task

Michael Schlichtkrull, Yulong Chen, Chenxi Whitehouse, Zhenyun Deng, Mubashara Akhtar

V-GlórIA - Customizing Large Vision and Language Models to European Portuguese

Afonso Simplício, David Semedo, Joao Magalhaes

Adapting LLM Predictions in In-Context Learning with Data Priors

Javier Chiyah-Garcia, Prasoon Goyal, Michael Johnston, Reza Ghanadan

E-Commerce Product Categorization with LLM-based Dual-Expert Classification Paradigm

Zhu Cheng, Wen Zhang, Chih-Chi Chou, You-Yi Jau, Archita Pathak

LLM-as-a-tutor in EFL Writing Education: Focusing on Evaluation of Student-LLM Interaction

Jieun Han, Haneul Yoo, Junho Myung, Minsun Kim, Hyunseung Lim

“Let’s Argue Both Sides”: Argument Generation Can Force Small Models to Utilize Previously Inaccessible Reasoning Capabilities

Kaveh Eskandari Miandoab, Vasanth Sarathy

What Kind of Sourcery is This? Evaluating GPT-4’s Performance on Linking Scientific Fact to Citations

Autumn Toney

HyPA-RAG: A Hybrid Parameter Adaptive Retrieval-Augmented Generation System for AI Legal and Policy Applications

Rishi Kalra, Zekun Wu, Ayesha Gulley, Airlie Hilliard, Xin Guan

Evaluating and Training Long-Context Large Language Models for Question Answering on Scientific Papers

Lukas Hilgert, Danni Liu, Jan Niehues

Pearl: Personalizing Large Language Model Writing Assistants with Generation-Calibrated Retrievers

Sheshera Mysore, Zhuoran Lu, Mengting Wan, Longqi Yang, Bahareh Sarrafzadeh