Natural Language Understanding

Incomplete Utterance Rewriting with Editing Operation Guidance and Utterance Augmentation EMNLP 2024 Integrating Argumentation and Hate-Speech-based Techniques for Countering Misinformation EMNLP 2024 Language Models are Surprisingly Fragile to Drug Names in Biomedical Benchmarks EMNLP 2024 Large Language Models Fall Short: Understanding Complex Relationships in Detective Narratives ACL 2024 Learning Semantic Structure through First-Order-Logic Translation EMNLP 2024 Leveraging pre-trained language models for linguistic analysis: A case of argument structure constructions EMNLP 2024 LexEval: A Comprehensive Chinese Legal Benchmark for Evaluating Large Language Models NeurIPS 2024 Liar, Liar, Logical Mire: A Benchmark for Suppositional Reasoning in Large Language Models EMNLP 2024 Linguistic Bias in ChatGPT: Language Models Reinforce Dialect Discrimination EMNLP 2024 LLM-Rubric: A Multidimensional, Calibrated Approach to Automated Evaluation of Natural Language Texts ACL 2024 LLMs Assist NLP Researchers: Critique Paper (Meta-)Reviewing EMNLP 2024 LLMs for Generating and Evaluating Counterfactuals: A Comprehensive Study EMNLP 2024 M4LE: A Multi-Ability Multi-Range Multi-Task Multi-Domain Long-Context Evaluation Benchmark for Large Language Models ACL 2024 MAVEN-FACT: A Large-scale Event Factuality Detection Dataset EMNLP 2024 MetaPro 2.0: Computational Metaphor Processing on the Effectiveness of Anomalous Language Modeling ACL 2024 MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark NeurIPS 2024 MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Models EMNLP 2024 Multilingual Fine-Grained News Headline Hallucination Detection EMNLP 2024 Naming, Describing, and Quantifying Visual Objects in Humans and LLMs ACL 2024 NEO-BENCH: Evaluating Robustness of Large Language Models with Neologisms ACL 2024 On Evaluating Explanation Utility for Human-AI Decision Making in NLP EMNLP 2024 On the Evaluation of Speech Foundation Models for Spoken Language Understanding ACL 2024 Overview of the Context24 Shared Task on Contextualizing Scientific Claims ACL 2024 PARADISE: Evaluating Implicit Planning Skills of Language Models with Procedural Warnings and Tips Dataset ACL 2024 Paraphrasing in Affirmative Terms Improves Negation Understanding ACL 2024