Skip to content
conftrace_

dialogue evaluation

54 papers

Papers

Your Students Don’t Use LLMs Like You Wish They Did ACL 2026 Amulet: Putting Complex Multi-Turn Conversations on the Stand with LLM Juries EMNLP 2025 An Improved, Strong Baseline for Pre-Trained Large Language Models as Task-Oriented Dialogue Systems EMNLP 2025 An Interpretable and Crosslingual Method for Evaluating Second-Language Dialogues NAACL 2025 CMT-Eval: A Novel Chinese Multi-turn Dialogue Evaluation Dataset Addressing Real-world Conversational Challenges EMNLP 2025 CU at BEA 2025 Shared Task: A BERT-Based Cross-Attention Approach for Evaluating Pedagogical Responses in Dialogue ACL 2025 Emphasising Structured Information: Integrating Abstract Meaning Representation into LLMs for Enhanced Open-Domain Dialogue Evaluation EMNLP 2025 MARS-Bench: A Multi-turn Athletic Real-world Scenario Benchmark for Dialogue Evaluation EMNLP 2025 Measure only what is measurable: towards conversation requirements for evaluating task-oriented dialogue systems ACL 2025 RAIDEN Benchmark: Evaluating Role-playing Conversational Agents with Measurement-Driven Custom Dialogues COLING 2025 RMTBench: Benchmarking LLMs Through Multi-Turn User-Centric Role-Playing EMNLP 2025 A Comparative Multidimensional Analysis of Empathetic Systems EACL 2024 A Comprehensive Analysis of the Effectiveness of Large Language Models as Automatic Dialogue Evaluators AAAI 2024 CharacterEval: A Chinese Benchmark for Role-Playing Conversational Agent Evaluation ACL 2024 CPsyCoun: A Report-based Multi-turn Dialogue Reconstruction and Evaluation Framework for Chinese Psychological Counseling ACL 2024 ESC-Eval: Evaluating Emotion Support Conversations in Large Language Models EMNLP 2024 Leveraging LLMs for Dialogue Quality Measurement NAACL 2024 MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues ACL 2024 On the Benchmarking of LLMs for Open-Domain Dialogue Evaluation ACL 2024 SLIDE: A Framework Integrating Small and Large Language Models for Open-Domain Dialogues Evaluation ACL 2024 Soda-Eval: Open-Domain Dialogue Evaluation in the age of LLMs EMNLP 2024 Better Correlation and Robustness: A Distribution-Balanced Self-Supervised Learning Framework for Automatic Dialogue Evaluation NeurIPS 2023 C-PMI: Conditional Pointwise Mutual Information for Turn-level Dialogue Evaluation ACL 2023 DEnsity: Open-domain Dialogue Evaluation Metric using Density Estimation ACL 2023 Evaluating Open-Domain Dialogues in Latent Space with Next Sentence Prediction and Mutual Information ACL 2023