conftrace_

dialogue evaluation

57 papers

Explore in graph

Co-occurring keywords

large language model (13587) dialogue system (1667) open-domain dialogue (83) automatic evaluation (225) multi-turn dialogue (198) dialogue coherence (16) conversational agent (241) language model (4599) natural language generation (785) self-supervised learning (3777)

Papers

Your Students Don’t Use LLMs Like You Wish They Did ACL 2026
CU at BEA 2025 Shared Task: A BERT-Based Cross-Attention Approach for Evaluating Pedagogical Responses in Dialogue ACL 2025
MARS-Bench: A Multi-turn Athletic Real-world Scenario Benchmark for Dialogue Evaluation EMNLP 2025
Measure only what is measurable: towards conversation requirements for evaluating task-oriented dialogue systems ACL 2025
Emphasising Structured Information: Integrating Abstract Meaning Representation into LLMs for Enhanced Open-Domain Dialogue Evaluation EMNLP 2025
RAIDEN Benchmark: Evaluating Role-playing Conversational Agents with Measurement-Driven Custom Dialogues COLING 2025
RMTBench: Benchmarking LLMs Through Multi-Turn User-Centric Role-Playing EMNLP 2025
An Improved, Strong Baseline for Pre-Trained Large Language Models as Task-Oriented Dialogue Systems EMNLP 2025
An Interpretable and Crosslingual Method for Evaluating Second-Language Dialogues NAACL 2025
CMT-Eval: A Novel Chinese Multi-turn Dialogue Evaluation Dataset Addressing Real-world Conversational Challenges EMNLP 2025
Amulet: Putting Complex Multi-Turn Conversations on the Stand with LLM Juries EMNLP 2025
CharacterEval: A Chinese Benchmark for Role-Playing Conversational Agent Evaluation ACL 2024
MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues ACL 2024
ESC-Eval: Evaluating Emotion Support Conversations in Large Language Models EMNLP 2024
On the Benchmarking of LLMs for Open-Domain Dialogue Evaluation ACL 2024
A Comparative Multidimensional Analysis of Empathetic Systems EACL 2024
Leveraging LLMs for Dialogue Quality Measurement NAACL 2024
A Comprehensive Analysis of the Effectiveness of Large Language Models as Automatic Dialogue Evaluators AAAI 2024
SLIDE: A Framework Integrating Small and Large Language Models for Open-Domain Dialogues Evaluation ACL 2024
CPsyCoun: A Report-based Multi-turn Dialogue Reconstruction and Evaluation Framework for Chinese Psychological Counseling ACL 2024
Soda-Eval: Open-Domain Dialogue Evaluation in the age of LLMs EMNLP 2024
MEEP: Is this Engaging? Prompting Large Language Models for Dialogue Evaluation in Multilingual Settings EMNLP 2023
RADE: Reference-Assisted Dialogue Evaluation for Open-Domain Dialogue ACL 2023
Better Correlation and Robustness: A Distribution-Balanced Self-Supervised Learning Framework for Automatic Dialogue Evaluation NIPS 2023
TaskDiff: A Similarity Metric for Task-Oriented Conversations EMNLP 2023