conftrace_

automated evaluation

58 papers

Explore in graph

Co-occurring keywords

large language model (13587) human evaluation (379) language model (4599) text summarization (896) automatic evaluation (225) evaluation metric (573) benchmark evaluation (1556) dialogue system (1667) multimodal learning (4645) human preference (124)

Papers

Evaluation of Generated Poetry AACL 2025
AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark ACL 2025
A Measure of the System Dependence of Automated Metrics ACL 2025
From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judge EMNLP 2025
TheoremExplainAgent: Towards Video-based Multimodal Explanations for LLM Theorem Understanding ACL 2025
Graders Should Cheat: Privileged Information Enables Expert-Level Automated Evaluations EMNLP 2025
Can LLMs Generate and Solve Linguistic Olympiad Puzzles? EMNLP 2025
InstaJudge: Aligning Judgment Bias of LLM-as-Judge with Humans in Industry Applications EMNLP 2025
VideoAutoArena: An Automated Arena for Evaluating Large Multimodal Models in Video Analysis through User Simulation CVPR 2025
AutoDetect: Towards a Unified Framework for Automated Weakness Detection in Large Language Models EMNLP 2024
FineSurE: Fine-grained Summarization Evaluation using LLMs ACL 2024
APPLS: Evaluating Evaluation Metrics for Plain Language Summarization EMNLP 2024
QualEval: Qualitative Evaluation for Model Improvement NAACL 2024
Automated Evaluation of Teacher Encouragement of Student-to-Student Interactions in a Simulated Classroom Discussion NAACL 2024
LLM-Rubric: A Multidimensional, Calibrated Approach to Automated Evaluation of Natural Language Texts ACL 2024
Long-form factuality in large language models NIPS 2024
AutoHallusion: Automatic Generation of Hallucination Benchmarks for Vision-Language Models EMNLP 2024
Efficient Performance Tracking: Leveraging Large Language Models for Automated Construction of Scientific Leaderboards EMNLP 2024
Revisiting Automated Evaluation for Long-form Table Question Answering EMNLP 2024
Refining App Reviews: Dataset, Methodology, and Evaluation EMNLP 2024
Automated Metrics for Medical Multi-Document Summarization Disagree with Human Evaluations ACL 2023
IC3: Image Captioning by Committee Consensus EMNLP 2023
WikiOmnia: filtration and evaluation of the generated QA corpus on the whole Russian Wikipedia EMNLP 2022
SEM-F1: an Automatic Way for Semantic Evaluation of Multi-Narrative Overlap Summaries at Scale EMNLP 2022
Open-Domain Dialog Evaluation Using Follow-Ups Likelihood COLING 2022