conftrace_

evaluation framework

138 papers

Explore in graph

Co-occurring keywords

large language model (13587) language model (4599) text generation (2913) evaluation metric (573) human evaluation (379) retrieval-augmented generation (1592) dialogue system (1667) model evaluation (445) question answering (2963) benchmark evaluation (1556)

Papers

NewsBench: A Systematic Evaluation Framework for Assessing Editorial Capabilities of Large Language Models in Chinese Journalism ACL 2024
PolyWER: A Holistic Evaluation Framework for Code-Switched Speech Recognition EMNLP 2024
Automated Assessment of Fidelity and Interpretability: An Evaluation Framework for Large Language Models’ Explanations (Student Abstract) AAAI 2024
GenRES: Rethinking Evaluation for Generative Relation Extraction in the Era of Large Language Models NAACL 2024
Reasoning or Reciting? Exploring the Capabilities and Limitations of Language Models Through Counterfactual Tasks NAACL 2024
RAGAs: Automated Evaluation of Retrieval Augmented Generation EACL 2024
An Evaluation Mechanism of LLM-based Agents on Manipulating APIs EMNLP 2024
Reference Matters: Benchmarking Factual Error Correction for Dialogue Summarization with Fine-grained Evaluation Framework ACL 2023
The Devil is in the Details: On the Pitfalls of Event Extraction Evaluation ACL 2023
Measuring the Instability of Fine-Tuning ACL 2023
Are Personalized Stochastic Parrots More Dangerous? Evaluating Persona Biases in Dialogue Systems EMNLP 2023
No Strong Feelings One Way or Another: Re-operationalizing Neutrality in Natural Language Inference ACL 2023
Automating Behavioral Testing in Machine Translation EMNLP 2023
LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluation NIPS 2023
Benchmark Data and Evaluation Framework for Intent Discovery Around COVID-19 Vaccine Hesitancy EACL 2023
Gauging the Gap Between Human and Machine Text Simplification Through Analytical Evaluation of Simplification Strategies and Errors EACL 2023
InteractEva: A Simulation-Based Evaluation Framework for Interactive AI Systems AAAI 2022
SRL4E – Semantic Role Labeling for Emotions: A Unified Evaluation Framework ACL 2022
A Simulation-Based Evaluation Framework for Interactive AI Systems and Its Application AAAI 2022
How General-Purpose Is a Language Model? Usefulness and Safety with Human Prompters in the Wild AAAI 2022
A Consistent and Efficient Evaluation Strategy for Attribution Methods ICML 2022
It’s Commonsense, isn’t it? Demystifying Human Evaluations in Commonsense-Enhanced NLG Systems EACL 2021
Compression, Transduction, and Creation: A Unified Framework for Evaluating Natural Language Generation EMNLP 2021
SF-QA: Simple and Fair Evaluation Library for Open-domain Question Answering EACL 2021
Extending Multi-Document Summarization Evaluation to the Interactive Setting NAACL 2021