conftrace_

evaluation methodology

109 papers

Explore in graph

Co-occurring keywords

benchmark evaluation (1556) large language model (13587) human evaluation (379) machine translation (2499) natural language processing (2034) model evaluation (445) evaluation metric (573) machine learning (436) benchmark dataset (635) evaluation benchmark (257)

Papers

Enough Is Enough! a Case Study on the Effect of Data Size for Evaluation Using Universal Dependencies COLING 2024
Medical Dialogue System: A Survey of Categories, Methods, Evaluation and Challenges ACL 2024
Domain Dynamics: Evaluating Large Language Models in English-Hindi Translation EMNLP 2024
The Art of Defending: A Systematic Evaluation and Analysis of LLM Defense Strategies on Safety and Over-Defensiveness ACL 2024
ReproHum #0124-03: Reproducing Human Evaluations of end-to-end approaches for Referring Expression Generation COLING 2024
A linguistically-motivated evaluation methodology for unraveling model’s abilities in reading comprehension tasks EMNLP 2024
Beyond Probabilities: Unveiling the Misalignment in Evaluating Large Language Models ACL 2024
Accurate and Nuanced Open-QA Evaluation Through Textual Entailment ACL 2024
“My Answer is C”: First-Token Probabilities Do Not Match Text Answers in Instruction-Tuned Language Models ACL 2024
Evaluation and Continual Improvement for an Enterprise AI Assistant NAACL 2024
Benchmark Data Repositories for Better Benchmarking NIPS 2024
The 2024 ReproNLP Shared Task on Reproducibility of Evaluations in NLP: Overview and Results COLING 2024
The GenderQueer Test Suite EMNLP 2024
Rethinking Evaluation Methods for Machine Unlearning EMNLP 2024
Human-Centered Evaluation of Language Technologies EMNLP 2024
Post Turing: Mapping the landscape of LLM Evaluation EMNLP 2023
On Degrees of Freedom in Defining and Testing Natural Language Understanding ACL 2023
Why We Should Report the Details in Subjective Evaluation of TTS More Rigorously INTERSPEECH 2023
A Call for Standardization and Validation of Text Style Transfer Evaluation ACL 2023
Rogue Scores ACL 2023
The Devil is in the Details: On the Pitfalls of Event Extraction Evaluation ACL 2023
Reduce Human Labor On Evaluating Conversational Information Retrieval System: A Human-Machine Collaboration Approach EMNLP 2023
The Validity of Evaluation Results: Assessing Concurrence Across Compositionality Benchmarks CONLL 2023
Navigating the Pitfalls of Active Learning Evaluation: A Systematic Framework for Meaningful Performance Assessment NIPS 2023
Evaluating Zero-Shot Event Structures: Recommendations for Automatic Content Extraction (ACE) Annotations ACL 2023