conftrace_

llm evaluation

141 papers

Explore in graph

Co-occurring keywords

large language model (13587) benchmark evaluation (1556) evaluation benchmark (257) question answering (2963) language model (4599) prompt engineering (1135) hallucination detection (530) text generation (2913) evaluation metric (573) fairness evaluation (118)

Papers

TitleTrap: Probing Presentation Bias in LLM-Based Scientific Reviewing IJCNLP 2025
Let LLMs Take on the Latest Challenges! A Chinese Dynamic Question Answering Benchmark COLING 2025
CharacterBox: Evaluating the Role-Playing Capabilities of LLMs in Text-Based Virtual Worlds NAACL 2025
Are LLM-Judges Robust to Expressions of Uncertainty? Investigating the effect of Epistemic Markers on LLM-based Evaluation NAACL 2025
Assessing Crowdsourced Annotations with LLMs: Linguistic Certainty as a Proxy for Trustworthiness NAACL 2025
Line of Duty: Evaluating LLM Self-Knowledge via Consistency in Feasibility Boundaries NAACL 2025
Know Thyself: Validating Knowledge Awareness of LLM-based Persona Agents NAACL 2025
Praetor: A Fine-Grained Generative LLM Evaluator with Instance-Level Customizable Evaluation Criteria ACL 2025
GerMedIQ: A Resource for Simulated and Synthesized Anamnesis Interview Responses in German ACL 2025
Measuring Bias and Agreement in Large Language Model Presupposition Judgments ACL 2025
AL-QASIDA: Analyzing LLM Quality and Accuracy Systematically in Dialectal Arabic ACL 2025
DOVE: A Large-Scale Multi-Dimensional Predictions Dataset Towards Meaningful LLM Evaluation ACL 2025
MDBench: A Synthetic Multi-Document Reasoning Benchmark Generated with Knowledge Guidance ACL 2025
AdvERSEM: Adversarial Robustness Testing and Training of LLM-based Groundedness Evaluators via Semantic Structure Manipulation EMNLP 2025
Which of These Best Describes Multiple Choice Evaluation with LLMs? A) Forced B) Flawed C) Fixable D) All of the Above ACL 2025
Crowd Comparative Reasoning: Unlocking Comprehensive Evaluations for LLM-as-a-Judge ACL 2025
Can External Validation Tools Improve Annotation Quality for LLM-as-a-Judge? ACL 2025
Improving Automatic Evaluation of Large Language Models (LLMs) in Biomedical Relation Extraction via LLMs-as-the-Judge ACL 2025
Ask Me Like I’m Human: LLM-based Evaluation with For-Human Instructions Correlates Better with Human Evaluations than Human Judges ACL 2025
An Empirical Study of LLM-as-a-Judge for LLM Evaluation: Fine-tuned Judge Model is not a General Substitute for GPT-4 ACL 2025
Counterfactual Evaluation for Blind Attack Detection in LLM-based Evaluation Systems IJCNLP 2025
FLEX: A Benchmark for Evaluating Robustness of Fairness in Large Language Models NAACL 2025
Human and LLM-Based Resume Matching: An Observational Study NAACL 2025
ObjVariantEnsemble: Advancing Point Cloud LLM Evaluation in Challenging Scenes with Subtly Distinguished Objects AAAI 2025
LLM-as-an-Interviewer: Beyond Static Testing Through Dynamic LLM Evaluation ACL 2025