conftrace_

llm evaluation

141 papers

Explore in graph

Co-occurring keywords

large language model (13587) benchmark evaluation (1556) evaluation benchmark (257) question answering (2963) language model (4599) prompt engineering (1135) hallucination detection (530) text generation (2913) evaluation metric (573) fairness evaluation (118)

Papers

RPC-Bench: A Fine-grained Benchmark for Research Paper Comprehension ACL 2026
LLM-as-a-Judge for Low-Resource Languages: Adapting Ragas and Comparative Ranking for Romanian EACL 2026
FinMathBench: A Formula-Driven Benchmark for Evaluating LLMs’ Math Reasoning Capabilities in Finance AAAI 2026
Language Models Don’t Know What You Want: Evaluating Personalization in Deep Research Needs Real Users ACL 2026
CLEAR: Error Analysis via LLM-as-a-Judge Made Easy AAAI 2026
Tracking the evolution of LLM capabilities for Belarusian with OpenAI Evals EACL 2026
Debate, Deliberate, Decide (D3): A Cost-Aware Adversarial Framework for Reliable and Interpretable LLM Evaluation EACL 2026
ConInstruct: Evaluating Large Language Models on Conflict Detection and Resolution in Instructions AAAI 2026
The Confidence Trap: Gender Bias and Predictive Certainty in LLMs AAAI 2026
Better Datasets Start from RefineLab: Automatic Optimization for High-Quality Dataset Refinement AAAI 2026
Controllable Contamination Detection for Reliable LLM Evaluation with Statistical Guarantees ACL 2026
Where Norms and References Collide: Evaluating LLMs on Normative Reasoning AAAI 2026
Persistent Instability in LLM’s Personality Measurements: Effects of Scale, Reasoning, and Conversation History AAAI 2026
Democratizing Diplomacy: A Harness for Evaluating Any Large Language Model on Full-Press Diplomacy AAAI 2026
NarraBench: A Comprehensive Framework for Narrative Benchmarking EACL 2026
FFE-Hallu: Hallucinations in Fixed Figurative Expressions: A Benchmark of Idioms and Proverbs in the Persian Language EACL 2026
MIRAGE-Bench: Automatic Multilingual Benchmark Arena for Retrieval-Augmented Generation Systems NAACL 2025
Ask Me Like I’m Human: LLM-based Evaluation with For-Human Instructions Correlates Better with Human Evaluations than Human Judges ACL 2025
Which of These Best Describes Multiple Choice Evaluation with LLMs? A) Forced B) Flawed C) Fixable D) All of the Above ACL 2025
LLM-as-an-Interviewer: Beyond Static Testing Through Dynamic LLM Evaluation ACL 2025
Towards Optimal Evaluation Efficiency for Large Language Models EMNLP 2025
ObjVariantEnsemble: Advancing Point Cloud LLM Evaluation in Challenging Scenes with Subtly Distinguished Objects AAAI 2025
Improving Automatic Evaluation of Large Language Models (LLMs) in Biomedical Relation Extraction via LLMs-as-the-Judge ACL 2025
Unsupervised Hallucination Detection by Inspecting Reasoning Processes EMNLP 2025
Optimization before Evaluation: Evaluation with Unoptimized Prompts Can be Misleading ACL 2025