conftrace_

evaluation benchmark

257 papers

Explore in graph

Co-occurring keywords

large language model (13587) benchmark evaluation (1556) question answering (2963) language model (4599) model evaluation (445) language model evaluation (227) instruction following (396) machine translation (2499) multimodal learning (4645) multilingual nlp (1426)

Papers

CriticEval: Evaluating Large-scale Language Model as Critic NIPS 2024
Navigating the Maze of Explainable AI: A Systematic Approach to Evaluating Methods and Metrics NIPS 2024
ViLCo-Bench: VIdeo Language COntinual learning Benchmark NIPS 2024
CK12: A Rounded K12 Knowledge Graph Based Benchmark for Chinese Holistic Cognition Evaluation AAAI 2024
Ada-LEval: Evaluating long-context LLMs with length-adaptable benchmarks NAACL 2024
DialogBench: Evaluating LLMs as Human-like Dialogue Systems NAACL 2024
Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMs EACL 2024
Holistic Evaluation for Interleaved Text-and-Image Generation EMNLP 2024
Toward a Stable, Fair, and Comprehensive Evaluation of Object Hallucination in Large Vision-Language Models NIPS 2024
Evaluating Object Hallucination in Large Vision-Language Models EMNLP 2023
On using distribution-based compositionality assessment to evaluate compositional generalisation in machine translation EMNLP 2023
CCEval: A Representative Evaluation Benchmark for the Chinese-centric Multilingual Machine Translation EMNLP 2023
QUDeval: The Evaluation of Questions Under Discussion Discourse Parsing EMNLP 2023
HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Models EMNLP 2023
ToMChallenges: A Principle-Guided Dataset and Diverse Evaluation Tasks for Exploring Theory of Mind CONLL 2023
Post Turing: Mapping the landscape of LLM Evaluation EMNLP 2023
FERMAT: An Alternative to Accuracy for Numerical Reasoning ACL 2023
CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion NIPS 2023
Considerations for meaningful sign language machine translation based on glosses ACL 2023
The Devil is in the Details: On the Pitfalls of Event Extraction Evaluation ACL 2023
Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena NIPS 2023
Mass-Producing Failures of Multimodal Systems with Language Models NIPS 2023
EVALIGN: Visual Evaluation of Translation Alignment Models EACL 2023
A Comprehensive Evaluation of Biomedical Entity Linking Models EMNLP 2023
Navigating the Pitfalls of Active Learning Evaluation: A Systematic Framework for Meaningful Performance Assessment NIPS 2023