conftrace_

evaluation benchmark

257 papers

Explore in graph

Co-occurring keywords

large language model (13587) benchmark evaluation (1556) question answering (2963) language model (4599) model evaluation (445) language model evaluation (227) instruction following (396) machine translation (2499) multimodal learning (4645) multilingual nlp (1426)

Papers

DiBiMT: A Novel Benchmark for Measuring Word Sense Disambiguation Biases in Machine Translation ACL 2022
BAHP: Benchmark of Assessing Word Embeddings in Historical Portuguese EMNLP 2021
FINDINGS OF THE IWSLT 2021 EVALUATION CAMPAIGN ACL 2021
Scalable Evaluation of Multi-Agent Reinforcement Learning with Melting Pot ICML 2021
What is SemEval evaluating? A Systematic Analysis of Evaluation Campaigns in NLP EMNLP 2021
Robustness Evaluation of Entity Disambiguation Using Prior Probes: the Case of Entity Overshadowing EMNLP 2021
WiC-TSV: An Evaluation Benchmark for Target Sense Verification of Words in Context EACL 2021
Benchmarking: Past, Present and Future ACL 2021
RADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog Systems ACL 2021
Avoiding Overlap in Data Augmentation for AMR-to-Text Generation IJCNLP 2021
Automatically Identifying Gender Issues in Machine Translation using Perturbations EMNLP 2020
What Question Answering can Learn from Trivia Nerds ACL 2020
A Diverse Corpus for Evaluating and Developing English Math Word Problem Solvers ACL 2020
An Analysis of Natural Language Inference Benchmarks through the Lens of Negation EMNLP 2020
COGS: A Compositional Generalization Challenge Based on Semantic Interpretation EMNLP 2020
Evaluating Models’ Local Decision Boundaries via Contrast Sets EMNLP 2020
MOCHA: A Dataset for Training and Evaluating Generative Reading Comprehension Metrics EMNLP 2020
GLUECoS: An Evaluation Benchmark for Code-Switched NLP ACL 2020
Towards Understanding Sample Variance in Visually Grounded Language Generation: Evaluations and Observations EMNLP 2020
How coherent are neural models of coherence? COLING 2020
R4C: A Benchmark for Evaluating RC Systems to Get the Right Answer for the Right Reason ACL 2020
MLQA: Evaluating Cross-lingual Extractive Question Answering ACL 2020
Neural Text Summarization: A Critical Evaluation IJCNLP 2019
The FLORES Evaluation Datasets for Low-Resource Machine Translation: Nepali–English and Sinhala–English IJCNLP 2019
Evaluation Benchmarks and Learning Criteria for Discourse-Aware Sentence Representations EMNLP 2019