conftrace_

evaluation benchmark

257 papers

Explore in graph

Co-occurring keywords

large language model (13587) benchmark evaluation (1556) question answering (2963) language model (4599) model evaluation (445) language model evaluation (227) instruction following (396) machine translation (2499) multimodal learning (4645) multilingual nlp (1426)

Papers

Findings of the WMT 2024 Biomedical Translation Shared Task: Test Sets on Abstract Level EMNLP 2024
Weak-eval-Strong: Evaluating and Eliciting Lateral Thinking of LLMs with Situation Puzzles NIPS 2024
Uncovering Stereotypes in Large Language Models: A Task Complexity-based Approach EACL 2024
Findings of the SIGTYP 2024 Shared Task on Word Embedding Evaluation for Ancient and Historical Languages EACL 2024
SilverAlign: MT-Based Silver Data Algorithm for Evaluating Word Alignment COLING 2024
Unveiling Strengths and Weaknesses of NLP Systems Based on a Rich Evaluation Corpus: The Case of NER in French COLING 2024
S3Eval: A Synthetic, Scalable, Systematic Evaluation Suite for Large Language Model NAACL 2024
FREB-TQA: A Fine-Grained Robustness Evaluation Benchmark for Table Question Answering NAACL 2024
Investigating Data Contamination in Modern Benchmarks for Large Language Models NAACL 2024
BotChat: Evaluating LLMs’ Capabilities of Having Multi-Turn Dialogues NAACL 2024
Benchmarking Generation and Evaluation Capabilities of Large Language Models for Instruction Controllable Summarization NAACL 2024
Latxa: An Open Language Model and Evaluation Suite for Basque ACL 2024
Towards the TopMost: A Topic Modeling System Toolkit ACL 2024
On the Benchmarking of LLMs for Open-Domain Dialogue Evaluation ACL 2024
FBK@IWSLT Test Suites Task: Gender Bias evaluation with MuST-SHE ACL 2024
KIEval: A Knowledge-grounded Interactive Evaluation Framework for Large Language Models ACL 2024
EmoBench: Evaluating the Emotional Intelligence of Large Language Models ACL 2024
Mobile-Bench: An Evaluation Benchmark for LLM-based Mobile Agents ACL 2024
CharacterEval: A Chinese Benchmark for Role-Playing Conversational Agent Evaluation ACL 2024
SUPER: Evaluating Agents on Setting Up and Executing Tasks from Research Repositories EMNLP 2024
From LLMs to MLLMs: Exploring the Landscape of Multimodal Jailbreaking EMNLP 2024
ChartInsights: Evaluating Multimodal Large Language Models for Low-Level Chart Question Answering EMNLP 2024
M3SciQA: A Multi-Modal Multi-Document Scientific QA Benchmark for Evaluating Foundation Models EMNLP 2024
Is It Good Data for Multilingual Instruction Tuning or Just Bad Multilingual Evaluation for Large Language Models? EMNLP 2024
ALIGN-SIM: A Task-Free Test Bed for Evaluating and Interpreting Sentence Embeddings through Semantic Similarity Alignment EMNLP 2024