conftrace_

evaluation benchmark

257 papers

Explore in graph

Co-occurring keywords

large language model (13587) benchmark evaluation (1556) question answering (2963) language model (4599) model evaluation (445) language model evaluation (227) instruction following (396) machine translation (2499) multimodal learning (4645) multilingual nlp (1426)

Papers

Stress-Testing Long-Context Language Models with Lifelong ICL and Task Haystack NIPS 2024
SUGARCREPE++ Dataset: Vision-Language Model Sensitivity to Semantic and Lexical Alterations NIPS 2024
OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI NIPS 2024
LexEval: A Comprehensive Chinese Legal Benchmark for Evaluating Large Language Models NIPS 2024
Large Language Models' Expert-level Global History Knowledge Benchmark (HiST-LLM) NIPS 2024
AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agents NIPS 2024
IDGen: Item Discrimination Induced Prompt Generation for LLM Evaluation NIPS 2024
PrivacyLens: Evaluating Privacy Norm Awareness of Language Models in Action NIPS 2024
DINGO: Towards Diverse and Fine-Grained Instruction-Following Evaluation AAAI 2024
DevEval: A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositories ACL 2024
Dissecting Human and LLM Preferences ACL 2024
L-Eval: Instituting Standardized Evaluation for Long Context Language Models ACL 2024
∞Bench: Extending Long Context Evaluation Beyond 100K Tokens ACL 2024
Prometheus-Vision: Vision-Language Model as a Judge for Fine-Grained Evaluation ACL 2024
Evaluating Mathematical Reasoning of Large Language Models: A Focus on Error Identification and Correction ACL 2024
Expanding FLORES+ Benchmark for More Low-Resource Settings: Portuguese-Emakhuwa Machine Translation Evaluation EMNLP 2024
Machine Translation Evaluation Benchmark for Wu Chinese: Workflow and Analysis EMNLP 2024
MiTTenS: A Dataset for Evaluating Gender Mistranslation EMNLP 2024
RAG-QA Arena: Evaluating Domain Robustness for Long-form Retrieval Augmented Question Answering EMNLP 2024
Susu Box or Piggy Bank: Assessing Cultural Commonsense Knowledge between Ghana and the US EMNLP 2024
Themis: A Reference-free NLG Evaluation Language Model with Flexibility and Interpretability EMNLP 2024
MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Models EMNLP 2024
Measuring the Robustness of NLP Models to Domain Shifts EMNLP 2024
Factcheck-Bench: Fine-Grained Evaluation Benchmark for Automatic Fact-checkers EMNLP 2024
GTBench: Uncovering the Strategic Reasoning Capabilities of LLMs via Game-Theoretic Evaluations NIPS 2024