conftrace_

medical benchmark

12 papers

Explore in graph

Co-occurring keywords · papers mentioning both

large language model (9) medical ai (2) medical domain (2) clinical evaluation (2) language model evaluation (2) question answering (2) benchmark evaluation (2) zero-shot learning (2) shallow cue (1) clinical nlp (1)

Papers

Beyond the Leaderboard: Rethinking Medical Benchmarks for Large Language Models ACL 2026 MediEval: A Unified Medical Benchmark for Patient-Contextual and Knowledge-Grounded Reasoning in LLMs ACL 2026 Automatic Evaluation of Healthcare LLMs Beyond Question-Answering NAACL 2025 Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving ICML 2025 LLMEval-Med: A Real-world Clinical Benchmark for Medical LLMs with Physician Validation EMNLP 2025 MedOdyssey: A Medical Domain Benchmark for Long Context Evaluation Up to 200K Tokens NAACL 2025 Pattern Recognition or Medical Knowledge? The Problem with Multiple-Choice Questions in Medicine ACL 2025 CMB: A Comprehensive Medical Benchmark in Chinese NAACL 2024 MedJourney: Benchmark and Evaluation of Large Language Models over Patient Clinical Journey NeurIPS 2024 OmniMedVQA: A New Large-Scale Comprehensive Evaluation Benchmark for Medical LVLM CVPR 2024 UltraMedical: Building Specialized Generalists in Biomedicine NeurIPS 2024 MedEval: A Multi-Level, Multi-Task, and Multi-Domain Medical Benchmark for Language Model Evaluation EMNLP 2023