model evaluation

Provably Accurate Shapley Value Estimation via Leverage Score Sampling ICLR 2025 Quantification of Large Language Model Distillation ACL 2025 RCScore: Quantifying Response Consistency in Large Language Models EMNLP 2025 ReIFE: Re-evaluating Instruction-Following Evaluation NAACL 2025 Reliable, Reproducible, and Really Fast Leaderboards with Evalica COLING 2025 Rethinking Reward Model Evaluation: Are We Barking up the Wrong Tree? ICLR 2025 SeaExam and SeaBench: Benchmarking LLMs with Local Multilingual Questions in Southeast Asia NAACL 2025 SELF-[IN]CORRECT: LLMs Struggle with Discriminating Self-Generated Responses AAAI 2025 SFAL: Semantic-Functional Alignment Scores for Distributional Evaluation of Auto-Interpretability in Sparse Autoencoders EMNLP 2025 SkillVerse : Assessing and Enhancing LLMs with Tree Evaluation ACL 2025 skLEP: A Slovak General Language Understanding Benchmark ACL 2025 SSA: Semantic Contamination of LLM-Driven Fake News Detection EMNLP 2025 Style Over Substance: Evaluation Biases for Large Language Models COLING 2025 SYNC: A Synthetic Long-Context Understanding Benchmark for Controlled Comparisons of Model Capabilities EMNLP 2025 Task-Aware Evaluation and Error-Overlap Analysis for Large Language Models AACL 2025 TFDP: Token-Efficient Disparity Audits for Autoregressive LLMs via Single-Token Masked Evaluation EMNLP 2025 The Alternative Annotator Test for LLM-as-a-Judge: How to Statistically Justify Replacing Human Annotators with LLMs ACL 2025 The Practical Impacts of Theoretical Constructs on Empathy Modeling EMNLP 2025 The Stochastic Parrot on LLM’s Shoulder: A Summative Assessment of Physical Concept Understanding NAACL 2025 Think Again! The Effect of Test-Time Compute on Preferences, Opinions, and Beliefs of Large Language Models ACL 2025 ThinkSLM: Towards Reasoning in Small Language Models EMNLP 2025 Towards Comprehensive Evaluation of Open-Source Language Models: A Multi-Dimensional, User-Driven Approach ACL 2025 Towards Evaluation of Language Models with Skill Dimensions: A Case Study on Narrative Question Answering EMNLP 2025 Towards Holistic Evaluation of Large Audio-Language Models: A Comprehensive Survey EMNLP 2025 Towards Open Foundation Language Model and Corpus for Macedonian: A Low-Resource Language ACL 2025