model evaluation

Navigating the Modern Evaluation Landscape: Considerations in Benchmarks and Frameworks for Large Language Models (LLMs) COLING 2024 Online GNN Evaluation Under Test-time Graph Distribution Shifts ICLR 2024 On scalable oversight with weak LLMs judging strong LLMs NeurIPS 2024 On the Relationship between Truth and Political Bias in Language Models EMNLP 2024 OpenEval: Benchmarking Chinese LLMs across Capability, Alignment and Safety ACL 2024 PaCoST: Paired Confidence Significance Testing for Benchmark Contamination Detection in Large Language Models EMNLP 2024 PertEval: Unveiling Real Knowledge Capacity of LLMs with Knowledge-Invariant Perturbations NeurIPS 2024 Plot Twist: Multimodal Models Don’t Comprehend Simple Chart Details EMNLP 2024 Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Models ACL 2024 Pre-Trained Language Models Represent Some Geographic Populations Better than Others COLING 2024 Pride and Prejudice: LLM Amplifies Self-Bias in Self-Refinement ACL 2024 Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Models EMNLP 2024 Prometheus-Vision: Vision-Language Model as a Judge for Fine-Grained Evaluation ACL 2024 Quality Matters: Evaluating Synthetic Data for Tool-Using LLMs EMNLP 2024 Quantifying Contamination in Evaluating Code Generation Capabilities of Language Models ACL 2024 Questioning the Survey Responses of Large Language Models NeurIPS 2024 Rethinking Evaluation Methods for Machine Unlearning EMNLP 2024 Rethinking LLM Memorization through the Lens of Adversarial Compression NeurIPS 2024 SedarEval: Automated Evaluation using Self-Adaptive Rubrics EMNLP 2024 SEFLAG: Systematic Evaluation Framework for NLP Models and Datasets in Latin and Ancient Greek EMNLP 2024 Self-Evaluation of Large Language Model based on Glass-box Features EMNLP 2024 Self-Recognition in Language Models EMNLP 2024 SeMaScore: A new evaluation metric for automatic speech recognition tasks Interspeech 2024 Stress-Testing Capability Elicitation With Password-Locked Models NeurIPS 2024 SynthEval: Hybrid Behavioral Testing of NLP Models with Synthetic CheckLists EMNLP 2024