evaluation framework

Exploring Precision and Recall to assess the quality and diversity of LLMs ACL 2024 Extrinsic Evaluation of Cultural Competence in Large Language Models EMNLP 2024 FreeEval: A Modular Framework for Trustworthy and Efficient Evaluation of Large Language Models EMNLP 2024 GenRES: Rethinking Evaluation for Generative Relation Extraction in the Era of Large Language Models NAACL 2024 HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal ICML 2024 HD-Eval: Aligning Large Language Model Evaluators Through Hierarchical Criteria Decomposition ACL 2024 Is this the real life? Is this just fantasy? The Misleading Success of Simulating Social Interactions With LLMs EMNLP 2024 NewsBench: A Systematic Evaluation Framework for Assessing Editorial Capabilities of Large Language Models in Chinese Journalism ACL 2024 PolyWER: A Holistic Evaluation Framework for Code-Switched Speech Recognition EMNLP 2024 PrivacyLens: Evaluating Privacy Norm Awareness of Language Models in Action NeurIPS 2024 ProxyQA: An Alternative Framework for Evaluating Long-Form Text Generation with Large Language Models ACL 2024 PSST: A Benchmark for Evaluation-driven Text Public-Speaking Style Transfer EMNLP 2024 Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formatting ICLR 2024 RAGAs: Automated Evaluation of Retrieval Augmented Generation EACL 2024 Reasoning or Reciting? Exploring the Capabilities and Limitations of Language Models Through Counterfactual Tasks NAACL 2024 SEAL: A Framework for Systematic Evaluation of Real-World Super-Resolution ICLR 2024 SPOR: A Comprehensive and Practical Evaluation Method for Compositional Generalization in Data-to-Text Generation ACL 2024 SWE-bench: Can Language Models Resolve Real-world Github Issues? ICLR 2024 Are Personalized Stochastic Parrots More Dangerous? Evaluating Persona Biases in Dialogue Systems EMNLP 2023 Automating Behavioral Testing in Machine Translation EMNLP 2023 Benchmark Data and Evaluation Framework for Intent Discovery Around COVID-19 Vaccine Hesitancy EACL 2023 Gauging the Gap Between Human and Machine Text Simplification Through Analytical Evaluation of Simplification Strategies and Errors EACL 2023 How Much Space Has Been Explored? Measuring the Chemical Space Covered by Databases and Machine-Generated Molecules ICLR 2023 LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluation NeurIPS 2023 Measuring the Instability of Fine-Tuning ACL 2023