Evaluation

Are self-explanations from Large Language Models faithful? ACL 2024 Assessing and Verifying Task Utility in LLM-Powered Applications EMNLP 2024 A Systematic Analysis on the Temporal Generalization of Language Models in Social Media ACL 2024 A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and Recommendations EMNLP 2024 AutoDetect: Towards a Unified Framework for Automated Weakness Detection in Large Language Models EMNLP 2024 AXCEL: Automated eXplainable Consistency Evaluation using LLMs EMNLP 2024 BEHAVIOR Vision Suite: Customizable Dataset Generation via Simulation CVPR 2024 Benchmarking Segmentation Models with Mask-Preserved Attribute Editing CVPR 2024 Beyond Probabilities: Unveiling the Misalignment in Evaluating Large Language Models ACL 2024 Beyond Reference: Evaluating High Quality Translations Better than Human References EMNLP 2024 Beyond Text: Unveiling Multimodal Proficiency of Large Language Models with MultiAPI Benchmark ACL 2024 Beyond the Numbers: Transparency in Relation Extraction Benchmark Creation and Leaderboards EMNLP 2024 BiasAlert: A Plug-and-play Tool for Social Bias Detection in LLMs EMNLP 2024 Bias in News Summarization: Measures, Pitfalls and Corpora ACL 2024 Calibrating Language Models with Adaptive Temperature Scaling EMNLP 2024 Can Large Language Models Understand Real-World Complex Instructions? AAAI 2024 CAPE: CAM as a Probabilistic Ensemble for Enhanced DNN Interpretation CVPR 2024 CAVA: A Tool for Cultural Alignment Visualization & Analysis EMNLP 2024 Challenging Large Language Models with New Tasks: A Study on their Adaptability and Robustness ACL 2024 Compare without Despair: Reliable Preference Evaluation with Generation Separability EMNLP 2024 Comparing the Robustness of Modern No-Reference Image- and Video-Quality Metrics to Adversarial Attacks AAAI 2024 ConceptMix: A Compositional Image Generation Benchmark with Controllable Difficulty NeurIPS 2024 Confidence Calibration of Classifiers with Many Classes NeurIPS 2024 CONSTRUCTURE: Benchmarking CONcept STRUCTUre REasoning for Multimodal Large Language Models EMNLP 2024 CONTESTS: a Framework for Consistency Testing of Span Probabilities in Language Models EMNLP 2024