Evaluation

Approximate Leave-one-out Cross Validation for Regression with ℓ_1 Regularizers AISTATS 2024 ArabicMMLU: Assessing Massive Multitask Language Understanding in Arabic ACL 2024 Are Language Models Actually Useful for Time Series Forecasting? NeurIPS 2024 Are Large Language Models Consistent over Value-laden Questions? EMNLP 2024 Are Large Language Models Good Statisticians? NeurIPS 2024 Are Large Language Models (LLMs) Good Social Predictors? EMNLP 2024 Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Data ACL 2024 Are modern neural ASR architectures robust for polysynthetic languages? EMNLP 2024 Are More LLM Calls All You Need? Towards the Scaling Properties of Compound AI Systems NeurIPS 2024 Are You Serious? Handling Disagreement When Annotating Conspiracy Theory Texts EACL 2024 ARIES: A Corpus of Scientific Paper Edits Made in Response to Peer Reviews ACL 2024 Ask Again, Then Fail: Large Language Models’ Vacillations in Judgment ACL 2024 Assessing “Implicit” Retrieval Robustness of Large Language Models EMNLP 2024 A Survey of Learning Criteria Going beyond the Usual Risk (Abstract Reprint) AAAI 2024 A Toolbox for Modelling Engagement with Educational Videos AAAI 2024 Auditing Local Explanations is Hard NeurIPS 2024 Auditing Privacy Mechanisms via Label Inference Attacks NeurIPS 2024 A User-Centric Multi-Intent Benchmark for Evaluating Large Language Models EMNLP 2024 Automating Dataset Updates Towards Reliable and Timely Evaluation of Large Language Models NeurIPS 2024 ∞Bench: Extending Long Context Evaluation Beyond 100K Tokens ACL 2024 BenchIE^FL: A Manually Re-Annotated Fact-Based Open Information Extraction Benchmark ACL 2024 Benchmark Data Repositories for Better Benchmarking NeurIPS 2024 Benchmarking Chinese Commonsense Reasoning of LLMs: From Chinese-Specifics to Reasoning-Memorization Correlations ACL 2024 Benchmarking Data Science Agents ACL 2024 Benchmarking Estimators for Natural Experiments: A Novel Dataset and a Doubly Robust Algorithm NeurIPS 2024