out-of-distribution evaluation

Black Swan: Abductive and Defeasible Video Reasoning in Unpredictable Events CVPR 2025 Can Out-of-Distribution Evaluations Uncover Reliance on Prediction Shortcuts? A Case Study in Question Answering EMNLP 2025 MathGAP: Out-of-Distribution Evaluation on Problems with Arbitrarily Complex Proofs ICLR 2025 Quantifying Generalization Complexity for Large Language Models ICLR 2025 REVIVING YOUR MNEME: Predicting The Side Effects of LLM Unlearning and Fine-Tuning via Sparse Model Diffing EMNLP 2025 Adaptive Labeling for Efficient Out-of-distribution Model Evaluation NeurIPS 2024 A Symbolic Framework for Evaluating Mathematical Reasoning and Generalisation with Transformers NAACL 2024 Leveraging Generative Large Language Models with Visual Instruction and Demonstration Retrieval for Multimodal Sarcasm Detection NAACL 2024 ArTrivia: Harvesting Arabic Wikipedia to Build A New Arabic Question Answering Dataset EMNLP 2023 A Survey on Out-of-Distribution Evaluation of Neural NLP Models IJCAI 2023 Benchmarking Distribution Shift in Tabular Data with TableShift NeurIPS 2023 Making Large Language Models Better Data Creators EMNLP 2023 Towards Multi-task Learning of Speech and Speaker Recognition Interspeech 2023 Language Prior Is Not the Only Shortcut: A Benchmark for Shortcut Learning in VQA EMNLP 2022 Automatic Generation of Contrast Sets from Scene Graphs: Probing the Compositional Consistency of GQA NAACL 2021 Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering ICCV 2021 Roses Are Red, Violets Are Blue... but Should VQA Expect Them To? CVPR 2021 Two Sides of Meta-Learning Evaluation: In vs. Out of Distribution NeurIPS 2021 Improving QA Generalization by Concurrent Modeling of Multiple Biases EMNLP 2020