Evaluation

Svarah: Evaluating English ASR Systems on Indian Accents Interspeech 2023 Synthetic data for model selection ICML 2023 Systematic Assessment of Factual Knowledge in Large Language Models EMNLP 2023 System Combination via Quality Estimation for Grammatical Error Correction EMNLP 2023 System Identification of Neural Systems: If We Got It Right, Would We Know? ICML 2023 TeCS: A Dataset and Benchmark for Tense Consistency of Machine Translation ACL 2023 TELeR: A General Taxonomy of LLM Prompts for Benchmarking Complex Tasks EMNLP 2023 Temporal and Second Language Influence on Intra-Annotator Agreement and Stability in Hate Speech Labelling ACL 2023 Test-time Augmentation for Factual Probing EMNLP 2023 TextVerifier: Robustness Verification for Textual Classifiers with Certifiable Guarantees ACL 2023 The Devil is in the Details: On the Pitfalls of Event Extraction Evaluation ACL 2023 The Linearity of the Effect of Surprisal on Reading Times across Languages EMNLP 2023 Theoretical Behavior of XAI Methods in the Presence of Suppressor Variables ICML 2023 The Shifted and The Overlooked: A Task-oriented Investigation of User-GPT Interactions EMNLP 2023 This prompt is measuring <mask>: evaluating bias evaluation in language models ACL 2023 To Burst or Not to Burst: Generating and Quantifying Improbable Text EMNLP 2023 Toward a Perspectivist Turn in Ground Truthing for Predictive Computing AAAI 2023 Towards General Error Diagnosis via Behavioral Testing in Machine Translation EMNLP 2023 Towards Inferential Reproducibility of Machine Learning Research ICLR 2023 Towards Reliable Item Sampling for Recommendation Evaluation AAAI 2023 Towards Reliable Neural Specifications ICML 2023 Training and Meta-Evaluating Machine Translation Evaluation Metrics at the Paragraph Level EMNLP 2023 Transitioning from benchmarks to a real-world case of information-seeking in Scientific Publications ACL 2023 Transparency at the Source: Evaluating and Interpreting Language Models With Access to the True Distribution EMNLP 2023 ULF: Unsupervised Labeling Function Correction using Cross-Validation for Weak Supervision EMNLP 2023