language model evaluation

SINAI at SemEval-2024 Task 8: Fine-tuning on Words and Perplexity as Features for Detecting Machine Written Text SemEval 2024 Stratified Prediction-Powered Inference for Effective Hybrid Evaluation of Language Models NeurIPS 2024 Susu Box or Piggy Bank: Assessing Cultural Commonsense Knowledge between Ghana and the US EMNLP 2024 TofuEval: Evaluating Hallucinations of LLMs on Topic-Focused Dialogue Summarization NAACL 2024 Token-length Bias in Minimal-pair Paradigm Datasets COLING 2024 UltraEval: A Lightweight Platform for Flexible and Comprehensive Evaluation for LLMs ACL 2024 UnMASKed: Quantifying Gender Biases in Masked Language Models through Linguistically Informed Job Market Prompts EACL 2024 A Better Way to Do Masked Language Model Scoring ACL 2023 A Confederacy of Models: a Comprehensive Evaluation of LLMs on Creative Writing EMNLP 2023 bgGLUE: A Bulgarian General Language Understanding Evaluation Benchmark ACL 2023 Building Real-World Meeting Summarization Systems using Large Language Models: A Practical Perspective EMNLP 2023 Building Socio-culturally Inclusive Stereotype Resources with Community Engagement NeurIPS 2023 Can Language Models Be Specific? How? ACL 2023 ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learning EMNLP 2023 Counterfactual reasoning: Testing language models’ understanding of hypothetical scenarios ACL 2023 Discovering Language Model Behaviors with Model-Written Evaluations ACL 2023 DUMB: A Benchmark for Smart Evaluation of Dutch Models EMNLP 2023 Elo Uncovered: Robustness and Best Practices in Language Model Evaluation EMNLP 2023 Evaluating the Rationale Understanding of Critical Reasoning in Logical Reading Comprehension EMNLP 2023 FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation EMNLP 2023 Is ChatGPT a Financial Expert? Evaluating Language Models on Financial Natural Language Processing EMNLP 2023 Jamp: Controlled Japanese Temporal Inference Dataset for Evaluating Generalization Capacity of Language Models ACL 2023 “John is 50 years old, can his son be 65?” Evaluating NLP Models’ Understanding of Feasibility EACL 2023 Language models are not naysayers: an analysis of language models on negation benchmarks ACL 2023 LeXFiles and LegalLAMA: Facilitating English Multinational Legal Language Model Development ACL 2023