conftrace_

linguistic evaluation

14 papers

Explore in graph

Co-occurring keywords · papers mentioning both

large language model (6) machine translation (4) test suite (3) minimal pair (3) translation quality (3) language model (3) semantic analysis (3) neural machine translation (3) chinese language (2) grammatical analysis (2)

Papers

CLEAR: A Comprehensive Linguistic Evaluation of Argument Rewriting by Large Language Models EMNLP 2025 Fine-Grained Evaluation of English-Russian MT in 2025: Linguistic Challenges Mirroring Human Translator Training EMNLP 2025 SEA-HELM: Southeast Asian Holistic Evaluation of Language Models ACL 2025 TurBLiMP: A Turkish Benchmark of Linguistic Minimal Pairs EMNLP 2025 Chinese Morpheme-informed Evaluation of Large Language Models COLING 2024 Investigating the Linguistic Performance of Large Language Models in Machine Translation EMNLP 2024 LIEDER: Linguistically-Informed Evaluation for Discourse Entity Recognition ACL 2024 RuBLiMP: Russian Benchmark of Linguistic Minimal Pairs EMNLP 2024 Polyglot or Not? Measuring Multilingual Encyclopedic Knowledge in Foundation Models EMNLP 2023 Probing Quantifier Comprehension in Large Language Models: Another Example of Inverse Scaling EMNLP 2023 SLING: Sino Linguistic Evaluation of Large Language Models EMNLP 2022 Linguistic Evaluation for the 2021 State-of-the-art Machine Translation Systems for German to English and English to German EMNLP 2021 Fine-grained linguistic evaluation for state-of-the-art Machine Translation EMNLP 2020 Linguistic Evaluation of German-English Machine Translation Using a Test Suite ACL 2019