corpus filtering

Text Filter Based on Automatically Acquired Vocabularies for Multilingual Machine Translation EACL 2026 FIRE: Flexible Integration of Data Quality Ratings for Effective Pretraining EMNLP 2025 Improving the Quality of Web-mined Parallel Corpora of Low-Resource Languages using Debiasing Heuristics EMNLP 2025 “A Little is Enough”: Few-Shot Quality Estimation based Corpus Filtering improves Machine Translation ACL 2023 Separating the Wheat from the Chaff with BREAD: An open-source benchmark and metrics to detect redundancy in text EMNLP 2023 There’s No Data like Better Data: Using QE Metrics for MT Data Filtering EMNLP 2023 Improving Machine Translation with Phrase Pair Injection and Corpus Filtering EMNLP 2022 Whose Language Counts as High Quality? Measuring Language Ideologies in Text Data Selection EMNLP 2022 Allegro.eu Submission to WMT21 News Translation Task EMNLP 2021 Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpus EMNLP 2021 ISTIC’s Triangular Machine Translation System for WMT2021 EMNLP 2021 Learning Feature Weights using Reward Modeling for Denoising Parallel Corpora EMNLP 2021 The University of Edinburgh’s English-German and English-Hausa Submissions to the WMT21 News Translation Task EMNLP 2021 Alibaba Submission to the WMT20 Parallel Corpus Filtering Task EMNLP 2020 An exploratory approach to the Parallel Corpus Filtering shared task WMT20 EMNLP 2020 Not Low-Resource Anymore: Aligner Ensembling, Batch Filtering, and New Datasets for Bengali-English Machine Translation EMNLP 2020 OpusFilter: A Configurable Parallel Corpus Filtering Toolbox ACL 2020 ParaCrawl: Web-Scale Acquisition of Parallel Corpora ACL 2020 Parallel Corpus Filtering via Pre-trained Language Models ACL 2020 Volctrans Parallel Corpus Filtering System for WMT 2020 EMNLP 2020 Filtering of Noisy Parallel Corpora Based on Hypothesis Generation ACL 2019 Low-Resource Corpus Filtering Using Multilingual Sentence Embeddings ACL 2019 Parallel Corpus Filtering Based on Fuzzy String Matching ACL 2019 uniblock: Scoring and Filtering Corpus with Unicode Block Information EMNLP 2019 Webinterpret Submission to the WMT2019 Shared Task on Parallel Corpus Filtering ACL 2019