web corpus

From Real to Synthetic: Synthesizing Millions of Diversified and Complicated User Instructions with Attributed Grounding ACL 2025 MANTA: A Scalable Pipeline for Transmuting Massive Web Corpora into Instruction Datasets EMNLP 2025 RegMix: Data Mixture as Regression for Language Model Pre-training ICLR 2025 Rethinking KenLM: Good and Bad Model Ensembles for Efficient Text Quality Filtering in Large Web Corpora ACL 2025 SWEb: A Large Web Dataset for the Scandinavian Languages ICLR 2025 Web-Based Corpus Compilation of the Emirati Arabic Dialect COLING 2025 A Shocking Amount of the Web is Machine Translated: Insights from Multi-Way Parallelism ACL 2024 CLASSLA-web: Comparable Web Corpora of South Slavic Languages Enriched with Linguistic and Genre Annotation COLING 2024 Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research ACL 2024 Intersecting Register and Genre: Understanding the Contents of Web-Crawled Corpora EMNLP 2024 MAmmoTH2: Scaling Instructions from the Web NeurIPS 2024 Text Filtering Classifiers for Medium-Resource Languages COLING 2024 Unsupervised Outlier Detection for Language-Independent Text Quality Filtering COLING 2024 Validating and Exploring Large Geographic Corpora COLING 2024 D4: Improving LLM Pretraining via Document De-Duplication and Diversification NeurIPS 2023 WordScape: a Pipeline to extract multilingual, visually rich Documents with Layout Annotations from Web Crawl Data NeurIPS 2023 Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpus EMNLP 2021 Privacy at Scale: Introducing the PrivaSeer Corpus of Web Privacy Policies ACL 2021 What’s in the Box? An Analysis of Undesirable Content in the Common Crawl Corpus ACL 2021 Building a Corpus for the Zaza–Gorani Language Family COLING 2020 Extracting meaning by idiomaticity: Description of the HSemID system at CogALex VI (2020) COLING 2020 Findings of the WMT 2019 Shared Task on Parallel Corpus Filtering for Low-Resource Conditions ACL 2019 A hybrid pipeline of rules and machine learning to filter web-crawled parallel corpora EMNLP 2018 ‘BonTen’ – Corpus Concordance System for ‘NINJAL Web Japanese Corpus’ COLING 2016