conftrace_

web corpus

22 papers

Explore in graph

Co-occurring keywords

language model (4599) large language model (13587) low-resource language (2273) data filtering (99) data augmentation (3052) machine translation (2499) text classification (6793) corpus linguistics (233) instruction tuning (838) corpus creation (64)

Papers

MANTA: A Scalable Pipeline for Transmuting Massive Web Corpora into Instruction Datasets EMNLP 2025
From Real to Synthetic: Synthesizing Millions of Diversified and Complicated User Instructions with Attributed Grounding ACL 2025
Web-Based Corpus Compilation of the Emirati Arabic Dialect COLING 2025
Rethinking KenLM: Good and Bad Model Ensembles for Efficient Text Quality Filtering in Large Web Corpora ACL 2025
Intersecting Register and Genre: Understanding the Contents of Web-Crawled Corpora EMNLP 2024
Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research ACL 2024
Text Filtering Classifiers for Medium-Resource Languages COLING 2024
Unsupervised Outlier Detection for Language-Independent Text Quality Filtering COLING 2024
Validating and Exploring Large Geographic Corpora COLING 2024
MAmmoTH2: Scaling Instructions from the Web NIPS 2024
A Shocking Amount of the Web is Machine Translated: Insights from Multi-Way Parallelism ACL 2024
CLASSLA-web: Comparable Web Corpora of South Slavic Languages Enriched with Linguistic and Genre Annotation COLING 2024
D4: Improving LLM Pretraining via Document De-Duplication and Diversification NIPS 2023
WordScape: a Pipeline to extract multilingual, visually rich Documents with Layout Annotations from Web Crawl Data NIPS 2023
What’s in the Box? An Analysis of Undesirable Content in the Common Crawl Corpus ACL 2021
Privacy at Scale: Introducing the PrivaSeer Corpus of Web Privacy Policies ACL 2021
Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpus EMNLP 2021
Building a Corpus for the Zaza–Gorani Language Family COLING 2020
Extracting meaning by idiomaticity: Description of the HSemID system at CogALex VI (2020) COLING 2020
Findings of the WMT 2019 Shared Task on Parallel Corpus Filtering for Low-Resource Conditions ACL 2019
A hybrid pipeline of rules and machine learning to filter web-crawled parallel corpora EMNLP 2018
‘BonTen’ – Corpus Concordance System for ‘NINJAL Web Japanese Corpus’ COLING 2016