text preprocessing

Do Diacritics Matter? Evaluating the Impact of Arabic Diacritics on Tokenization and LLM Benchmarks EACL 2026 Do Tokenizers Fail on Informal Hindi Expressions? Evidence from Static, Downstream, and Robustness Analyses EACL 2026 Challenges in Processing Chinese Texts Across Genres and Eras EMNLP 2025 Don’t Touch My Diacritics NAACL 2025 From Clay to Code: Transforming Hittite Texts for Machine Learning NAACL 2025 Py-Elotl: A Python NLP package for the languages of Mexico NAACL 2025 Rubic2: Ensemble Model for Russian Lemmatization ACL 2025 Semantic Outlier Removal with Embedding Models and LLMs ACL 2025 so much depends / upon / a whitespace: Why Whitespace Matters for Poets and LLMs EMNLP 2025 Splintering Nonconcatenative Languages for Better Tokenization ACL 2025 SUWMIT at BioLaySumm2025: Instruction-based Summarization with Contrastive Decoding ACL 2025 Developing a Part-of-speech Tagger for Diplomatically Edited Old Irish Text COLING 2024 Fundus: A Simple-to-Use News Scraper Optimized for High Quality Extractions ACL 2024 GlotCC: An Open Broad-Coverage CommonCrawl Corpus and Pipeline for Minority Languages NeurIPS 2024 Make Compound Sentences Simple to Analyze: Learning to Split Sentences for Aspect-based Sentiment Analysis EMNLP 2024 N-gram-Based Preprocessing for Sandhi Reversion in Vedic Sanskrit EMNLP 2024 One Year of Continuous and Automatic Data Gathering from Parliaments of European Union Member States COLING 2024 Quantifying the Impact of Disfluency on Spoken Content Summarization COLING 2024 Segment Any Text: A Universal Approach for Robust, Efficient and Adaptable Sentence Segmentation EMNLP 2024 TafsirExtractor: Text Preprocessing Pipeline preparing Classical Arabic Literature for Machine Learning Applications COLING 2024 Codex to corpus: Exploring annotation and processing for an open and extensible machine-readable edition of the Florentine Codex ACL 2023 Diacritic Recognition Performance in Arabic ASR Interspeech 2023 Sentence Identification with BOS and EOS Label Combinations EACL 2023 The State of Profanity Obfuscation in Natural Language Processing Scientific Publications ACL 2023 Where’s the Point? Self-Supervised Multilingual Punctuation-Agnostic Sentence Segmentation ACL 2023