Language Modeling

Meet in the Middle: A New Pre-training Paradigm NeurIPS 2023 MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers NeurIPS 2023 Mitigating the Learning Bias towards Repetition by Self-Contrastive Training for Open-Ended Generation ACL 2023 Mixed-domain Language Modeling for Processing Long Legal Documents EMNLP 2023 Mixed Orthographic/Phonemic Language Modeling: Beyond Orthographically Restricted Transformers (BORT) ACL 2023 Modeling Complex Event Scenarios via Simple Entity-focused Questions EACL 2023 Modelling Language Acquisition through Syntactico-Semantic Pattern Finding EACL 2023 MotionGPT: Human Motion as a Foreign Language NeurIPS 2023 Multilingual BERT has an accent: Evaluating English influences on fluency in multilingual models EACL 2023 Multilingual Sequence-to-Sequence Models for Hebrew NLP ACL 2023 Multi-Task Training with In-Domain Language Models for Diagnostic Reasoning ACL 2023 MVP: Multi-task Supervised Pre-training for Natural Language Generation ACL 2023 nanoT5: Fast & Simple Pre-training and Fine-tuning of T5 Models with Limited Resources EMNLP 2023 Narrative Cloze as a Training Objective: Towards Modeling Stories Using Narrative Chain Embeddings ACL 2023 Natural Response Generation for Chinese Reading Comprehension EMNLP 2023 Navigating Data Scarcity: Pretraining for Medical Utterance Classification ACL 2023 Neural Dynamic Focused Topic Model AAAI 2023 NLMs: Augmenting Negation in Language Models EMNLP 2023 NLP-LISAC at SemEval-2023 Task 9: Multilingual Tweet Intimacy Analysis via a Transformer-based Approach and Data Augmentation SemEval 2023 Nonparametric Masked Language Modeling ACL 2023 On Monotonic Aggregation for Open-domain QA Interspeech 2023 On-the-fly Cross-lingual Masking for Multilingual Pre-training ACL 2023 On the Generalization Ability of Retrieval-Enhanced Transformers EACL 2023 On the N-gram Approximation of Pre-trained Language Models Interspeech 2023 On the Potential and Limitations of Few-Shot In-Context Learning to Generate Metamorphic Specifications for Tax Preparation Software EMNLP 2023