Language Modeling

On the utility of enhancing BERT syntactic bias with Token Reordering Pretraining CoNLL 2023 Open-Domain Hierarchical Event Schema Induction by Incremental Prompting and Verification ACL 2023 Open-ended Commonsense Reasoning with Unrestricted Answer Candidates EMNLP 2023 Open-source Large Language Models are Strong Zero-shot Query Likelihood Models for Document Ranking EMNLP 2023 ORCA: A Challenging Benchmark for Arabic Language Understanding ACL 2023 PaLM: Scaling Language Modeling with Pathways JMLR 2023 Parameter-Efficient Korean Character-Level Language Modeling EACL 2023 PEER: Pre-training ELECTRA Extended by Ranking ACL 2023 Performance Implications of Using Unrepresentative Corpora in Arabic Natural Language Processing EMNLP 2023 Personality Understanding of Fictional Characters during Book Reading ACL 2023 PersonaLM: Language Model Personalization via Domain-distributed Span Aggregated K-Nearest N-gram Retrieval Augmentation EMNLP 2023 PHD: Pixel-Based Language Modeling of Historical Documents EMNLP 2023 Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Models ACL 2023 Predicting Numerals in Text Using Nearest Neighbor Language Models ACL 2023 Preference-grounded Token-level Guidance for Language Model Fine-tuning NeurIPS 2023 Pretraining Language Models with Human Preferences ICML 2023 Pretraining Language Models with Text-Attributed Heterogeneous Graphs EMNLP 2023 Pre-Training to Learn in Context ACL 2023 Privacy- and Utility-Preserving NLP with Anonymized data: A case study of Pseudonymization ACL 2023 Privacy Implications of Retrieval-Based Language Models EMNLP 2023 Prompt Discriminative Language Models for Domain Adaptation ACL 2023 Prompting Neural Machine Translation with Translation Memories AAAI 2023 PTCSpell: Pre-trained Corrector Based on Character Shape and Pinyin for Chinese Spelling Correction ACL 2023 Pushdown Layers: Encoding Recursive Structure in Transformer Language Models EMNLP 2023 Race, Gender, and Age Biases in Biomedical Masked Language Models ACL 2023