Language Modeling

Give Me the Facts! A Survey on Factual Knowledge Probing in Pre-trained Language Models EMNLP 2023 GLADIS: A General and Large Acronym Disambiguation Benchmark EACL 2023 GlobalBench: A Benchmark for Global Progress in Natural Language Processing EMNLP 2023 GPoeT: a Language Model Trained for Rhyme Generation on Synthetic Data EACL 2023 GPT-2 Metadata Pretraining Towards Instruction Finetuning for Ukrainian EACL 2023 Gradual Language Model Adaptation Using Fine-Grained Typology EACL 2023 Graph-based Relation Mining for Context-free Out-of-vocabulary Word Embedding Learning ACL 2023 Grokking of Hierarchical Structure in Vanilla Transformers ACL 2023 Guiding Image Captioning Models Toward More Specific Captions ICCV 2023 Have LLMs Advanced Enough? A Challenging Problem Solving Benchmark For Large Language Models EMNLP 2023 Hints on the data for language modeling of synthetic languages with transformers ACL 2023 HistAlign: Improving Context Dependency in Language Generation by Aligning with History EMNLP 2023 How Generative Spoken Language Modeling Encodes Noisy Speech: Investigation from Phonetics to Syntactics Interspeech 2023 How to Control Sentiment in Text Generation: A Survey of the State-of-the-Art in Sentiment-Control Techniques ACL 2023 How to Determine the Most Powerful Pre-trained Language Model without Brute Force Fine-tuning? An Empirical Survey EMNLP 2023 How to Plant Trees in Language Models: Data and Architectural Effects on the Emergence of Syntactic Inductive Biases ACL 2023 Humans and language models diverge when predicting repeating text CoNLL 2023 Hungry Hungry Hippos: Towards Language Modeling with State Space Models ICLR 2023 HyperT5: Towards Compute-Efficient Korean Language Modeling ACL 2023 IDOL: Indicator-oriented Logic Pre-training for Logical Reasoning ACL 2023 Improving Contrastive Learning of Sentence Embeddings from AI Feedback ACL 2023 Improving Language Model Integration for Neural Machine Translation ACL 2023 Improving Numeracy by Input Reframing and Quantitative Pre-Finetuning Task EACL 2023 Improving Span Representation by Efficient Span-Level Attention EMNLP 2023 Incorporating Syntactic Knowledge into Pre-trained Language Model using Optimization for Overcoming Catastrophic Forgetting EMNLP 2023