language modeling

FFF: Fixing Flawed Foundations in Contrastive Pre-Training Results in Very Strong Vision-Language Models CVPR 2024 Findings of the Second BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corpora CoNLL 2024 Fractal Patterns May Illuminate the Success of Next-Token Prediction NeurIPS 2024 Frequency Explains the Inverse Correlation of Large Language Models’ Size, Training Data Amount, and Surprisal’s Fit to Reading Times EACL 2024 From Partial to Strictly Incremental Constituent Parsing EACL 2024 Functional Interpolation for Relative Positions improves Long Context Transformers ICLR 2024 Future Language Modeling from Temporal Document History ICLR 2024 FuxiTranyu: A Multilingual Large Language Model Trained with Balanced Data EMNLP 2024 Generating Interpretations of Policy Announcements EMNLP 2024 GPT-SW3: An Autoregressive Language Model for the Scandinavian Languages COLING 2024 Headless Language Models: Learning without Predicting with Contrastive Weight Tying ICLR 2024 HoLM: Analyzing the Linguistic Unexpectedness in Homeric Poetry COLING 2024 How Vocabulary Sharing Facilitates Multilingualism in LLaMA? ACL 2024 Hyper-QKSG: Framework for Automating Query Generation and Knowledge-Snippet Extraction from Tables and Lists EMNLP 2024 Image as a Language: Revisiting Scene Text Recognition via Balanced, Unified and Synchronized Vision-Language Reasoning Network AAAI 2024 In-Context Pretraining: Language Modeling Beyond Document Boundaries ICLR 2024 Is Child-Directed Speech Effective Training Data for Language Models? EMNLP 2024 Language Modeling Is Compression ICLR 2024 Layer-Condensed KV Cache for Efficient Inference of Large Language Models ACL 2024 Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers AISTATS 2024 Learning and Transferring Sparse Contextual Bigrams with Linear Transformers NeurIPS 2024 Learning Disentangled Semantic Spaces of Explanations via Invertible Neural Networks ACL 2024 Lexicon-Level Contrastive Visual-Grounding Improves Language Modeling ACL 2024 LiBERTa: Advancing Ukrainian Language Modeling through Pre-training from Scratch COLING 2024 Linear Transformers with Learnable Kernel Functions are Better In-Context Models ACL 2024