Papers
Looking to Learn: Token-wise Dynamic Gating for Low-Resource Vision-Language Modelling
Bianca-Mihaela Ganescu, Suchir Salhan, Andrew Caines et al.
Sample-Efficient Language Modeling with Linear Attention and Lightweight Enhancements
Patrick Haller, Jonas Golde, Alan Akbik
BLiSS: Evaluating Bilingual Learner Competence in Second Language Small Language Models
Yuan Gao, Suchir Salhan, Andrew Caines et al.
Exploring smaller batch sizes for a high-performing BabyLM model architecture
Sharid Loáiciga, Eleni Fysikoudi, Asad B. Sayeed
BitMar: Low-Bit Multimodal Fusion with Episodic Memory for Edge Devices
Euhid Aman, Esteban Carlin, Hsing-Kuo Kenneth Pao et al.
What is the Best Sequence Length for BabyLM?
Suchir Salhan, Richard Diehl Martinez, Zébulon Goriely et al.
Design and Analysis of few Million Parameter Transformer-based Language Models trained over a few Million Tokens Dataset
Yen-Che Hsiao, Abhishek Dutta
Large Language Models and Children Have Different Learning Trajectories in Determiner Acquisition
Olivia La Fiandra, Nathalie Fernandez Echeverri, Patrick Shafto et al.
TafBERTa: Learning Grammatical Rules from Small-Scale Language Acquisition Data in Hebrew
Anita Gelboim, Elior Sulem
Model Merging to Maintain Language-Only Performance in Developmentally Plausible Multimodal Models
Ece Takmaz, Lisa Bylinina, Jakub Dotlacil
Are BabyLMs Deaf to Gricean Maxims? A Pragmatic Evaluation of Sample-efficient Language Models
Raha Askari, Sina Zarrieß, Özge Alacam et al.
Unifying Mixture of Experts and Multi-Head Latent Attention for Efficient Language Models
Sushant Mehta, Raj Dandekar, Rajat Dandekar et al.
Contrastive Decoding for Synthetic Data Generation in Low-Resource Language Modeling
Jannek Ulm, Kevin Du, Vésteinn Snæbjarnarson
Rethinking the Role of Text Complexity in Language Model Pretraining
Dan John Velasco, Matthew Theodore Roque
TAQEEM 2025: Overview of The First Shared Task for Arabic Quality Evaluation of Essays in Multi-dimensions
May Bashendy, Salam Albatarni, Sohaila Eltanbouly et al.
QIAS 2025: Overview of the Shared Task on Islamic Inheritance Reasoning and Knowledge Assessment
Abdessalam Bouchekif, Samer Rashwani, Emad Soliman Ali Mohamed et al.
PalmX 2025: The First Shared Task on Benchmarking LLMs on Arabic and Islamic Culture
Fakhraddin Alwajih, Abdellah El Mekki, Hamdy Mubarak et al.
NADI 2025: The First Multidialectal Arabic Speech Processing Shared Task
Bashar Talafha, Hawau Olamide Toyin, Peter Sullivan et al.
MAHED Shared Task: Multimodal Detection of Hope and Hate Emotions in Arabic Content
Wajdi Zaghouani, Md. Rafiul Biswas, Mabrouka Bessghaier et al.
IslamicEval 2025: The First Shared Task of Capturing LLMs Hallucination in Islamic Content
Hamdy Mubarak, Rana Malhas, Watheq Mansour et al.
Phoneme-level mispronunciation detection in Quranic recitation using ShallowTransformer
Mohamed Nadhir Daoud, Mohamed Anouar Ben Messaoud
Iqra’Eval: A Shared Task on Qur’anic Pronunciation Assessment
Yassine El Kheir, Amit Meghanani, Hawau Olamide Toyin et al.
ImageEval 2025: The First Arabic Image Captioning Shared Task
Ahlam Bashiti, Alaa Aljabari, Hadi Khaled Hamoud et al.
BAREC Shared Task 2025 on Arabic Readability Assessment
Khalid N. Elmadani, Bashar Alhafni, Hanada Taha et al.