Papers
PMPO: A Self-Optimizing Framework for Creating High-Fidelity Measurement Tools for Social Bias in Large Language Models
Zeqiang Wang, Yuqi Wang, Xinyue Wu et al.
Integrating Video and Text: A Balanced Approach to Multimodal Summary Generation and Evaluation
Galann Pennec, Zhengyuan Liu, Nicholas Asher et al.
More Than a Score: Probing the Impact of Prompt Specificity on LLM Code Generation
Yangtian Zi, Harshitha Menon, Arjun Guha
Can AI Validate Science? Benchmarking LLMs on Claim →Evidence Reasoning in AI Papers
Shashidhar Reddy Javaji, Yupeng Cao, Haohang Li et al.
What Would You Ask When You First Saw a2+b2=c2? Evaluating LLM on Curiosity-Driven Question Generation
Shashidhar Reddy Javaji, Zining Zhu
Beyond statistical significance: Quantifying uncertainty and statistical variability in multilingual and multitask NLP evaluation
Jonne Sälevä, Duygu Ataman, Constantine Lignos
Large Language Models Encode Semantics and Alignment in Linearly Separable Representations
Baturay Saglam, Paul Kassianik, Blaine Nelson et al.
Interpreting the Effects of Quantization on LLMs
Manpreet Singh, Hassan Sajjad
VideoChain: A Transformer-Based Framework for Multi-hop Video Question Generation
Arpan Phukan, Anupam Pandey, Deepjyoti Bodo et al.
Q2E: Query-to-Event Decomposition for Zero-Shot Multilingual Text-to-Video Retrieval
Shubhashis Roy Dipta, Francis Ferraro
PerCoR: Evaluating Commonsense Reasoning in Persian via Multiple-Choice Sentence Completion
Morteza Alikhani, Mohammadtaha Bagherifard, Erfan Zinvandi et al.
CtrlShift: Steering Language Models for Dense Quotation Retrieval with Dynamic Prompts
Chuang Liang, Wei Li, Yanqiu Shao
What Are They Talking About? A Benchmark of Knowledge-Grounded Discussion Summarization
Weixiao Zhou, Junnan Zhu, Gengyao Li et al.
Large Temporal Models: Unlocking Temporal Understanding in LLMs for Temporal Relation Classification
Omri Homburger, Kfir Bar
Are Humans as Brittle as Large Language Models?
Jiahui Li, Sean Papay, Roman Klinger
BhashaSetu: Cross-Lingual Knowledge Transfer from High-Resource to Extreme Low-Resource Languages
Subhadip Maji, Arnab Bhattacharya
DharmaBench: Evaluating Language Models on Buddhist Texts in Sanskrit and Tibetan
Kai Golan Hashiloni, Shay Cohen, Asaf Shina et al.
The Confidence Paradox: Can LLM Know When It’s Wrong?
Sahil Tripathi, MD Tabrez Nafis, Imran Hussain et al.
LangCompress: Language-Aware Compression of Large Language Models
Dieu-Hien Nguyen, Nguyen-Khang Le, Truong Dinh Do et al.
INTERCHART: Benchmarking Visual Reasoning Across Decomposed and Distributed Chart Information
Anirudh Iyengar Kaniyar Narayana Iyengar, Srija Mukhopadhyay, Adnan Qidwai et al.
Task-Aligned Tool Recommendation for Large Language Models
Hang Gao, Yongfeng Zhang
Characterizing Mamba’s Selective Memory using Auto-Encoders
Tamanna Hossain, Robert L. Logan Iv, Chandrasekhara Ganesh Jagadeesan et al.
A Multimodal Recaptioning Framework to Account for Perceptual Diversity Across Languages in Vision-Language Modeling
Kyle Buettner, Jacob T. Emmerson, Adriana Kovashka
Atomic Consistency Preference Optimization for Long-Form Question Answering
Jingfeng Chen, Raghuveer Thirukovalluru, Junlin Wang et al.