Papers
Contextual Metric Meta-Evaluation by Measuring Local Metric Accuracy
Athiya Deviyani, Fernando Diaz
Echoes of Discord: Forecasting Hater Reactions to Counterspeech
Xiaoying Song, Sharon Lisseth Perez, Xinchen Yu et al.
Jailbreaking with Universal Multi-Prompts
Yu-Ling Hsu, Hsuan Su, Shang-Tse Chen
How Inclusively do LMs Perceive Social and Moral Norms?
Michael Galarnyk, Agam Shah, Dipanwita Guhathakurta et al.
Robust Bias Detection in MLMs and its Application to Human Trait Ratings
Ingroj Shrestha, Louis Tay, Padmini Srinivasan
A Practical Examination of AI-Generated Text Detectors for Large Language Models
Brian Tufts, Xuandong Zhao, Lei Li
Human and LLM-Based Resume Matching: An Observational Study
Swanand Vaishampayan, Hunter Leary, Yoseph Berhanu Alebachew et al.
WordGame: Efficient & Effective LLM Jailbreak via Simultaneous Obfuscation in Query and Response
Tianrong Zhang, Bochuan Cao, Yuanpu Cao et al.
Improving Consistency in LLM Inference using Probabilistic Tokenization
Ashutosh Sathe, Divyanshu Aggarwal, Sunayana Sitaram
MMAU: A Holistic Benchmark of Agent Capabilities Across Diverse Domains
Guoli Yin, Haoping Bai, Shuang Ma et al.
Decoding Fatphobia: Examining Anti-Fat and Pro-Thin Bias in AI-Generated Images
Jane Warren, Gary M. Weiss, Fernando Martinez et al.
From Text to Emoji: How PEFT-Driven Personality Manipulation Unleashes the Emoji Potential in LLMs
Navya Jain, Zekun Wu, Cristian Enrique Munoz Villalobos et al.
TAGCOS: Task-agnostic Gradient Clustered Coreset Selection for Instruction Tuning Data
Jipeng Zhang, Yaxuan Qin, Renjie Pi et al.
Swan and ArabicMTEB: Dialect-Aware, Arabic-Centric, Cross-Lingual, and Cross-Cultural Embedding Models and Benchmarks
Gagan Bhatia, El Moatez Billah Nagoudi, Abdellah El Mekki et al.
Richer Output for Richer Countries: Uncovering Geographical Disparities in Generated Stories and Travel Recommendations
Kirti Bhagat, Kinshuk Vasisht, Danish Pruthi
GuideQ: Framework for Guided Questioning for progressive informational collection and classification
Priya Mishra, Suraj Racha, Kaustubh Ponkshe et al.
Beneath the Surface of Consistency: Exploring Cross-lingual Knowledge Representation Sharing in LLMs
Maxim Ifergan, Leshem Choshen, Roee Aharoni et al.
Re-evaluating Automatic LLM System Ranking for Alignment with Human Preference
Mingqi Gao, Yixin Liu, Xinyu Hu et al.
SFMSS: Service Flow aware Medical Scenario Simulation for Conversational Data Generation
Zhijie Bao, Qingyun Liu, Xuanjing Huang et al.
Music for All: Representational Bias and Cross-Cultural Adaptability of Music Generation Models
Atharva Mehta, Shivam Chauhan, Amirbek Djanibekov et al.
FinNLI: Novel Dataset for Multi-Genre Financial Natural Language Inference Benchmarking
Jabez Magomere, Elena Kochkina, Samuel Mensah et al.
Lost in the Distance: Large Language Models Struggle to Capture Long-Distance Relational Knowledge
Meiyun Wang, Takeshi Kojima, Yusuke Iwasawa et al.
Rethinking Smoothness for Fast and Adaptable Entity Alignment Decoding
Yuanyi Wang, Han Li, Haifeng Sun et al.
Improving Reward Models with Synthetic Critiques
Zihuiwen Ye, Fraser David Greenlee, Max Bartolo et al.
How Well Do LLMs Handle Cantonese? Benchmarking Cantonese Capabilities of Large Language Models
Jiyue Jiang, Pengan Chen, Liheng Chen et al.