Papers
Grahak-Nyay: Consumer Grievance Redressal through Large Language Models
Shrey Ganatra, Swapnil Bhattacharyya, Harshvivek Kashid et al.
LLM Driven Legal Text Analytics: A Case Study For Food Safety Violation Cases
Suyog Joshi, Soumyajit Basu, Lipika Dey et al.
Legal Document Summarization: A Zero-shot Modular Agentic Workflow Approach
Taha Sadikot, Sarika Jain
LeCNet: A Legal Citation Network Benchmark Dataset
Pooja Harde, Bhavya Jain, Sarika Jain
Findings of the JUST-NLP 2025 Shared Task on English-to-Hindi Legal Machine Translation
Kshetrimayum Boynao Singh, Sandeep Kumar, Debtanu Datta et al.
Findings of the JUST-NLP 2025 Shared Task on Summarization of Indian Court Judgments
Debtanu Datta, Shounak Paul, Kshetrimayum Boynao Singh et al.
Overview of the 1st Workshop on NLP for Empowering Justice
Ashutosh Modi, Saptarshi Ghosh, Asif Ekbal et al.
Test Set Quality in Multilingual LLM Evaluation
Chalamalasetti Kranti, Gabriel Bernier-Colborne, Yvan Gauthier et al.
InFiNITE (∞): Indian Financial Narrative Inference Tasks & Evaluations
Sohom Ghosh, Arnab Maji, Sudip Kumar Naskar
Non-Determinism of “Deterministic” LLM System Settings in Hosted Environments
Berk Atıl, Sarp Aykent, Alexa Chittams et al.
Beyond the Rubric: Cultural Misalignment in LLM Benchmarks for Sexual and Reproductive Health
Sumon Kanti Dey, Manvi S, Zeel Mehta et al.
Evaluation of Generated Poetry
David Mareček, Kateřina Motalík Hodková, Tomáš Musil et al.
SynClaimEval: A Framework for Evaluating the Utility of Synthetic Data in Long-Context Claim Verification
Mohamed Elaraby, Jyoti Prakash Maheswari
“The dentist is an involved parent, the bartender is not”: Revealing Implicit Biases in QA with Implicit BBQ
Aarushi Wagh, Saniya Srivastava
Between the Drafts: An Evaluation Framework for Identifying Quality Improvement and Stylistic Differences in Scientific Texts
Danqing Chen, Ingo Weber, Felix Dietrich
Fair Play in the Newsroom: Actor-Based Filtering Gender Discrimination in Text Corpora
Stefanie Urchs, Veronika Thurner, Matthias Aßenmacher et al.
Reliable Inline Code Documentation with LLMs: Fine-Grained Evaluation of Comment Quality and Coverage
Rohan Patil, Gaurav Tirodkar, Shubham Gatfane
Simulating Training Data Leakage in Multiple-Choice Benchmarks for LLM Evaluation
Naila Shafirni Hidayat, Muhammad Dehan Al Kautsar, Alfan Farizki Wicaksono et al.
Measuring Visual Understanding in Telecom domain: Performance Metrics for Image-to-UML conversion using VLMs
H. G. Ranjani, Rutuja Prabhudesai
Beyond Tokens and Into Minds: Future Directions for Human-Centered Evaluation in Machine Translation Post-Editing
Molly Apsel, Sunil Kothari, Manish Mehta et al.
“AGI” team at SHROOM-CAP: Data-Centric Approach to Multilingual Hallucination Detection using XLM-RoBERTa
Harsh Rathwa, Pruthwik Mishra, Shrikant Malviya
SmurfCat at SHROOM-CAP: Factual but Awkward? Fluent but Wrong? Tackling Both in LLM Scientific QA
Timur Ionov, Evgenii Nikolaev, Artem Vazhentsev et al.
SHROOM-CAP: Shared Task on Hallucinations and Related Observable Overgeneration Mistakes in Crosslingual Analyses of Publications
Aman Sinha, Federica Gamba, Raúl Vázquez et al.