Sameer Singh

Lost in Simulation: LLM-Simulated Users are Unreliable Proxies for Human Users in Agentic Evaluations ACL 2026 Characterizing Mamba’s Selective Memory using Auto-Encoders IJCNLP 2025 Nudging: Inference-time Alignment of LLMs via Guided Decoding ACL 2025 Small Changes, Large Consequences: Analyzing the Allocational Fairness of LLMs in Hiring Contexts IJCNLP 2025 TurtleBench: A Visual Programming Benchmark in Turtle Geometry NAACL 2025 Are Models Biased on Text without Gender-related Language? ICLR 2024 Benchmark Data Repositories for Better Benchmarking NeurIPS 2024 Downstream Trade-offs of a Family of Text Watermarks EMNLP 2024 EchoPrompt: Instructing the Model to Rephrase Queries for Improved In-context Learning NAACL 2024 Measuring and Improving Attentiveness to Partial Inputs with Counterfactuals EMNLP 2024 MisgenderMender: A Community-Informed Approach to Interventions for Misgendering NAACL 2024 Perceptions of Linguistic Uncertainty by Language Models and Humans EMNLP 2024 Plot Twist: Multimodal Models Don’t Comprehend Simple Chart Details EMNLP 2024 Selective Perception: Learning Concise State Descriptions for Language Model Actors NAACL 2024 Skill Set Optimization: Reinforcing Language Model Behavior via Transferable Skills ICML 2024 The Bias Amplification Paradox in Text-to-Image Generation NAACL 2024 What's In My Big Data? ICLR 2024 Coverage-based Example Selection for In-Context Learning EMNLP 2023 Do Embodied Agents Dream of Pixelated Sheep: Embodied Decision Making using Language Guided World Modelling ICML 2023 Factual and Informative Review Generation for Explainable Recommendation AAAI 2023 Maestro: A Gamified Platform for Teaching AI Robustness AAAI 2023 MISGENDERED: Limits of Large Language Models in Understanding Pronouns ACL 2023 Post Hoc Explanations of Language Models Can Improve Language Models NeurIPS 2023 To Adapt or to Annotate: Challenges and Interventions for Domain Adaptation in Open-Domain Question Answering ACL 2023 Combining Feature and Instance Attribution to Detect Artifacts ACL 2022 Continued Pretraining for Better Zero- and Few-Shot Promptability EMNLP 2022 Cutting Down on Prompts and Parameters: Simple Few-Shot Learning with Language Models ACL 2022 FRUIT: Faithfully Reflecting Updated Information in Text NAACL 2022 Impact of Pretraining Term Frequencies on Few-Shot Numerical Reasoning EMNLP 2022 Prompt Waywardness: The Curious Case of Discretized Interpretation of Continuous Prompts NAACL 2022 PYLON: A PyTorch Framework for Learning with Constraints AAAI 2022 ReCLIP: A Strong Zero-Shot Baseline for Referring Expression Comprehension ACL 2022 Snoopy: An Online Interface for Exploring the Effect of Pretraining Term Frequencies on Few-Shot LM Performance EMNLP 2022 Structurally Diverse Sampling for Sample-Efficient Training and Comprehensive Evaluation EMNLP 2022 Successive Prompting for Decomposing Complex Questions EMNLP 2022 Zero- and Few-Shot NLP with Pretrained Language Models ACL 2022 An Empirical Comparison of Instance Attribution Methods for NLP NAACL 2021 Benchmarking Scalable Methods for Streaming Cross Document Entity Coreference ACL 2021 Beyond Accuracy: Behavioral Testing of NLP Models with Checklist (Extended Abstract) IJCAI 2021 Calibrate Before Use: Improving Few-shot Performance of Language Models ICML 2021 Competency Problems: On Finding and Removing Artifacts in Language Data EMNLP 2021 Concealed Data Poisoning Attacks on NLP Models NAACL 2021 Counterfactual Explanations Can Be Manipulated NeurIPS 2021 Enforcing Consistency in Weakly Supervised Semantic Parsing ACL 2021 Entity-Based Knowledge Conflicts in Question Answering EMNLP 2021 Evaluating Entity Disambiguation and the Role of Popularity in Retrieval-Based NLP ACL 2021 Generative Context Pair Selection for Multi-hop Question Answering EMNLP 2021 Improved Consistency Regularization for GANs AAAI 2021 Learning with Instance Bundles for Reading Comprehension EMNLP 2021 Paired Examples as Indirect Supervision in Latent Decision Models EMNLP 2021 Reliable Post hoc Explanations: Modeling Uncertainty in Explainability NeurIPS 2021 Robustness and Adversarial Examples in Natural Language Processing EMNLP 2021 What Models Know About Their Attackers: Deriving Attacker Information From Latent Representations EMNLP 2021 AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Prompts EMNLP 2020 Benefits of Intermediate Annotations in Reading Comprehension ACL 2020 Beyond Accuracy: Behavioral Testing of NLP Models with CheckList ACL 2020 COVIDLies: Detecting COVID-19 Misinformation on Social Media EMNLP 2020 Dynamic Sampling Strategies for Multi-Task Reading Comprehension ACL 2020 Evaluating Models’ Local Decision Boundaries via Contrast Sets EMNLP 2020 Explain Your Move: Understanding Agent Actions Using Specific and Relevant Feature Attribution ICLR 2020 Gradient-based Analysis of NLP Models is Manipulable EMNLP 2020 Interpreting Predictions of NLP Models EMNLP 2020 MedICaT: A Dataset of Medical Images, Captions, and Textual References EMNLP 2020 MOCHA: A Dataset for Training and Evaluating Generative Reading Comprehension Metrics EMNLP 2020 Neural Module Networks for Reasoning over Text ICLR 2020 Obtaining Faithful Interpretations from Compositional Neural Networks ACL 2020 On Importance Sampling-Based Evaluation of Latent Language Models ACL 2020 Tweeki: Linking Named Entities on Twitter to a Knowledge Graph EMNLP 2020 AllenNLP Interpret: A Framework for Explaining Predictions of NLP Models EMNLP 2019 Are Red Roses Red? Evaluating Consistency of Question-Answering Models ACL 2019 Barack’s Wife Hillary: Using Knowledge Graphs for Fact-Aware Language Modeling ACL 2019 Compositional Questions Do Not Necessitate Multi-hop Reasoning ACL 2019 Comprehensive Multi-Dataset Evaluation of Reading Comprehension EMNLP 2019 Deep Adversarial Learning for NLP NAACL 2019 Do NLP Models Know Numbers? Probing Numeracy in Embeddings EMNLP 2019 DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphs NAACL 2019 Evaluating Question Answering Evaluation EMNLP 2019 GenderQuant: Quantifying Mention-Level Genderedness NAACL 2019 Investigating Robustness and Interpretability of Link Prediction via Adversarial Modifications NAACL 2019 Knowledge Enhanced Contextual Word Representations EMNLP 2019 PoMo: Generating Entity-Specific Post-Modifiers in Context NAACL 2019 Universal Adversarial Triggers for Attacking and Analyzing NLP EMNLP 2019 Combining Symbolic Expressions and Black-box Function Evaluations in Neural Programs ICLR 2018 Embedding Multimodal Relational Data for Knowledge Base Completion EMNLP 2018 Generating Natural Adversarial Examples ICLR 2018 Interpretation of Natural Language Rules in Conversational Machine Reading EMNLP 2018 Semantically Equivalent Adversarial Rules for Debugging NLP models ACL 2018 Entity Linking via Joint Encoding of Types, Descriptions, and Context EMNLP 2017 Better call Saul: Flexible Programming for Learning and Inference in NLP COLING 2016 Connotation Frames: A Data-Driven Investigation ACL 2016 “Why Should I Trust You?”: Explaining the Predictions of Any Classifier NAACL 2016 Efficient Second-Order Gradient Boosting for Conditional Random Fields AISTATS 2015 Injecting Logical Background Knowledge into Embeddings for Relation Extraction NAACL 2015 WOLFE: An NLP-friendly Declarative Machine Learning Stack NAACL 2015 Dynamic Knowledge-Base Alignment for Coreference Resolution CoNLL 2013 A Discriminative Hierarchical Model for Fast Coreference at Large Scale ACL 2012 Monte Carlo MCMC: Efficient Inference by Approximate Sampling EMNLP 2012 Large-Scale Cross-Document Coreference Using Distributed Inference and Hierarchical Models ACL 2011 Constraint-Driven Rank-Based Learning for Information Extraction NAACL 2010 Minimally-Supervised Extraction of Entities from Text Advertisements NAACL 2010 FACTORIE: Probabilistic Programming via Imperatively Defined Factor Graphs NeurIPS 2009 Training Factor Graphs with Reinforcement Learning for Efficient MAP Inference NeurIPS 2009