NAACL 2021

941 papers

ShadowGNN: Graph Projection Neural Network for Text-to-SQL Parser

Zhi Chen, Lu Chen, Yanbin Zhao, Ruisheng Cao, Zihan Xu

Universal Semantic Tagging for English and Mandarin Chinese

Wenxi Li, Yiyang Hou, Yajie Ye, Li Liang, Weiwei Sun

GPT Perdetry Test: Generating new meanings for new words

Nikolay Malkin, Sameera Lanka, Pranav Goel, Sudha Rao, Nebojsa Jojic

User-Generated Text Corpus for Evaluating Japanese Morphological Analysis and Lexical Normalization

Shohei Higashiyama, Masao Utiyama, Taro Watanabe, Eiichiro Sumita

Decompose, Fuse and Generate: A Formation-Informed Method for Chinese Definition Generation

Hua Zheng, Damai Dai, Lei Li, Tianyu Liu, Zhifang Sui

Pre-training with Meta Learning for Chinese Word Segmentation

Zhen Ke, Liang Shi, Songtao Sun, Erli Meng, Bin Wang

Do RNN States Encode Abstract Phonological Alternations?

Miikka Silfverberg, Francis Tyers, Garrett Nicolai, Mans Hulden

Few-Shot Text Classification with Triplet Networks, Data Augmentation, and Curriculum Learning

Jason Wei, Chengyu Huang, Soroush Vosoughi, Yu Cheng, Shiqi Xu

Frustratingly Easy Edit-based Linguistic Steganography with a Masked Language Model

Honai Ueoka, Yugo Murawaki, Sadao Kurohashi

On Unifying Misinformation Detection

Nayeon Lee, Belinda Z. Li, Sinong Wang, Pascale Fung, Hao Ma

Discrete Argument Representation Learning for Interactive Argument Pair Identification

Lu Ji, zhongyu wei, Jing Li, Qi Zhang, Xuanjing Huang

Neural Network Surgery: Injecting Data Patterns into Pre-trained Models with Minimal Instance-wise Side Effects

Zhiyuan Zhang, Xuancheng Ren, Qi Su, Xu Sun, Bin He

Neural Quality Estimation with Multiple Hypotheses for Grammatical Error Correction

Zhenghao Liu, Xiaoyuan Yi, Maosong Sun, Liner Yang, Tat-Seng Chua

TITA: A Two-stage Interaction and Topic-Aware Text Matching Model

Xingwu Sun, Yanling Cui, Hongyin Tang, Qiuyu Zhu, Fuzheng Zhang

Supporting Clustering with Contrastive Learning

Dejiao Zhang, Feng Nan, Xiaokai Wei, Shang-Wen Li, Henghui Zhu

Self-training Improves Pre-training for Natural Language Understanding

Jingfei Du, Edouard Grave, Beliz Gunel, Vishrav Chaudhary, Onur Çelebi

Latent-Optimized Adversarial Neural Transfer for Sarcasm Detection

Xu Guo, Boyang Li, Han Yu, Chunyan Miao

Targeted Adversarial Training for Natural Language Understanding

Lis Pereira, Xiaodong Liu, Hao Cheng, Hoifung Poon, Jianfeng Gao

BBAEG: Towards BERT-based Biomedical Adversarial Example Generation for Text Classification

Ishani Mondal

Probing Contextual Language Models for Common Ground with Visual Representations

Gabriel Ilharco, Rowan Zellers, Ali Farhadi, Hannaneh Hajishirzi

Multitasking Inhibits Semantic Drift

Athul Paul Jacob, Mike Lewis, Jacob Andreas

Unsupervised Vision-and-Language Pre-training Without Parallel Images and Captions

Liunian Harold Li, Haoxuan You, Zhecan Wang, Alireza Zareian, Shih-fu Chang

OCID-Ref: A 3D Robotic Dataset With Embodied Language For Clutter Scene Grounding

Ke-Jyun Wang, Yun-Hsuan Liu, Hung-Ting Su, Jen-Wei Wang, Yu-Siang Wang

MIMOQA: Multimodal Input Multimodal Output Question Answering

Hrituraj Singh, Anshul Nasery, Denil Mehta, Aishwarya Agarwal, Jatin Lamba

Multimodal End-to-End Sparse Model for Emotion Recognition

Wenliang Dai, Samuel Cahyawijaya, Zihan Liu, Pascale Fung

Improving Factual Completeness and Consistency of Image-to-Text Radiology Report Generation

Yasuhide Miura, Yuhao Zhang, Emily Tsai, Curtis Langlotz, Dan Jurafsky

A Deep Metric Learning Approach to Account Linking

Aleem Khan, Elizabeth Fleming, Noah Schofield, Marcus Bishop, Nicholas Andrews

Text Editing by Command

Felix Faltings, Michel Galley, Gerold Hintz, Chris Brockett, Chris Quirk

SpanPredict: Extraction of Predictive Document Spans with Neural Attention

Vivek Subramanian, Matthew Engelhard, Sam Berchuck, Liqun Chen, Ricardo Henao

AVA: an Automatic eValuation Approach for Question Answering Systems

Thuy Vu, Alessandro Moschitti

Nutri-bullets Hybrid: Consensual Multi-document Summarization

Darsh Shah, LILI YU, Tao Lei, Regina Barzilay

Learning How to Ask: Querying LMs with Mixtures of Soft Prompts

Guanghui Qin, Jason Eisner

SCRIPT: Self-Critic PreTraining of Transformers

Erik Nijkamp, Bo Pang, Ying Nian Wu, Caiming Xiong

ReadTwice: Reading Very Large Documents with Memories

Yury Zemlyanskiy, Joshua Ainslie, Michiel De Jong, Philip Pham, Ilya Eckstein

Revisiting Simple Neural Probabilistic Language Models

Simeng Sun, Mohit Iyyer

On the Transformer Growth for Progressive BERT Training

Xiaotao Gu, Liyuan Liu, Hongkun Yu, Jing Li, Chen Chen

Limitations of Autoregressive Models and Their Alternatives

Chu-Cheng Lin, Aaron Jaech, Xin Li, Matthew R. Gormley, Jason Eisner

On the Inductive Bias of Masked Language Modeling: From Statistical to Syntactic Dependencies

Tianyi Zhang, Tatsunori B. Hashimoto

Too Much in Common: Shifting of Embeddings in Transformer Language Models and its Implications

Daniel Biś, Maksim Podkorytov, Xiuwen Liu

Evaluating the Values of Sources in Transfer Learning

Md Rizwan Parvez, Kai-Wei Chang

DirectProbe: Studying Representations without Classifiers

Yichu Zhou, Vivek Srikumar

Contextualized Perturbation for Textual Adversarial Attack

Dianqi Li, Yizhe Zhang, Hao Peng, Liqun Chen, Chris Brockett

Evaluating Saliency Methods for Neural Language Models

Shuoyang Ding, Philipp Koehn

Factual Probing Is [MASK]: Learning vs. Learning to Recall

Zexuan Zhong, Dan Friedman, Danqi Chen

Attention Head Masking for Inference Time Content Selection in Abstractive Summarization

Shuyang Cao, Lu Wang

An Empirical Study on Neural Keyphrase Generation

Rui Meng, Xingdi Yuan, Tong Wang, Sanqiang Zhao, Adam Trischler

Paragraph-level Simplification of Medical Texts

Ashwin Devaraj, Iain Marshall, Byron Wallace, Junyi Jessy Li

ENTRUST: Argument Reframing with Language Models and Entailment

Tuhin Chakrabarty, Christopher Hidey, Smaranda Muresan

Hurdles to Progress in Long-form Question Answering

Kalpesh Krishna, Aurko Roy, Mohit Iyyer

A Simple and Efficient Multi-Task Learning Approach for Conditioned Dialogue Generation

Yan Zeng, Jian-Yun Nie

Modeling Human Mental States with an Entity-based Narrative Graph

I-Ta Lee, Maria Leonor Pacheco, Dan Goldwasser

Identifying inherent disagreement in natural language inference

Xinliang Frederick Zhang, Marie-Catherine de Marneffe

Profiling of Intertextuality in Latin Literature Using Word Embeddings

Patrick J. Burns, James A. Brofos, Kyle Li, Pramit Chaudhuri, Joseph P. Dexter

Self Promotion in US Congressional Tweets

Jun Wang, Kelly Cui, Bei Yu

Multitask Learning for Emotionally Analyzing Sexual Abuse Disclosures

Ramit Sawhney, Puneet Mathur, Taru Jain, Akash Kumar Gautam, Rajiv Ratn Shah

TuringAdvice: A Generative and Dynamic Evaluation of Language Use

Rowan Zellers, Ari Holtzman, Elizabeth Clark, LIANHUI Qin, Ali Farhadi

What Will it Take to Fix Benchmarking in Natural Language Understanding?

Samuel R. Bowman, George Dahl

GSum: A General Framework for Guided Neural Abstractive Summarization

Zi-Yi Dou, Pengfei Liu, Hiroaki Hayashi, Zhengbao Jiang, Graham Neubig

Understanding Factuality in Abstractive Summarization with FRANK: A Benchmark for Factuality Metrics

Artidoro Pagnoni, Vidhisha Balachandran, Yulia Tsvetkov

What’s in a Summary? Laying the Groundwork for Advances in Hospital-Course Summarization

Griffin Adams, Emily Alsentzer, Mert Ketenci, Jason Zucker, Noemie Elhadad

Enriching Transformers with Structured Tensor-Product Representations for Abstractive Summarization

Yichen Jiang, Asli Celikyilmaz, Paul Smolensky, Paul Soulos, Sudha Rao

Efficiently Summarizing Text and Graph Encodings of Multi-Document Clusters

Ramakanth Pasunuru, Mengwen Liu, Mohit Bansal, Sujith Ravi, Markus Dreyer

Adversarial Learning for Zero-Shot Stance Detection on Social Media

Emily Allaway, Malavika Srikanth, Kathleen McKeown

Adapting BERT for Continual Learning of a Sequence of Aspect Sentiment Classification Tasks

Zixuan Ke, Hu Xu, Bing Liu

Learning Paralinguistic Features from Audiobooks through Style Voice Conversion

Zakaria Aldeneh, Matthew Perez, Emily Mower Provost

Knowledge Enhanced Masked Language Model for Stance Detection

Kornraphop Kawintiranon, Lisa Singh

Seq2Emo: A Sequence to Multi-Label Emotion Classification Model

Chenyang Huang, Amine Trabelsi, Xuebin Qin, Nawshad Farruque, Lili Mou

Event Representation with Sequential, Semi-Supervised Discrete Variables

Mehdi Rezaee, Francis Ferraro

Constructing Taxonomies from Pretrained Language Models

Catherine Chen, Kevin Lin, Dan Klein

Recent advances in neural metaphor processing: A linguistic, cognitive and social perspective

Xiaoyu Tong, Ekaterina Shutova, Martha Lewis

ESC: Redesigning WSD with Extractive Sense Comprehension

Edoardo Barba, Tommaso Pasini, Roberto Navigli

Scalar Adjective Identification and Multilingual Ranking

Aina Garí Soler, Marianna Apidianaki

Scalable and Interpretable Semantic Change Detection

Syrielle Montariol, Matej Martinc, Lidia Pivovarova

Multi-Step Reasoning Over Unstructured Text with Beam Dense Retrieval

Chen Zhao, Chenyan Xiong, Jordan Boyd-Graber, Hal Daume III

Does Structure Matter? Encoding Documents for Machine Reading Comprehension

Hui Wan, Song Feng, Chulaka Gunasekara, Siva Sankalp Patel, Sachindra Joshi

Differentiable Open-Ended Commonsense Reasoning

Bill Yuchen Lin, Haitian Sun, Bhuwan Dhingra, Manzil Zaheer, Xiang Ren

A Dataset of Information-Seeking Questions and Answers Anchored in Research Papers

Pradeep Dasigi, Kyle Lo, Iz Beltagy, Arman Cohan, Noah A. Smith

SPARTQA: A Textual Question Answering Benchmark for Spatial Reasoning

Roshanak Mirzaee, Hossein Rajaby Faghihi, Qiang Ning, Parisa Kordjamshidi

If You Want to Go Far Go Together: Unsupervised Joint Candidate Evidence Retrieval for Multi-hop Question Answering

Vikas Yadav, Steven Bethard, Mihai Surdeanu

Time-Stamped Language Model: Teaching Language Models to Understand The Flow of Events

Hossein Rajaby Faghihi, Parisa Kordjamshidi

Adapting Coreference Resolution for Processing Violent Death Narratives

Ankith Uppunda, Susan Cochran, Jacob Foster, Alina Arseniev-Koehler, Vickie Mays

Data and Model Distillation as a Solution for Domain-transferable Fact Verification

Mitch Paul Mithun, Sandeep Suntwal, Mihai Surdeanu

On the Use of Context for Predicting Citation Worthiness of Sentences in Scholarly Articles

Rakesh Gosangi, Ravneet Arora, Mohsen Gheisarieha, Debanjan Mahata, Haimin Zhang

Leveraging Deep Representations of Radiology Reports in Survival Analysis for Predicting Heart Failure Patient Mortality

Hyun Gi Lee, Evan Sholle, Ashley Beecy, Subhi Al’Aref, Yifan Peng

Empirical Evaluation of Pre-trained Transformers for Human-Level NLP: The Role of Sample Size and Dimensionality

Adithya V Ganesan, Matthew Matero, Aravind Reddy Ravula, Huy Vu, H. Andrew Schwartz

Constrained Multi-Task Learning for Event Coreference Resolution

Jing LU, Vincent Ng

Extracting a Knowledge Base of Mechanisms from COVID-19 Papers

Tom Hope, Aida Amini, David Wadden, Madeleine van Zuylen, Sravanthi Parasa

On Biasing Transformer Attention Towards Monotonicity

Annette Rios, Chantal Amrhein, Noëmi Aepli, Rico Sennrich

Ab Antiquo: Neural Proto-language Reconstruction

Carlo Meloni, Shauli Ravfogel, Yoav Goldberg

Linguistic Complexity Loss in Text-Based Therapy

Jason Wei, Kelly Finn, Emma Templeton, Thalia Wheatley, Soroush Vosoughi

Word Complexity is in the Eye of the Beholder

Sian Gooding, Ekaterina Kochmar, Seid Muhie Yimam, Chris Biemann

How (Non-)Optimal is the Lexicon?

Tiago Pimentel, Irene Nikkarinen, Kyle Mahowald, Ryan Cotterell, Damian Blasi

Finding Concept-specific Biases in Form–Meaning Associations

Tiago Pimentel, Brian Roark, Søren Wichmann, Ryan Cotterell, Damian Blasi

Language in a (Search) Box: Grounding Language Learning in Real-World Human-Machine Interaction

Federico Bianchi, Ciro Greco, Jacopo Tagliabue

Identifying Medical Self-Disclosure in Online Communities

Mina Valizadeh, Pardis Ranjbar-Noiey, Cornelia Caragea, Natalie Parde

“I’m Not Mad”: Commonsense Implications of Negation and Contradiction

Liwei Jiang, Antoine Bosselut, Chandra Bhagavatula, Yejin Choi

Swords: A Benchmark for Lexical Substitution with Improved Data Coverage and Quality

Mina Lee, Chris Donahue, Robin Jia, Alexander Iyabor, Percy Liang

MultiOpEd: A Corpus of Multi-Perspective News Editorials

Siyi Liu, Sihao Chen, Xander Uyttendaele, Dan Roth

Plot-guided Adversarial Example Construction for Evaluating Open-domain Story Generation

Sarik Ghazarian, Zixi Liu, Akash S M, Ralph Weischedel, Aram Galstyan

SOCCER: An Information-Sparse Discourse State Tracking Collection in the Sports Commentary Domain

Ruochen Zhang, Carsten Eickhoff