NAACL 2021

941 papers

MelBERT: Metaphor Detection via Contextualized Late Interaction using Metaphorical Identification Theories

Minjin Choi, Sunkyung Lee, Eunseong Choi, Heesoo Park, Junhyuk Lee

Field Embedding: A Unified Grain-Based Framework for Word Representation

Junjie Luo, Xi Chen, Jichao Sun, Yuejia Xiang, Ningyu Zhang

UmlsBERT: Clinical Domain Knowledge Augmentation of Contextual Embeddings Using the Unified Medical Language System Metathesaurus

George Michalopoulos, Yuanxin Wang, Hussam Kaka, Helen Chen, Alexander Wong

Modeling Event Plausibility with Consistent Conceptual Abstraction

Ian Porada, Kaheer Suleman, Adam Trischler, Jackie Chi Kit CHEUNG

Lattice-BERT: Leveraging Multi-Granularity Representations in Chinese Pre-trained Language Models

Yuxuan Lai, Yijia Liu, Yansong Feng, Songfang Huang, Dongyan Zhao

ERNIE-Gram: Pre-Training with Explicitly N-Gram Masked Language Modeling for Natural Language Understanding

Dongling Xiao, Yu-Kun Li, Han Zhang, Yu Sun, Hao Tian

Mask Attention Networks: Rethinking and Strengthen Transformer

Zhihao Fan, Yeyun Gong, Dayiheng Liu, zhongyu wei, Siyuan Wang

Learning to Organize a Bag of Words into Sentences with Neural Networks: An Empirical Study

Chongyang Tao, Shen Gao, Juntao Li, Yansong Feng, Dongyan Zhao

Revisiting the Weaknesses of Reinforcement Learning for Neural Machine Translation

Samuel Kiegeland, Julia Kreutzer

Explicitly Modeling Syntax in Language Models with Incremental Parsing and a Dynamic Oracle

Yikang Shen, Shawn Tan, Alessandro Sordoni, Siva Reddy, Aaron Courville

Bridging Resolution: Making Sense of the State of the Art

Hideo Kobayashi, Vincent Ng

Evaluating the Impact of a Hierarchical Discourse Representation on Entity Coreference Resolution Performance

Sopan Khosla, James Fiacco, Carolyn Rose

Did they answer? Subjective acts and intents in conversational discourse

Elisa Ferracane, Greg Durrett, Junyi Jessy Li, Katrin Erk

RST Parsing from Scratch

Thanh-Tung Nguyen, Xuan-Phi Nguyen, Shafiq Joty, Xiaoli Li

Improving Neural RST Parsing Model with Silver Agreement Subtrees

Naoki Kobayashi, Tsutomu Hirao, Hidetaka Kamigaito, Manabu Okumura, Masaaki Nagata

Context Tracking Network: Graph-based Context Modeling for Implicit Discourse Relation Recognition

Yingxue Zhang, Fandong Meng, Peng Li, Ping Jian, Jie Zhou

Incorporating Syntax and Semantics in Coreference Resolution with Heterogeneous Graph Attention Network

Fan Jiang, Trevor Cohn

Adding Chit-Chat to Enhance Task-Oriented Dialogues

Kai Sun, Seungwhan Moon, Paul Crook, Stephen Roller, Becka Silvert

Put Chatbot into Its Interlocutor’s Shoes: New Framework to Learn Chatbot Responding with Intention

Hsuan Su, Jiun-hao Jhan, Fan-Yun Sun, Saurav Sahay, Hung-yi Lee

Fine-grained Post-training for Improving Retrieval-based Dialogue Systems

Janghoon Han, Taesuk Hong, Byoungjae Kim, Youngjoong Ko, Jungyun Seo

How Robust are Fact Checking Systems on Colloquial Claims?

Byeongchang Kim, Hyunwoo Kim, Seokhee Hong, Gunhee Kim

Generating Negative Samples by Manipulating Golden Responses for Unsupervised Learning of a Response Evaluation Model

ChaeHun Park, Eugene Jang, Wonsuk Yang, Jong Park

Video-aided Unsupervised Grammar Induction

Songyang Zhang, Linfeng Song, Lifeng Jin, Kun Xu, Dong Yu

GEMNET: Effective Gated Gazetteer Representations for Recognizing Complex Entities in Low-context Input

Tao Meng, Anjie Fang, Oleg Rokhlenko, Shervin Malmasi

PCFGs Can Do Better: Inducing Probabilistic Context-Free Grammars with Many Symbols

Songlin Yang, Yanpeng Zhao, Kewei Tu

Neural Sequence Segmentation as Determining the Leftmost Segments

Yangming Li, Lemao Liu, Kaisheng Yao

Larger-Context Tagging: When and Why Does It Work?

Jinlan Fu, Liangjing Feng, Qi Zhang, Xuanjing Huang, Pengfei Liu

Annotating and Modeling Fine-grained Factuality in Summarization

Tanya Goyal, Greg Durrett

RefSum: Refactoring Neural Summarization

Yixin Liu, Zi-Yi Dou, Pengfei Liu

Efficient Attentions for Long Document Summarization

Luyang Huang, Shuyang Cao, Nikolaus Parulian, Heng Ji, Lu Wang

D2S: Document-to-Slide Generation Via Query-Based Text Summarization

Edward Sun, Yufang Hou, Dakuo Wang, Yunfeng Zhang, Nancy X. R. Wang

A New Approach to Overgenerating and Scoring Abstractive Summaries

Kaiqiang Song, Bingqing Wang, Zhe Feng, Fei Liu

Structure-Aware Abstractive Conversation Summarization via Discourse and Action Graphs

Jiaao Chen, Diyi Yang

Disentangling Semantics and Syntax in Sentence Embeddings with Pre-trained Language Models

James Y. Huang, Kuan-Hao Huang, Kai-Wei Chang

Temporal Reasoning on Implicit Events from Distant Supervision

Ben Zhou, Kyle Richardson, Qiang Ning, Tushar Khot, Ashish Sabharwal

Incremental Few-shot Text Classification with Multi-round New Classes: Formulation, Dataset and System

Congying Xia, Wenpeng Yin, Yihao Feng, Philip Yu

Structure-Grounded Pretraining for Text-to-SQL

Xiang Deng, Ahmed Hassan Awadallah, Christopher Meek, Oleksandr Polozov, Huan Sun

Looking Beyond Sentence-Level Natural Language Inference for Question Answering and Text Summarization

Anshuman Mishra, Dhruvesh Patel, Aparna Vijayakumar, Xiang Lorraine Li, Pavan Kapanipathi

DuoRAT: Towards Simpler Text-to-SQL Models

Torsten Scholak, Raymond Li, Dzmitry Bahdanau, Harm de Vries, Chris Pal

Understanding by Understanding Not: Modeling Negation in Language Models

Arian Hosseini, Siva Reddy, Dzmitry Bahdanau, R Devon Hjelm, Alessandro Sordoni

On the Transferability of Minimal Prediction Preserving Inputs in Question Answering

Shayne Longpre, Yi Lu, Chris DuBois

RECONSIDER: Improved Re-Ranking using Span-Focused Cross-Attention for Open Domain Question Answering

Srinivasan Iyer, Sewon Min, Yashar Mehdad, Wen-tau Yih

Text Modular Networks: Learning to Decompose Tasks in the Language of Existing Models

Tushar Khot, Daniel Khashabi, Kyle Richardson, Peter Clark, Ashish Sabharwal

Robust Question Answering Through Sub-part Alignment

Jifan Chen, Greg Durrett

Explainable Multi-hop Verbal Reasoning Through Internal Monologue

Zhengzhong Liang, Steven Bethard, Mihai Surdeanu

Capturing Row and Column Semantics in Transformer Based Question Answering over Tables

Michael Glass, Mustafa Canim, Alfio Gliozzo, Saneem Chemmengath, Vishwajeet Kumar

Self-Supervised Test-Time Learning for Reading Comprehension

Pratyay Banerjee, Tejas Gokhale, Chitta Baral

Towards Modeling the Style of Translators in Neural Machine Translation

Yue Wang, Cuong Hoang, Marcello Federico

Towards Continual Learning for Multilingual Machine Translation via Vocabulary Substitution

Xavier Garcia, Noah Constant, Ankur Parikh, Orhan Firat

The Curious Case of Hallucinations in Neural Machine Translation

Vikas Raunak, Arul Menezes, Marcin Junczys-Dowmunt

Assessing Reference-Free Peer Evaluation for Machine Translation

Sweta Agrawal, George Foster, Markus Freitag, Colin Cherry

Macro-Average: Rare Types Are Important Too

Thamme Gowda, Weiqiu You, Constantine Lignos, Jonathan May

Harnessing Multilinguality in Unsupervised Machine Translation for Rare Languages

Xavier Garcia, Aditya Siddhant, Orhan Firat, Ankur Parikh

DReCa: A General Task Augmentation Strategy for Few-Shot Natural Language Inference

Shikhar Murty, Tatsunori B. Hashimoto, Christopher Manning

Certified Robustness to Word Substitution Attack with Differential Privacy

Wenjie Wang, Pengfei Tang, Jian Lou, Li Xiong

Understanding Hard Negatives in Noise Contrastive Estimation

Wenzheng Zhang, Karl Stratos

Posterior Differential Regularization with f-divergence for Improving Model Robustness

Hao Cheng, Xiaodong Liu, Lis Pereira, Yaoliang Yu, Jianfeng Gao

Fine-Tuning Pre-trained Language Model with Weak Supervision: A Contrastive-Regularized Self-Training Approach

Yue Yu, Simiao Zuo, Haoming Jiang, Wendi Ren, Tuo Zhao

Improving Pretrained Models for Zero-shot Multi-label Text Classification through Reinforced Label Hierarchy Reasoning

Hui LIU, Danqing Zhang, Bing Yin, Xiaodan Zhu

Improving Cross-Modal Alignment in Vision Language Navigation via Syntactic Information

Jialu Li, Hao Tan, Mohit Bansal

Modular Networks for Compositional Instruction Following

Rodolfo Corona, Daniel Fried, Coline Devin, Dan Klein, Trevor Darrell

Grounding Open-Domain Instructions to Automate Web Support Tasks

Nancy Xu, Sam Masling, Michael Du, Giovanni Campagna, Larry Heck

MTAG: Modal-Temporal Attention Graph for Unaligned Human Multimodal Language Sequences

Jianing Yang, Yongxin Wang, Ruitao Yi, Yuying Zhu, Azaan Rehman

Measuring Social Biases in Grounded Vision and Language Embeddings

Candace Ross, Boris Katz, Andrei Barbu

LightningDOT: Pre-training Visual-Semantic Embeddings for Real-Time Image-Text Retrieval

Siqi Sun, Yen-Chun Chen, Linjie Li, Shuohang Wang, Yuwei Fang

Generalization in Instruction Following Systems

Soham Dan, Michael Zhou, Dan Roth

An Empirical Comparison of Instance Attribution Methods for NLP

Pouya Pezeshkpour, Sarthak Jain, Byron Wallace, Sameer Singh

Low-Complexity Probing via Finding Subnetworks

Steven Cao, Victor Sanh, Alexander Rush

Does BERT Pretrained on Clinical Notes Reveal Sensitive Data?

Eric Lehman, Sarthak Jain, Karl Pichotta, Yoav Goldberg, Byron Wallace

On Attention Redundancy: A Comprehensive Study

Yuchen Bian, Jiaji Huang, Xingyu Cai, Jiahong Yuan, Kenneth Church

Towards Interpreting and Mitigating Shortcut Learning Behavior of NLU models

Mengnan Du, Varun Manjunatha, Rajiv Jain, Ruchi Deshpande, Franck Dernoncourt

Template Filling with Generative Transformers

Xinya Du, Alexander Rush, Claire Cardie

Document-Level Event Argument Extraction by Conditional Generation

Sha Li, Heng Ji, Jiawei Han

Probabilistic Box Embeddings for Uncertain Knowledge Graph Reasoning

Xuelu Chen, Michael Boratko, Muhao Chen, Shib Sankar Dasgupta, Xiang Lorraine Li

Neural Language Modeling for Contextualized Temporal Graph Generation

Aman Madaan, Yiming Yang

Self-Training with Weak Supervision

Giannis Karamanolakis, Subhabrata Mukherjee, Guoqing Zheng, Ahmed Hassan Awadallah

Linking Entities to Unseen Knowledge Bases with Arbitrary Schemas

Yogarshi Vyas, Miguel Ballesteros

How to Motivate Your Dragon: Teaching Goal-Driven Agents to Speak and Act in Fantasy Worlds

Prithviraj Ammanabrolu, Jack Urbanek, Margaret Li, arthur szlam, Tim Rocktäschel

Spoken Language Understanding for Task-oriented Dialogue Systems with Augmented Memory Networks

Jie Wu, Ian Harris, Hongzhi Zhao

A Comparative Study on Schema-Guided Dialogue State Tracking

Jie Cao, Yi Zhang

Human-like informative conversations: Better acknowledgements using conditional mutual information

Ashwin Paranjape, Christopher Manning

“Nice Try, Kiddo”: Investigating Ad Hominems in Dialogue Responses

Emily Sheng, Kai-Wei Chang, Prem Natarajan, Nanyun Peng

Few-shot Intent Classification and Slot Filling with Retrieved Examples

Dian Yu, Luheng He, yuan zhang, Xinya Du, Panupong Pasupat

Enhancing Factual Consistency of Abstractive Summarization

Chenguang Zhu, William Hinthorn, Ruochen Xu, Qingkai Zeng, Michael Zeng

Improving Zero and Few-Shot Abstractive Summarization with Intermediate Fine-tuning and Data Augmentation

Alexander Fabbri, Simeng Han, Haoyuan Li, Haoran Li, Marjan Ghazvininejad

Noisy Self-Knowledge Distillation for Text Summarization

Yang Liu, Sheng Shen, Mirella Lapata

Identifying Helpful Sentences in Product Reviews

Iftah Gamzu, Hila Gonen, Gilad Kutiel, Ran Levy, Eugene Agichtein

Extending Multi-Document Summarization Evaluation to the Interactive Setting

Ori Shapira, Ramakanth Pasunuru, Hadar Ronen, Mohit Bansal, Yael Amsterdamer

Representing Numbers in NLP: a Survey and a Vision

Avijit Thawani, Jay Pujara, Filip Ilievski, Pedro Szekely

Get Your Vitamin C! Robust Fact Verification with Contrastive Evidence

Tal Schuster, Adam Fisch, Regina Barzilay

Preregistering NLP research

Emiel van Miltenburg, Chris van der Lee, Emiel Krahmer

On learning and representing social meaning in NLP: a sociolinguistic perspective

Dong Nguyen, Laura Rosseel, Jack Grieve

The Importance of Modeling Social Factors of Language: Theory and Practice

Dirk Hovy, Diyi Yang

Implicitly Abusive Language – What does it actually look like and why are we not getting there?

Michael Wiegand, Josef Ruppenhofer, Elisabeth Eder

SPARTA: Efficient Open-Domain Question Answering via Sparse Transformer Matching Retrieval

Tiancheng Zhao, Xiaopeng Lu, Kyusong Lee

XOR QA: Cross-lingual Open-Retrieval Question Answering

Akari Asai, Jungo Kasai, Jonathan Clark, Kenton Lee, Eunsol Choi

QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answering

Michihiro Yasunaga, Hongyu Ren, Antoine Bosselut, Percy Liang, Jure Leskovec

Open-Domain Question Answering Goes Conversational via Question Rewriting

Raviteja Anantha, Svitlana Vakulenko, Zhucheng Tu, Shayne Longpre, Stephen Pulman

Open Domain Question Answering over Tables via Dense Retrieval

Jonathan Herzig, Thomas Müller, Syrine Krichene, Julian Eisenschlos

MetaXL: Meta Representation Transformation for Low-resource Cross-lingual Learning

Mengzhou Xia, Guoqing Zheng, Subhabrata Mukherjee, Milad Shokouhi, Graham Neubig