EMNLP 2021

1,847 papers

Tribrid: Stance Classification with Neural Inconsistency Detection

Song Yang, Jacopo Urbani

Powering Comparative Classification with Sentiment Analysis via Domain Adaptive Knowledge Transfer

Zeyu Li, Yilong Qin, Zihan Liu, Wei Wang

NewsCLIPpings: Automatic Generation of Out-of-Context Multimodal Media

Grace Luo, Trevor Darrell, Anna Rohrbach

VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understanding

Hu Xu, Gargi Ghosh, Po-Yao Huang, Dmytro Okhonko, Armen Aghajanyan

Integrating Visuospatial, Linguistic, and Commonsense Structure into Story Visualization

Adyasha Maharana, Mohit Bansal

Visual News: Benchmark and Challenges in News Image Captioning

Fuxiao Liu, Yinghan Wang, Tianlu Wang, Vicente Ordonez

Residual Adapters for Parameter-Efficient ASR Adaptation to Atypical and Accented Speech

Katrin Tomanek, Vicky Zayats, Dirk Padfield, Kara Vaillancourt, Fadi Biadsy

Interactive Machine Comprehension with Dynamic Knowledge Graphs

Xingdi Yuan

Levenshtein Training for Word-level Quality Estimation

Shuoyang Ding, Marcin Junczys-Dowmunt, Matt Post, Philipp Koehn

Boosting Cross-Lingual Transfer via Self-Learning with Uncertainty Estimation

Liyan Xu, Xuchao Zhang, Xujiang Zhao, Haifeng Chen, Feng Chen

It Is Not As Good As You Think! Evaluating Simultaneous Machine Translation on Interpretation Data

Jinming Zhao, Philip Arthur, Gholamreza Haffari, Trevor Cohn, Ehsan Shareghi

A Generative Framework for Simultaneous Machine Translation

Yishu Miao, Phil Blunsom, Lucia Specia

Controlling Machine Translation for Multiple Attributes with Additive Interventions

Andrea Schioppa, David Vilar, Artem Sokolov, Katja Filippova

BERT, mBERT, or BiBERT? A Study on Contextualized Embeddings for Neural Machine Translation

Haoran Xu, Benjamin Van Durme, Kenton Murray

Multilingual Unsupervised Neural Machine Translation with Denoising Adapters

Ahmet Üstün, Alexandre Berard, Laurent Besacier, Matthias Gallé

CLIFF: Contrastive Learning for Improving Faithfulness and Factuality in Abstractive Summarization

Shuyang Cao, Lu Wang

Finding a Balanced Degree of Automation for Summary Evaluation

Shiyue Zhang, Mohit Bansal

Simple Conversational Data Augmentation for Semi-supervised Abstractive Dialogue Summarization

Jiaao Chen, Diyi Yang

QuestEval: Summarization Asks for Fact-based Evaluation

Thomas Scialom, Paul-Alexis Dray, Sylvain Lamprier, Benjamin Piwowarski, Jacopo Staiano

Aspect-Controllable Opinion Summarization

Reinald Kim Amplayo, Stefanos Angelidis, Mirella Lapata

Adversarial Regularization as Stackelberg Game: An Unrolled Optimization Approach

Simiao Zuo, Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He

Towards Zero-Shot Knowledge Distillation for Natural Language Processing

Ahmad Rashid, Vasileios Lioutas, Abbas Ghaddar, Mehdi Rezagholizadeh

SPECTRA: Sparse Structured Text Rationalization

Nuno M. Guerreiro, André F. T. Martins

Knowledge Base Completion Meets Transfer Learning

Vid Kocijan, Thomas Lukasiewicz

Sparse Attention with Linear Units

Biao Zhang, Ivan Titov, Rico Sennrich

Editing Factual Knowledge in Language Models

Nicola De Cao, Wilker Aziz, Ivan Titov

Cross-Register Projection for Headline Part of Speech Tagging

Adrian Benton, Hanyang Li, Igor Malioutov

StreamHover: Livestream Transcript Summarization and Annotation

SangWoo Cho, Franck Dernoncourt, Tim Ganter, Trung Bui, Nedim Lipka

Timeline Summarization based on Event Graph Compression via Time-Aware Optimal Transport

Manling Li, Tengfei Ma, Mo Yu, Lingfei Wu, Tian Gao

NDH-Full: Learning and Evaluating Navigational Agents on Full-Length Dialogue

Hyounghun Kim, Jialu Li, Mohit Bansal

Weakly-Supervised Visual-Retriever-Reader for Knowledge-based Question Answering

Man Luo, Yankai Zeng, Pratyay Banerjee, Chitta Baral

Mind the Context: The Impact of Contextualization in Neural Module Networks for Grounding Visual Referring Expressions

Arjun Akula, Spandana Gella, Keze Wang, Song-chun Zhu, Siva Reddy

Hitting your MARQ: Multimodal ARgument Quality Assessment in Long Debate Video

Md Kamrul Hasan, James Spann, Masum Hasan, Md Saiful Islam, Kurtis Haut

Sequential Randomized Smoothing for Adversarially Robust Speech Recognition

Raphael Olivier, Bhiksha Raj

Improving Pre-trained Vision-and-Language Embeddings for Phrase Grounding

Zi-Yi Dou, Nanyun Peng

Discovering the Unknown Knowns: Turning Implicit Knowledge in the Dataset into Explicit Training Examples for Visual Question Answering

Jihyung Kil, Cheng Zhang, Dong Xuan, Wei-Lun Chao

Improving Stance Detection with Multi-Dataset Learning and Knowledge Distillation

Yingjie Li, Chenye Zhao, Cornelia Caragea

Does BERT Learn as Humans Perceive? Understanding Linguistic Styles through Lexica

Shirley Anugrah Hayati, Dongyeop Kang, Lyle Ungar

Open Aspect Target Sentiment Classification with Natural Language Prompts

Ronald Seoh, Ian Birle, Mrinal Tak, Haw-Shiuan Chang, Brian Pinette

Think about it! Improving defeasible reasoning by first modeling the question scenario.

Aman Madaan, Niket Tandon, Dheeraj Rajagopal, Peter Clark, Yiming Yang

Structure-aware Fine-tuning of Sequence-to-sequence Transformers for Transition-based AMR Parsing

Jiawei Zhou, Tahira Naseem, Ramon Fernandez Astudillo, Young-Suk Lee, Radu Florian

Flexible Generation of Natural Language Deductions

Kaj Bostrom, Xinyu Zhao, Swarat Chaudhuri, Greg Durrett

Inducing Transformer’s Compositional Generalization Ability via Auxiliary Sequence Prediction Tasks

Yichen Jiang, Mohit Bansal

Implicit Premise Generation with Discourse-aware Commonsense Knowledge Models

Tuhin Chakrabarty, Aadit Trivedi, Smaranda Muresan

On the Benefit of Syntactic Supervision for Cross-lingual Transfer in Semantic Role Labeling

Zhisong Zhang, Emma Strubell, Eduard Hovy

Universal Sentence Representation Learning with Conditional Masked Language Model

Ziyi Yang, Yinfei Yang, Daniel Cer, Jax Law, Eric Darve

Data Collection vs. Knowledge Graph Completion: What is Needed to Improve Coverage?

Kenneth Church, Yuchen Bian

BiSECT: Learning to Split and Rephrase Sentences with Bitexts

Joongwon Kim, Mounica Maddela, Reno Kriz, Wei Xu, Chris Callison-Burch

GupShup: Summarizing Open-Domain Code-Switched Conversations

Laiba Mehnaz, Debanjan Mahata, Rakesh Gosangi, Uma Sushmitha Gunturi, Riya Jain

MultiDoc2Dial: Modeling Dialogues Grounded in Multiple Documents

Song Feng, Siva Sankalp Patel, Hui Wan, Sachindra Joshi

Mitigating False-Negative Contexts in Multi-document Question Answering with Retrieval Marginalization

Ansong Ni, Matt Gardner, Pradeep Dasigi

Simple Entity-Centric Questions Challenge Dense Retrievers

Christopher Sciavolino, Zexuan Zhong, Jinhyuk Lee, Danqi Chen

Single-dataset Experts for Multi-dataset Question Answering

Dan Friedman, Ben Dodge, Danqi Chen

ReasonBERT: Pre-trained to Reason with Distant Supervision

Xiang Deng, Yu Su, Alyssa Lees, You Wu, Cong Yu

Perhaps PTLMs Should Go to School – A Task to Assess Open Book and Closed Book QA

Manuel Ciosici, Joe Cecil, Dong-Ho Lee, Alex Hedges, Marjorie Freedman

Multi-stage Training with Improved Negative Contrast for Neural Passage Retrieval

Jing LU, Gustavo Hernandez Abrego, Ji Ma, Jianmo Ni, Yinfei Yang

FewshotQA: A simple framework for few-shot learning of question answering tasks using pre-trained text-to-text models

Rakesh Chada, Pradeep Natarajan

Summarize-then-Answer: Generating Concise Explanations for Multi-hop Reading Comprehension

Naoya Inoue, Harsh Trivedi, Steven Sinha, Niranjan Balasubramanian, Kentaro Inui

A Scalable Framework for Learning From Implicit User Feedback to Improve Natural Language Understanding in Large-Scale Conversational AI Systems

Sunghyun Park, Han Li, Ameen Patel, Sidharth Mudgal, Sungjin Lee

Evaluating Scholarly Impact: Towards Content-Aware Bibliometrics

Saurav Manchanda, George Karypis

A Semantic Feature-Wise Transformation Relation Network for Automatic Short Answer Grading

Zhaohui Li, Yajur Tomar, Rebecca J. Passonneau

Detecting Health Advice in Medical Research Literature

Yingya Li, Jun Wang, Bei Yu

Navigating the Kaleidoscope of COVID-19 Misinformation Using Deep Learning

Yuanzhi Chen, Mohammad Hasan

Math Word Problem Generation with Mathematical Consistency and Problem Context Constraints

Zichao Wang, Andrew Lan, Richard Baraniuk

IGA: An Intent-Guided Authoring Assistant

Simeng Sun, Wenlong Zhao, Varun Manjunatha, Rajiv Jain, Vlad Morariu

Contrastive Code Representation Learning

Paras Jain, Ajay Jain, Tianjun Zhang, Pieter Abbeel, Joseph Gonzalez

Effective Convolutional Attention Network for Multi-label Clinical Document Classification

Yang Liu, Hua Cheng, Russell Klopfer, Matthew R. Gormley, Thomas Schaaf

Learning to Selectively Learn for Weakly-supervised Paraphrase Generation

Kaize Ding, Dingcheng Li, Alexander Hanbo Li, Xing Fan, Chenlei Guo

Good-Enough Example Extrapolation

Jason Wei

Data and Parameter Scaling Laws for Neural Machine Translation

Mitchell A Gordon, Kevin Duh, Jared Kaplan

Rule-based Morphological Inflection Improves Neural Terminology Translation

Weijia Xu, Marine Carpuat

Analyzing the Surprising Variability in Word Embedding Stability Across Languages

Laura Burdick, Jonathan K. Kummerfeld, Rada Mihalcea

A Large-Scale Study of Machine Translation in Turkic Languages

Jamshidbek Mirzakhalov, Anoop Babu, Duygu Ataman, Sherzod Kariev, Francis Tyers

Classification-based Quality Estimation: Small and Efficient Models for Real-world Applications

Shuo Sun, Ahmed El-Kishky, Vishrav Chaudhary, James Cross, Lucia Specia

Improving Simultaneous Translation by Incorporating Pseudo-References with Fewer Reorderings

Junkun Chen, Renjie Zheng, Atsuhito Kita, Mingbo Ma, Liang Huang

Frustratingly Simple but Surprisingly Strong: Using Language-Independent Features for Zero-shot Cross-lingual Semantic Parsing

Jingfeng Yang, Federico Fancellu, Bonnie Webber, Diyi Yang

A Massively Multilingual Analysis of Cross-linguality in Shared Embedding Space

Alexander Jones, William Yang Wang, Kyle Mahowald

A Simple and Effective Method To Eliminate the Self Language Bias in Multilingual Representations

Ziyi Yang, Yinfei Yang, Daniel Cer, Eric Darve

Diverse Distributions of Self-Supervised Tasks for Meta-Learning in NLP

Trapit Bansal, Karthick Prasad Gunasekaran, Tong Wang, Tsendsuren Munkhdalai, Andrew McCallum

Muppet: Massive Multi-task Representations with Pre-Finetuning

Armen Aghajanyan, Anchit Gupta, Akshat Shrivastava, Xilun Chen, Luke Zettlemoyer

Pairwise Supervised Contrastive Learning of Sentence Representations

Dejiao Zhang, Shang-Wen Li, Wei Xiao, Henghui Zhu, Ramesh Nallapati

Paired Examples as Indirect Supervision in Latent Decision Models

Nitish Gupta, Sameer Singh, Matt Gardner, Dan Roth

Do Transformer Modifications Transfer Across Implementations and Applications?

Sharan Narang, Hyung Won Chung, Yi Tay, Liam Fedus, Thibault Fevry

Gradient-based Adversarial Attacks against Text Transformers

Chuan Guo, Alexandre Sablayrolles, Herve Jegou, Douwe Kiela

TADPOLE: Task ADapted Pre-Training via AnOmaLy DEtection

Vivek Madan, Ashish Khetan, Zohar Karnin

STraTA: Self-Training with Task Augmentation for Better Few-shot Learning

Tu Vu, Minh-Thang Luong, Quoc Le, Grady Simon, Mohit Iyyer

Efficient Nearest Neighbor Language Models

Junxian He, Graham Neubig, Taylor Berg-Kirkpatrick

Continual Few-Shot Learning for Text Classification

Ramakanth Pasunuru, Veselin Stoyanov, Mohit Bansal

Model Selection for Cross-lingual Transfer

Yang Chen, Alan Ritter

Distributionally Robust Multilingual Machine Translation

Chunting Zhou, Daniel Levy, Xian Li, Marjan Ghazvininejad, Graham Neubig

Instance-adaptive training with noise-robust losses against noisy labels

Lifeng Jin, Linfeng Song, Kun Xu, Dong Yu

NegatER: Unsupervised Discovery of Negatives in Commonsense Knowledge Bases

Tara Safavi, Jing Zhu, Danai Koutra

GradTS: A Gradient-Based Automatic Auxiliary Task Selection Method Based on Transformer Networks

Weicheng Ma, Renze Lou, Kai Zhang, Lili Wang, Soroush Vosoughi

Controlled Evaluation of Grammatical Knowledge in Mandarin Chinese Language Models

Yiwen Wang, Jennifer Hu, Roger Levy, Peng Qian

“Average” Approximates “First Principal Component”? An Empirical Analysis on Representations from Neural Language Models

Zihan Wang, Chengyu Dong, Jingbo Shang

Text Counterfactuals via Latent Optimization and Shapley-Guided Search

Xiaoli Fern, Quintin Pope

The Stem Cell Hypothesis: Dilemma behind Multi-Task Learning with Transformer Encoders

Han He, Jinho D. Choi

Human Rationales as Attribution Priors for Explainable Stance Detection

Sahil Jayaram, Emily Allaway

Comparing Text Representations: A Theory-Driven Approach

Gregory Yauney, David Mimno

How Do Neural Sequence Models Generalize? Local and Global Cues for Out-of-Distribution Prediction

D. Anthony Bau, Jacob Andreas