EMNLP 2021

1,847 papers

Unsupervised Relation Extraction: A Variational Autoencoder Approach

Chenhan Yuan, Hoda Eldardiry

AttentionRank: Unsupervised Keyphrase Extraction using Self and Cross Attentions

Haoran Ding, Xiao Luo

“It doesn’t look good for a date”: Transforming Critiques into Preferences for Conversational Recommendation Systems

Victor Bursztyn, Jennifer Healey, Nedim Lipka, Eunyee Koh, Doug Downey

Few-Shot Intent Detection via Contrastive Pre-Training and Fine-Tuning

Jianguo Zhang, Trung Bui, Seunghyun Yoon, Xiang Chen, Zhiwei Liu

Contextual Rephrase Detection for Reducing Friction in Dialogue Systems

Zhuoyi Wang, Saurabh Gupta, Jie Hao, Xing Fan, Dingcheng Li

Self-training Improves Pre-training for Few-shot Learning in Task-oriented Dialog Systems

Fei Mi, Wanhao Zhou, Lingjing Kong, Fengyu Cai, Minlie Huang

Iconary: A Pictionary-Based Game for Testing Multimodal Communication with Drawings and Text

Christopher Clark, Jordi Salvador, Dustin Schwenk, Derrick Bonafilia, Mark Yatskar

DIALKI: Knowledge Identification in Conversational Systems through Dialogue-Document Contextualization

Zeqiu Wu, Bo-Ru Lu, Hannaneh Hajishirzi, Mari Ostendorf

CR-Walker: Tree-Structured Graph Reasoning and Dialog Acts for Conversational Recommendation

Wenchang Ma, Ryuichi Takanobu, Minlie Huang

Efficient Contrastive Learning via Novel Data Augmentation and Curriculum Learning

Seonghyeon Ye, Jiseon Kim, Alice Oh

Sentence Bottleneck Autoencoders from Transformer Language Models

Ivan Montero, Nikolaos Pappas, Noah A. Smith

Knowledge-Aware Meta-learning for Low-Resource Text Classification

Huaxiu Yao, Ying-xin Wu, Maruan Al-Shedivat, Eric Xing

Competency Problems: On Finding and Removing Artifacts in Language Data

Matt Gardner, William Merrill, Jesse Dodge, Matthew Peters, Alexis Ross

Foreseeing the Benefits of Incidental Supervision

Hangfeng He, Mingyuan Zhang, Qiang Ning, Dan Roth

Effects of Parameter Norm Growth During Transformer Training: Inductive Bias from Gradient Descent

William Merrill, Vivek Ramanujan, Yoav Goldberg, Roy Schwartz, Noah A. Smith

Cross-Attention is All You Need: Adapting Pretrained Transformers for Machine Translation

Mozhdeh Gheini, Xiang Ren, Jonathan May

Nearest Neighbour Few-Shot Learning for Cross-lingual Classification

M Saiful Bari, Batool Haider, Saab Mansour

Translation-based Supervision for Policy Generation in Simultaneous Neural Machine Translation

Ashkan Alinejad, Hassan S. Shavarani, Anoop Sarkar

HintedBT: Augmenting Back-Translation with Quality and Transliteration Hints

Sahana Ramnath, Melvin Johnson, Abhirut Gupta, Aravindan Raghuveer

Is “moby dick” a Whale or a Bird? Named Entities and Terminology in Speech Translation

Marco Gaido, Susana Rodríguez, Matteo Negri, Luisa Bentivogli, Marco Turchi

Speechformer: Reducing Information Loss in Direct Speech Translation

Sara Papi, Marco Gaido, Matteo Negri, Marco Turchi

Improving Zero-Shot Cross-Lingual Transfer Learning via Robust Training

Kuan-Hao Huang, Wasi Ahmad, Nanyun Peng, Kai-Wei Chang

mT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs

Zewen Chi, Li Dong, Shuming Ma, Shaohan Huang, Saksham Singhal

“Wikily” Supervised Neural Translation Tailored to Cross-Lingual Tasks

Mohammad Sadegh Rasooli, Chris Callison-Burch, Derry Tanti Wijaya

GFST: Gender-Filtered Self-Training for More Accurate Gender in Translation

Prafulla Kumar Choubey, Anna Currey, Prashant Mathur, Georgiana Dinu

Conditional probing: measuring usable information beyond a baseline

John Hewitt, Kawin Ethayarajh, Percy Liang, Christopher Manning

On the Transferability of Adversarial Attacks against Neural Text Classifier

Liping Yuan, Xiaoqing Zheng, Yi Zhou, Cho-jui Hsieh, Kai-Wei Chang

Contrastive Explanations for Model Interpretability

Alon Jacovi, Swabha Swayamdipta, Shauli Ravfogel, Yanai Elazar, Yejin Choi

Sorting through the noise: Testing robustness of information processing in pre-trained language models

Lalchand Pandia, Allyson Ettinger

How much pretraining data do language models need to learn syntax?

Laura Pérez-Mayos, Miguel Ballesteros, Leo Wanner

Evaluating the Robustness of Neural Language Models to Input Perturbations

Milad Moradi, Matthias Samwald

Debiasing Methods in Natural Language Understanding Make Bias More Accessible

Michael Mendelson, Yonatan Belinkov

Achieving Model Robustness through Discrete Adversarial Training

Maor Ivgi, Jonathan Berant

When differential privacy meets NLP: The devil is in the detail

Ivan Habernal

Shortcutted Commonsense: Data Spuriousness in Deep Learning of Commonsense Reasoning

Ruben Branco, António Branco, João António Rodrigues, João Ricardo Silva

ConSeC: Word Sense Disambiguation as Continuous Sense Comprehension

Edoardo Barba, Luigi Procopio, Roberto Navigli

Stepmothers are mean and academics are pretentious: What do pretrained language models learn about you?

Rochelle Choenni, Ekaterina Shutova, Robert Van Rooij

RuleBERT: Teaching Soft Rules to Pre-Trained Language Models

Mohammed Saeed, Naser Ahmadi, Preslav Nakov, Paolo Papotti

Fast, Effective, and Self-Supervised: Transforming Masked Language Models into Universal Lexical and Sentence Encoders

Fangyu Liu, Ivan Vulić, Anna Korhonen, Nigel Collier

Asking It All: Generating Contextualized Questions for any Semantic Role

Valentina Pyatkin, Paul Roit, Julian Michael, Yoav Goldberg, Reut Tsarfaty

Salience-Aware Event Chain Modeling for Narrative Understanding

Xiyang Zhang, Muhao Chen, Jonathan May

Focus on what matters: Applying Discourse Coherence Theory to Cross Document Coreference

William Held, Dan Iter, Dan Jurafsky

Narrative Embedding: Re-Contextualization Through Attention

Sean Wilner, Daniel Woolridge, Madeleine Glick

Weakly supervised discourse segmentation for multiparty oral conversations

Lila Gravellier, Julie Hunter, Philippe Muller, Thomas Pellegrini, Isabelle Ferrané

Conundrums in Event Coreference Resolution: Making Sense of the State of the Art

Jing LU, Vincent Ng

Understanding Politics via Contextualized Discourse Processing

Rajkumar Pujari, Dan Goldwasser

MS-Mentions: Consistently Annotating Entity Mentions in Materials Science Procedural Text

Tim O’Gorman, Zach Jensen, Sheshera Mysore, Kevin Huang, Rubayyat Mahbub

Evaluating the Evaluation Metrics for Style Transfer: A Case Study in Multilingual Formality Transfer

Eleftheria Briakou, Sweta Agrawal, Joel Tetreault, Marine Carpuat

AfroMT: Pretraining Strategies and Reproducible Benchmarks for Translation of 8 African Languages

Machel Reid, Junjie Hu, Graham Neubig, Yutaka Matsuo

Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpus

Jesse Dodge, Maarten Sap, Ana Marasović, William Agnew, Gabriel Ilharco

The Perils of Using Mechanical Turk to Evaluate Open-Ended Text Generation

Marzena Karpinska, Nader Akoury, Mohit Iyyer

A Large-Scale Dataset for Empathetic Response Generation

Anuradha Welivita, Yubo Xie, Pearl Pu

Learning Logic Rules for Document-Level Relation Extraction

Dongyu Ru, Changzhi Sun, Jiangtao Feng, Lin Qiu, Hao Zhou

Zero-Shot Information Extraction as a Unified Text-to-Triple Translation

Chenguang Wang, Xiao Liu, Zui Chen, Haoyun Hong, Jie Tang

Extend, don’t rebuild: Phrasing conditional graph modification as autoregressive sequence labelling

Leon Weber, Jannes Münchmeyer, Samuele Garda, Ulf Leser

Label Verbalization and Entailment for Effective Zero and Few-Shot Relation Extraction

Oscar Sainz, Oier Lopez de Lacalle, Gorka Labaka, Ander Barrena, Eneko Agirre

Feedback Attribution for Counterfactual Bandit Learning in Multi-Domain Spoken Language Understanding

Tobias Falke, Patrick Lehnen

Towards Incremental Transformers: An Empirical Analysis of Transformer Models for Incremental NLU

Patrick Kahardipraja, Brielen Madureira, David Schlangen

We’ve had this conversation before: A Novel Approach to Measuring Dialog Similarity

Ofer Lavi, Ella Rabinovich, Segev Shlomov, David Boaz, Inbal Ronen

ConvFiT: Conversational Fine-Tuning of Pretrained Language Models

Ivan Vulić, Pei-Hao Su, Samuel Coope, Daniela Gerz, Paweł Budzianowski

Cross-lingual Intermediate Fine-tuning improves Dialogue State Tracking

Nikita Moghe, Mark Steedman, Alexandra Birch

Detecting Speaker Personas from Conversational Texts

Jia-Chen Gu, Zhenhua Ling, Yu Wu, Quan Liu, Zhigang Chen

MindCraft: Theory of Mind Modeling for Situated Dialogue in Collaborative Tasks

Cristian-Paul Bara, Sky CH-Wang, Joyce Chai

Contrastive Out-of-Distribution Detection for Pretrained Transformers

Wenxuan Zhou, Fangyu Liu, Muhao Chen

ReGen: Reinforcement Learning for Text and Knowledge Base Generation using Pretrained Language Models

Pierre Dognin, Inkit Padhi, Igor Melnyk, Payel Das

Certified Robustness to Programmable Transformations in LSTMs

Yuhao Zhang, Aws Albarghouthi, Loris D’Antoni

Relational World Knowledge Representation in Contextual Language Models: A Review

Tara Safavi, Danai Koutra

Neural Attention-Aware Hierarchical Topic Model

Yuan Jin, He Zhao, Ming Liu, Lan Du, Wray Buntine

IR like a SIR: Sense-enhanced Information Retrieval for Multiple Languages

Rexhina Blloshmi, Tommaso Pasini, Niccolò Campolungo, Somnath Banerjee, Roberto Navigli

Ultra-High Dimensional Sparse Representations with Binarization for Efficient Text Retrieval

Kyoung-Rok Jang, Junmo Kang, Giwon Hong, Sung-Hyon Myaeng, Joohee Park

Contextualized Query Embeddings for Conversational Search

Sheng-Chieh Lin, Jheng-Hong Yang, Jimmy Lin

Monitoring geometrical properties of word embeddings for detecting the emergence of new topics.

Clément Christophe, Julien Velcin, Jairo Cugliari, Manel Boumghar, Philippe Suignard

Condenser: a Pre-training Architecture for Dense Retrieval

Luyu Gao, Jamie Callan

Revisiting the Uniform Information Density Hypothesis

Clara Meister, Tiago Pimentel, Patrick Haller, Lena Jäger, Ryan Cotterell

A surprisal–duration trade-off across and within the world’s languages

Tiago Pimentel, Clara Meister, Elizabeth Salesky, Simone Teufel, Damian Blasi

Frequency Effects on Syntactic Rule Learning in Transformers

Jason Wei, Dan Garrette, Tal Linzen, Ellie Pavlick

Predicting emergent linguistic compositions through time: Syntactic frame extension via multimodal chaining

Lei Yu, Yang Xu

Learning Universal Authorship Representations

Rafael A. Rivera-Soto, Olivia Elizabeth Miano, Juanita Ordonez, Barry Y. Chen, Aleem Khan

CoPHE: A Count-Preserving Hierarchical Evaluation Metric in Large-Scale Multi-Label Text Classification

Matúš Falis, Hang Dong, Alexandra Birch, Beatrice Alex

Voice Query Auto Completion

Raphael Tang, Karun Kumar, Kendra Chalkley, Ji Xin, Liming Zhang

Jump-Starting Item Parameters for Adaptive Language Tests

Arya D. McCarthy, Kevin P. Yancey, Geoffrey T. LaFlair, Jesse Egbert, Manqian Liao

Semantic Novelty Detection in Natural Language Descriptions

Nianzu Ma, Alexander Politowicz, Sahisnu Mazumder, Jiahua Chen, Bing Liu

Memory and Knowledge Augmented Language Models for Inferring Salience in Long-Form Stories

David Wilmot, Frank Keller

SELFEXPLAIN: A Self-Explaining Architecture for Neural Text Classifiers

Dheeraj Rajagopal, Vidhisha Balachandran, Eduard H Hovy, Yulia Tsvetkov

The World of an Octopus: How Reporting Bias Influences a Language Model’s Perception of Color

Cory Paik, Stéphane Aroca-Ouellette, Alessandro Roncone, Katharina Kann

Do Long-Range Language Models Actually Use Long-Range Context?

Simeng Sun, Kalpesh Krishna, Andrew Mattarella-Micke, Mohit Iyyer

Exploring the Role of BERT Token Representations to Explain Sentence Probing Results

Hosein Mohebbi, Ali Modarressi, Mohammad Taher Pilehvar

Disentangling Representations of Text by Masking Transformers

Xiongyi Zhang, Jan-Willem van de Meent, Byron Wallace

The Impact of Positional Encodings on Multilingual Compression

Vinit Ravishankar, Anders Søgaard

Learning Compact Metrics for MT

Amy Pu, Hyung Won Chung, Ankur Parikh, Sebastian Gehrmann, Thibault Sellam

Smelting Gold and Silver for Improved Multilingual AMR-to-Text Generation

Leonardo F. R. Ribeiro, Jonas Pfeiffer, Yue Zhang, Iryna Gurevych

Injecting Entity Types into Entity-Guided Text Generation

Xiangyu Dong, Wenhao Yu, Chenguang Zhu, Meng Jiang

Truth-Conditional Captions for Time Series Data

Harsh Jhamtani, Taylor Berg-Kirkpatrick

Moral Stories: Situated Reasoning about Norms, Intents, Actions, and their Consequences

Denis Emelin, Ronan Le Bras, Jena D. Hwang, Maxwell Forbes, Yejin Choi

Building Adaptive Acceptability Classifiers for Neural NLG

Soumya Batra, Shashank Jain, Peyman Heidari, Ankit Arun, Catharine Youngs

Conditional Poisson Stochastic Beams

Clara Meister, Afra Amini, Tim Vieira, Ryan Cotterell

Active Learning by Acquiring Contrastive Examples

Katerina Margatina, Giorgos Vernikos, Loic Barrault, Nikolaos Aletras

Artificial Text Detection via Examining the Topology of Attention Maps

Laida Kushnareva, Daniil Cherniavskii, Vladislav Mikhailov, Ekaterina Artemova, Serguei Barannikov

The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers

Róbert Csordás, Kazuki Irie, Juergen Schmidhuber

Classification of hierarchical text using geometric deep learning: the case of clinical trials corpus

Sohrab Ferdowsi, Nikolay Borissov, Julien Knafou, Poorya Amini, Douglas Teodoro