Papers
Debugging Sequence-to-Sequence Models with Seq2Seq-Vis
Hendrik Strobelt, Sebastian Gehrmann, Michael Behrisch et al.
Interpretable Structure Induction via Sparse Attention
Ben Peters, Vlad Niculae, André F. T. Martins
Representation of Word Meaning in the Intermediate Projection Layer of a Neural Language Model
Steven Derby, Paul Miller, Brian Murphy et al.
Explicitly modeling case improves neural dependency parsing
Clara Vania, Adam Lopez
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
Alex Wang, Amanpreet Singh, Julian Michael et al.
Extracting Syntactic Trees from Transformer Encoder Self-Attentions
David Mareček, Rudolf Rosa
State Gradients for RNN Memory Analysis
Lyan Verwimp, Hugo Van hamme, Vincent Renkens et al.
Interpretable Word Embedding Contextualization
Kyoung-Rok Jang, Sung-Hyon Myaeng, Sang-Bum Kim
Probing sentence embeddings for structure-dependent tense
Geoff Bacon, Terry Regier
Predicting and interpreting embeddings for out of vocabulary words in downstream tasks
Nicolas Garneau, Jean-Samuel Leboeuf, Luc Lamontagne
Language Models Learn POS First
Naomi Saphra, Adam Lopez
Interpretable Textual Neuron Representations for NLP
Nina Poerner, Benjamin Roth, Hinrich Schütze
Does it care what you asked? Understanding Importance of Verbs in Deep Learning QA System
Barbara Rychalska, Dominika Basaj, Anna Wróblewska et al.
How much should you ask? On the question structure in QA systems.
Barbara Rychalska, Dominika Basaj, Anna Wróblewska et al.
Learning Explanations from Language Data
David Harbecke, Robert Schwarzenberg, Christoph Alt
Context-Free Transductions with Neural Stacks
Yiding Hao, William Merrill, Dana Angluin et al.
Evaluating Grammaticality in Seq2seq Models with a Broad Coverage HPSG Grammar: A Case Study on Machine Translation
Johnny Wei, Khiem Pham, Brendan O’Connor et al.
An Analysis of Encoder Representations in Transformer-Based Machine Translation
Alessandro Raganato, Jörg Tiedemann
Firearms and Tigers are Dangerous, Kitchen Knives and Zebras are Not: Testing whether Word Embeddings Can Tell
Pia Sommerauer, Antske Fokkens
Importance of Self-Attention for Sentiment Analysis
Gaël Letarte, Frédérik Paradis, Philippe Giguère et al.
Interpreting Word-Level Hidden State Behaviour of Character-Level LSTM Language Models
Avery Hiebert, Cole Peterson, Alona Fyshe et al.
Iterative Recursive Attention Model for Interpretable Sequence Classification
Martin Tutek, Jan Šnajder
Under the Hood: Using Diagnostic Classifiers to Investigate and Improve how Language Models Track Agreement Information
Mario Giulianelli, Jack Harding, Florian Mohnert et al.