Dieuwke Hupkes

Compute Optimal Scaling of Skills: Knowledge vs Reasoning ACL 2025 Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judges ACL 2025 Lost in Inference: Rediscovering the Role of Natural Language Inference for Large Language Models NAACL 2025 Interpretability of Language Models via Task Spaces ACL 2024 Memorisation Cartography: Mapping out the Memorisation-Generalisation Continuum in Neural Machine Translation EMNLP 2023 Mind the instructions: a holistic evaluation of consistency and interactions in prompt-based learning CoNLL 2023 Neural Agents Struggle to Take Turns in Bidirectional Emergent Communication ICLR 2023 Separating form and meaning: Using self-consistency to quantify task understanding across multiple senses EMNLP 2023 The Validity of Evaluation Results: Assessing Concurrence Across Compositionality Benchmarks CoNLL 2023 Can Transformers Process Recursive Nested Constructions, Like Humans? COLING 2022 Sparse Interventions in Language Models with Differentiable Masking EMNLP 2022 Text Characterization Toolkit (TCT) AACL 2022 The Curious Case of Absolute Position Embeddings EMNLP 2022 The Paradox of the Compositionality of Natural Language: A Neural Machine Translation Case Study ACL 2022 Attention vs non-attention for a Shapley-based explanation method NAACL 2021 Co-evolution of language and agents in referential games EACL 2021 Generalising to German Plural Noun Classes, from the Perspective of a Recurrent Neural Network CoNLL 2021 Language Modelling as a Multi-Task Problem EACL 2021 Language Models Use Monotonicity to Assess NPI Licensing ACL 2021 Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little EMNLP 2021 Compositionality Decomposed: How do Neural Networks Generalise? (Extended Abstract) IJCAI 2020 Internal and external pressures on language emergence: least effort, object constancy and frequency EMNLP 2020 Location Attention for Extrapolation to Longer Sequences ACL 2020 The Grammar of Emergent Languages EMNLP 2020 Analysing Neural Language Models: Contextual Decomposition Reveals Default Reasoning in Number and Gender Assignment CoNLL 2019 Assessing Incrementality in Sequence-to-Sequence Models ACL 2019 On the Realization of Compositionality in Neural Networks ACL 2019 Proceedings of the 2019 ACL Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP ACL 2019 The emergence of number and syntax units in LSTM language models NAACL 2019 Transcoding Compositionally: Using Attention to Find More Generalizable Solutions ACL 2019 Analysing the potential of seq-to-seq models for incremental interpretation in task-oriented dialogue EMNLP 2018 Do Language Models Understand Anything? On the Ability of LSTMs to Understand Negative Polarity Items EMNLP 2018 Under the Hood: Using Diagnostic Classifiers to Investigate and Improve how Language Models Track Agreement Information EMNLP 2018 Visualisation and 'Diagnostic Classifiers' Reveal how Recurrent and Recursive Neural Networks Process Hierarchical Structure (Extended Abstract) IJCAI 2018