Frank Keller

Contrastive Learning with Narrative Twins for Modeling Story Salience EACL 2026 PosterSum: A Multimodal Benchmark for Scientific Poster Summarization AACL 2025 PosterSum: A Multimodal Benchmark for Scientific Poster Summarization IJCNLP 2025 Predicting Implicit Arguments in Procedural Video Instructions ACL 2025 BookWorm: A Dataset for Character Description and Analysis EMNLP 2024 Efficient Pre-training for Localized Instruction Generation of Procedural Videos ECCV 2024 Causal and Temporal Inference in Visual Question Generation by Utilizing Pre-trained Models ACL 2024 MovieSum: An Abstractive Summarization Dataset for Movie Screenplays ACL 2024 Select and Summarize: Scene Saliency for Movie Script Summarization NAACL 2024 Learning the Effects of Physical Actions in a Multi-modal Environment EACL 2023 Detecting and Grounding Important Characters in Visual Stories AAAI 2023 Who Are You Referring To? Coreference Resolution In Image Narrations ICCV 2023 Meta-learning For Vision-and-language Cross-lingual Transfer EMNLP 2023 Visual Storytelling with Question-Answer Plans EMNLP 2023 Semi-supervised multimodal coreference resolution in image narrations EMNLP 2023 Learning Action Changes by Measuring Verb-Adverb Textual Relationships CVPR 2023 Learn2Augment: Learning to Composite Videos for Data Augmentation in Action Recognition ECCV 2022 CLASTER: Clustering with Reinforcement Learning for Zero-Shot Action Recognition ECCV 2022 Not All Relations Are Equal: Mining Informative Labels for Scene Graph Generation CVPR 2022 Investigating Negation in Pre-trained Vision-and-language Models EMNLP 2021 Movie Summarization via Sparse Graph Construction AAAI 2021 Memory and Knowledge Augmented Language Models for Inferring Salience in Long-Form Stories EMNLP 2021 Modelling Suspense in Short Stories as Uncertainty Reduction over Neural Representation ACL 2020 Heads-up! Unsupervised Constituency Parsing via Self-Attention Heads AACL 2020 Screenplay Summarization Using Latent Narrative Structure ACL 2020 Dependency Grammar Induction with a Neural Variational Transition-Based Parser AAAI 2019 An Imitation Learning Approach to Unsupervised Parsing ACL 2019 Movie Plot Analysis via Turning Point Identification EMNLP 2019 Movie Plot Analysis via Turning Point Identification IJCNLP 2019 Cross-lingual Visual Verb Sense Disambiguation NAACL 2019 An Evaluation of Image-Based Verb Prediction Models against Human Eye-Tracking Data NAACL 2018 Automatic Description Generation from Images: A Survey of Models, Datasets, and Evaluation Measures (Extended Abstract) IJCAI 2017 Extreme Clicking for Efficient Object Annotation ICCV 2017 An Analysis of Action Recognition Datasets for Language and Vision Tasks ACL 2017 Image Pivoting for Learning Multilingual Multimodal Representations EMNLP 2017 Training Object Class Detectors With Click Supervision CVPR 2017 Unsupervised Visual Sense Disambiguation for Verbs using Multimodal Embeddings NAACL 2016 Cross-lingual Transfer of Correlations between Parts of Speech and Gaze Features COLING 2016 We Don't Need No Bounding-Boxes: Training Object Class Detectors Using Only Human Verification CVPR 2016 Modeling Human Reading with Neural Attention EMNLP 2016 Weakly Supervised Part-of-speech Tagging Using Eye-tracking Data ACL 2016 Semantic Role Labeling Improves Incremental Parsing ACL 2015 Semantic Role Labeling Improves Incremental Parsing IJCNLP 2015 Incremental Semantic Role Labeling with Tree Adjoining Grammar EMNLP 2014 Comparing Automatic Evaluation Measures for Image Description ACL 2014 Query-by-Example Image Retrieval using Visual Dependency Representations COLING 2014 Image Description using Visual Dependency Representations EMNLP 2013 Exploring the Utility of Joint Morphological and Syntactic Learning from Child-directed Speech EMNLP 2013 A Model of Discourse Predictions in Human Sentence Processing EMNLP 2011 Cognitively Plausible Models of Human Language Processing ACL 2010 Syntactic and Semantic Factors in Processing Difficulty: An Integrated Measure ACL 2010 Using Foreign Inclusion Detection to Improve Parsing Performance EMNLP 2007 Using Foreign Inclusion Detection to Improve Parsing Performance CONLL 2007 An Information Retrieval Approach to Sense Ranking NAACL 2007 Integrating Syntactic Priming into an Incremental Probabilistic Parser, with an Application to Psycholinguistic Modeling COLING 2006 Modelling Semantic Role Pausibility in Human Sentence Processing EACL 2006 Priming Effects in Combinatory Categorial Grammar EMNLP 2006 Integrating Syntactic Priming into an Incremental Probabilistic Parser, with an Application to Psycholinguistic Modeling ACL 2006 Computational Modelling of Structural Priming in Dialogue NAACL 2006 Parallelism in Coordination as an Instance of Syntactic Priming: Evidence from Corpus-based Modeling EMNLP 2005 Lexicalization in Crosslinguistic Probabilistic Parsing: The Case of French ACL 2005 The Entropy Rate Principle as a Predictor of Processing Effort: An Evaluation against Eye-tracking Data EMNLP 2004 The Web as a Baseline: Evaluating the Performance of Unsupervised Web-based Models for a Range of NLP Tasks NAACL 2004 Probabilistic Parsing for German Using Sister-Head Dependencies ACL 2003 Using the Web to Overcome Data Sparseness EMNLP 2002 Evaluating Smoothing Algorithms against Plausibility Judgements ACL 2001