← Authors

Frank Keller

66 papers · 2001–2026 · 13 conferences · across top CS/AI conferences

Achievements

πŸƒ Academic Marathon (24) πŸ—ΊοΈ Taxonomy Completionist (70) 🌈 Renaissance Researcher (8) 🐝 Cross-Pollinator (6) πŸŒ‰ Interdisciplinary Bridge 🧭 Keyword Pioneer 🐣 Hot Topic Early Bird 🌍 Conference Polyglot (13) 🀝 Dynamic Duo (12) 🌱 Topic Pioneer πŸ”¬ Deep Specialist (10) 🧬 Topic Evolution πŸ† Keyword Champion (2) ⚑ Prolific Year (5) ❓ The Questioner πŸ“ˆ Trend Setter πŸ”₯ Unstoppable (13) πŸ’Ž Century Club (64) πŸš€ Conference Pioneer πŸ—ƒοΈ Keyword Collector (156)

Conferences

EMNLP (18) ACL (16) NAACL (7) CVPR (4) AAAI (3) COLING (3) EACL (3) ECCV (3) IJCNLP (3) AACL (2) ICCV (2) CONLL (1) IJCAI (1)

Top co-authors

Mirella Lapata (12) Amit Dubey (7) Spandana Gella (5) Laura Sevilla-Lara (5) Desmond Elliott (5) Marcus Rohrbach (4) Patrick Sturt (4) Pinelopi Papalampidi (4) Rohit Saxena (4) Hakan Bilen (4)

Research topics

Digital Humanities (1)

Keywords

multimodal learning (5) video understanding (3) unsupervised learning (3) vision language model (3) coreference resolution (3) bounding box (2) grammar induction (2) abstractive summarization (2) visual reasoning (2) weakly supervised learning (2) text summarization (2) language model (2) vision-language model (2) natural language processing (2) document summarization (2) multi-modal learning (2) object detection (2) action recognition (2) visual storytelling (2) narrative structure (2)

Papers

Contrastive Learning with Narrative Twins for Modeling Story Salience EACL 2026
PosterSum: A Multimodal Benchmark for Scientific Poster Summarization AACL 2025
PosterSum: A Multimodal Benchmark for Scientific Poster Summarization IJCNLP 2025
Predicting Implicit Arguments in Procedural Video Instructions ACL 2025
BookWorm: A Dataset for Character Description and Analysis EMNLP 2024
Efficient Pre-training for Localized Instruction Generation of Procedural Videos ECCV 2024
Causal and Temporal Inference in Visual Question Generation by Utilizing Pre-trained Models ACL 2024
MovieSum: An Abstractive Summarization Dataset for Movie Screenplays ACL 2024
Select and Summarize: Scene Saliency for Movie Script Summarization NAACL 2024
Learning the Effects of Physical Actions in a Multi-modal Environment EACL 2023
Detecting and Grounding Important Characters in Visual Stories AAAI 2023
Who Are You Referring To? Coreference Resolution In Image Narrations ICCV 2023
Meta-learning For Vision-and-language Cross-lingual Transfer EMNLP 2023
Visual Storytelling with Question-Answer Plans EMNLP 2023
Semi-supervised multimodal coreference resolution in image narrations EMNLP 2023
Learning Action Changes by Measuring Verb-Adverb Textual Relationships CVPR 2023
Learn2Augment: Learning to Composite Videos for Data Augmentation in Action Recognition ECCV 2022
CLASTER: Clustering with Reinforcement Learning for Zero-Shot Action Recognition ECCV 2022
Not All Relations Are Equal: Mining Informative Labels for Scene Graph Generation CVPR 2022
Investigating Negation in Pre-trained Vision-and-language Models EMNLP 2021
Movie Summarization via Sparse Graph Construction AAAI 2021
Memory and Knowledge Augmented Language Models for Inferring Salience in Long-Form Stories EMNLP 2021
Modelling Suspense in Short Stories as Uncertainty Reduction over Neural Representation ACL 2020
Heads-up! Unsupervised Constituency Parsing via Self-Attention Heads AACL 2020
Screenplay Summarization Using Latent Narrative Structure ACL 2020
Dependency Grammar Induction with a Neural Variational Transition-Based Parser AAAI 2019
An Imitation Learning Approach to Unsupervised Parsing ACL 2019
Movie Plot Analysis via Turning Point Identification EMNLP 2019
Movie Plot Analysis via Turning Point Identification IJCNLP 2019
Cross-lingual Visual Verb Sense Disambiguation NAACL 2019
An Evaluation of Image-Based Verb Prediction Models against Human Eye-Tracking Data NAACL 2018
Automatic Description Generation from Images: A Survey of Models, Datasets, and Evaluation Measures (Extended Abstract) IJCAI 2017
Extreme Clicking for Efficient Object Annotation ICCV 2017
An Analysis of Action Recognition Datasets for Language and Vision Tasks ACL 2017
Image Pivoting for Learning Multilingual Multimodal Representations EMNLP 2017
Training Object Class Detectors With Click Supervision CVPR 2017
Unsupervised Visual Sense Disambiguation for Verbs using Multimodal Embeddings NAACL 2016
Cross-lingual Transfer of Correlations between Parts of Speech and Gaze Features COLING 2016
We Don't Need No Bounding-Boxes: Training Object Class Detectors Using Only Human Verification CVPR 2016
Modeling Human Reading with Neural Attention EMNLP 2016
Weakly Supervised Part-of-speech Tagging Using Eye-tracking Data ACL 2016
Semantic Role Labeling Improves Incremental Parsing ACL 2015
Semantic Role Labeling Improves Incremental Parsing IJCNLP 2015
Incremental Semantic Role Labeling with Tree Adjoining Grammar EMNLP 2014
Comparing Automatic Evaluation Measures for Image Description ACL 2014
Query-by-Example Image Retrieval using Visual Dependency Representations COLING 2014
Image Description using Visual Dependency Representations EMNLP 2013
Exploring the Utility of Joint Morphological and Syntactic Learning from Child-directed Speech EMNLP 2013
A Model of Discourse Predictions in Human Sentence Processing EMNLP 2011
Cognitively Plausible Models of Human Language Processing ACL 2010
Syntactic and Semantic Factors in Processing Difficulty: An Integrated Measure ACL 2010
Using Foreign Inclusion Detection to Improve Parsing Performance EMNLP 2007
Using Foreign Inclusion Detection to Improve Parsing Performance CONLL 2007
An Information Retrieval Approach to Sense Ranking NAACL 2007
Integrating Syntactic Priming into an Incremental Probabilistic Parser, with an Application to Psycholinguistic Modeling COLING 2006
Modelling Semantic Role Pausibility in Human Sentence Processing EACL 2006
Priming Effects in Combinatory Categorial Grammar EMNLP 2006
Integrating Syntactic Priming into an Incremental Probabilistic Parser, with an Application to Psycholinguistic Modeling ACL 2006
Computational Modelling of Structural Priming in Dialogue NAACL 2006
Parallelism in Coordination as an Instance of Syntactic Priming: Evidence from Corpus-based Modeling EMNLP 2005
Lexicalization in Crosslinguistic Probabilistic Parsing: The Case of French ACL 2005
The Entropy Rate Principle as a Predictor of Processing Effort: An Evaluation against Eye-tracking Data EMNLP 2004
The Web as a Baseline: Evaluating the Performance of Unsupervised Web-based Models for a Range of NLP Tasks NAACL 2004
Probabilistic Parsing for German Using Sister-Head Dependencies ACL 2003
Using the Web to Overcome Data Sparseness EMNLP 2002
Evaluating Smoothing Algorithms against Plausibility Judgements ACL 2001