Research and Development

Neurosymbolic Narrative Intelligence


Narrative Intelligence edited by Michael Mateas and Phoebe Sengers and Computational Narrative Intelligence: A Human-centered Goal for Artificial Intelligence by Mark O. Riedl.

Narrative Question Answering

The NarrativeQA Reading Comprehension Challenge by Tomáš Kočiský, Jonathan Schwarz, Phil Blunsom, Chris Dyer, Karl Moritz Hermann, Gábor Melis and Edward Grefenstette, A Corpus and Cloze Evaluation for Deeper Understanding of Commonsense Stories by Nasrin Mostafazadeh, Nathanael Chambers, Xiaodong He, Devi Parikh, Dhruv Batra, Lucy Vanderwende, Pushmeet Kohli and James F. Allen, MovieQA: Understanding Stories in Movies through Question-answering by Makarand Tapaswi, Yukun Zhu, Rainer Stiefelhagen, Antonio Torralba, Raquel Urtasun and Sanja Fidler, MarioQA: Answering Questions by Watching Gameplay Videos by Jonghwan Mun, Paul Hongsuck Seo, Ilchae Jung and Bohyung Han, DramaQA: Character-centered Video Story Understanding with Hierarchical QA by Seongho Choi, Kyoung-Woon On, Yu-Jung Heo, Ahjeong Seo, Youwon Jang, Seungchan Lee, Minsu Lee and Byoung-Tak Zhang, Social-IQ: A Question Answering Benchmark for Artificial Social Intelligence by Amir Zadeh, Michael Chan, Paul Pu Liang, Edmund Tong and Louis-Philippe Morency, Evaluating Theory of Mind in Question Answering by Aida Nematzadeh, Kaylee Burns, Erin Grant, Alison Gopnik and Thomas L. Griffiths, Revisiting the Evaluation of Theory of Mind through Question Answering by Matthew Le, Y-Lan Boureau and Maximilian Nickel, A Read-write Memory Network for Movie Story Understanding by Seil Na, Sangho Lee, Jisung Kim and Gunhee Kim, Multimodal Dual Attention Memory for Video Story Question Answering by Kyung-Min Kim, Seong-Ho Choi, Jin-Hwa Kim and Byoung-Tak Zhang, Movie Question Answering: Remembering the Textual Cues for Layered Visual Contents by Bo Wang, Youjiang Xu, Yahong Han and Richang Hong, Progressive Attention Memory Network for Movie Story Question Answering by Junyeong Kim, Minuk Ma, Kyungsu Kim, Sungjin Kim and Chang D. Yoo and DeepStory: Video Story QA by Deep Embedded Memory Networks by Kyung-Min Kim, Min-Oh Heo, Seong-Ho Choi and Byoung-Tak Zhang.

Narrative Prediction

Neural Networks for Narrative Continuation by Melissa Roemmele, An Encoder-decoder Approach to Predicting Causal Relations in Stories by Melissa Roemmele and Andrew Gordon and Learning to Predict Explainable Plots for Neural Story Generation by Gang Chen, Yang Liu, Huanbo Luan, Meng Zhang, Qun Liu and Maosong Sun.

Narrative Generation

Hierarchical Neural Story Generation by Angela Fan, Mike Lewis and Yann Dauphin, Controllable Neural Story Plot Generation via Reinforcement Learning by Pradyumna Tambwekar, Murtaza Dhuliawala, Lara J. Martin, Animesh Mehta, Brent Harrison and Mark O. Riedl, A Character-centric Neural Model for Automated Story Generation by Danyang Liu, Juntao Li, Meng-Hsuan Yu, Ziming Huang, Gongshen Liu, Dongyan Zhao and Rui Yan, Event Representations for Automated Story Generation with Deep Neural Nets by Lara J. Martin, Prithviraj Ammanabrolu, Xinyu Wang, William Hancock, Shruti Singh, Brent Harrison and Mark O. Riedl, Story Realization: Expanding Plot Events into Sentences by Prithviraj Ammanabrolu, Ethan Tien, Wesley Cheung, Zhaochen Luo, William Ma, Lara J. Martin and Mark O. Riedl and Guided Neural Language Generation for Automated Storytelling by Prithviraj Ammanabrolu, Ethan Tien, Wesley Cheung, Zhaochen Luo, William Ma, Lara J. Martin and Mark O. Riedl.

Interactive Narrative Generation

Toward Automated Quest Generation in Text-adventure Games by Prithviraj Ammanabrolu, William Broniec, Alex Mueller, Jeremy Paul and Mark O. Riedl, Bringing Stories Alive: Generating Interactive Fiction Worlds by Prithviraj Ammanabrolu, Wesley Cheung, Dan Tu, William Broniec and Mark O. Riedl, Generating Interactive Worlds with Text by Angela Fan, Jack Urbanek, Pratik Ringshia, Emily Dinan, Emma Qian, Siddharth Karamcheti, Shrimai Prabhumoye, Douwe Kiela, Tim Rocktäschel, Arthur Szlam and Jason Weston, Illuminating Generalization in Deep Reinforcement Learning through Procedural Level Generation by Niels Justesen, Ruben Rodriguez Torrado, Philip Bontrager, Ahmed Khalifa, Julian Togelius and Sebastian Risi, Obstacle Tower: A Generalization Challenge in Vision, Control, and Planning by Arthur Juliani, Ahmed Khalifa, Vincent-Pierre Berges, Jonathan Harper, Ervin Teng, Hunter Henry, Adam Crespi, Julian Togelius and Danny Lange, The Animal-AI Environment: Training and Testing Animal-like Artificial Cognition by Benjamin Beyret, José Hernández-Orallo, Lucy Cheke, Marta Halina, Murray Shanahan and Matthew Crosby, Procedural Content Generation: From Automatically Generating Game Levels to Increasing Generality in Machine Learning by Sebastian Risi and Julian Togelius, Strategically Training and Evaluating Agents in Procedurally Generated Environments by Richard Everett and Optimising Worlds to Evaluate and Influence Reinforcement Learning Agents by Richard Everett, Adam Cobb, Andrew Markham and Stephen Roberts.

Interactive Narrative Playing

Playing Text-adventure Games with Graph-based Deep Reinforcement Learning by Prithviraj Ammanabrolu and Mark O. Riedl, Comprehensible Context-driven Text Game Playing by Xusen Yin and Jonathan May, NAIL: A General Interactive Fiction Agent by Matthew Hausknecht, Ricky Loynd, Greg Yang, Adith Swaminathan and Jason D. Williams, Playing Atari with Deep Reinforcement Learning by Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou, Daan Wierstra and Martin Riedmiller, Human-level Control through Deep Reinforcement Learning by Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A. Rusu, Joel Veness, Marc G. Bellemare, Alex Graves, Martin Riedmiller, Andreas K. Fidjeland, Georg Ostrovski, Stig Petersen, Charles Beattie, Amir Sadik, Ioannis Antonoglou, Helen King, Dharshan Kumaran, Daan Wierstra, Shane Legg and Demis Hassabis, Deep Learning for Video Game Playing by Niels Justesen, Philip Bontrager, Julian Togelius and Sebastian Risi and A Survey of Deep Reinforcement Learning in Video Games by Kun Shao, Zhentao Tang, Yuanheng Zhu, Nannan Li and Dongbin Zhao.

Visual Narrative

Action Starring Narratives and Events: Structure and Inference in Visual Narrative Comprehension by Neil Cohn and Eva Wittenberg, A Starring Role for Inference in the Neurocognition of Visual Narratives by Neil Cohn, Multi-task Model for Comic Book Image Analysis by Nhu-Van Nguyen, Christophe Rigaud and Jean-Christophe Burie, Computational Approaches to Comics Analysis by Jochen Laubrock and Alexander Dunst and Computational Approaches to Analyzing and Generating Comics by Aditya Upadhyayula, Chris Martens, Rogelio E. Cardona-Rivera, Andrew T. Hendrickson and Neil Cohn.


Art of the Storyboard by John P. Hart and Neural Storyboard Artist: Visualizing Stories with Coherent Image Sequences by Shizhe Chen, Bei Liu, Jianlong Fu, Ruihua Song, Qin Jin, Pingping Lin, Xiaoyu Qi, Chunting Wang and Jin Zhou.


Show Me a Story: Towards Coherent Neural Story Illustration by Hareesh Ravi, Lezi Wang, Carlos Muniz, Leonid Sigal, Dimitris Metaxas and Mubbasir Kapadia and Variational Recurrent Sequence-to-sequence Retrieval for Stepwise Illustration by Vishwash Batra, Aparajita Haldar, Yulan He, Hakan Ferhatosmanoglu, George Vogiatzis and Tanaya Guha.

Narrative Visualization

Towards a Computational Model of Narrative Visualization by Alok Baikadi, Julius Goth, Christopher Mitchell, Eun Ha, Bradford Mott and James Lester, Contextualize, Show and Tell: A Neural Visual Storyteller by Diana Gonzalez-Rico and Gibran Fuentes-Pineda, Show Me a Story: Towards Coherent Neural Story Illustration by Hareesh Ravi, Lezi Wang, Carlos Muniz, Leonid Sigal, Dimitris Metaxas and Mubbasir Kapadia, Neural Storyboard Artist: Visualizing Stories with Coherent Image Sequences by Shizhe Chen, Bei Liu, Jianlong Fu, Ruihua Song, Qin Jin, Pingping Lin, Xiaoyu Qi, Chunting Wang and Jin Zhou and StoryGAN: A Sequential Conditional GAN for Story Visualization by Yitong Li, Zhe Gan, Yelong Shen, Jingjing Liu, Yu Cheng, Yuexin Wu, Lawrence Carin, David Carlson and Jianfeng Gao.

Narrative Transcription

Video Description: A Survey of Methods, Datasets, and Evaluation Metrics by Nayyer Aafaq, Ajmal Mian, Wei Liu, Syed Z. Gilani and Mubarak Shah, Grounded Video Description by Luowei Zhou, Yannis Kalantidis, Xinlei Chen, Jason J. Corso and Marcus Rohrbach, Translating Video Content to Natural Language Descriptions by Marcus Rohrbach, Wei Qiu, Ivan Titov, Stefan Thater, Manfred Pinkal and Bernt Schiele, Translating Videos to Natural Language using Deep Recurrent Neural Networks by Subhashini Venugopalan, Huijuan Xu, Jeff Donahue, Marcus Rohrbach, Raymond Mooney and Kate Saenko, Towards Coherent Natural Language Description of Video Streams by Muhammad U. G. Khan, Lei Zhang and Yoshihiko Gotoh, Coherent Multi-sentence Video Description with Variable Level of Detail by Anna Rohrbach, Marcus Rohrbach, Wei Qiu, Annemarie Friedrich, Manfred Pinkal and Bernt Schiele, Verbalization of 3D Scenes Based on Natural Language Generation Techniques by Vassilios Golfinopoulos, Dimitrios Makris, Georgios Bardis, Georgios Miaoulis and Dimitri Plemenos, From the Event Log of a Social Simulation to Narrative Discourse: Content Planning in Story Generation by Carlos León, Samer Hassan and Pablo Gervás, The "Inverse Hollywood Problem": From Video to Scripts and Storyboards via Causal Analysis by Matthew Brand, The Visuospatial Dimension of Writing by Thierry Olive and Jean-Michel Passerault, Verbal, Visual, and Spatial Working Memory in Written Language Production by Ronald T. Kellogg, Thierry Olive and Annie Piolat, Verbal, Visual, and Spatial Working Memory Demands During Text Composition by Thierry Olive, Ronald T. Kellogg and Annie Piolat and The Contribution of Different Components of Working Memory to Knowledge Transformation During Writing by David Galbraith, Sheila Ford, Gillian Walker and Jessica Ford.

Narrative Summarization

Summarizing Narratives by Wendy G. Lohnert, John B. Black and Brian J. Reiser, Narrative Summarization by Inderjeet Mani, A Framework for Summarizing Game Experiences as Narratives by Yun-Gyung Cheong and R. Michael Young, Automatized Summarization of Multiplayer Games by Peter Mindek, Ivan Viola, Eduard Gröller and Stefan Bruckner, Action Summary for Computer Games: Extracting Action for Spectator Modes and Summaries by Nick Halper and Maic Masuch, Automated Creation of Movie Summaries in Interactive Virtual Environments by Doron Friedman, Ariel Shamir, Yishai Feldman and Tsvi Dagan and Coherent Narrative Summarization with a Cognitive Model by Renxian Zhang, Wenjie Li, Naishi Liu and Dehong Gao.