Phoster

Research and Development

Reinforcement Learning

Introduction

Reinforcement Learning: An Introduction by Richard S. Sutton and Andrew G. Barto and Algorithms for Reinforcement Learning by Csaba Szepesvári.

Multi-armed Bandits

On the Likelihood that One Unknown Probability Exceeds Another in View of the Evidence of Two Samples by William R. Thompson, On the Theory of Apportionment by William R. Thompson, Some Aspects of the Sequential Design of Experiments by Herbert Robbins, A Problem in the Sequential Design of Experiments by Richard Bellman and Bandit Problems: Sequential Allocation of Experiments by Donald A. Berry and Bert Fristedt.

Markov Decision Processes

A Markovian Decision Process by Richard Bellman, Dynamic Programming and Markov Processes by Ronald A. Howard, Learning Machines: A Unified View by John H. Andreae, A Set of Successive Approximation Methods for Discounted Markovian Decision Problems by Johannes A. E. E. van Nunen and Modified Policy Iteration Algorithms for Discounted Markov Decision Problems by Martin L. Puterman and Moon C. Shin.

Learning Automata

Learning Automata - A Survey by Kumpati S. Narendra and Mandayam A. L. Thathachar and Learning Automata: An Introduction by Kumpati S. Narendra and Mandayam A. L. Thathachar.

Dynamic Programming

Dynamic Programming by Richard Bellman, Dynamic Programming by Ronald A. Howard and Learning from Delayed Rewards by Christopher J. C. H. Watkins.

Monte Carlo Methods

Monte Carlo Methods by Malvin H. Kalos and Paula A. Whitlock, Monte Carlo Methods by John Hammersley, Simulation and the Monte Carlo Method by Reuven Y. Rubinstein and Dirk P. Kroese, Monte Carlo: Concepts, Algorithms, and Applications by George Fishman and Monte Carlo Statistical Methods by Christian Robert and George Casella.

Temporal-difference Learning

An Adaptive Optimal Controller for Discrete-time Markov Environments by Ian H. Witten, Temporal Credit Assignment in Reinforcement Learning by Richard S. Sutton, Learning to Predict by the Methods of Temporal Differences by Richard S. Sutton and Analysis of Temporal-diffference Learning with Function Approximation by John N. Tsitsiklis and Benjamin Van Roy.

Multi-step Bootstrapping

Learning from Delayed Rewards by Christopher J. C. H. Watkins, Truncating Temporal Differences: On the Efficient Implementation of TD (lambda) for Reinforcement Learning by Pawel Cichosz and Effective Multi-step Temporal-difference Learning for Non-linear Function Approximation by Harm van Seijen.

Exploration versus Exploitation

The Apparent Conflict between Estimation and Control - A Survey of the Two-armed Bandit Problem by Ian H. Witten, Optimal Control Systems by Aleksandr A. Feldbaum and Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence by John H. Holland.

Function Approximation

Issues in Using Function Approximation for Reinforcement Learning by Sebastian Thrun and Anton Schwartz, Residual Algorithms: Reinforcement Learning with Function Approximation by Leemon Baird, Generalization in Reinforcement Learning: Safely Approximating the Value Function by Justin A. Boyan and Andrew W. Moore, An Analysis of Linear Models, Linear Value-function Approximation, and Feature Selection for Reinforcement Learning by Ronald Parr, Lihong Li, Gavin Taylor, Christopher Painter-Wakefield and Michael L. Littman and An Analysis of Reinforcement Learning with Function Approximation by Francisco S. Melo, Sean P. Meyn and M. Isabel Ribeiro.

Policy Optimization

Comparing Policy-gradient Algorithms by Richard S. Sutton, Satinder P. Singh and David A. McAllester, Policy Gradient Methods for Reinforcement Learning with Function Approximation by Richard S. Sutton, David A. McAllester, Satinder P. Singh and Yishay Mansour and A Class of Gradient-estimating Algorithms for Reinforcement Learning in Neural Networks by Ronald J. Williams.

Simulation

Metacontrol for Adaptive Imagination-based Optimization by Jessica B. Hamrick, Andrew J. Ballard, Razvan Pascanu, Oriol Vinyals, Nicolas Heess and Peter W. Battaglia and Imagination-augmented Agents for Deep Reinforcement Learning by Theophane Weber, Sébastien Racanière, David P. Reichert, Lars Buesing, Arthur Guez, Danilo J. Rezende, Adrià P. Badia, Oriol Vinyals, Nicolas Heess, Yujia Li, Razvan Pascanu, Peter W. Battaglia, David Silver and Daan Wierstra.

Planning

Machine Learning Methods for Planning edited by Steven Minton, Reinforcement Learning and Automated Planning: A Survey by Ioannis Partalas, Dimitris Vrakas and Ioannis Vlahavas, Combining Reinforcement Learning with Symbolic Planning by Matthew Grounds and Daniel Kudenko, Learning Model-based Planning from Scratch by Razvan Pascanu, Yujia Li, Oriol Vinyals, Nicolas Heess, Lars Buesing, Sebastien Racanière, David Reichert, Théophane Weber, Daan Wierstra and Peter Battaglia, The Predictron: End-to-end Learning and Planning by David Silver, Hado van Hasselt, Matteo Hessel, Tom Schaul, Arthur Guez, Tim Harley, Gabriel Dulac-Arnold, David Reichert, Neil Rabinowitz, Andre Barreto and Thomas Degris and Model-based Planning with Discrete and Continuous Actions by Mikael Henaff, William F. Whitney and Yann LeCun.

Multi-objective

Multiobjective Reinforcement Learning: A Comprehensive Overview by Chunming Liu, Xin Xu and Dewen Hu, Empirical Evaluation Methods for Multiobjective Reinforcement Learning Algorithms by Peter Vamplew, Richard Dazeley, Adam Berry, Rustam Issabekov and Evan Dekker and Multi-objective Deep Reinforcement Learning by Hossam Mossalam, Yannis M. Assael, Diederik M. Roijers and Shimon Whiteson.

Multi-agent

Multi-agent Reinforcement Learning: A Critical Survey by Yoav Shoham, Rob Powers and Trond Grenager and A Unified Game-theoretic Approach to Multiagent Reinforcement Learning by Marc Lanctot, Vinicius Zambaldi, Audrunas Gruslys, Angeliki Lazaridou, Karl Tuyls, Julien Perolat, David Silver and Thore Graepel.

Deep Reinforcement Learning

A Brief Survey of Deep Reinforcement Learning by Kai Arulkumaran, Marc P. Deisenroth, Miles Brundage and Anil A. Bharath, Deep Reinforcement Learning by Yuxi Li, Human-level Control through Deep Reinforcement Learning by Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A. Rusu, Joel Veness, Marc G. Bellemare, Alex Graves, Martin Riedmiller, Andreas K. Fidjeland, Georg Ostrovski, Stig Petersen, Charles Beattie, Amir Sadik, Ioannis Antonoglou, Helen King, Dharshan Kumaran, Daan Wierstra, Shane Legg and Demis Hassabis, Massively Parallel Methods for Deep Reinforcement Learning by Arun Nair, Praveen Srinivasan, Sam Blackwell, Cagdas Alcicek, Rory Fearon, Alessandro De Maria, Vedavyas Panneershelvam, Mustafa Suleyman, Charles Beattie, Stig Petersen, Shane Legg, Volodymyr Mnih, Koray Kavukcuoglu and David Silver and IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-learner Architectures by Lasse Espeholt, Hubert Soyer, Remi Munos, Karen Simonyan, Volodymyr Mnih, Tom Ward, Yotam Doron, Vlad Firoiu, Tim Harley, Iain Dunning, Shane Legg and Koray Kavukcuoglu.

Neuroevolution

Evolutionary Neuroscience

Evolutionary Neuroscience edited by Jon H. Kaas, Evolution of the Brain and Intelligence by Harry Jerison, Structure and Evolution of Invertebrate Nervous Systems by Andreas Schmidt-Rhaesa, Steffen Harzsch and Günter Purschke, Brain Organization and the Origin of Insects: An Assessment by Nicholas J. Strausfeld, The Evolution of Brains from Early Mammals to Humans by Jon H. Kaas, The Limbic System in Mammalian Brain Evolution by Roger L. Reep, Barb L. Finlay and Richard B. Darlington, The Anterior Cingulate Cortex: The Evolution of an Interface between Emotion and Cognition by John M. Allman, Atiya Hakeem, Joseph M. Erwin, Esther Nimchinsky and Patrick Hof, Architecture, Neurocytology and Comparative Organization of Monkey and Human Cingulate Cortices by Brent A. Vogt, The Anterior Cingulate Gyrus and the Mechanism of Self-regulation by Michael I. Posner, Mary K. Rothbart, Brad E. Sheese and Yiyuan Tang, Towards a Human Self-regulation System: Common and Distinct Neural Signatures of Emotional and Behavioural Control by Robert Langner, Susanne Leiberg, Felix Hoffstaedter and Simon B. Eickhoff, Evolutionary Developmental Biology Meets the Brain: The Origins of Mammalian Cortex by Harvey J. Karten, The Emergence and Evolution of Mammalian Neocortex by R. Glenn Northcutt and Jon H. Kaas, Evolution of the Neocortex: A Perspective from Developmental Biology by Pasko Rakic, Linked Regularities in the Development and Evolution of Mammalian Brains by Barbara L. Finlay and Richard B. Darlington, Modeling Transformations of Neurodevelopmental Sequences across Mammalian Species by Alan D. Workman, Christine J. Charvet, Barbara Clancy, Richard B. Darlington and Barbara L. Finlay and On the Evolutionary Origins of Executive Functions by Alfredo Ardila.

Developmental Neuroscience

Developmental Biology by Scott Gilbert, Evolutionary Developmental Biology by Brian K. Hall, Developmental Neurobiology edited by Mahendra S. Rao and Marcus Jacobson, Development of the Nervous System by Dan H. Sanes, Thomas A. Reh and William A. Harris, Building Brains: An Introduction to Neural Development by David J. Price, Andrew P. Jarman, John O. Mason and Peter C. Kind, Principles of Neural Development by Dale Purves and Jeff W. Lichtman, Theoretical Models of Neural Development by Geoffrey J. Goodhill and Developmental Cognitive Neuroscience by Mark H. Johnson and Michelle de Haan.

Evolutionary Neurogenetics

Genetic Correlates of the Evolving Primate Brain by Eric J. Vallender, Genetic Basis of Human Brain Evolution by Eric J. Vallender, Nitzan Mekel-Bobrov and Bruce T. Lahn, Neuroscience: Genes and Human Brain Evolution by Daniel H. Geschwind and Genevieve Konopka, Genetic Links between Brain Development and Brain Evolution by Sandra L. Gilbert, William B. Dobyns and Bruce T. Lahn, Genetic Changes Shaping the Human Brain by Byoung-Il Bae, Divya Jayaraman and Christopher A. Walsh and Human-specific Genomic Signatures of Neocortical Expansion by Marta Florio, Victor Borrell and Wieland B. Huttner.

Developmental Neurogenetics

Building Brains: An Introduction to Neural Development by David J. Price, Andrew P. Jarman, John O. Mason and Peter C. Kind, Gene Expression and Cell-cell Interactions in the Developing Nervous System edited by Jean M. Lauder and Phillip G. Nelson and Genetic Links between Brain Development and Brain Evolution by Sandra L. Gilbert, William B. Dobyns and Bruce T. Lahn.

Behavioral Neurogenetics

Embryogenesis of Behavioral Nerve Nets by Roger W. Sperry, An Ethological Approach to the Genetical Study of Human Behavior by Daniel Freedman, Neuro-behavioral Ontogeny: A Synthesis of Ethological and Neurophysiological Concepts by Michael W. Fox, Cellular Mechanisms Underlying Behavior - Neuroethology by Graham Hoyle, The Roles of Experience in the Development of Behavior and the Nervous System by Gilbert Gottlieb, Environmental and Neural Determinants of Behavior in Development by Timothy H. Moran, Structure and Development of Behavior Systems by Jerry A. Hogan, Development of Behavior Systems by Jerry A. Hogan, Behavioral Neurobiology: The Cellular Organization of Natural Behavior by James Park, Blueprints for Behavior: Genetic Specification of Neural Circuitry for Innate Behaviors by Devanand S. Manoli, Geoffrey W. Meissner and Bruce S. Baker and Wired for Behaviors: From Development to Function of Innate Limbic System Circuitry by Katie Sokolowski and Joshua G. Corbin.

Computational Genetics

Modeling and Simulation of Genetic Regulatory Systems: A Literature Review by Hidde De Jong, Genetic Network Modeling by Eugene P. van Someren, Lodewyk F. A. Wessels, Eric Backer and Marcel J. T. Reinders, Computational Modeling of Genetic and Biochemical Networks edited by James M. Bower and Hamid Bolouri, Modelling Gene Networks at Different Organisational Levels by Thomas Schlitt and Alvis Brazma, Current Approaches to Gene Regulatory Network Modelling by Thomas Schlitt and Alvis Brazma and Modelling and Analysis of Gene Regulatory Networks by Guy Karlebach and Ron Shamir.

Computational Neurogenetics

Computational Neurogenetics by Nikola K. Kasabov and Lubica Benuskova and Computational Neurogenetic Modeling by Lubica Benuskova and Nikola K. Kasabov.

Evolutionary Computation

Introduction to Evolutionary Computing by Agoston E. Eiben and James E. Smith, Evolutionary Computation: A Unified Approach by Kenneth A. De Jong, Advances in Evolutionary Computing: Theory and Applications edited by Ashish Ghosh and Shigeyoshi Tsutsui, Evolutionary Algorithms for Solving Multi-objective Problems by Carlos A. Coello Coello, Gary B. Lamont and David A. Van Veldhuizen and Evolving Virtual Creatures by Karl Sims.

Computational Neural Development

Modeling Neural Development edited by Arjen van Ooyen, Using Theoretical Models to Analyse Neural Development by Arjen van Ooyen, Artificial Life Models of Neural Development by Angelo Cangelosi, Stefano Nolfi and Domenico Parisi, Gene Regulation and Biological Development in Neural Networks: An Exploratory Model by Angelo Cangelosi and Jeffrey L. Elman, Artificial Neurogenesis: An Introduction and Selective Review by Taras Kowaliw, Nicolas Bredeche, Sylvain Chevallier and René Doursat, Artificial Development by Simon Harding and Wolfgang Banzhaf, Simulating Evolution with a Computational Model of Embryogeny by Christopher P. Bowers, Using Embryonic Stages to Increase the Evolvability of Development by Diego Federici, Three Ways to Grow Designs: A Comparison of Embryogenies for an Evolutionary Design Problem by Peter Bentley and Sanjeev Kumar and A Taxonomy for Artificial Embryogeny by Kenneth O. Stanley and Risto Miikkulainen.

Neuroevolution

An Overview of Neuroevolution Techniques by Vincent Hoekstra, Neural Architecture Search: A Survey by Thomas Elsken, Jan H. Metzen and Frank Hutter, Evolving Artificial Neural Networks by Xin Yao, A New Evolutionary System for Evolving Artificial Neural Networks by Xin Yao and Yong Liu, A Genetic Programming Approach to Designing Convolutional Neural Network Architectures by Masanori Suganuma, Shinichi Shirakawa and Tomoharu Nagao, An Evolutionary Algorithm that Constructs Recurrent Neural Networks by Peter J. Angeline, Gregory M. Saunders and Jordan B. Pollack, Evolving Neural Networks through Augmenting Topologies by Kenneth O. Stanley and Risto Miikkulainen, Evolving Deep Neural Networks by Risto Miikkulainen, Jason Liang, Elliot Meyerson, Aditya Rawal, Dan Fink, Olivier Francon, Bala Raju, Hormoz Shahrzad, Arshak Navruzyan, Nigel Duffy and Babak Hodjat, Evolutionary Approach to Machine Learning and Deep Neural Networks - Neuro-evolution and Gene Regulatory Networks by Hitoshi Iba, Neuroevolution: From Architectures to Learning by Dario Floreano, Peter Dürr and Claudio Mattiussi, Efficient Reinforcement Learning through Evolving Neural Network Topologies by Kenneth O. Stanley and Risto Miikkulainen, Hierarchical Representations for Efficient Architecture Search by Hanxiao Liu, Karen Simonyan, Oriol Vinyals, Chrisantha Fernando and Koray Kavukcuoglu and Evolving a Neurocontroller through a Process of Embryogeny by Diego Federici.

Computational Neuroethology

Instinct

The Study of Instinct by Nikolaas Tinbergen, Learning and Instinct in Animals by William H. Thorpe and Instinct and Innate Behavior: Toward an Ethological Psychology by Gordon M. Burghardt.

Ethology

The Foundations of Ethology by Konrad Lorenz, Ethology: The Mechanisms and Evolution of Behavior by James L. Gould, Animal Motivation and Cognition by Frederick Toates, Animal Cognition by Kristin Andrews and Ljiljana Radenovic, Animal Behavior by Stephen J. Crowley and Colin Allen, Motivation of Human and Animal Behavior: An Ethological View by Konrad Lorenz and Paul Leyhausen, Ethological Concepts and Human Development by Wagner H. Bridger, On Aims and Methods of Cognitive Ethology by Dale Jamieson and Marc Bekoff and Cognitive Ethology: A New Approach for Studying Human Cognition by Alan Kingstone, Daniel Smilek and John D. Eastwood.

Computational Ethology

Toward a Science of Computational Ethology by David J. Anderson and Pietro Perona, Artificial Ethology by Owen Holland and David McFarland, Lessons from Cognitive Ethology: Animal Models for Ethological Computing by Irene M. Pepperberg and Old Tricks, New Dogs: Ethology and Interactive Creatures by Bruce M. Blumberg.

Neuroethology

What is Neuroethology? by Jörg-Peter Ewert, The Scope of Neuroethology by Graham Hoyle and Neuroethology and the Philosophy of Cognitive Science by Brian L. Keeley.

Computational Neuroethology

Intelligence as Adaptive Behavior: An Experiment in Computational Neuroethology by Randall D. Beer and Computational Neuroethology: A Provisional Manifesto by David Cliff.

Simulation and Machine Ethics

Mental Simulation and Imagination

Handbook of Imagination and Mental Simulation edited by Keith D. Markman, William M. P. Klein and Julie A. Suhr, The Development of Mental Scenario Building and Episodic Foresight by Thomas Suddendorf and Jonathan Redshaw, The Development of Episodic Foresight: Emerging Concepts and Methods by Judith A. Hudson, Estelle M. Mayhew and Janani Prabhakar and Episodic Simulation of Future Events by Daniel L. Schacter, Donna R. Addis and Randy L. Buckner.

Social Cognition and Theory of Mind

The Evolution of Social Cognition by Nathan J. Emery, Theories of Theories of Mind edited by Peter Carruthers and Peter K. Smith, Integrating Simulation and Theory of Mind: From Self to Social Cognition by Christian Keysers and Valeria Gazzola, The Power of Simulation: Imagining One's Own and Other's Behavior by Jean Decety and Julie Grèzes, Social Cognition, Language Acquisition and the Development of the Theory of Mind by Jay L. Garfield, Candida C. Peterson and Tricia Perry, Development of Intersubjectivity in Social Pretend Play by Artin Göncü, Children's Representation of Narrative Perspectives in Storytelling and Pretense in Relation to Theory of Mind by Hande Ilgaz, Development and Neurophysiology of Mentalizing by Uta Frith and Christopher D. Frith, Understanding Other Minds: Perspectives from Developmental Social Neuroscience edited by Simon Baron-Cohen, Michael Lombardo, Helen Tager-Flusberg and Donald Cohen, Developmental Accounts of Theory-of-mind Acquisition: Achieving Clarity via Computational Cognitive Modeling by Paul Bello and Nicholas Cassimatis, Simulating Minds: The Philosophy, Psychology, and Neuroscience of Mindreading by Alvin I. Goldman, Mindreaders: The Cognitive Basis of "Theory of Mind" by Ian Apperly, The Neural Basis of Mentalizing by Christopher D. Frith and Uta Frith, The Neural Correlates of Theory of Mind within Interpersonal Interactions by James K. Rilling, Alan G. Sanfey, Jessica A. Aronson, Leigh E. Nystrom and Jonathan D. Cohen and Neural Correlates of Mentalizing-related Computations during Strategic Interactions in Humans by Alan N. Hampton, Peter Bossaerts and John P. O'Doherty.

Affective Computing

Affective Computing by Rosalind W. Picard, Recognition and Simulation of Emotions by Christian Kleine-Cosack and Mind-reading Machines: Automated Inference of Complex Mental States by Rana A. El-Kaliouby.

Social Simulation and Interactive Narrative

Social Comprehension and Judgment: The Role of Situation Models, Narratives, and Implicit Theories by Robert S. Wyer, Narrative-based Representations of Social Knowledge: Their Construction and Use in Comprehension, Memory, and Judgment by Robert S. Wyer, Rashmi Adaval and Stanley J. Colcombe, The Neural Bases of Social Cognition and Story Comprehension by Raymond A. Mar, Embodied Simulation Theory: Imagination and Narrative by Vittorio Gallese, Simulating Social Complexity by Bruce Edmonds and Ruth Meyer, When does Social Simulation Need Cognitive Models by Nigel Gilbert, Using Cognitive Agents in Social Simulations by Alberto Caballero, Juan Botía and Antonio Gómez-Skarmeta, Cognition and Multi-agent Interaction: From Cognitive Modeling to Social Simulation by Ron Sun, Empathy, Simulation, and Narrative by Shaun Gallagher, Simulation versus Narrative: Introduction to Ludology by Gonzalo Frasca, The Function of Fiction is the Abstraction and Simulation of Social Experience by Raymond A. Mar and Keith Oatley, Fiction: Simulation of Social Worlds by Keith Oatley and Mixing Story and Simulation in Interactive Narrative by Mark O. Riedl, Andrew Stern and Don M. Dini.

Machine Ethics

Architectures for Functional Imagination by Hugo G. Marques and Owen Holland, Simulation-based Internal Models for Safer Robots by Christian Blum, Alan Winfield and Verena V. Hafner, Towards an Ethical Robot: Internal Models, Consequences and Ethical Action Selection by Alan Winfield, Christian Blum and Wenguo Liu and An Architecture for Ethical Robots Inspired by the Simulation Theory of Cognition by Dieter Vanderelst and Alan Winfield.

Ethical Decision Support Systems

Moral Psychology

Atlas of Moral Psychology edited by Kurt Gray and Jesse Graham, The Moral Psychology Handbook by John M. Doris and Moral Psychology: A Contemporary Introduction by Valerie Tiberius.

Moral Reasoning

The Psychology of Moral Reasoning by Monica Bucciarelli, Sangeet Khemlani and Philip N. Johnson-Laird.

Machine Ethics

Machine Ethics edited by Michael Anderson and Susan L. Anderson, The Nature, Importance, and Difficulty of Machine Ethics by James H. Moor, Computational Models of Ethical Reasoning: Challenges, Initial Steps, and Future Directions by Bruce M. McLaren, An Approach to Computing Ethics by Michael Anderson, Susan L. Anderson and Chris Armen, Machine Ethics: Creating an Ethical Intelligent Agent by Michael Anderson and Susan L. Anderson, Machine Morality: Bottom-up and Top-down Approaches for Modelling Human Moral Faculties by Wendell Wallach, Colin Allen and Iva Smit, Formal Verification of Ethical Choices in Autonomous Systems by Louise Dennis, Michael Fisher, Marija Slavkovik and Matt Webster and An Architecture for Ethical Robots Inspired by the Simulation Theory of Cognition by Dieter Vanderelst and Alan Winfield.

Ethical Decision-making

The Psychology of Judgment and Decision Making by Scott Plous, Ethical Decision Making in Organizations: A Person-situation Interactionist Model by Linda K. Trevino, Ethical Decision Making by Individuals in Organizations: An Issue-contingent Model by Thomas M. Jones, Ethical Decision Making: A Review of the Empirical Literature by Robert C. Ford and Woodrow D. Richardson, Ethical Decision‐making Models: A Review of the Literature by R. Rocco Cottone and Ronald E. Claus, A Neurocognitive Model of the Ethical Decision-making Process: Implications for Study and Practice by Scott J. Reynolds and A Conceptual and Computational Model of Moral Decision Making in Human and Artificial Agents by Wendell Wallach, Stan Franklin and Colin Allen.

Decision Support

Can Computer Tools Support Ethical Decision Making? by Kevin Mancherjee and Angela C. Sodan, Supporting Ethical Problem Solving: An Exploratory Investigation by Russell W. Robbins, William A. Wallace and Bill Puka and Towards a Design Science of Ethical Decision Support by Kieran Mathieson.

Collective Intelligence

Emergence and Synergy

Emergence as a Construct: History and Issues by Jeffrey Goldstein, Emergent Processes in Group Behavior by Robert L. Goldstone, Michael E. Roberts and Todd M. Gureckis, The Collaborative Emergence of Group Cognition by Georg Theiner and John Sutton and In Search of Synergy in Small Group Performance by James R. Larson.

Swarm Intelligence

Swarm Intelligence by James Kennedy, Swarm Intelligence: From Natural to Artificial Systems by Eric Bonabeau, Marco Dorigo, Guy Theraulaz and Franziska Klügl, Swarms, Phase Transitions, and Collective Intelligence by Mark M. Millonas and Fundamentals of Computational Swarm Intelligence by Andries P. Engelbrecht.

Collective Animal Behavior

Collective Animal Behavior by David J. T. Sumpter, Collective Cognition in Animal Groups by Iain D. Couzin, Group Decision-making in Animals by Larissa Conradt and Timothy J. Roper and Group Decisions in Humans and Animals: A Survey by Larissa Conradt and Christian List.

Collective Intelligence

An Introduction to Collective Intelligence by David H. Wolpert and Kagan Tumer and Handbook of Collective Intelligence edited by Thomas W. Malone and Michael S. Bernstein.

Distributed Cognition

Cognition in the Wild by Edwin Hutchins, A Brief Introduction to Distributed Cognition by Yvonne Rogers, Distributed Cognition: An Alternative Framework for Analysing and Explaining Collaborative Working by Yvonne Rogers and Judy Ellis and Situation Awareness as Distributed Cognition by Henrik Artman and Christer Garbis.

Group Cognition

Recognizing Group Cognition by Georg Theiner, Colin Allen and Robert L. Goldstone, Varieties of Group Cognition by Georg Theiner, The Collaborative Emergence of Group Cognition by Georg Theiner and John Sutton and The Constitution of Group Cognition by Gerry Stahl.

Group Creativity

Creativity in Groups and Teams by Paul B. Paulus, Timothy S. Larey and Mary T. Dzindolet, Group Composition, Creative Synergy, and Group Performance by Simon Taggar, Enhancing Ideational Creativity in Groups by Paul B. Paulus and Vincent R. Brown, Modeling Cognitive Interactions during Group Brainstorming by Vincent Brown, Michael Tumeo, Timothy S. Larey and Paul B. Paulus and Team Innovation through Collaboration by Claudia A. Sacramento, M. W. Sophie Chang and Michael A. West.

Team Cognition

Team Cognition by Nancy J. Cooke, Jamie C. Gorman, Jennifer L. Winner and Francis T. Durso, Interactive Team Cognition by Nancy J. Cooke, Jamie C. Gorman, Christopher W. Myers and Jasmine L. Duran and Theories of Team Cognition: Cross-disciplinary Perspectives edited by Eduardo Salas, Stephen M. Fiore and Michael P. Letsky.

Organizational Learning

Organizational Learning by Barbara Levitt and James G. March, Organizational Learning: The Contributing Processes and the Literatures by George P. Huber, Organizational Learning: A Review of Some Literatures by Mark Dodgson, The Link between Individual and Organizational Learning by Daniel H. Kim and Organizational Learning: Creating, Retaining and Transferring Knowledge by Linda Argote.

Organizational Intelligence

The Pursuit of Organizational Intelligence: Decisions and Learning in Organizations by James G. March and The Power of Minds at Work: Organizational Intelligence in Action by Karl Albrecht.

Multi-agent Systems and Distributed Artificial Intelligence

Multiagent Systems by Katia P. Sycara, Multi-agent Systems by Wiebe van der Hoek and Michael Wooldridge, Cognition and Multi-agent Interaction: From Cognitive Modeling to Social Simulation edited by Ron Sun, Agent-based Computational Sociology by Flaminio Squazzoni, Multi-agent Systems: An Introduction to Distributed Artificial Intelligence by Jacques Ferber and Gerhard Weiss and Foundations of Distributed Artificial Intelligence edited by Greg M. P. O'Hare and Nicholas R. Jennings.

Sensemaking

Comprehension

Comprehension and Situation Awareness by Francis T. Durso, Katherine A. Rawson and Sara Girotto, Cross-understanding: Implications for Group Cognition and Performance by George P. Huber and Kyle Lewis, Shared Mental Models by Catholijn M. Jonker, Maria Birna van Riemsdijk and Bas Vermeulen, Measuring Shared Team Mental Models: A Meta-analysis by Leslie A. DeChurch and Jessica R. Mesmer-Magnus, Mental Models in Narrative Comprehension by Gordon H. Bower and Daniel G. Morrow and Dimensions of Situation Model Construction in Narrative Comprehension by Rolf A. Zwaan, Joseph P. Magliano and Arthur C. Graesser.

Schemata

Scripts, Plans, Goals and Understanding: An Inquiry into Human Knowledge Structures by Roger C. Schank and Robert P. Abelson, Schemata: The Building Blocks of Cognition by David E. Rumelhart, Psychological Status of the Script Concept by Robert P. Abelson, Stories, Scripts, and Scenes: Aspects of Schema Theory by Jean M. Mandler and Scripts in Organizational Behavior by Dennis A. Gioia and Peter P. Poole.

Framing

Frame Analysis: An Essay on the Organization of Experience by Erving Goffman and Conceptual Issues in Framing Theory: A Systematic Examination of a Decade's Literature by Porismita Borah.

Rhetoric, Discourse and Argumentation

Rhetoric, Discourse and Argument in Organizational Sensemaking: A Reflexive Tale by Tony J. Watson and Representing Reality: Discourse, Rhetoric and Social Construction by Jonathan Potter.

Social Constructionism

An Introduction to Social Constructionism by Vivien Burr, Social Constructionism, Discourse and Realism edited by Ian Parker and The Social Construction of Reality: A Treatise in the Sociology of Knowledge by Peter L. Berger and Thomas Luckmann.

Social Semiotics

Language as Social Semiotic: The Social Interpretation of Language and Meaning by Michael A. K. Halliday and Social Semiotics by Bob Hodge.

Socionarratology

Toward a Socionarratology: New Ways of Analyzing Natural-language Narratives by David Herman, Narrative and Sociology by Matti Hyvärinen and The Narrative Construction of Reality by Jerome Bruner.

Sensemaking

The Social Psychology of Organizing by Karl E. Weick, Sensemaking in Organisations by Karl E. Weick, Organized Sensemaking: A Commentary on Processes of Interpretive Work by Karl E. Weick, Interpretation in Organizations: Sensemaking and Strategy by Susan C. Schneider, Sensemaking by Michael W. Kramer, The Social Processes of Organizational Sensemaking by Sally Maitlis and Narrative Tools to Improve Collaborative Sense-making by Eddie Soulier and Jean Caussanel.

Situation Awareness

Toward a Theory of Situation Awareness in Dynamic Systems by Mica R. Endsley, Theoretical Underpinnings of Situation Awareness: A Critical Review by Mica R. Endsley and Daniel J. Garland, A Cognitive Approach to Situation Awareness: Theory and Application by Sébastien Tremblay, Situation Awareness as Distributed Cognition by Henrik Artman and Christer Garbis and Comprehension and Situation Awareness by Francis T. Durso, Katherine A. Rawson and Sara Girotto.

Narrative Comprehension and Prediction

Comprehension

Narrative Comprehension by Rolf A. Zwaan, Joseph P. Magliano and Arthur C. Graesser, Narrative Comprehension: A Discourse Perspective by Catherine Emmott, Narrative Competence: Play, Storytelling, and Story Comprehension by Lee Galda, Toward a Model of Children's Story Comprehension by Eugene Charniak, Inferential and Memory Skills in Children's Comprehension of Stories by Oakhill Jane, What's in a Story: An Approach to Comprehension and Instruction by Nancy L. Stein and Tom Trabasso, Situation Models and Concepts in Story Comprehension by Arthur C. Graesser and Katja Wiemer-Hastings, Mental Imagery, Text Illustrations, and Children's Story Comprehension and Recall by Linda B. Gambrell and Paula Brooks Jawitz, Imagination and Simulation in Audience Responses to Fiction by Alvin Goldman, The Neural Bases of Social Cognition and Story Comprehension by Raymond A. Mar, The Neuropsychology of Narrative: Story Comprehension, Story Production and Their Interrelation by Raymond A. Mar, Narrative Representation and Comprehension by Arthur C. Graesser, Jonathan M. Golding and Debra L. Long, A Computer's Understanding of Literature by Arthur C. Graesser, Nia Dowell and Christian Moldovan and Cognitive Models of Discourse Comprehension for Narrative Generation by James Niehaus and R. Michael Young.

Mental Models

Mental Models in Narrative Comprehension by Gordon H. Bower and Daniel G. Morrow, Mental Models and Thought Experiments by Nenad Miščević, Thought Experiments and Fictional Narratives by David Davies, Mental Models in Narrative Comprehension by Gordon H. Bower and Daniel G. Morrow and Cognitive Structures in Comprehension and Memory of Narrative Discourse by Perry W. Thorndyke.

Situation Models

Situation Models and Concepts in Story Comprehension by Arthur C. Graesser and Katja Wiemer-Hastings, Updating Situation Models during Narrative Comprehension by Daniel G. Morrow, Gordon H. Bower and Steven L. Greenspan, Working Memory and Situation Model Updating by Gabriel A. Radvansky and David E. Copeland and Updating a Situation Model: A Memory-based Text Processing View by Edward J. O'Brien, Michelle L. Rizzella, Jason E. Albrecht and Jennifer G. Halleran.

Mental Simulation

Handbook of Imagination and Mental Simulation edited by Keith D. Markman, William M. P. Klein and Julie A. Suhr, Reading Imaginatively: The Imagination in Cognitive Science and Cognitive Literary Studies by Emily T. Troscianko, Imagination and Simulation in Audience Responses to Fiction by Alvin I. Goldman, Mental Imagery in the Experience of Literary Narrative: Views from Embodied Cognition by Anežka Kuzmičová, Thought Experiments and Fictional Narratives by David Davies, The Immersed Experiencer: Toward an Embodied Theory of Language Comprehension by Rolf A. Zwaan, The Experiential View of Language Comprehension by Barbara Kaup, Rolf A. Zwaan and Jana Lüdtke, Understanding Scene Descriptions as Event Simulations by David L. Waltz and Imagination in Narratives by Herbert H. Clark and Mija M. Van Der Wege.

Social Cognition

Understanding and Predicting Social Events: The Effects of Narrative Construction on Inference Generation by Kristi A. Costabile and Stanley B. Klein, Advanced Social Cognition in the Literary Arts by Joan Peskin, Raymond A. Mar and Theanna Bischoff, Readers' Trait-based Models of Characters in Narrative Comprehension by David N. Rapp, Richard J. Gerrig and Deborah A. Prentice, Character Profiles and the Activation of Predictive Inferences by Kelly A. Peracchi and Edward J. O'Brien, Narrative-based Representations of Social Knowledge: Their Construction and Use in Comprehension, Memory, and Judgment by Robert S. Wyer, Rashmi Adaval and Stanley J. Colcombe, Social Comprehension and Judgment: The Role of Situation Models, Narratives, and Implicit Theories by Robert S. Wyer and The Neural Bases of Social Cognition and Story Comprehension by Raymond A. Mar.

Schemata

Scripts, Plans, Goals, and Understanding: An Inquiry into Human Knowledge Structures by Roger C. Schank and Robert P. Abelson, Scripts in Memory for Text by Gordon H. Bower, John B. Black and Terrence J. Turner, A Schema-theoretic View of Basic Processes in Reading Comprehension by Richard C. Anderson and P. David Pearson, Role of the Reader's Schema in Comprehension, Learning, and Memory by Richard C. Anderson and Schemata: The Building Blocks by David E. Rumelhart.

Causality

The Perception of Causality by Albert Michotte, Brain Mechanisms Underlying Perceptual Causality by Jonathan A. Fugelsang, Matthew E. Roser, Paul M. Corballis, Michael S. Gazzaniga and Kevin N. Dunbar, How the Brain Perceives Causality: An Event-related fMRI Study by Sarah-Jayne Blakemore, Pierre Fonlupt, Mathilde Pachot-Clouard, Céline Darmon, Pascal Boyer, Andrew N Meltzoff, Christoph Segebarth and Jean Decety, Mental Simulation of Causality by Gary L. Wells and Igor Gavanski, Reasoning about Change: Time and Causation from the Standpoint of Artificial Intelligence by Yoav Shoham, Causation, Prediction, and Search by Peter Spirtes, Clark N. Glymour and Richard Scheines, Categorization as Causal Reasoning by Bob Rehder, The Effect of Context on the Structure of Categories by Emilie M. Roth and Edward J. Shoben, A Causal-model Theory of Conceptual Representation and Categorization by Bob Rehder, Causal Status as a Determinant of Feature Centrality by Woo-kyoung Ahn, Nancy S. Kim, Mary E. Lassaline and Martin J. Dennis, Causality and Model Abstraction by Yumi Iwasaki and Herbert A. Simon, Dynamic Model Abstraction by Kangsun Lee and Paul A. Fishwick, Cause-effect Relation Learning by Zornitsa Kozareva, Automatic Extraction of Causal Relations from Natural Language Texts: A Comprehensive Survey by Nabiha Asghar, The Mental Representation of Narrative Texts as Networks: The Role of Necessity and Sufficiency in the Detection of Different Types of Causal Relations by Isabelle Tapiero, Paul van den Broek and Marie-Pilar Quintana, Causal Cohesion and Story Coherence by Tom Trabasso, Causal Thinking and the Representation of Narrative Events by Tom Trabasso and Paul van den Broek, Causal Relatedness and Importance of Story Events by Tom Trabasso and Linda L. Sperry, Causal Reasoning in the Comprehension of Simple Narrative Texts by Charles R. Fletcher and Charles P. Bloom, The Availability of Causal Information during Reading by Debra L. Long, Mark R. Seely and Brian J. Oppy, Narrative Causalities by Emma Kafalenos, Time, Narrative Sequence and Causality by Marina Grishakova, Causality and Narrative by Jon-K Adams, Causal Inferences and the Comprehension of Narrative Texts by Paul van den Broek and Causality and Imagination by Caren M. Walker and Alison Gopnik.

Prediction

Strategic Production of Predictive Inferences during Comprehension by David Allbritton, The Role of Predictive Inferences in Situation Model Construction by Rebecca Fincher‐Kiefer, Narrative Progression in the Short Story: A Corpus Stylistic Approach by Michael J. Toolan and Story Comprehension for Predicting What Happens Next by Snigdha Chaturvedi, Haoruo Peng and Dan Roth.

Surprise

The Cognitive Structure of Surprise: Looking for Basic Principles by Emiliano Lorini and Cristiano Castelfranchi.

Suspense

Suspense: Conceptualizations, Theoretical Analyses, and Empirical Explorations edited by Peter Vorderer, Hans Jurgen Wulff and Mike Friedrichsen, Toward a General Psychological Model of Tension and Suspense by Moritz Lehne and Stefan Koelsch, Creating Suspense and Surprise in Short Literary Fiction: A Stylistic and Narratological Approach by Yumiko Iwata and A Computational Model of Narrative Generation for Suspense by Yun-Gyung Cheong.

Narrative and Generalization

Introduction

Primitive Culture: Researches into the Development of Mythology, Philosophy, Religion, Art, and Custom by Edward B. Tylor, An Introduction to the Science of Comparative Mythology and Folklore by George W. Cox, The Golden Bough: A Study in Comparative Religion by James G. Frazer, Morphology of the Folktale by Vladimir Propp, The Archetypes and the Collective Unconscious by Carl G. Jung, Archetypal Patterns in Poetry: Psychological Studies of Imagination by Maud Bodkin, The Archetypes of Literature by Northrop Frye, The Structural Study of Myth by Claude Lévi-Strauss, Motif-index of Folk-literature: A Classification of Narrative Elements in Folktales, Ballads, Myths, Fables, Mediaeval Romances, Exempla, Fabliaux, Jest-books and Local Legends by Stith Thompson, The Thirty-six Dramatic Situations by Georges Polti, The Basic Patterns of Plot by William F. Harris, The Seven Basic Plots: Why We Tell Stories by Christopher Booker, 20 Master Plots: And How to Build Them by Ronald B. Tobias, The Hero: A Study in Tradition by Fitzroy R. Somerset and The Hero with a Thousand Faces by Joseph Campbell.

Computer-aided and Automated Text Interpretation

Computer-aided Text Interpretation

Towards a Decision Support System for Text Interpretation by Alessia Bellusci, Andrea Bellandi, Giulia Benotto, Amedeo Cappelli, Emiliano Giovannetti and Simone Marchi and Computer-aided Text Analysis: An Open-aired Laboratory for Social Sciences by Yurij Castelfranchi.

Computer-automated Text Interpretation

Hermeneutics: From Textual Explication to Computer Understanding? by John C. Mallery, Roger Hurwitz and Gavan Duffy and Natural Language Understanding within a Cognitive Semantics Framework by Inger Lytje.