Kenneth O. Stanley

Assistant Professor

University of Central Florida School of Electrical Engineering and Computer Science


kstanley@cs.ucf.edu
Office: Harris 332

Vita: PDF

Evolutionary Complexity Research Group (EPlex)

Quick Links: Meeting | Teaching | Research | Service | NEAT Users | HyperNEAT Users | Software/Source Code | Animated Demos | Publications |

Evolutionary Games and Entertainment: Picbreeder | NERO Video Game | Dance Evolution | Galactic Arms Race (GAR) | GAR Interview with AIGameDev.com

Research

I am the director of the Evolutionary Complexity (EPlex) Research Group at UCF. Our research focuses on abstracting the essential properties of natural evolution that made it possible to discover astronomically complex structures such as the human brain.

I developed a method, called NEAT (NeuroEvolution of Augmenting Topologies), that begins evolution with a population of very simple networks and complexifies the networks over generations by adding new neurons and connections.

We recently developed an extension to NEAT called HyperNEAT that can evolve neural networks with millions of connections and exploit geometric regularities in the task domain.. Publications on HyperNEAT include HyperNEAT applied to checkers (AAAI-08), HyperNEAT in multiagent learning (GECCO-08), HyperNEAT applied to a simple vision task with massive scaling (GECCO-07), and HyperNEAT in robot control with differing geometries (GECCO-07). HyperNEAT source code is also available in C# and C++.

I discuss some of my research interests in this interview (9/30/06) conducted by Tom Barbalet for biota.org. (broken link is now fixed 11/2/08)

In this interview (12/11/08) with AIGameDev.com, I discuss Galactic Arms Race and my thoughts on automatic content generation for video games through evolution.

Before joining UCF, I was a member of the UTCS Neural Networks Research Group.

Günter Bachelier created a gallery of computerized portraits of myself , generated through an evolutionary process, as part of our recognition for winning the Best Paper Award at EvoMUSART 2008. Gunter added another set here

Service Activities and Invited Talks

I will be speaking at the 13th Evolutionary Biology Meeting in Marseilles about the CPPN abstraction of development 9/22-9/25.

I delivered an invited plenary lecture on HyperNEAT at the 18th International Conference on Artificial Neural Networks (ICANN 2008).

I am the chair of the IEEE Task Force on Computational Intelligence in Video Games. If you are interested in the combination of AI and video games, please feel free to join the task force by sending me an email

In 2008, I co-chair with Sanjeev Kumar the Generative Developmental Systems track at GECCO-2008. We were founding co-chairs of the track, which is the only exclusive conference venue for papers in GDS, along with Julian Miller in 2007.

I am on the program committee of the AAAI-08 AI Video Competition. Accepted videos will be showcased at AAAI-08 in Chicago, including Shakey awards for the best videos and $3,000 in prizes. Follow the link for submission instructions!

Teaching

Current Semester: Spring 2010: AI for Game Programming (CAP 4053): Syllabus | Lectures and Assignments

Old: Fall 2009: NeuroEvolution and Generative and Developmental Systems (CAP 6616): Syllabus | Lectures and Assignments

Old: Spring 2009: AI for Game Programming (CAP 4053): Syllabus | Lectures and Assignments

Old: Fall 2008: NeuroEvolution and Generative and Developmental Systems (CAP 6616): Syllabus | Lectures and Assignments

Old: Spring 2008: AI for Game Programming (CAP 4932): Syllabus | Lectures and Assignments

Old: Fall 2007: NeuroEvolution and Generative and Developmental Systems (CAP 6616): Syllabus | Lectures and Assignments

Old: Spring 2007: Machine Learning (CAP 5810): Syllabus | Lectures and Assignments

Old: Fall 2006: Topics in NeuroEvolution and Developmental Encoding (CAP 6938): Syllabus | Lectures and Assignments

Machine Learning I (EEL 4818; Undergraduate Honors) Class Homepage (Co-taught with Drs. R. DeMara, M. Georgiopoulos, M. Mollaghasemi, and I. Garibay)

Old: Spring 2006: Topics in NeuroEvolution (CAP 6938)

NEAT and HyperNEAT Users

Derek James runs a NEAT Users Group on Yahoo. Please feel free to join to discuss NEAT or HyperNEAT-related issues.

If you are a NEAT user, or interested in working with NEAT, please see the NEAT Users Page , which includes a helpful FAQ.

New! There is now also a HyperNEAT Users Page

Schedule Meeting

You can schedule a meeting with me here: Online Meeting Schedule (please follow the instructions there)

Note that you must be logged into the EPlex website in order to use this feature. If you see the message, "You are not authorized to view this resource," then you need to log in first and the page will appear. If you do not have a login, please send me an email to schedule a meeting.

Evolutionary Games and Entertainment

Galactic Arms Race

Multiplayer online space combat with evolving weapons!

Picbreeder

Evolve pictures online!

Dance Evolution

Train 3D animated characters to dance to any MIDI song using interactive evolution.

The NERO Video Game

Evolve robots in real time to train for battle!

Software / Source Code

Novelty Search

Novelty Search C++ by Joel Lehman implements the novelty search algorithm introduced by Lehman and Stanley in Exploiting Open-Endedness to Solve Problems Through the Search for Novelty . Experiments in the paper are included in the software release.

HyperNEAT Versions

HyperNEAT is Hypercube-based NeuroEvolution of Augmenting Topologies, a new algorithm for evolving very large neural networks with geometric regularities. More information is available under publications.

NEAT Versions

NEAT-based Genetic Art (CPPN Explorer) Programs and Other CPPN Applications

For an introduction to the theory behind Compositional Pattern Producing Networks (CPPNs), which explains how the patterns produced by these programs are possible to evolve, please refer to our paper Exploiting Regularity Without Development.

Animated Demos

Animations of evolved NEAT neural network behavior: Robot Duel, hall navigation, function approximation, NEAT Hopper, and Peons. Demo formats include GIF animations, .avi movies, and a Windows executable.

The Evolution of a Spaceship

Watch how NEAT neural networks evolved to draw a multi-featured spaceship out of scratch. A fascinating exhibition of complexification and the evolution of form.

Paperback Book Available with Chapter on NEAT

For people who are interested in learning about NEAT, but prefer explanations intended for general audiences to reading research-level papers, I am happy to recommend AI Techniques for Game Programming by Mat Buckland. Most of the final chapter of this book describes NEAT in a fun and simple style. The book also comes with source code. This book is a good resource for hobbyists or video game programmers interested in AI techniques. (Researchers should still refer to the NEAT research publications available below.) It also includes useful introductions to genetic algorithms and neural networks.
To those who already own the book: Feel free to email me questions or ideas you have regarding NEAT. I am happy to receive feedback.

Selected Publications

(For a full list of my publications, including links, please see my vita)

Dissertation

Ph.D. Dissertation: EFFICIENT EVOLUTION OF NEURAL NETWORKS THROUGH COMPLEXIFICATION
Kenneth O. Stanley
Department of Computer Sciences, The University of Texas at Austin
Technical Report~AI-TR-04-39, August 2004.

Journal Papers

Autonomous Evolution of Topographic Regularities in Artificial Neural Networks
Jason Gauci and Kenneth O. Stanley
School of Electrical Engineering and Computer Science, University of Central Florida
To appear in: Neural Computation journal. Cambridge, MA: MIT Press, 2010. Manuscript 38 pages

Automatic Content Generation in the Galactic Arms Race Video Game
Erin J. Hastings, Ratan K. Guha, and Kenneth O. Stanley
School of Electrical Engineering and Computer Science, University of Central Florida
To appear in: IEEE Transactions on Computational Intelligence and AI in Games, volume 4, number 1, New York: IEEE Press, 2009. Manuscript 19 pages

Interactive Evolution of Particle Systems for Computer Graphics and Animation
Erin J. Hastings, Ratan K. Guha, and Kenneth O. Stanley
School of Electrical Engineering and Computer Science, University of Central Florida
To appear in: IEEE Transactions on Evolutionary Computation, New York: IEEE Press, 2009. Manuscript 15 pages

Exploiting Functional Relationships in Musical Composition
Amy K. Hoover and Kenneth O. Stanley
School of Electrical Engineering and Computer Science, University of Central Florida
To appear in: Connection Science Special Issue on Music, Brain, & Cognition. Abington, UK: Taylor & Francis, 2009. Manuscript 33 pages

A Hypercube-Based Indirect Encoding for Evolving Large-Scale Neural Networks
Kenneth O. Stanley, David B. D'Ambrosio, and Jason Gauci
School of Electrical Engineering and Computer Science, University of Central Florida
To appear in: Artificial Life journal. Cambridge, MA: MIT Press, 2009. Manuscript 39 pages

Picbreeder: Collaborative Interactive Evolution of Images
Jimmy Secretan, Nicholas Beato, David B. D'Ambrosio, Adelein Rodriguez, Adam Campbell, and Kenneth O. Stanley
School of Electrical Engineering and Computer Science, University of Central Florida
To appear in: Leonardo (Transactions Section) 41(1), 2007. 2 pages (This article is a short notice written for the transaction section of the journal)

Compositional Pattern Producing Networks: A Novel Abstraction of Development
Kenneth O. Stanley
School of Electrical Engineering and Computer Science, University of Central Florida
In: Genetic Programming and Evolvable Machines Special Issue on Developmental Systems New York, NY: Springer, 2007. 36 pages.

REAL-TIME NEUROEVOLUTION IN THE NERO VIDEO GAME
Kenneth O. Stanley, Bobby D. Bryant, and Risto Miikkulainen
Department of Computer Sciences, The University of Texas at Austin
IEEE Transactions on Evolutionary Computation 9(6): 653-668, December 2005.

COMPETITIVE COEVOLUTION THROUGH EVOLUTIONARY COMPLEXIFICATION
Kenneth O. Stanley and Risto Miikkulainen
Department of Computer Sciences, The University of Texas at Austin
Journal of Artificial Intelligence Research 21: 63-100, 2004.

A TAXONOMY FOR ARTIFICIAL EMBRYOGENY
Kenneth O. Stanley and Risto Miikkulainen
Department of Computer Sciences, The University of Texas at Austin
Artificial Life journal 9(2):93-130, 2003.

EVOLVING NEURAL NETWORKS THROUGH AUGMENTING TOPOLOGIES
Kenneth O. Stanley and Risto Miikkulainen
Department of Computer Sciences, The University of Texas at Austin
Evolutionary Computation 10(2):99-127, 2002.

ONLINE INTERACTIVE NEURO-EVOLUTION
Adrian Agogino(1), Kenneth Stanley(2), and Risto Miikkulainen(2)
(1) Dept. of Electrical and Computer Engineering, The University of Texas at Austin
(2) Department of Computer Sciences, The University of Texas at Austin
Neural Processing Letters 11(1):29-37, 2000.

Conference and Symposium Papers

Evolving Policy Geometry for Scalable Multiagent Learning
David B. D.Ambrosio, Joel Lehman, Sebastian Risi, and Kenneth O. Stanley
School of Electrical Engineering and Computer Science, University of Central Florida
To appear in: Proceedings of the Ninth International Conference on Autonomous Agents and Multiagent Systems (AAMAS-2010). 8 pages.

Learning to Dance through Interactive Evolution
Greg Dubbin and Kenneth O. Stanley
School of Electrical Engineering and Computer Science, University of Central Florida
To appear in: Proceedings of the Eighth European Event on Evolutionary and Biologically Inspired Music, Sound, Art and Design (EvoMUSART 2010). New York, NY: Springer, 2010. 10 pages.

Evolving Content in the Galactic Arms Race Video Game
Erin Hastings, Ratan Guha, and Kenneth O. Stanley
School of Electrical Engineering and Computer Science, University of Central Florida
To appear in: Proceedings of the IEEE Symposium on Computational Intelligence and Games (CIG'09). Piscataway, NJ: IEEE, 2009. 8 pages.
Winner of the Best Paper Award at 2009 IEEE Symposium on Computational Intelligence and Games

Demonstrating Automatic Content Generation in the Galactic Arms Race Video Game
Erin Hastings, Ratan Guha, and Kenneth O. Stanley
School of Electrical Engineering and Computer Science, University of Central Florida
To appear in: Proceedings of the Artificial Intelligence and Interactive Digital Entertainment Conference Demonstration Program (AIIDE.09). Menlo Park, CA:AAAI, 2009. 2 pages.
Note: This paper is a short 2-page synopsis that accompanied a live demonstration booth. See other GAR papers for more complete treatments.

How Novelty Search Escapes the Deceptive Trap of Learning to Learn
Sebastian Risi, Sandy D. Vanderbleek, Charles E. Hughes and Kenneth O. Stanley
School of Electrical Engineering and Computer Science, University of Central Florida
To appear in: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2009). New York, NY: ACM, 2009. 8 pages.
Winner of the Best Paper Award in the Artificial Life, Evolutionary Robotics, Adaptive Behavior, Evolvable Hardware Track at GECCO-2009

Exploiting Open-Endedness to Solve Problems Through the Search for Novelty
Joel Lehman and Kenneth O. Stanley
School of Electrical Engineering and Computer Science, University of Central Florida
To appear in: Proceedings of the Eleventh International Conference on Artificial Life (ALIFE XI). Cambridge MA: MIT Press, 2008. 8 pages.

Generative Encoding for Multiagent Learning
David B. D'Ambrosio and Kenneth O. Stanley
School of Electrical Engineering and Computer Science, University of Central Florida
To appear in: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2008). New York, NY: ACM, 2008. 8 pages.
Accompanied by videos of evolved multiagent behavior.
Winner of the Best Paper Award in Generative and Developmental Systems at GECCO 2008

A Case Study on the Critical Role of Geometric Regularity in Machine Learning
Jason J. Gauci and Kenneth O. Stanley
School of Electrical Engineering and Computer Science, University of Central Florida
To appear in: Proceedings of the Twenty-Third AAAI Conference on Artificial Intelligence (AAAI-2008). Menlo Park, CA: AAAI Press, 2008 (6 pages)

Picbreeder: Evolving Pictures Collaboratively Online
Jimmy Secretan, Nicholas Beato, David B. D'Ambrosio, Adelein Rodriguez, Adam Campbell and Kenneth O. Stanley
School of Electrical Engineering and Computer Science, University of Central Florida
To appear in: Proceedings of Computer Human Interaction Conference (CHI 2008). New York, NY: ACM, 2008 (10 pages)

Scaffolding for Interactively Evolving Novel Drum Tracks for Existing Songs
Amy K. Hoover, Michael P. Rosario, and Kenneth O. Stanley
School of Electrical Engineering and Computer Science, University of Central Florida
In: Proceedings of the Sixth European Workshop on Evolutionary and Biologically Inspired Music, Sound, Art and Design (EvoMUSART 2008). New York, NY: Springer, 2008. 10 pages.
Winner of the Best Paper Award at EvoMUSART 2008

Generating Large-Scale Neural Networks Through Discovering Geometric Regularities
Jason J. Gauci and Kenneth O. Stanley
School of Electrical Engineering and Computer Science, University of Central Florida
To appear in: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2007). New York, NY: ACM, 2007. 8 pages.

A Novel Generative Encoding for Exploiting Neural Network Sensor and Output Geometry
David B. D'Ambrosio and Kenneth O. Stanley
School of Electrical Engineering and Computer Science, University of Central Florida
To appear in: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2007). New York, NY: ACM, 2007. 8 pages.
Nominated for Best Paper Award in the Generative and Developmental Systems track at GECCO-2007

NEAT Particles: Design, Representation, and Animation of Particle System Effects
Erin Hastings, Ratan Guha, and Kenneth O. Stanley
School of Electrical Engineering and Computer Science, University of Central Florida
To appear in: Proceedings of the IEEE Symposium on Computational Intelligence and Games (CIG'07). Piscataway, NJ: IEEE, 2007. 7 pages.

Exploiting Regularity Without Development
Kenneth O. Stanley
School of Electrical Engineering and Computer Science, University of Central Florida
To appear in: Proceedings of the AAAI Fall Symposium on Developmental Systems. Meno Park, CA: AAAI Press, 2006. 8 pages.

EVOLVING NEURAL NETWORK AGENTS IN THE NERO VIDEO GAME
Kenneth O. Stanley, Bobby D. Bryant, and Risto Miikkulainen
Department of Computer Sciences, The University of Texas at Austin
Proceedings of the IEEE 2005 Symposium on Computational Intelligence and Games (CIG'05). Piscataway, NJ: IEEE, 2005.
Winner of the Best Paper Award at CIG'05

RETAINING LEARNED BEHAVIOR DURING REAL-TIME NEUROEVOLUTION
Thomas D'Silva, Roy Janik, Michael Chrien, Kenneth O. Stanley, and Risto Miikkulainen
Department of Computer Sciences, The University of Texas at Austin
In:Proceedings of the Artificial Intelligence and Interactive Digital Entertainment Conference (AIIDE 2005).

REAL-TIME LEARNING IN THE NERO VIDEO GAME
Kenneth O. Stanley, Ryan Cornelius, Risto Miikkulainen, Thomas D'Silva, and Aliza Gold
Department of Computer Sciences, The University of Texas at Austin
In:Proceedings of the Artificial Intelligence and Interactive Digital Entertainment Conference Demonstration Program (AIIDE 2005).
Note: This paper is a short synopsis that accompanied a live demonstration booth

NEUROEVOLUTION OF AN AUTOMOBILE CRASH WARNING SYSTEM
Kenneth O. Stanley, Nate Kohl, Rini Sherony, and Risto Miikkulainen
Department of Computer Sciences, The University of Texas at Austin
In:Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-2005).

AUTOMATIC FEATURE SELECTION IN NEUROEVOLUTION
Shimon Whiteson, Peter Stone, Kenneth O. Stanley, Risto Miikkulainenn and Nate Kohl
Department of Computer Sciences, The University of Texas at Austin
In:Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-2005).

TOWARDS AN EMPIRICAL MEASURE OF EVOLVABILITY
Joseph Reisinger, Kenneth O. Stanley, and Risto Miikkulainenn
Department of Computer Sciences, The University of Texas at Austin
In:Proceedings of the Genetic and Evolutionary Computation Conference Workshop Program (GECCO-2005).

EVOLVING A ROVING EYE FOR GO
Kenneth O. Stanley and Risto Miikkulainen
Department of Computer Sciences, The University of Texas at Austin
Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-2004). New York, NY: Springer-Verlag, 2004.

EXPLOITING MORPHOLOGICAL CONVENTIONS FOR GENETIC REUSE
Kenneth O. Stanley, Joseph Reisinger, and Risto Miikkulainen
Department of Computer Sciences, The University of Texas at Austin
Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-2004) Workshop Program. New York, NY: Springer-Verlag, 2004
GECCO Workshop on Modularity, Regularity, and Hierarchy in Evolutionary Computation

EVOLVING REUSABLE NEURAL MODULES
Joseph Reisinger, Kenneth O. Stanley, and Risto Miikkulainen
Department of Computer Sciences, The University of Texas at Austin
Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-2004). New York, NY: Springer-Verlag, 2004.

AUTOMATIC FEATURE SELECTION IN NEUROEVOLUTION (older workshop version)
Shimon Whiteson, Kenneth O. Stanley, and Risto Miikkulainen
Department of Computer Sciences, The University of Texas at Austin
Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-2004) Workshop Program. New York, NY: Springer-Verlag, 2004
GECCO Workshop on Self-organization in Representations for Evolutionary Algorithms

EVOLVING ADAPTIVE NEURAL NETWORKS WITH AND WITHOUT ADAPTIVE SYNAPSES
Kenneth O. Stanley, Bobby D. Bryant, and Risto Miikkulainen
Department of Computer Sciences, The University of Texas at Austin
Proceedings of the 2003 IEEE Congress on Evolutionary Computation (CEC-2003). Canberra, Australia: IEEE Press, 2003.

ACHIEVING HIGH-LEVEL FUNCTIONALITY THROUGH COMPLEXIFICATION
Kenneth O. Stanley and Risto Miikkulainen
Department of Computer Sciences, The University of Texas at Austin
Proceedings of the AAAI-2003 Spring Symposium on Computational Synthesis. Stanford, CA: AAAI Press, 2003.

EFFICIENT REINFORCEMENT LEARNING THROUGH EVOLVING NEURAL NETWORK TOPOLOGIES
Kenneth O. Stanley and Risto Miikkulainen
Department of Computer Sciences, The University of Texas at Austin
Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-2002). San Francisco, CA: Morgan Kaufmann, 2002.
Winner of the Best Paper Award in Genetic Algorithms

CONTINUAL COEVOLUTION THROUGH COMPLEXIFICATION
Kenneth O. Stanley and Risto Miikkulainen
Department of Computer Sciences, The University of Texas at Austin
Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-2002). San Francisco, CA: Morgan Kaufmann, 2002.

THE DOMINANCE TOURNAMENT METHOD FOR MONITORING PROGRESS IN COEVOLUTION
Kenneth O. Stanley and Risto Miikkulainen
Department of Computer Sciences, The University of Texas at Austin
Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-2002) Workshop Program. San Francisco, CA: Morgan Kaufmann, 2002.
Analysis of Coevolution Workshop Link

EFFICIENT EVOLUTION OF NEURAL NETWORK TOPOLOGIES
Kenneth O. Stanley and Risto Miikkulainen
Department of Computer Sciences, The University of Texas at Austin
Proceedings of the 2002 Congress on Evolutionary Computation (CEC '02). Piscataway, NJ: IEEE, 2002.

Off-topic

The following tech report describes an algorithm for tracking concept drift that is unrelated to NEAT and my usual research:

LEARNING CONCEPT DRIFT WITH A COMMITTEE OF DECISION TREES
Kenneth O. Stanley
Department of Computer Sciences, The University of Texas at Austin
Technical Report AI-03-302, September 2003.

Contact me here:

kstanley@cs.ucf.edu .