week10-neuroevolution

Neuro-Evolution

TensorFlow.js

• Intro to TensorFlow.js video playlist: 6.5 and 6.6 are the most relevant in terms of the Layers API as applied below.
• Demo: Flappy Bird Learning, Code: Flappy Bird Learning
• Demo: Loading Saved Model, Code: Loading Saved Model
• Demo: Steering Evolution, Code: Steering Evolution

Toy-Neural-Network

• Neuro-Evolution Flappy Bird Coding Challenge
  • NeuroEvolution Video Part 1
  • NeuroEvolution Video Part 2
  • NeuroEvolution Video Part 3
  • NeuroEvolution Video Part 4
  • NeuroEvolution Video Part 5
  • NeuroEvolution Training Demo
  • NeuroEvolution Loading Trained Model Demo

Other NeuroEvolution examples

• Flappy Learning by @xviniette
• Asteroids Learning by @xviniette
• steering agent with p5.js by @lazoviccorp
• Snake NeuroEvolution by @emgoz, video demo
• NeuroEvolution playing Super Mario

References

• Evolving Neural Networks through Augmenting Topologies
• Evolving Novel Behaviors via Natural Selection
• Evolution 101: Neuroevolution by Danielle Whittaker
• NeuroEvolution on Wikipedia
• Neuroevolution of augmenting topologies aka NEAT on Wikipedia

Reinforcement Learning / Q-Learning

References

• Simple Reinforcement Learning with Tensorflow Part 0: Q-Learning with Tables and Neural Networks by Arthur Juliani
• Demystifying Deep Reinforcement Learning by Tambet Matiisen
• Playing Atari with Deep Reinforcement Learning (original DeepMind paper, video)
• Pong from Pixels Andrej Karpathy on reinforcement learning in general

Tools and Frameworks

• Unity ml-agents
• OpenAI gym
• REINFORCEjs
• ConvNetJS
• SynapticJS

Examples / Tutorials

• Reinforcement Q-Learning Tutorial
• Udacity's Q Learning example (uses OpenAI gym)
• Javascript Q Table Learning by @aidannelson
• Self-Driving Cars in the browser
• Q Learning Connect 4 (uses SynapticJS)