Skip to content

Maze experiment results

Brian H. edited this page Aug 7, 2015 · 2 revisions

Results for running the maze experiments with fitness and novelty searches

Medium maze

Both Fitness and Novelty searches were able to solve the maze over all 10 runs. The Novelty search faired better with an average run-time of 3 seconds less (35% improvement) and slightly less complex genome.

Fitness search

maze --config-path "." --archive-path "/tmp/maze-fit" --archive-name "maze" --web-path "/tmp/maze-fit" --best --work-path "/tmp/maze-fit" --check-stop 
Loading maze file: medium_maze.txt
Run   Iters.   Seconds    Nodes     Conns    Fitness   Fail   Comment 
--- --------- --------- --------- --------- --------- ------ ---------
  0        49    17.235        15        37   295.399        
  1        30     8.820        15        35   295.384        
  2        36    11.648        14        34   297.217        
  3        40    12.618        17        37   295.431        
  4        74    23.713        17        43   296.831        
  5        65    19.219        16        37   295.017        
  6        19     5.580        15        32   296.014        
  7        36    10.931        14        32   295.418        
  8        28     8.170        14        34   295.724        
  9        29     8.222        16        42   295.312        

Summary for trials excluding failures (and time for skipped)
      Iters.   Seconds    Nodes     Conns    Fitness
--- --------- --------- --------- --------- ---------
MIN        19     5.580        14        32   295.017        
AVG        41    12.616        15        36   295.775        
MAX        74    23.713        17        43   297.217        
Run Result Run Result
0 5
1 6
2 7
3 8
4 9

Novelty search

 maze --config-path "." --archive-path "/tmp/maze-nov" --archive-name "maze" --web-path "/tmp/maze-nov" --best --work-path "/tmp/maze-nov" --check-stop --novelty
Loading maze file: medium_maze.txt
Run   Iters.   Seconds    Nodes     Conns    Fitness   Fail   Comment 
--- --------- --------- --------- --------- --------- ------ ---------
  0        39    12.365        14        34   295.157        
  1        67    21.040        15        36   295.409        
  2        28     9.239        14        31   296.475        
  3        66    20.505        15        40   295.779        
  4        24     7.211        14        29   297.335        
  5         9     2.256        15        27   295.360        
  6        23     6.721        15        30   295.545        
  7        14     3.638        14        31   297.247        
  8        14     3.813        15        30   296.988        
  9        22     6.339        14        32   297.264        

Summary for trials excluding failures (and time for skipped)
      Iters.   Seconds    Nodes     Conns    Fitness
--- --------- --------- --------- --------- ---------
MIN         9     2.256        14        27   295.157        
AVG        31     9.313        14        32   296.256        
MAX        67    21.040        15        40   297.335        
Run Result Run Result
0 5
1 6
2 7
3 8
4 9