Maze experiment results - rqme/neat GitHub Wiki
Results for running the maze experiments with fitness and novelty searches
Medium maze
Both Fitness and Novelty searches were able to solve the maze over all 10 runs. The Novelty search faired better with an average run-time of 3 seconds less (35% improvement) and slightly less complex genome.
Fitness search
maze --config-path "." --archive-path "/tmp/maze-fit" --archive-name "maze" --web-path "/tmp/maze-fit" --best --work-path "/tmp/maze-fit" --check-stop
Loading maze file: medium_maze.txt
Run Iters. Seconds Nodes Conns Fitness Fail Comment
--- --------- --------- --------- --------- --------- ------ ---------
0 49 17.235 15 37 295.399
1 30 8.820 15 35 295.384
2 36 11.648 14 34 297.217
3 40 12.618 17 37 295.431
4 74 23.713 17 43 296.831
5 65 19.219 16 37 295.017
6 19 5.580 15 32 296.014
7 36 10.931 14 32 295.418
8 28 8.170 14 34 295.724
9 29 8.222 16 42 295.312
Summary for trials excluding failures (and time for skipped)
Iters. Seconds Nodes Conns Fitness
--- --------- --------- --------- --------- ---------
MIN 19 5.580 14 32 295.017
AVG 41 12.616 15 36 295.775
MAX 74 23.713 17 43 297.217
Run | Result | Run | Result |
---|---|---|---|
0 | ![]() |
5 | ![]() |
1 | ![]() |
6 | ![]() |
2 | ![]() |
7 | ![]() |
3 | ![]() |
8 | ![]() |
4 | ![]() |
9 | ![]() |
Novelty search
maze --config-path "." --archive-path "/tmp/maze-nov" --archive-name "maze" --web-path "/tmp/maze-nov" --best --work-path "/tmp/maze-nov" --check-stop --novelty
Loading maze file: medium_maze.txt
Run Iters. Seconds Nodes Conns Fitness Fail Comment
--- --------- --------- --------- --------- --------- ------ ---------
0 39 12.365 14 34 295.157
1 67 21.040 15 36 295.409
2 28 9.239 14 31 296.475
3 66 20.505 15 40 295.779
4 24 7.211 14 29 297.335
5 9 2.256 15 27 295.360
6 23 6.721 15 30 295.545
7 14 3.638 14 31 297.247
8 14 3.813 15 30 296.988
9 22 6.339 14 32 297.264
Summary for trials excluding failures (and time for skipped)
Iters. Seconds Nodes Conns Fitness
--- --------- --------- --------- --------- ---------
MIN 9 2.256 14 27 295.157
AVG 31 9.313 14 32 296.256
MAX 67 21.040 15 40 297.335
Run | Result | Run | Result |
---|---|---|---|
0 | ![]() |
5 | ![]() |
1 | ![]() |
6 | ![]() |
2 | ![]() |
7 | ![]() |
3 | ![]() |
8 | ![]() |
4 | ![]() |
9 | ![]() |