Evolved Recursive Distributed Representations
Author
Grieco, Matthew Victor
Subject
Washington and Lee University -- Honors in Computer Science
Genetic algorithms
Back propagation (Artificial intelligence)
Neural networks (computer science)
Metadata
Show full item recordDescription
Computer Science has become increasingly biologically inspired, with neural networks and evolutionary computing gaining increased prominence in the field. Recently, several difficulties
with modeling connectionist networks and using genetic algorithms to train neural networks were resolved ( or at least the topic of several studies). These problems included how
to create a connectionist model that could represent variable-sized recursive data structures in fixed-width patterns and how genetic algorithms were used to evolve neural networks.
However, no coherent union of these problems has been made. The purpose of this study is to compare Back-Propagation, the classic way to train connectionist networks, to those
Genetic Algorithms used for evolving weight dynamics, a novel way to train connectionist networks on a Recursive Auto-Associative Memory (RAAM) neural network architecture.
The ability of a Genetic Algorithm to train a RAAM network is tested through two different problems. The first comparison is made through a simple auto-association problem where
the fitness of networks trained by Genetic Algorithm's is compared with the fitness of networks trained by back-propagation. Since back-propagation has already been established
to create RAAM networks that can solve novel tasks, it is used here as a benchmark with which to compare RAAM architectures created with evolutionary techniques. Secondly, a
Pursuer/Evader Game is played by RAAM networks trained with a genetic algorithm. The results show that Genetic Algorithms are an effective method to examine the complexity
found in a RAAM network.