GECCO2021 - tut121 - Introductory Tutorials - Evolution of Neural Networks

Evolution of Neural Networks (tut121, Introductory Tutorials) Risto Miikkulainen Evolution of artificial neural networks has recently emerged as a powerful technique in two areas. First, while the standard value-function-based reinforcement learning works well when the environment is fully observable, neuroevolution makes it possible to disambiguate hidden state through memory. Such memory makes new applications possible in areas such as robotic control, game playing, and artificial life. Second, deep learning performance depends crucially on the network design, i.e. its architecture, hyperparameters, and other elements. While many such designs are too complex to be optimized by hand, neuroevolution can be used to do so automatically. Such evolutionary AutoML can be used to achieve good deep learning performance even with limited resources, or state=of-the art performance with more effort. It is also possible to optimize other aspects of the architecture, like its size, speed, or fit with hardware.