Please use this identifier to cite or link to this item: http://doi.org/10.25358/openscience-9806
Authors: Wittenberg, David
Rothlauf, Franz
Gagné, Christian
Title: Denoising autoencoder genetic programming : strategies to control exploration and exploitation in search
Online publication date: 15-Dec-2023
Year of first publication: 2023
Language: english
Abstract: Denoising autoencoder genetic programming (DAE-GP) is a novel neural network-based estimation of distribution genetic programming approach that uses denoising autoencoder long short-term memory networks as a probabilistic model to replace the standard mutation and recombination operators of genetic programming. At each generation, the idea is to capture promising properties of the parent population in a probabilistic model and to use corruption to transfer variations of these properties to the offspring. This work studies the influence of corruption and sampling steps on search. Corruption partially mutates candidate solutions that are used as input to the model, whereas the number of sampling steps defines how often we re-use the output during model sampling as input to the model. We study the generalization of the royal tree problem, the Airfoil problem, and the Pagie-1 problem, and find that both corruption strength and the number of sampling steps influence exploration and exploitation in search and affect performance: exploration increases with stronger corruption and lower number of sampling steps. The results indicate that both corruption and sampling steps are key to the success of the DAE-GP: it permits us to balance the exploration and exploitation behavior in search, resulting in an improved search quality. However, also selection is important for exploration and exploitation and should be chosen wisely.
DDC: 004 Informatik
004 Data processing
330 Wirtschaft
330 Economics
Institution: Johannes Gutenberg-Universität Mainz
Department: FB 03 Rechts- und Wirtschaftswissenschaften
Place: Mainz
ROR: https://ror.org/023b0x485
DOI: http://doi.org/10.25358/openscience-9806
Version: Published version
Publication type: Zeitschriftenaufsatz
License: CC BY
Information on rights of use: https://creativecommons.org/licenses/by/4.0/
Journal: Genetic programming and evolvable machines
24
Pages or article number: 17
Publisher: Springer Science + Business Media B.V.
Publisher place: Dordrecht u.a.
Issue date: 2023
ISSN: 1573-7632
Publisher DOI: 10.1007/s10710-023-09462-2
Appears in collections:DFG-491381577-H

Files in This Item:
  File Description SizeFormat
Thumbnail
denoising_autoencoder_genetic-20231213100011485.pdf1.78 MBAdobe PDFView/Open