Explorations of the Semantic Learning Machine Neuroevolution Algorithm: Dynamic Training Data Use, Ensemble Construction Methods, and Deep Learning Perspectives

Ivo Gonçalves, Marta Seca, Mauro Castelli

Research output: Chapter in Book/Report/Conference proceedingChapterpeer-review

Abstract

The recently proposed Semantic Learning Machine (SLM) neuroevolution algorithm is able to construct Neural Networks (NNs) over unimodal error landscapes in any supervised learning problem where the error is measured as a distance to the known targets. This chapter studies how different methods of dynamically using the training data affect the resulting generalization of the SLM algorithm. Across four real-world binary classification datasets, SLM is shown to outperform the Multi-layer Perceptron, with statistical significance, after parameter tuning is performed in both algorithms. Furthermore, this chapter also studies how different ensemble constructions methods influence the resulting generalization. The results show that the stochastic nature of SLM already confers enough diversity to the ensembles such that Bagging and Boosting cannot improve upon a simple averaging ensemble construction method. Finally, some initial results with SLM and Convolutional NNs are presented and future Deep Learning perspectives are discussed.
Original languageEnglish
Title of host publicationGenetic Programming Theory and Practice XVII
Subtitle of host publicationGenetic and Evolutionary Computation
EditorsWolfgang Banzhaf, Erik Goodman, Leigh Sheneman, Leonardo Trujillo, Bill Worzel
PublisherSpringer
Pages39-62
ISBN (Electronic)978-3-030-39958-0
ISBN (Print)978-3-030-39957-3
DOIs
Publication statusPublished - 8 May 2020

Publication series

NameGenetic Programming Theory and Practice XVII
ISSN (Print)1932-0167
ISSN (Electronic)1932-0175

Fingerprint Dive into the research topics of 'Explorations of the Semantic Learning Machine Neuroevolution Algorithm: Dynamic Training Data Use, Ensemble Construction Methods, and Deep Learning Perspectives'. Together they form a unique fingerprint.

Cite this