Metaheuristics and machine learning: an approach with reinforcement learning assisting neural architecture search.
Saved in:
| Title: | Metaheuristics and machine learning: an approach with reinforcement learning assisting neural architecture search. |
|---|---|
| Authors: | Venske, Sandra Mara Scós1,2 (AUTHOR) ssvenske@unicentro.br, de Almeida, Carolina Paula2 (AUTHOR), Delgado, Myriam Regattieri1 (AUTHOR) |
| Source: | Journal of Heuristics. Aug2024, Vol. 30 Issue 3/4, p199-224. 26p. |
| Subjects: | Artificial neural networks, Machine learning, Reinforcement learning, Protein structure prediction, Genetic algorithms, Metaheuristic algorithms, Evolutionary algorithms |
| Abstract: | Methaheuristics (MHs) are techniques widely used for solving complex optimization problems. In recent years, the interest in combining MH and machine learning (ML) has grown. This integration can occur mainly in two ways: ML-in-MH and MH-in-ML. In the present work, we combine the techniques in both ways—ML-in-MH-in-ML, providing an approach in which ML is considered to improve the performance of an evolutionary algorithm (EA), whose solutions encode parameters of an ML model—artificial neural network (ANN). Our approach called TS in EA in ANN employs a reinforcement learning neighborhood (RLN) mutation based on Thompson sampling (TS). TS is a parameterless reinforcement learning method, used here to boost the EA performance. In the experiments, every candidate ANN solves a regression problem known as protein structure prediction deviation. We consider two protein datasets, one with 16,382 and the other with 45,730 samples. The results show that TS in EA in ANN performs significantly better than a canonical genetic algorithm (GA in ANN) and the evolutionary algorithm without reinforcement learning (EA in ANN). Analyses of the parameter's frequency are also performed comparing the approaches. Finally, comparisons with the literature show that except for one particular case in the largest dataset, TS in EA in ANN outperforms other approaches considered the state of the art for the addressed datasets. [ABSTRACT FROM AUTHOR] |
| Copyright of Journal of Heuristics is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
|
Full text is not displayed to guests.
Login for full access.
|
|
Be the first to leave a comment!
