Towards implementation of residual-feedback GMDH neural network on parallel GPU memory guided by a regression curve.

Saved in:

Bibliographic Details
Title:	Towards implementation of residual-feedback GMDH neural network on parallel GPU memory guided by a regression curve.
Authors:	Brito, Ricardo¹, Fong, Simon¹ ccfong@umac.mo, Cho, Kyungeun², Song, Wei³, Wong, Raymond⁴, Mohammed, Sabah⁵, Fiaidhi, Jinan⁵
Source:	Journal of Supercomputing. Oct2016, Vol. 72 Issue 10, p3993-4020. 28p.
Subjects:	GMDH algorithms, Artificial neural networks, Computer networks, Neural computers, Graphics processing units
Abstract:	GMDH, which stands for Group Method Data Handling, is an evolutionary type of neural network. It has received much attention in the supercomputing research community because of its ability to optimize its internal structure for maximum prediction accuracy. GMDH works by evolving itself from a basic network, expanding its number of neurons and hidden layer until no further performance gain can be obtained. Earlier on, the authors proposed a novel strategy that extends existing GMDH neural network techniques. The new strategy, called residual-feedback, retains and reuses past prediction errors as part of the multivariate sample data that provides relevant multivariate inputs to the GMDH neural networks. This is important because the strength of GMDH, like any neural network, is in predicting outcomes from multivariate data, and it is very noise-tolerant. GMDH is a well-known ensemble type of prediction method that is capable of modeling highly non-linear relations. Maximum accuracy is often achieved by using only the minimum amount of network neurons and simplest layered structure. This paper contributes to the technical design of implementing GMDH on GPU memory where all the weight computations run on parallel GPU memory blocks. It is a first step towards developing complex neural network architecture on GPU with the capability of evolving and expanding its structure to minimally sufficient for obtaining the maximum prediction accuracy based on the given input data. [ABSTRACT FROM AUTHOR]
	Copyright of Journal of Supercomputing is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database:	Engineering Source

Description
Abstract:	GMDH, which stands for Group Method Data Handling, is an evolutionary type of neural network. It has received much attention in the supercomputing research community because of its ability to optimize its internal structure for maximum prediction accuracy. GMDH works by evolving itself from a basic network, expanding its number of neurons and hidden layer until no further performance gain can be obtained. Earlier on, the authors proposed a novel strategy that extends existing GMDH neural network techniques. The new strategy, called residual-feedback, retains and reuses past prediction errors as part of the multivariate sample data that provides relevant multivariate inputs to the GMDH neural networks. This is important because the strength of GMDH, like any neural network, is in predicting outcomes from multivariate data, and it is very noise-tolerant. GMDH is a well-known ensemble type of prediction method that is capable of modeling highly non-linear relations. Maximum accuracy is often achieved by using only the minimum amount of network neurons and simplest layered structure. This paper contributes to the technical design of implementing GMDH on GPU memory where all the weight computations run on parallel GPU memory blocks. It is a first step towards developing complex neural network architecture on GPU with the capability of evolving and expanding its structure to minimally sufficient for obtaining the maximum prediction accuracy based on the given input data. [ABSTRACT FROM AUTHOR]
ISSN:	09208542
DOI:	10.1007/s11227-016-1740-9