Intrinsic plasticity via natural gradient descent with application to drift compensation.
Saved in:
| Title: | Intrinsic plasticity via natural gradient descent with application to drift compensation. |
|---|---|
| Authors: | Neumann, K.1 kneumann@cor-lab.uni-bielefeld.de, Strub, C.1 cstrub@techfak.uni-bielefeld.de, Steil, J.J.1 jsteil@cor-lab.uni-bielefeld.de |
| Source: | Neurocomputing. Jul2013, Vol. 112, p26-33. 8p. |
| Subjects: | Machine learning, Material plasticity, Information theory, Geometric analysis, Performance evaluation, Comparative studies |
| Abstract: | Abstract: This paper investigates the learning dynamics of intrinsic plasticity (IP), which is a learning rule to tune a neuron's activation function such that its output distribution becomes approximately exponentially distributed. The information-geometric properties of intrinsic plasticity are analyzed and the improved natural gradient intrinsic plasticity (NIP) dynamics are evaluated for a variety of input distributions. Together with a further new modification of the IP rule, the high capability of NIP to cope with drift is demonstrated to have superior performance as compared to the standard gradient in experiments with synthetic and real world data. [Copyright &y& Elsevier] |
| Copyright of Neurocomputing is the property of Elsevier B.V. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
Be the first to leave a comment!
