Achieving Optimal Accuracy and Robustness Through Tight Excitatory–Inhibitory Balance in Shallow Spiking Recurrent Neural Network.

Saved in:
Bibliographic Details
Title: Achieving Optimal Accuracy and Robustness Through Tight Excitatory–Inhibitory Balance in Shallow Spiking Recurrent Neural Network.
Authors: Li, Shiwen1,2,3 (AUTHOR) shiwenlisw@gmail.com, Wang, Junsong1,2,4 (AUTHOR) wangjunsong@sztu.edu.cn, Zareen, Syeda Shamaila1 (AUTHOR) zareensyedashamaila@sztu.edu.cn
Source: International Journal of Neural Systems. Jun2026, Vol. 36 Issue 6, p1-18. 18p.
Subjects: Neural inhibition, Neural codes, Artificial neural networks, Fault tolerance (Engineering), Computational complexity, Memory
Abstract: Traditional deep neural networks exhibit high computational complexity during training and lack biological interpretability due to their reliance on backpropagation-based methods. Spiking Recurrent Neural Network (SRNN) performs well in processing spatio-temporal information by using discrete spike events. It attracts increasing attention in neural computing due to its biological plausibility and hardware implementation. To improve the performance of SRNN, we propose an excitation–inhibition balanced shallow SRNN (EI-SRNN), which is inspired by the balance of excitation and inhibition in the brain, by optimizing the input currents of reservoir neurons to achieve a tight balanced state. The proposed EI-SRNN achieves optimal accuracy while maintaining low computational complexity, debunking the conventional trade-off between accuracy and robustness. We analyze the neural encoding ability and information memory capacity of the EI-SRNN and compare the performance of the model under different degrees of excitation and inhibition. Our experiments demonstrate that EI-SRNN can have higher neural coding capacity and memory capacity under tight balanced excitatory and inhibitory balanced states, so it can achieve better accuracy while possessing stronger robustness. Furthermore, when the reservoir is dominated by excitatory influences, performance declines faster than when the reservoir is dominated by inhibitory influences. [ABSTRACT FROM AUTHOR]
Copyright of International Journal of Neural Systems is the property of World Scientific Publishing Company and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Description
Abstract:Traditional deep neural networks exhibit high computational complexity during training and lack biological interpretability due to their reliance on backpropagation-based methods. Spiking Recurrent Neural Network (SRNN) performs well in processing spatio-temporal information by using discrete spike events. It attracts increasing attention in neural computing due to its biological plausibility and hardware implementation. To improve the performance of SRNN, we propose an excitation–inhibition balanced shallow SRNN (EI-SRNN), which is inspired by the balance of excitation and inhibition in the brain, by optimizing the input currents of reservoir neurons to achieve a tight balanced state. The proposed EI-SRNN achieves optimal accuracy while maintaining low computational complexity, debunking the conventional trade-off between accuracy and robustness. We analyze the neural encoding ability and information memory capacity of the EI-SRNN and compare the performance of the model under different degrees of excitation and inhibition. Our experiments demonstrate that EI-SRNN can have higher neural coding capacity and memory capacity under tight balanced excitatory and inhibitory balanced states, so it can achieve better accuracy while possessing stronger robustness. Furthermore, when the reservoir is dominated by excitatory influences, performance declines faster than when the reservoir is dominated by inhibitory influences. [ABSTRACT FROM AUTHOR]
ISSN:01290657
DOI:10.1142/S0129065726500176