View in EDS

Meta-learning in spiking neural networks with reward-modulated STDP.

Saved in:
Bibliographic Details
Title: Meta-learning in spiking neural networks with reward-modulated STDP.
Authors: Gholamzadeh Khoee, Arsham1 (AUTHOR), Javaheri, Alireza2 (AUTHOR), Kheradpisheh, Saeed Reza1,2 (AUTHOR) s_kheradpisheh@sbu.ac.ir, Ganjtabesh, Mohammad1 (AUTHOR)
Source: Neurocomputing. Oct2024, Vol. 600, pN.PAG-N.PAG. 1p.
Subjects: Artificial neural networks, Machine learning, Episodic memory, Prefrontal cortex, Learning ability
Abstract: The human brain constantly learns and rapidly adapts to new situations by integrating acquired knowledge and experiences into memory. Developing this capability in machine learning models is considered an important goal of AI research since deep neural networks perform poorly when there is limited data or when they need to adapt quickly to new unseen tasks. Meta-learning models are proposed to facilitate quick learning in low-data regimes by employing absorbed information from the past. Although some models have recently been introduced that reached high-performance levels, they are not biologically plausible. In our research, we have proposed a bio-plausible meta-learning model inspired by the hippocampus and the prefrontal cortex using spiking neural networks with a reward-based learning system. The major contribution of our work lies in the design of a bio-plausible meta-learning framework that incorporates learning rules such as Spike-Timing-Dependent Plasticity (STDP) and Reward-Modulated STDP (R-STDP). This framework not only reflects biological learning mechanisms more accurately but also attains competitive results comparable to those achieved by traditional gradient descent-based approaches in meta-learning. Our proposed model includes a memory designed to prevent catastrophic forgetting, a phenomenon that occurs when meta-learning models forget what they have learned so far as learning the new task begins. Furthermore, our new model can easily be applied to spike-based neuromorphic devices and enables fast learning in neuromorphic hardware. The implications and predictions of various models for solving few-shot classification tasks are extensively analyzed. Base on the results, our model has demonstrated the ability to compete with the existing state-of-the-art meta-learning techniques, representing a significant step towards creating AI systems that emulate the human brain's ability to learn quickly and efficiently from limited data. • "Higher accuracy & generalization w.r.t SOTA methods in few-shot classification tasks." • "Improved the generalization of meta-SNNs by simulating an efficient episodic memory." • "Demonstrating the potential of using reward-modulated STDP in SNNS for meta-learning." [ABSTRACT FROM AUTHOR]
Copyright of Neurocomputing is the property of Elsevier B.V. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
FullText Text:
  Availability: 0
Header DbId: egs
DbLabel: Engineering Source
An: 178941746
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Meta-learning in spiking neural networks with reward-modulated STDP.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Gholamzadeh+Khoee%2C+Arsham%22">Gholamzadeh Khoee, Arsham</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Javaheri%2C+Alireza%22">Javaheri, Alireza</searchLink><relatesTo>2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Kheradpisheh%2C+Saeed+Reza%22">Kheradpisheh, Saeed Reza</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<i> s_kheradpisheh@sbu.ac.ir</i><br /><searchLink fieldCode="AR" term="%22Ganjtabesh%2C+Mohammad%22">Ganjtabesh, Mohammad</searchLink><relatesTo>1</relatesTo> (AUTHOR)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Neurocomputing%22">Neurocomputing</searchLink>. Oct2024, Vol. 600, pN.PAG-N.PAG. 1p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Artificial+neural+networks%22">Artificial neural networks</searchLink><br /><searchLink fieldCode="DE" term="%22Machine+learning%22">Machine learning</searchLink><br /><searchLink fieldCode="DE" term="%22Episodic+memory%22">Episodic memory</searchLink><br /><searchLink fieldCode="DE" term="%22Prefrontal+cortex%22">Prefrontal cortex</searchLink><br /><searchLink fieldCode="DE" term="%22Learning+ability%22">Learning ability</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: The human brain constantly learns and rapidly adapts to new situations by integrating acquired knowledge and experiences into memory. Developing this capability in machine learning models is considered an important goal of AI research since deep neural networks perform poorly when there is limited data or when they need to adapt quickly to new unseen tasks. Meta-learning models are proposed to facilitate quick learning in low-data regimes by employing absorbed information from the past. Although some models have recently been introduced that reached high-performance levels, they are not biologically plausible. In our research, we have proposed a bio-plausible meta-learning model inspired by the hippocampus and the prefrontal cortex using spiking neural networks with a reward-based learning system. The major contribution of our work lies in the design of a bio-plausible meta-learning framework that incorporates learning rules such as Spike-Timing-Dependent Plasticity (STDP) and Reward-Modulated STDP (R-STDP). This framework not only reflects biological learning mechanisms more accurately but also attains competitive results comparable to those achieved by traditional gradient descent-based approaches in meta-learning. Our proposed model includes a memory designed to prevent catastrophic forgetting, a phenomenon that occurs when meta-learning models forget what they have learned so far as learning the new task begins. Furthermore, our new model can easily be applied to spike-based neuromorphic devices and enables fast learning in neuromorphic hardware. The implications and predictions of various models for solving few-shot classification tasks are extensively analyzed. Base on the results, our model has demonstrated the ability to compete with the existing state-of-the-art meta-learning techniques, representing a significant step towards creating AI systems that emulate the human brain's ability to learn quickly and efficiently from limited data. • "Higher accuracy & generalization w.r.t SOTA methods in few-shot classification tasks." • "Improved the generalization of meta-SNNs by simulating an efficient episodic memory." • "Demonstrating the potential of using reward-modulated STDP in SNNS for meta-learning." [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Neurocomputing is the property of Elsevier B.V. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=178941746
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1016/j.neucom.2024.128173
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 1
        StartPage: N.PAG
    Subjects:
      – SubjectFull: Artificial neural networks
        Type: general
      – SubjectFull: Machine learning
        Type: general
      – SubjectFull: Episodic memory
        Type: general
      – SubjectFull: Prefrontal cortex
        Type: general
      – SubjectFull: Learning ability
        Type: general
    Titles:
      – TitleFull: Meta-learning in spiking neural networks with reward-modulated STDP.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Gholamzadeh Khoee, Arsham
      – PersonEntity:
          Name:
            NameFull: Javaheri, Alireza
      – PersonEntity:
          Name:
            NameFull: Kheradpisheh, Saeed Reza
      – PersonEntity:
          Name:
            NameFull: Ganjtabesh, Mohammad
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 10
              Text: Oct2024
              Type: published
              Y: 2024
          Identifiers:
            – Type: issn-print
              Value: 09252312
          Numbering:
            – Type: volume
              Value: 600
          Titles:
            – TitleFull: Neurocomputing
              Type: main
ResultId 1