View in EDS

Reinforcement-based processes actively regulate motor exploration along redundant solution manifolds.

Saved in:
Bibliographic Details
Title: Reinforcement-based processes actively regulate motor exploration along redundant solution manifolds.
Authors: Roth, Adam M.1, Calalo, Jan A.1, Lokesh, Rakshith2, Sullivan, Seth R.2, Grill, Stephen3, Jeka, John J.3,4,5, van der Kooij, Katinka6, Carter, Michael J.7, Cashaback, Joshua G. A.1,2,3,4,5 joshcash@udel.edu
Source: Proceedings of the Royal Society B: Biological Sciences. 10/25/2023, Vol. 290 Issue 2009, p1-12. 12p.
Subjects: Random walks, Motor learning, Motor ability, Stochastic processes, Reinforcement (Psychology), Neurological disorders, Songbirds
Abstract: From a baby's babbling to a songbird practising a new tune, exploration is critical to motor learning. A hallmark of exploration is the emergence of random walk behaviour along solution manifolds, where successive motor actions are not independent but rather become serially dependent. Such exploratory random walk behaviour is ubiquitous across species' neural firing, gait patterns and reaching behaviour. The past work has suggested that exploratory random walk behaviour arises from an accumulation of movement variability and a lack of error-based corrections. Here, we test a fundamentally different idea—that reinforcement-based processes regulate random walk behaviour to promote continual motor exploration to maximize success. Across three human reaching experiments, we manipulated the size of both the visually displayed target and an unseen reward zone, as well as the probability of reinforcement feedback. Our empirical and modelling results parsimoniously support the notion that exploratory random walk behaviour emerges by utilizing knowledge of movement variability to update intended reach aim towards recently reinforced motor actions. This mechanism leads to active and continuous exploration of the solution manifold, currently thought by prominent theories to arise passively. The ability to continually explore muscle, joint and task redundant solution manifolds is beneficial while acting in uncertain environments, during motor development or when recovering from a neurological disorder to discover and learn new motor actions. [ABSTRACT FROM AUTHOR]
Copyright of Proceedings of the Royal Society B: Biological Sciences is the property of Royal Society and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
FullText Text:
  Availability: 0
Header DbId: egs
DbLabel: Engineering Source
An: 173452822
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Reinforcement-based processes actively regulate motor exploration along redundant solution manifolds.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Roth%2C+Adam+M%2E%22">Roth, Adam M.</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Calalo%2C+Jan+A%2E%22">Calalo, Jan A.</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Lokesh%2C+Rakshith%22">Lokesh, Rakshith</searchLink><relatesTo>2</relatesTo><br /><searchLink fieldCode="AR" term="%22Sullivan%2C+Seth+R%2E%22">Sullivan, Seth R.</searchLink><relatesTo>2</relatesTo><br /><searchLink fieldCode="AR" term="%22Grill%2C+Stephen%22">Grill, Stephen</searchLink><relatesTo>3</relatesTo><br /><searchLink fieldCode="AR" term="%22Jeka%2C+John+J%2E%22">Jeka, John J.</searchLink><relatesTo>3,4,5</relatesTo><br /><searchLink fieldCode="AR" term="%22van+der+Kooij%2C+Katinka%22">van der Kooij, Katinka</searchLink><relatesTo>6</relatesTo><br /><searchLink fieldCode="AR" term="%22Carter%2C+Michael+J%2E%22">Carter, Michael J.</searchLink><relatesTo>7</relatesTo><br /><searchLink fieldCode="AR" term="%22Cashaback%2C+Joshua+G%2E+A%2E%22">Cashaback, Joshua G. A.</searchLink><relatesTo>1,2,3,4,5</relatesTo><i> joshcash@udel.edu</i>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Proceedings+of+the+Royal+Society+B%3A+Biological+Sciences%22">Proceedings of the Royal Society B: Biological Sciences</searchLink>. 10/25/2023, Vol. 290 Issue 2009, p1-12. 12p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Random+walks%22">Random walks</searchLink><br /><searchLink fieldCode="DE" term="%22Motor+learning%22">Motor learning</searchLink><br /><searchLink fieldCode="DE" term="%22Motor+ability%22">Motor ability</searchLink><br /><searchLink fieldCode="DE" term="%22Stochastic+processes%22">Stochastic processes</searchLink><br /><searchLink fieldCode="DE" term="%22Reinforcement+%28Psychology%29%22">Reinforcement (Psychology)</searchLink><br /><searchLink fieldCode="DE" term="%22Neurological+disorders%22">Neurological disorders</searchLink><br /><searchLink fieldCode="DE" term="%22Songbirds%22">Songbirds</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: From a baby's babbling to a songbird practising a new tune, exploration is critical to motor learning. A hallmark of exploration is the emergence of random walk behaviour along solution manifolds, where successive motor actions are not independent but rather become serially dependent. Such exploratory random walk behaviour is ubiquitous across species' neural firing, gait patterns and reaching behaviour. The past work has suggested that exploratory random walk behaviour arises from an accumulation of movement variability and a lack of error-based corrections. Here, we test a fundamentally different idea—that reinforcement-based processes regulate random walk behaviour to promote continual motor exploration to maximize success. Across three human reaching experiments, we manipulated the size of both the visually displayed target and an unseen reward zone, as well as the probability of reinforcement feedback. Our empirical and modelling results parsimoniously support the notion that exploratory random walk behaviour emerges by utilizing knowledge of movement variability to update intended reach aim towards recently reinforced motor actions. This mechanism leads to active and continuous exploration of the solution manifold, currently thought by prominent theories to arise passively. The ability to continually explore muscle, joint and task redundant solution manifolds is beneficial while acting in uncertain environments, during motor development or when recovering from a neurological disorder to discover and learn new motor actions. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Proceedings of the Royal Society B: Biological Sciences is the property of Royal Society and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=173452822
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1098/rspb.2023.1475
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 12
        StartPage: 1
    Subjects:
      – SubjectFull: Random walks
        Type: general
      – SubjectFull: Motor learning
        Type: general
      – SubjectFull: Motor ability
        Type: general
      – SubjectFull: Stochastic processes
        Type: general
      – SubjectFull: Reinforcement (Psychology)
        Type: general
      – SubjectFull: Neurological disorders
        Type: general
      – SubjectFull: Songbirds
        Type: general
    Titles:
      – TitleFull: Reinforcement-based processes actively regulate motor exploration along redundant solution manifolds.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Roth, Adam M.
      – PersonEntity:
          Name:
            NameFull: Calalo, Jan A.
      – PersonEntity:
          Name:
            NameFull: Lokesh, Rakshith
      – PersonEntity:
          Name:
            NameFull: Sullivan, Seth R.
      – PersonEntity:
          Name:
            NameFull: Grill, Stephen
      – PersonEntity:
          Name:
            NameFull: Jeka, John J.
      – PersonEntity:
          Name:
            NameFull: van der Kooij, Katinka
      – PersonEntity:
          Name:
            NameFull: Carter, Michael J.
      – PersonEntity:
          Name:
            NameFull: Cashaback, Joshua G. A.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 25
              M: 10
              Text: 10/25/2023
              Type: published
              Y: 2023
          Identifiers:
            – Type: issn-print
              Value: 09628452
          Numbering:
            – Type: volume
              Value: 290
            – Type: issue
              Value: 2009
          Titles:
            – TitleFull: Proceedings of the Royal Society B: Biological Sciences
              Type: main
ResultId 1