View in EDS

Autonomous Learning With High-Dimensional Computing Architecture Similar to Von Neumann's.

Saved in:
Bibliographic Details
Title: Autonomous Learning With High-Dimensional Computing Architecture Similar to Von Neumann's.
Authors: Kanerva, Pentti (AUTHOR)
Source: Neural Computation. Jul2026, Vol. 38 Issue 7, p1117-1134. 18p.
Subjects: Computer architecture, Biologically inspired computing, Automaticity (Learning process), Cognitive robotics, Computational neuroscience, Von Neumann, John, 1903-1957, Artificial intelligence
Abstract: We model human and animal learning by computing with high-dimensional vectors (e.g., D = 10,000). The architecture resembles traditional (von Neumann) computing with numbers, but the instructions refer to vectors and operate on them in superposition. The architecture includes a high-capacity memory for vectors, counterpart of the random-access memory (RAM) for numbers. The model's ability to learn from data reminds us of deep learning, but with an architecture closer to biology. The architecture agrees with an idea from psychology that human memory and learning involve a short-term working memory and a long-term data store. Neuroscience provides us with a model of the long-term memory, namely, the cortex of the cerebellum. With roots in psychology, biology, and traditional computing, a theory of computing with vectors can help us understand how brains compute. Application to learning by robots seems inevitable, but there is likely to be more, including language. Ultimately we want to compute with no more material and energy than brains use. To that end, we need a mathematical theory that agrees with psychology and biology and is suitable for nano-technology. We also need to exercise the theory in large-scale experiments. The analogy with traditional computing suggests that the architecture be programmable in terms of variables, values, and data structures, the very things that have made traditional computing ubiquitous and that seem worth learning from and emulating. [ABSTRACT FROM AUTHOR]
Copyright of Neural Computation is the property of MIT Press and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Psychology and Behavioral Sciences Collection
FullText Text:
  Availability: 0
Header DbId: pbh
DbLabel: Psychology and Behavioral Sciences Collection
An: 194393473
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Autonomous Learning With High-Dimensional Computing Architecture Similar to Von Neumann's.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Kanerva%2C+Pentti%22">Kanerva, Pentti</searchLink> (AUTHOR)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Neural+Computation%22">Neural Computation</searchLink>. Jul2026, Vol. 38 Issue 7, p1117-1134. 18p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Computer+architecture%22">Computer architecture</searchLink><br /><searchLink fieldCode="DE" term="%22Biologically+inspired+computing%22">Biologically inspired computing</searchLink><br /><searchLink fieldCode="DE" term="%22Automaticity+%28Learning+process%29%22">Automaticity (Learning process)</searchLink><br /><searchLink fieldCode="DE" term="%22Cognitive+robotics%22">Cognitive robotics</searchLink><br /><searchLink fieldCode="DE" term="%22Computational+neuroscience%22">Computational neuroscience</searchLink><br /><searchLink fieldCode="DE" term="%22Von+Neumann%2C+John%2C+1903-1957%22">Von Neumann, John, 1903-1957</searchLink><br /><searchLink fieldCode="DE" term="%22Artificial+intelligence%22">Artificial intelligence</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: We model human and animal learning by computing with high-dimensional vectors (e.g., D = 10,000). The architecture resembles traditional (von Neumann) computing with numbers, but the instructions refer to vectors and operate on them in superposition. The architecture includes a high-capacity memory for vectors, counterpart of the random-access memory (RAM) for numbers. The model's ability to learn from data reminds us of deep learning, but with an architecture closer to biology. The architecture agrees with an idea from psychology that human memory and learning involve a short-term working memory and a long-term data store. Neuroscience provides us with a model of the long-term memory, namely, the cortex of the cerebellum. With roots in psychology, biology, and traditional computing, a theory of computing with vectors can help us understand how brains compute. Application to learning by robots seems inevitable, but there is likely to be more, including language. Ultimately we want to compute with no more material and energy than brains use. To that end, we need a mathematical theory that agrees with psychology and biology and is suitable for nano-technology. We also need to exercise the theory in large-scale experiments. The analogy with traditional computing suggests that the architecture be programmable in terms of variables, values, and data structures, the very things that have made traditional computing ubiquitous and that seem worth learning from and emulating. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Neural Computation is the property of MIT Press and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=pbh&AN=194393473
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1162/NECO.a.1523
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 18
        StartPage: 1117
    Subjects:
      – SubjectFull: Computer architecture
        Type: general
      – SubjectFull: Biologically inspired computing
        Type: general
      – SubjectFull: Automaticity (Learning process)
        Type: general
      – SubjectFull: Cognitive robotics
        Type: general
      – SubjectFull: Computational neuroscience
        Type: general
      – SubjectFull: Von Neumann, John, 1903-1957
        Type: general
      – SubjectFull: Artificial intelligence
        Type: general
    Titles:
      – TitleFull: Autonomous Learning With High-Dimensional Computing Architecture Similar to Von Neumann's.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Kanerva, Pentti
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 07
              Text: Jul2026
              Type: published
              Y: 2026
          Identifiers:
            – Type: issn-print
              Value: 08997667
          Numbering:
            – Type: volume
              Value: 38
            – Type: issue
              Value: 7
          Titles:
            – TitleFull: Neural Computation
              Type: main
ResultId 1