View in EDS HTML Full Text PDF Full Text

Research of ReLU output device in ternary optical computer based on parallel fully connected layer.

Saved in:
Bibliographic Details
Title: Research of ReLU output device in ternary optical computer based on parallel fully connected layer.
Authors: Song, Kai1 (AUTHOR) skpark@163.com, Ma, Huaqiong1 (AUTHOR), Zhang, Haiming1 (AUTHOR), Yan, Liping2 (AUTHOR)
Source: Journal of Supercomputing. Apr2024, Vol. 80 Issue 6, p7269-7292. 24p.
Subjects: Parallel computers, Optical devices, Computers, Judgment (Psychology)
Abstract: When implementing fully connected layer computation on electronic computer (EC), slow computing speed and high power consumption result in the inefficiency of the overall process. The ternary optical computer (TOC) platform with enormous data bits and reconfigurable processor can solve the inefficiency of full-connection computation on EC. In this paper, we design the parallel scheme of fully connected layer operations based on TOC and the rectified linear unit (ReLU) output device to achieve the computation of nonlinear fully connected layer. Furthermore, we also use the ReLU output device and the positive and negative discriminator of modified signed digit (MSD) data to design the ReLU judgment output device, which can realize the operation of the ReLU activation function in one step. The operations of the nonlinear fully connected layer with ReLU function on TOC can reduce the amount of computation by one magnitude and have lower power consumption by experimentally verifying the accuracy of operations and analyzing hardware resources and clock cycles. Through comparison find that TOC consumes fewer data bits, while improving the calculation speed by approximately 10%. [ABSTRACT FROM AUTHOR]
Copyright of Journal of Supercomputing is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: egs
DbLabel: Engineering Source
An: 176249854
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Research of ReLU output device in ternary optical computer based on parallel fully connected layer.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Song%2C+Kai%22">Song, Kai</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> skpark@163.com</i><br /><searchLink fieldCode="AR" term="%22Ma%2C+Huaqiong%22">Ma, Huaqiong</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Zhang%2C+Haiming%22">Zhang, Haiming</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Yan%2C+Liping%22">Yan, Liping</searchLink><relatesTo>2</relatesTo> (AUTHOR)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Journal+of+Supercomputing%22">Journal of Supercomputing</searchLink>. Apr2024, Vol. 80 Issue 6, p7269-7292. 24p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Parallel+computers%22">Parallel computers</searchLink><br /><searchLink fieldCode="DE" term="%22Optical+devices%22">Optical devices</searchLink><br /><searchLink fieldCode="DE" term="%22Computers%22">Computers</searchLink><br /><searchLink fieldCode="DE" term="%22Judgment+%28Psychology%29%22">Judgment (Psychology)</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: When implementing fully connected layer computation on electronic computer (EC), slow computing speed and high power consumption result in the inefficiency of the overall process. The ternary optical computer (TOC) platform with enormous data bits and reconfigurable processor can solve the inefficiency of full-connection computation on EC. In this paper, we design the parallel scheme of fully connected layer operations based on TOC and the rectified linear unit (ReLU) output device to achieve the computation of nonlinear fully connected layer. Furthermore, we also use the ReLU output device and the positive and negative discriminator of modified signed digit (MSD) data to design the ReLU judgment output device, which can realize the operation of the ReLU activation function in one step. The operations of the nonlinear fully connected layer with ReLU function on TOC can reduce the amount of computation by one magnitude and have lower power consumption by experimentally verifying the accuracy of operations and analyzing hardware resources and clock cycles. Through comparison find that TOC consumes fewer data bits, while improving the calculation speed by approximately 10%. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Journal of Supercomputing is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=176249854
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1007/s11227-023-05737-8
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 24
        StartPage: 7269
    Subjects:
      – SubjectFull: Parallel computers
        Type: general
      – SubjectFull: Optical devices
        Type: general
      – SubjectFull: Computers
        Type: general
      – SubjectFull: Judgment (Psychology)
        Type: general
    Titles:
      – TitleFull: Research of ReLU output device in ternary optical computer based on parallel fully connected layer.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Song, Kai
      – PersonEntity:
          Name:
            NameFull: Ma, Huaqiong
      – PersonEntity:
          Name:
            NameFull: Zhang, Haiming
      – PersonEntity:
          Name:
            NameFull: Yan, Liping
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 04
              Text: Apr2024
              Type: published
              Y: 2024
          Identifiers:
            – Type: issn-print
              Value: 09208542
          Numbering:
            – Type: volume
              Value: 80
            – Type: issue
              Value: 6
          Titles:
            – TitleFull: Journal of Supercomputing
              Type: main
ResultId 1