Improving Resource Utilization by Curbing Speculative Trace Progression in Simultaneous Multi-Threading CPUs.

Saved in:
Bibliographic Details
Title: Improving Resource Utilization by Curbing Speculative Trace Progression in Simultaneous Multi-Threading CPUs.
Authors: YILIN ZHANG1 zhangyilin.bupt@gmail.com, WEI-MING LIN2 weiming.lin@utsa.edu
Source: Journal of Information Science & Engineering. Nov2016, Vol. 32 Issue 6, p1487-1502. 16p.
Subjects: Resource management, Simultaneous multithreading processors, Central processing units, Queuing theory, Control theory (Engineering)
Abstract: Simultaneous Multi-Threading (SMT) improves the overall performance of superscalar CPUs by allowing concurrent execution of multiple independent threads with sharing of key datapath components in order to better utilize the resources. Speculative executions help modern processors to exploit more Instruction-Level Parallelism. However, the performance penalty from a miss speculation is much more prominent in an SMT environment than a traditional multi-threading system due to the resulted waste of shared resources at clock-cycle level, versus thread level. In this paper, we show that instructions fetched due to incorrect prediction can be more than 30% of all instructions, which results in a huge waste of resources that could have been better used by other non-speculative threads. To minimize this waste of resources, a technique is proposed in this paper to control the amount of speculative instructions dispatched into Issue Queue (IQ), the most critically shared resource in the SMT pipeline. Simulation result shows the proposed technique can reduce the waste of resource due to miss-speculated traces by 38% and improve overall throughput by up to 17% in IPC. [ABSTRACT FROM AUTHOR]
Copyright of Journal of Information Science & Engineering is the property of Institute of Information Science, Academia Sinica and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
FullText Links:
  – Type: pdflink
Text:
  Availability: 0
Header DbId: egs
DbLabel: Engineering Source
An: 119179841
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Improving Resource Utilization by Curbing Speculative Trace Progression in Simultaneous Multi-Threading CPUs.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22YILIN+ZHANG%22">YILIN ZHANG</searchLink><relatesTo>1</relatesTo><i> zhangyilin.bupt@gmail.com</i><br /><searchLink fieldCode="AR" term="%22WEI-MING+LIN%22">WEI-MING LIN</searchLink><relatesTo>2</relatesTo><i> weiming.lin@utsa.edu</i>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Journal+of+Information+Science+%26+Engineering%22">Journal of Information Science & Engineering</searchLink>. Nov2016, Vol. 32 Issue 6, p1487-1502. 16p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Resource+management%22">Resource management</searchLink><br /><searchLink fieldCode="DE" term="%22Simultaneous+multithreading+processors%22">Simultaneous multithreading processors</searchLink><br /><searchLink fieldCode="DE" term="%22Central+processing+units%22">Central processing units</searchLink><br /><searchLink fieldCode="DE" term="%22Queuing+theory%22">Queuing theory</searchLink><br /><searchLink fieldCode="DE" term="%22Control+theory+%28Engineering%29%22">Control theory (Engineering)</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Simultaneous Multi-Threading (SMT) improves the overall performance of superscalar CPUs by allowing concurrent execution of multiple independent threads with sharing of key datapath components in order to better utilize the resources. Speculative executions help modern processors to exploit more Instruction-Level Parallelism. However, the performance penalty from a miss speculation is much more prominent in an SMT environment than a traditional multi-threading system due to the resulted waste of shared resources at clock-cycle level, versus thread level. In this paper, we show that instructions fetched due to incorrect prediction can be more than 30% of all instructions, which results in a huge waste of resources that could have been better used by other non-speculative threads. To minimize this waste of resources, a technique is proposed in this paper to control the amount of speculative instructions dispatched into Issue Queue (IQ), the most critically shared resource in the SMT pipeline. Simulation result shows the proposed technique can reduce the waste of resource due to miss-speculated traces by 38% and improve overall throughput by up to 17% in IPC. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Journal of Information Science & Engineering is the property of Institute of Information Science, Academia Sinica and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=119179841
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 16
        StartPage: 1487
    Subjects:
      – SubjectFull: Resource management
        Type: general
      – SubjectFull: Simultaneous multithreading processors
        Type: general
      – SubjectFull: Central processing units
        Type: general
      – SubjectFull: Queuing theory
        Type: general
      – SubjectFull: Control theory (Engineering)
        Type: general
    Titles:
      – TitleFull: Improving Resource Utilization by Curbing Speculative Trace Progression in Simultaneous Multi-Threading CPUs.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: YILIN ZHANG
      – PersonEntity:
          Name:
            NameFull: WEI-MING LIN
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 11
              Text: Nov2016
              Type: published
              Y: 2016
          Identifiers:
            – Type: issn-print
              Value: 10162364
          Numbering:
            – Type: volume
              Value: 32
            – Type: issue
              Value: 6
          Titles:
            – TitleFull: Journal of Information Science & Engineering
              Type: main
ResultId 1