View in EDS

Scalable Design and Implementations for MPI Parallel Overlapping I/O.

Saved in:
Bibliographic Details
Title: Scalable Design and Implementations for MPI Parallel Overlapping I/O.
Authors: Wei-keng Liao1 wkliao@ece.northwestern.edu, Coloma, Kenin1 kcoloma@ece.northwestern.edu, Choudhary, Alok1 choudherj@ece.northwestern.edu, Ward, Lee2 lee@sandia.gov, Russell, Eric2 edrusse@sandia.gov, Pundit, Neil2 pundit@sandia.gov
Source: IEEE Transactions on Parallel & Distributed Systems. Nov2006, Vol. 17 Issue 11, p1264-1276. 13p. 5 Black and White Photographs, 10 Diagrams, 1 Chart, 2 Graphs.
Subjects: Cache memory, POSIX (Computer software standard), Interface circuits, Computer storage devices, Computer operating systems, Computer science
Abstract: We investigate the Message Passing Interface Input/Output (MPI I/O) implementation issues for two overlapping access patterns: the overlaps among processes within a single I/O operation and the overlaps across a sequence of I/O operations. The former case considers whether I/O atomicity can be obtained in the overlapping regions. The latter focuses on the file consistency problem on parallel machines with client-side file caching enabled. Traditional solutions for both overlapping I/O problems use whole file or byte-range file locking to ensure exclusive access to the overlapping regions and bypass the file system cache. Unfortunately, not only can file locking serialize I/O, but it can also increase the aggregate communication overhead between clients and I/O servers. For atomicity, we first differentiate MPI's requirements from the Portable Operating System Interface (POSIX) standard and propose two scalable approaches, graph coloring and process-rank ordering, which can resolve access conflicts and maintain I/O parallelism. For solving the file consistency problem across multiple I/O operations, we propose a method called Persistent File Domains, which tackles cache coherency with additional information and coordination to guarantee safe cache access without using file locks. [ABSTRACT FROM AUTHOR]
Copyright of IEEE Transactions on Parallel & Distributed Systems is the property of IEEE and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
FullText Text:
  Availability: 0
Header DbId: egs
DbLabel: Engineering Source
An: 22878582
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Scalable Design and Implementations for MPI Parallel Overlapping I/O.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Wei-keng+Liao%22">Wei-keng Liao</searchLink><relatesTo>1</relatesTo><i> wkliao@ece.northwestern.edu</i><br /><searchLink fieldCode="AR" term="%22Coloma%2C+Kenin%22">Coloma, Kenin</searchLink><relatesTo>1</relatesTo><i> kcoloma@ece.northwestern.edu</i><br /><searchLink fieldCode="AR" term="%22Choudhary%2C+Alok%22">Choudhary, Alok</searchLink><relatesTo>1</relatesTo><i> choudherj@ece.northwestern.edu</i><br /><searchLink fieldCode="AR" term="%22Ward%2C+Lee%22">Ward, Lee</searchLink><relatesTo>2</relatesTo><i> lee@sandia.gov</i><br /><searchLink fieldCode="AR" term="%22Russell%2C+Eric%22">Russell, Eric</searchLink><relatesTo>2</relatesTo><i> edrusse@sandia.gov</i><br /><searchLink fieldCode="AR" term="%22Pundit%2C+Neil%22">Pundit, Neil</searchLink><relatesTo>2</relatesTo><i> pundit@sandia.gov</i>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22IEEE+Transactions+on+Parallel+%26+Distributed+Systems%22">IEEE Transactions on Parallel & Distributed Systems</searchLink>. Nov2006, Vol. 17 Issue 11, p1264-1276. 13p. 5 Black and White Photographs, 10 Diagrams, 1 Chart, 2 Graphs.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Cache+memory%22">Cache memory</searchLink><br /><searchLink fieldCode="DE" term="%22POSIX+%28Computer+software+standard%29%22">POSIX (Computer software standard)</searchLink><br /><searchLink fieldCode="DE" term="%22Interface+circuits%22">Interface circuits</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+storage+devices%22">Computer storage devices</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+operating+systems%22">Computer operating systems</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+science%22">Computer science</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: We investigate the Message Passing Interface Input/Output (MPI I/O) implementation issues for two overlapping access patterns: the overlaps among processes within a single I/O operation and the overlaps across a sequence of I/O operations. The former case considers whether I/O atomicity can be obtained in the overlapping regions. The latter focuses on the file consistency problem on parallel machines with client-side file caching enabled. Traditional solutions for both overlapping I/O problems use whole file or byte-range file locking to ensure exclusive access to the overlapping regions and bypass the file system cache. Unfortunately, not only can file locking serialize I/O, but it can also increase the aggregate communication overhead between clients and I/O servers. For atomicity, we first differentiate MPI's requirements from the Portable Operating System Interface (POSIX) standard and propose two scalable approaches, graph coloring and process-rank ordering, which can resolve access conflicts and maintain I/O parallelism. For solving the file consistency problem across multiple I/O operations, we propose a method called Persistent File Domains, which tackles cache coherency with additional information and coordination to guarantee safe cache access without using file locks. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of IEEE Transactions on Parallel & Distributed Systems is the property of IEEE and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=22878582
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1109/TPDS.2006.163
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 13
        StartPage: 1264
    Subjects:
      – SubjectFull: Cache memory
        Type: general
      – SubjectFull: POSIX (Computer software standard)
        Type: general
      – SubjectFull: Interface circuits
        Type: general
      – SubjectFull: Computer storage devices
        Type: general
      – SubjectFull: Computer operating systems
        Type: general
      – SubjectFull: Computer science
        Type: general
    Titles:
      – TitleFull: Scalable Design and Implementations for MPI Parallel Overlapping I/O.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Wei-keng Liao
      – PersonEntity:
          Name:
            NameFull: Coloma, Kenin
      – PersonEntity:
          Name:
            NameFull: Choudhary, Alok
      – PersonEntity:
          Name:
            NameFull: Ward, Lee
      – PersonEntity:
          Name:
            NameFull: Russell, Eric
      – PersonEntity:
          Name:
            NameFull: Pundit, Neil
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 11
              Text: Nov2006
              Type: published
              Y: 2006
          Identifiers:
            – Type: issn-print
              Value: 10459219
          Numbering:
            – Type: volume
              Value: 17
            – Type: issue
              Value: 11
          Titles:
            – TitleFull: IEEE Transactions on Parallel & Distributed Systems
              Type: main
ResultId 1