View in EDS

The Evolution of Global Scale Filesystems for Scientific Software Distribution.

Saved in:
Bibliographic Details
Title: The Evolution of Global Scale Filesystems for Scientific Software Distribution.
Authors: Blomer, Jakob1, Buncic, Predrag1, Meusel, Rene1, Ganis, Gerardo1, Sfiligoi, Igor2, Thain, Douglas3
Source: Computing in Science & Engineering. Nov2015, Vol. 17 Issue 6, p61-71. 11p.
Subjects: Scientific software, System analysis software, Scientific computing, Information storage & retrieval systems, Computer systems
Abstract: Delivering complex software across a worldwide distributed system is a major challenge in high-throughput scientific computing. The problem arises at different scales for many scientific communities that use grids, clouds, and distributed clusters to satisfy their computing needs. For high-energy physics (HEP) collaborations dealing with large amounts of data that rely on hundreds of thousands of cores spread around the world for data processing, the challenge is particularly acute. To serve the needs of the HEP community, several iterations were made to create a scalable, user-level filesystem that delivers software worldwide on a daily basis. The implementation was designed in 2006 to serve the needs of one experiment running on thousands of machines. Since that time, this idea evolved into a new production global-scale filesystem serving the needs of multiple science communities on hundreds of thousands of machines around the world. [ABSTRACT FROM PUBLISHER]
Copyright of Computing in Science & Engineering is the property of IEEE and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
FullText Text:
  Availability: 0
Header DbId: egs
DbLabel: Engineering Source
An: 110690201
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: The Evolution of Global Scale Filesystems for Scientific Software Distribution.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Blomer%2C+Jakob%22">Blomer, Jakob</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Buncic%2C+Predrag%22">Buncic, Predrag</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Meusel%2C+Rene%22">Meusel, Rene</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Ganis%2C+Gerardo%22">Ganis, Gerardo</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Sfiligoi%2C+Igor%22">Sfiligoi, Igor</searchLink><relatesTo>2</relatesTo><br /><searchLink fieldCode="AR" term="%22Thain%2C+Douglas%22">Thain, Douglas</searchLink><relatesTo>3</relatesTo>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Computing+in+Science+%26+Engineering%22">Computing in Science & Engineering</searchLink>. Nov2015, Vol. 17 Issue 6, p61-71. 11p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Scientific+software%22">Scientific software</searchLink><br /><searchLink fieldCode="DE" term="%22System+analysis+software%22">System analysis software</searchLink><br /><searchLink fieldCode="DE" term="%22Scientific+computing%22">Scientific computing</searchLink><br /><searchLink fieldCode="DE" term="%22Information+storage+%26+retrieval+systems%22">Information storage & retrieval systems</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+systems%22">Computer systems</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Delivering complex software across a worldwide distributed system is a major challenge in high-throughput scientific computing. The problem arises at different scales for many scientific communities that use grids, clouds, and distributed clusters to satisfy their computing needs. For high-energy physics (HEP) collaborations dealing with large amounts of data that rely on hundreds of thousands of cores spread around the world for data processing, the challenge is particularly acute. To serve the needs of the HEP community, several iterations were made to create a scalable, user-level filesystem that delivers software worldwide on a daily basis. The implementation was designed in 2006 to serve the needs of one experiment running on thousands of machines. Since that time, this idea evolved into a new production global-scale filesystem serving the needs of multiple science communities on hundreds of thousands of machines around the world. [ABSTRACT FROM PUBLISHER]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Computing in Science & Engineering is the property of IEEE and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=110690201
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1109/MCSE.2015.111
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 11
        StartPage: 61
    Subjects:
      – SubjectFull: Scientific software
        Type: general
      – SubjectFull: System analysis software
        Type: general
      – SubjectFull: Scientific computing
        Type: general
      – SubjectFull: Information storage & retrieval systems
        Type: general
      – SubjectFull: Computer systems
        Type: general
    Titles:
      – TitleFull: The Evolution of Global Scale Filesystems for Scientific Software Distribution.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Blomer, Jakob
      – PersonEntity:
          Name:
            NameFull: Buncic, Predrag
      – PersonEntity:
          Name:
            NameFull: Meusel, Rene
      – PersonEntity:
          Name:
            NameFull: Ganis, Gerardo
      – PersonEntity:
          Name:
            NameFull: Sfiligoi, Igor
      – PersonEntity:
          Name:
            NameFull: Thain, Douglas
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 11
              Text: Nov2015
              Type: published
              Y: 2015
          Identifiers:
            – Type: issn-print
              Value: 15219615
          Numbering:
            – Type: volume
              Value: 17
            – Type: issue
              Value: 6
          Titles:
            – TitleFull: Computing in Science & Engineering
              Type: main
ResultId 1