View in EDS HTML Full Text PDF Full Text

PvaPy streaming framework for real‐time data processing.

Saved in:
Bibliographic Details
Title: PvaPy streaming framework for real‐time data processing.
Authors: Veseli, Siniša1 (AUTHOR) sveseli@anl.gov, Hammonds, John1 (AUTHOR), Henke, Steven1 (AUTHOR), Parraga, Hannah1 (AUTHOR), Frosik, Barbara1 (AUTHOR), Schwarz, Nicholas1 (AUTHOR)
Source: Journal of Synchrotron Radiation. May2025, Vol. 32 Issue 3, p823-836. 14p.
Subjects: Remote computing, Electronic data processing, Image converters, Data analysis, Pythons
Abstract: User facility upgrades, new measurement techniques, advances in data analysis algorithms as well as advances in detector capabilities result in an increasing amount of data collected at X‐ray beamlines. Some of these data must be analyzed and reconstructed on demand to help execute experiments dynamically and modify them in real time. In turn, this requires a computing framework for real‐time processing capable of moving data quickly from the detector to local or remote computing resources, processing data, and returning results to users. In this paper, we discuss the streaming framework built on top of PvaPy, a Python API for the EPICS pvAccess protocol. We describe the framework architecture and capabilities, and discuss scientific use cases and applications that benefit from streaming workflows implemented on top of this framework. We also illustrate the framework's performance in terms of achievable data‐processing rates for various detector image sizes. [ABSTRACT FROM AUTHOR]
Copyright of Journal of Synchrotron Radiation is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: egs
DbLabel: Engineering Source
An: 185103732
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: PvaPy streaming framework for real‐time data processing.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Veseli%2C+Siniša%22">Veseli, Siniša</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> sveseli@anl.gov</i><br /><searchLink fieldCode="AR" term="%22Hammonds%2C+John%22">Hammonds, John</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Henke%2C+Steven%22">Henke, Steven</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Parraga%2C+Hannah%22">Parraga, Hannah</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Frosik%2C+Barbara%22">Frosik, Barbara</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Schwarz%2C+Nicholas%22">Schwarz, Nicholas</searchLink><relatesTo>1</relatesTo> (AUTHOR)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Journal+of+Synchrotron+Radiation%22">Journal of Synchrotron Radiation</searchLink>. May2025, Vol. 32 Issue 3, p823-836. 14p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Remote+computing%22">Remote computing</searchLink><br /><searchLink fieldCode="DE" term="%22Electronic+data+processing%22">Electronic data processing</searchLink><br /><searchLink fieldCode="DE" term="%22Image+converters%22">Image converters</searchLink><br /><searchLink fieldCode="DE" term="%22Data+analysis%22">Data analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Pythons%22">Pythons</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: User facility upgrades, new measurement techniques, advances in data analysis algorithms as well as advances in detector capabilities result in an increasing amount of data collected at X‐ray beamlines. Some of these data must be analyzed and reconstructed on demand to help execute experiments dynamically and modify them in real time. In turn, this requires a computing framework for real‐time processing capable of moving data quickly from the detector to local or remote computing resources, processing data, and returning results to users. In this paper, we discuss the streaming framework built on top of PvaPy, a Python API for the EPICS pvAccess protocol. We describe the framework architecture and capabilities, and discuss scientific use cases and applications that benefit from streaming workflows implemented on top of this framework. We also illustrate the framework's performance in terms of achievable data‐processing rates for various detector image sizes. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Journal of Synchrotron Radiation is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=185103732
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1107/S1600577525002115
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 14
        StartPage: 823
    Subjects:
      – SubjectFull: Remote computing
        Type: general
      – SubjectFull: Electronic data processing
        Type: general
      – SubjectFull: Image converters
        Type: general
      – SubjectFull: Data analysis
        Type: general
      – SubjectFull: Pythons
        Type: general
    Titles:
      – TitleFull: PvaPy streaming framework for real‐time data processing.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Veseli, Siniša
      – PersonEntity:
          Name:
            NameFull: Hammonds, John
      – PersonEntity:
          Name:
            NameFull: Henke, Steven
      – PersonEntity:
          Name:
            NameFull: Parraga, Hannah
      – PersonEntity:
          Name:
            NameFull: Frosik, Barbara
      – PersonEntity:
          Name:
            NameFull: Schwarz, Nicholas
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 05
              Text: May2025
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-print
              Value: 09090495
          Numbering:
            – Type: volume
              Value: 32
            – Type: issue
              Value: 3
          Titles:
            – TitleFull: Journal of Synchrotron Radiation
              Type: main
ResultId 1