FPGA‐accelerated streaming data reduction achieving an average compression ratio over 8000 in a 17.4 kHz, 840 kpixel CITIUS detector for quasi‐elastic gamma‐ray scattering.
Saved in:
| Title: | FPGA‐accelerated streaming data reduction achieving an average compression ratio over 8000 in a 17.4 kHz, 840 kpixel CITIUS detector for quasi‐elastic gamma‐ray scattering. |
|---|---|
| Authors: | Nishino, Haruki1,2 (AUTHOR) haruki.nishino@spring8.or.jp, Kobayashi, Masashi2,3 (AUTHOR), Hiraki, Toshiyuki Nishiyama2 (AUTHOR), Honjo, Yoshiaki2 (AUTHOR), Ozaki, Kyosuke2 (AUTHOR), Yamaga, Mitsuhiro1,2 (AUTHOR), Nagasawa, Nobumoto1,2 (AUTHOR), Yoda, Yoshitaka1,2 (AUTHOR), Joti, Yasumasa1,2 (AUTHOR), Saito, Makina2,3 (AUTHOR), Hatsui, Takaki2 (AUTHOR) |
| Source: | Journal of Synchrotron Radiation. May2026, Vol. 33 Issue 3, p609-616. 8p. |
| Subjects: | Data reduction, Field programmable gate arrays, Quasielastic light scattering, Acquisition of data, Data compression, X-ray detection, Data analysis |
| Abstract: | We present a data‐acquisition and ‐analysis framework for quasi‐elastic gamma‐ray scattering (QEGS) experiments at BL35XU of SPring‐8, equipped with an 840 kpixel CITIUS X‐ray detector operating at 17.4 kHz. The detector produces data at 27 GB s−1 (216 Gbps), and typical experiments involve acquisition over beam‐time periods longer than 24 h, generating datasets of 2.3 PB per day. To handle this volume, we constructed a data‐handling pipeline consisting of the detector, data reduction at the beamline and analysis tools at the data center. The data reduction employs field‐programmable gate array (FPGA)‐accelerated per‐pixel processing to reduce data entropy, followed by Zstandard compression on CPUs, achieving an average compression ratio of over 8000. The compressed data are transferred to the SPring‐8 data center within two to three minutes of data acquisition. At the data center, analysis tools are provided via the Open OnDemand platform, enabling incremental integration and spectral analysis through a web‐based interface without the need for high‐performance‐computing command‐line interaction. This data‐handling pipeline has been applied in QEGS user experiments, where it enabled timely feedback on experimental data, with integrated results available within six minutes and spectral analysis within seven minutes of integration. [ABSTRACT FROM AUTHOR] |
| Copyright of Journal of Synchrotron Radiation is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
|
Full text is not displayed to guests.
Login for full access.
|
|
| FullText | Links: – Type: pdflink Text: Availability: 1 |
|---|---|
| Header | DbId: egs DbLabel: Engineering Source An: 193520476 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: FPGA‐accelerated streaming data reduction achieving an average compression ratio over 8000 in a 17.4 kHz, 840 kpixel CITIUS detector for quasi‐elastic gamma‐ray scattering. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Nishino%2C+Haruki%22">Nishino, Haruki</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<i> haruki.nishino@spring8.or.jp</i><br /><searchLink fieldCode="AR" term="%22Kobayashi%2C+Masashi%22">Kobayashi, Masashi</searchLink><relatesTo>2,3</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Hiraki%2C+Toshiyuki+Nishiyama%22">Hiraki, Toshiyuki Nishiyama</searchLink><relatesTo>2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Honjo%2C+Yoshiaki%22">Honjo, Yoshiaki</searchLink><relatesTo>2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Ozaki%2C+Kyosuke%22">Ozaki, Kyosuke</searchLink><relatesTo>2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Yamaga%2C+Mitsuhiro%22">Yamaga, Mitsuhiro</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Nagasawa%2C+Nobumoto%22">Nagasawa, Nobumoto</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Yoda%2C+Yoshitaka%22">Yoda, Yoshitaka</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Joti%2C+Yasumasa%22">Joti, Yasumasa</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Saito%2C+Makina%22">Saito, Makina</searchLink><relatesTo>2,3</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Hatsui%2C+Takaki%22">Hatsui, Takaki</searchLink><relatesTo>2</relatesTo> (AUTHOR) – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Journal+of+Synchrotron+Radiation%22">Journal of Synchrotron Radiation</searchLink>. May2026, Vol. 33 Issue 3, p609-616. 8p. – Name: Subject Label: Subjects Group: Su Data: <searchLink fieldCode="DE" term="%22Data+reduction%22">Data reduction</searchLink><br /><searchLink fieldCode="DE" term="%22Field+programmable+gate+arrays%22">Field programmable gate arrays</searchLink><br /><searchLink fieldCode="DE" term="%22Quasielastic+light+scattering%22">Quasielastic light scattering</searchLink><br /><searchLink fieldCode="DE" term="%22Acquisition+of+data%22">Acquisition of data</searchLink><br /><searchLink fieldCode="DE" term="%22Data+compression%22">Data compression</searchLink><br /><searchLink fieldCode="DE" term="%22X-ray+detection%22">X-ray detection</searchLink><br /><searchLink fieldCode="DE" term="%22Data+analysis%22">Data analysis</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: We present a data‐acquisition and ‐analysis framework for quasi‐elastic gamma‐ray scattering (QEGS) experiments at BL35XU of SPring‐8, equipped with an 840 kpixel CITIUS X‐ray detector operating at 17.4 kHz. The detector produces data at 27 GB s−1 (216 Gbps), and typical experiments involve acquisition over beam‐time periods longer than 24 h, generating datasets of 2.3 PB per day. To handle this volume, we constructed a data‐handling pipeline consisting of the detector, data reduction at the beamline and analysis tools at the data center. The data reduction employs field‐programmable gate array (FPGA)‐accelerated per‐pixel processing to reduce data entropy, followed by Zstandard compression on CPUs, achieving an average compression ratio of over 8000. The compressed data are transferred to the SPring‐8 data center within two to three minutes of data acquisition. At the data center, analysis tools are provided via the Open OnDemand platform, enabling incremental integration and spectral analysis through a web‐based interface without the need for high‐performance‐computing command‐line interaction. This data‐handling pipeline has been applied in QEGS user experiments, where it enabled timely feedback on experimental data, with integrated results available within six minutes and spectral analysis within seven minutes of integration. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Journal of Synchrotron Radiation is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=193520476 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1107/S1600577526000883 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 8 StartPage: 609 Subjects: – SubjectFull: Data reduction Type: general – SubjectFull: Field programmable gate arrays Type: general – SubjectFull: Quasielastic light scattering Type: general – SubjectFull: Acquisition of data Type: general – SubjectFull: Data compression Type: general – SubjectFull: X-ray detection Type: general – SubjectFull: Data analysis Type: general Titles: – TitleFull: FPGA‐accelerated streaming data reduction achieving an average compression ratio over 8000 in a 17.4 kHz, 840 kpixel CITIUS detector for quasi‐elastic gamma‐ray scattering. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Nishino, Haruki – PersonEntity: Name: NameFull: Kobayashi, Masashi – PersonEntity: Name: NameFull: Hiraki, Toshiyuki Nishiyama – PersonEntity: Name: NameFull: Honjo, Yoshiaki – PersonEntity: Name: NameFull: Ozaki, Kyosuke – PersonEntity: Name: NameFull: Yamaga, Mitsuhiro – PersonEntity: Name: NameFull: Nagasawa, Nobumoto – PersonEntity: Name: NameFull: Yoda, Yoshitaka – PersonEntity: Name: NameFull: Joti, Yasumasa – PersonEntity: Name: NameFull: Saito, Makina – PersonEntity: Name: NameFull: Hatsui, Takaki IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 05 Text: May2026 Type: published Y: 2026 Identifiers: – Type: issn-print Value: 09090495 Numbering: – Type: volume Value: 33 – Type: issue Value: 3 Titles: – TitleFull: Journal of Synchrotron Radiation Type: main |
| ResultId | 1 |
