A critical comparative study of the performance of three AI-assisted programs for bone age determination.

Saved in:
Bibliographic Details
Title: A critical comparative study of the performance of three AI-assisted programs for bone age determination.
Authors: Pape, Johanna1 (AUTHOR), Rosolowski, Maciej2 (AUTHOR), Pfäffle, Roland3 (AUTHOR), Beeskow, Anne B.4 (AUTHOR), Gräfe, Daniel1 (AUTHOR) Daniel.Graefe@medizin.uni-leipzig.de
Source: European Radiology. Mar2025, Vol. 35 Issue 3, p1190-1196. 7p.
Subjects: Artificial intelligence, Standard deviations, Artificial bones, Accounting exams, Age groups
Abstract: Objectives: To date, AI-supported programs for bone age (BA) determination for medical use in Europe have almost only been validated separately, according to Greulich and Pyle (G&P). Therefore, the current study aimed to compare the performance of three programs, namely BoneXpert, PANDA, and BoneView, on a single Central European population. Materials and methods: For this retrospective study, hand radiographs of 306 children aged 1–18 years, stratified by gender and age, were included. A subgroup consisting of the age group accounting for 90% of examinations in clinical practice was formed. The G&P BA was estimated by three human experts—as ground truth—and three AI-supported programs. The mean absolute deviation, the root mean squared error (RMSE), and dropouts by the AI were calculated. Results: The correlation between all programs and the ground truth was prominent (R2 ≥ 0.98). In the total group, BoneXpert had a lower RMSE than BoneView and PANDA (0.62 vs. 0.65 and 0.75 years) with a dropout rate of 2.3%, 20.3% and 0%, respectively. In the subgroup, there was less difference in RMSE (0.66 vs. 0.68 and 0.65 years, max. 4% dropouts). The standard deviation between the AI readers was lower than that between the human readers (0.54 vs. 0.62 years, p < 0.01). Conclusion: All three AI programs predict BA after G&P in the main age range with similar high reliability. Differences arise at the boundaries of childhood. Key Points: QuestionThere is a lack of comparative, independent validation for artificial intelligence-based bone age estimation in children. FindingsThree commercially available programs estimate bone age after Greulich and Pyle with similarly high reliability in a central European cohort. Clinical relevanceThe comparative study will help the reader choose a software for bone age estimation approved for the European market depending on the targeted age group and economic considerations. [ABSTRACT FROM AUTHOR]
Copyright of European Radiology is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: egs
DbLabel: Engineering Source
An: 183110201
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: A critical comparative study of the performance of three AI-assisted programs for bone age determination.
– Name: Author
  Label: Authors
  Group: Au
  Data: &lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Pape%2C+Johanna%22&quot;&gt;Pape, Johanna&lt;/searchLink&gt;&lt;relatesTo&gt;1&lt;/relatesTo&gt; (AUTHOR)&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Rosolowski%2C+Maciej%22&quot;&gt;Rosolowski, Maciej&lt;/searchLink&gt;&lt;relatesTo&gt;2&lt;/relatesTo&gt; (AUTHOR)&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Pf&#228;ffle%2C+Roland%22&quot;&gt;Pf&#228;ffle, Roland&lt;/searchLink&gt;&lt;relatesTo&gt;3&lt;/relatesTo&gt; (AUTHOR)&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Beeskow%2C+Anne+B%2E%22&quot;&gt;Beeskow, Anne B.&lt;/searchLink&gt;&lt;relatesTo&gt;4&lt;/relatesTo&gt; (AUTHOR)&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Gr&#228;fe%2C+Daniel%22&quot;&gt;Gr&#228;fe, Daniel&lt;/searchLink&gt;&lt;relatesTo&gt;1&lt;/relatesTo&gt; (AUTHOR)&lt;i&gt; Daniel.Graefe@medizin.uni-leipzig.de&lt;/i&gt;
– Name: TitleSource
  Label: Source
  Group: Src
  Data: &lt;searchLink fieldCode=&quot;JN&quot; term=&quot;%22European+Radiology%22&quot;&gt;European Radiology&lt;/searchLink&gt;. Mar2025, Vol. 35 Issue 3, p1190-1196. 7p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: &lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Artificial+intelligence%22&quot;&gt;Artificial intelligence&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Standard+deviations%22&quot;&gt;Standard deviations&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Artificial+bones%22&quot;&gt;Artificial bones&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Accounting+exams%22&quot;&gt;Accounting exams&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Age+groups%22&quot;&gt;Age groups&lt;/searchLink&gt;
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Objectives: To date, AI-supported programs for bone age (BA) determination for medical use in Europe have almost only been validated separately, according to Greulich and Pyle (G&amp;P). Therefore, the current study aimed to compare the performance of three programs, namely BoneXpert, PANDA, and BoneView, on a single Central European population. Materials and methods: For this retrospective study, hand radiographs of 306 children aged 1–18 years, stratified by gender and age, were included. A subgroup consisting of the age group accounting for 90% of examinations in clinical practice was formed. The G&amp;P BA was estimated by three human experts—as ground truth—and three AI-supported programs. The mean absolute deviation, the root mean squared error (RMSE), and dropouts by the AI were calculated. Results: The correlation between all programs and the ground truth was prominent (R2 ≥ 0.98). In the total group, BoneXpert had a lower RMSE than BoneView and PANDA (0.62 vs. 0.65 and 0.75 years) with a dropout rate of 2.3%, 20.3% and 0%, respectively. In the subgroup, there was less difference in RMSE (0.66 vs. 0.68 and 0.65 years, max. 4% dropouts). The standard deviation between the AI readers was lower than that between the human readers (0.54 vs. 0.62 years, p &lt; 0.01). Conclusion: All three AI programs predict BA after G&amp;P in the main age range with similar high reliability. Differences arise at the boundaries of childhood. Key Points: QuestionThere is a lack of comparative, independent validation for artificial intelligence-based bone age estimation in children. FindingsThree commercially available programs estimate bone age after Greulich and Pyle with similarly high reliability in a central European cohort. Clinical relevanceThe comparative study will help the reader choose a software for bone age estimation approved for the European market depending on the targeted age group and economic considerations. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: &lt;i&gt;Copyright of European Radiology is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder&#39;s express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.&lt;/i&gt; (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=183110201
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1007/s00330-024-11169-6
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 7
        StartPage: 1190
    Subjects:
      – SubjectFull: Artificial intelligence
        Type: general
      – SubjectFull: Standard deviations
        Type: general
      – SubjectFull: Artificial bones
        Type: general
      – SubjectFull: Accounting exams
        Type: general
      – SubjectFull: Age groups
        Type: general
    Titles:
      – TitleFull: A critical comparative study of the performance of three AI-assisted programs for bone age determination.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Pape, Johanna
      – PersonEntity:
          Name:
            NameFull: Rosolowski, Maciej
      – PersonEntity:
          Name:
            NameFull: Pfäffle, Roland
      – PersonEntity:
          Name:
            NameFull: Beeskow, Anne B.
      – PersonEntity:
          Name:
            NameFull: Gräfe, Daniel
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 03
              Text: Mar2025
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-print
              Value: 09387994
          Numbering:
            – Type: volume
              Value: 35
            – Type: issue
              Value: 3
          Titles:
            – TitleFull: European Radiology
              Type: main
ResultId 1