View in EDS

Towards human-level performance on automatic pose estimation of infant spontaneous movements.

Saved in:
Bibliographic Details
Title: Towards human-level performance on automatic pose estimation of infant spontaneous movements.
Authors: Groos, Daniel1 (AUTHOR), Adde, Lars2,3 (AUTHOR), Støen, Ragnhild2,4 (AUTHOR), Ramampiaro, Heri5 (AUTHOR), Ihlen, Espen A.F.1 (AUTHOR) espen.ihlen@ntnu.no
Source: Computerized Medical Imaging & Graphics. Jan2022, Vol. 95, pN.PAG-N.PAG. 1p.
Subjects: Video recording, Infants, Convolutional neural networks, Brain injuries, Posture
Abstract: Assessment of spontaneous movements can predict the long-term developmental disorders in high-risk infants. In order to develop algorithms for automated prediction of later disorders, highly precise localization of segments and joints by infant pose estimation is required. Four types of convolutional neural networks were trained and evaluated on a novel infant pose dataset, covering the large variation in 1424 videos from a clinical international community. The localization performance of the networks was evaluated as the deviation between the estimated keypoint positions and human expert annotations. The computational efficiency was also assessed to determine the feasibility of the neural networks in clinical practice. The best performing neural network had a similar localization error to the inter-rater spread of human expert annotations, while still operating efficiently. Overall, the results of our study show that pose estimation of infant spontaneous movements has a great potential to support research initiatives on early detection of developmental disorders in children with perinatal brain injuries by quantifying infant movements from video recordings with human-level performance. [Display omitted] • Infant pose estimation localizes body postures of infants accurately in video frames. • A large-scale database of infant videos from international clinical networks. • Hospital recordings and home-based smartphone videos across various infant groups. • Performance of convolutional neural networks approaches human annotation spread. • Automatic, markerless pose estimation with real-time inference on consumer GPU. [ABSTRACT FROM AUTHOR]
Copyright of Computerized Medical Imaging & Graphics is the property of Pergamon Press - An Imprint of Elsevier Science and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Description
Abstract:Assessment of spontaneous movements can predict the long-term developmental disorders in high-risk infants. In order to develop algorithms for automated prediction of later disorders, highly precise localization of segments and joints by infant pose estimation is required. Four types of convolutional neural networks were trained and evaluated on a novel infant pose dataset, covering the large variation in 1424 videos from a clinical international community. The localization performance of the networks was evaluated as the deviation between the estimated keypoint positions and human expert annotations. The computational efficiency was also assessed to determine the feasibility of the neural networks in clinical practice. The best performing neural network had a similar localization error to the inter-rater spread of human expert annotations, while still operating efficiently. Overall, the results of our study show that pose estimation of infant spontaneous movements has a great potential to support research initiatives on early detection of developmental disorders in children with perinatal brain injuries by quantifying infant movements from video recordings with human-level performance. [Display omitted] • Infant pose estimation localizes body postures of infants accurately in video frames. • A large-scale database of infant videos from international clinical networks. • Hospital recordings and home-based smartphone videos across various infant groups. • Performance of convolutional neural networks approaches human annotation spread. • Automatic, markerless pose estimation with real-time inference on consumer GPU. [ABSTRACT FROM AUTHOR]
ISSN:08956111
DOI:10.1016/j.compmedimag.2021.102012