Exercise quality assessment in monocular video streaming.
Saved in:
| Title: | Exercise quality assessment in monocular video streaming. |
|---|---|
| Authors: | Zhang, Yongchang1 (AUTHOR), Xu, Boxuan1 (AUTHOR), Lin, Zhaowen1 (AUTHOR) linzw@bupt.edu.cn, Li, Junjie1 (AUTHOR), Ming, Anlong1 (AUTHOR) mal@bupt.edu.cn |
| Source: | Engineering Applications of Artificial Intelligence. Aug2026:Part 2, Vol. 177, pN.PAG-N.PAG. 1p. |
| Subjects: | Pose estimation (Computer vision), Streaming media, Home rehabilitation, Time series analysis, Physical activity, Artificial intelligence, Psychological feedback |
| Abstract: | The recent proliferation of home-based exercise content has garnered significant attention. This has led to an increasing demand for Artificial Intelligence (AI) devices capable of automatically assessing exercise quality and providing guidance. However, existing real-time exercise quality assessment algorithms require instructors and learners to share similar camera views. Furthermore, these methods often rely on pre-labeled data, support a limited number of exercise actions, and offer restricted feedback. Among the numerous videos where data is hard to pre-label, instructors and learners may have unrestricted camera views and inconsistent body shape, while instructors may demonstrate unpredicted actions. To address the aforementioned challenges, we propose a method for Exercise Quality Assessment in Monocular Videos (MV-EQA), which incorporates a Skeleton Mapping and View Aligning (SMVA) module, a Multi-Feature Dynamic Time Warping (MF-DTW) module, and online/offline Exercise Quality Assessment (EQA) modules. Specifically, SMVA utilizes a lightweight encoder–decoder network based on transformer architecture that effectively handles differences in view and skeleton between learners and instructors while preserving inherent variations in their movements; MF-DTW utilizes multiple body information for temporal alignment; online/offline EQA modules enable online feedback (scoring with visual comparison) and offline feedback (reviews with comments). Extensive experiments indicate the superiority of our approach over other methods in EQA tasks. The code is available at link. • Reveals view and skeleton inconsistency impacts on home exercise assessment. • SMVA method bypasses 2D-to-3D errors and handles view and skeleton differences. • Introduces MF-DTW for precise temporal alignment between learner and instructor. • Uses large language models to provide detailed exercise quality feedback. • Provides real-time multimodal scoring and visual comparison for exercises. [ABSTRACT FROM AUTHOR] |
| Copyright of Engineering Applications of Artificial Intelligence is the property of Pergamon Press - An Imprint of Elsevier Science and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
| FullText | Text: Availability: 0 |
|---|---|
| Header | DbId: egs DbLabel: Engineering Source An: 193754981 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Exercise quality assessment in monocular video streaming. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Zhang%2C+Yongchang%22">Zhang, Yongchang</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Xu%2C+Boxuan%22">Xu, Boxuan</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Lin%2C+Zhaowen%22">Lin, Zhaowen</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> linzw@bupt.edu.cn</i><br /><searchLink fieldCode="AR" term="%22Li%2C+Junjie%22">Li, Junjie</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Ming%2C+Anlong%22">Ming, Anlong</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> mal@bupt.edu.cn</i> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Engineering+Applications+of+Artificial+Intelligence%22">Engineering Applications of Artificial Intelligence</searchLink>. Aug2026:Part 2, Vol. 177, pN.PAG-N.PAG. 1p. – Name: Subject Label: Subjects Group: Su Data: <searchLink fieldCode="DE" term="%22Pose+estimation+%28Computer+vision%29%22">Pose estimation (Computer vision)</searchLink><br /><searchLink fieldCode="DE" term="%22Streaming+media%22">Streaming media</searchLink><br /><searchLink fieldCode="DE" term="%22Home+rehabilitation%22">Home rehabilitation</searchLink><br /><searchLink fieldCode="DE" term="%22Time+series+analysis%22">Time series analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Physical+activity%22">Physical activity</searchLink><br /><searchLink fieldCode="DE" term="%22Artificial+intelligence%22">Artificial intelligence</searchLink><br /><searchLink fieldCode="DE" term="%22Psychological+feedback%22">Psychological feedback</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: The recent proliferation of home-based exercise content has garnered significant attention. This has led to an increasing demand for Artificial Intelligence (AI) devices capable of automatically assessing exercise quality and providing guidance. However, existing real-time exercise quality assessment algorithms require instructors and learners to share similar camera views. Furthermore, these methods often rely on pre-labeled data, support a limited number of exercise actions, and offer restricted feedback. Among the numerous videos where data is hard to pre-label, instructors and learners may have unrestricted camera views and inconsistent body shape, while instructors may demonstrate unpredicted actions. To address the aforementioned challenges, we propose a method for Exercise Quality Assessment in Monocular Videos (MV-EQA), which incorporates a Skeleton Mapping and View Aligning (SMVA) module, a Multi-Feature Dynamic Time Warping (MF-DTW) module, and online/offline Exercise Quality Assessment (EQA) modules. Specifically, SMVA utilizes a lightweight encoder–decoder network based on transformer architecture that effectively handles differences in view and skeleton between learners and instructors while preserving inherent variations in their movements; MF-DTW utilizes multiple body information for temporal alignment; online/offline EQA modules enable online feedback (scoring with visual comparison) and offline feedback (reviews with comments). Extensive experiments indicate the superiority of our approach over other methods in EQA tasks. The code is available at link. • Reveals view and skeleton inconsistency impacts on home exercise assessment. • SMVA method bypasses 2D-to-3D errors and handles view and skeleton differences. • Introduces MF-DTW for precise temporal alignment between learner and instructor. • Uses large language models to provide detailed exercise quality feedback. • Provides real-time multimodal scoring and visual comparison for exercises. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Engineering Applications of Artificial Intelligence is the property of Pergamon Press - An Imprint of Elsevier Science and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=193754981 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1016/j.engappai.2026.114905 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 1 StartPage: N.PAG Subjects: – SubjectFull: Pose estimation (Computer vision) Type: general – SubjectFull: Streaming media Type: general – SubjectFull: Home rehabilitation Type: general – SubjectFull: Time series analysis Type: general – SubjectFull: Physical activity Type: general – SubjectFull: Artificial intelligence Type: general – SubjectFull: Psychological feedback Type: general Titles: – TitleFull: Exercise quality assessment in monocular video streaming. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Zhang, Yongchang – PersonEntity: Name: NameFull: Xu, Boxuan – PersonEntity: Name: NameFull: Lin, Zhaowen – PersonEntity: Name: NameFull: Li, Junjie – PersonEntity: Name: NameFull: Ming, Anlong IsPartOfRelationships: – BibEntity: Dates: – D: 05 M: 08 Text: Aug2026:Part 2 Type: published Y: 2026 Identifiers: – Type: issn-print Value: 09521976 Numbering: – Type: volume Value: 177 Titles: – TitleFull: Engineering Applications of Artificial Intelligence Type: main |
| ResultId | 1 |