The “Conducting Master”: An Interactive, Real-Time Gesture Monitoring System Based on Spatiotemporal Motion Templates.
Saved in:
| Title: | The “Conducting Master”: An Interactive, Real-Time Gesture Monitoring System Based on Spatiotemporal Motion Templates. |
|---|---|
| Authors: | Maes, Pieter-Jan (AUTHOR), Amelynck, Denis (AUTHOR), Lesaffre, Micheline (AUTHOR), Leman, Marc (AUTHOR), Arvind, D.K. (AUTHOR) |
| Source: | International Journal of Human-Computer Interaction. Jul2013, Vol. 29 Issue 7, p471-487. 17p. 1 Color Photograph, 7 Diagrams, 1 Chart, 7 Graphs. |
| Subjects: | Spatiotemporal processes, Human-computer interaction, Mathematical models, Musical meter & rhythm, Body movement |
| Abstract: | Research in the field of embodied music cognition has shown the importance of coupled processes of body activity (action) and multimodal representations of these actions (perception) in how music is processed. Technologies in the field of human–computer interaction (HCI) provide excellent means to intervene into, and extend, these coupled action-perception processes. In this article this model is applied to a concrete HCI application, called the “Conducting Master.” The application facilitates multiple users to interact in real time with the system in order to explore and learn how musical meter can be articulated into body movements (i.e., meter-mimicking gestures). Techniques are provided to model and automatically recognize these gestures in order to provide multimodal feedback streams back to the users. These techniques are based on template-based methods that allow approaching meter-mimicking gestures explicitly from a spatiotemporal account. To conclude, some concrete setups are presented in which the functionality of the Conducting Master was evaluated. [ABSTRACT FROM PUBLISHER] |
| Copyright of International Journal of Human-Computer Interaction is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Psychology and Behavioral Sciences Collection |
|
Full text is not displayed to guests.
Login for full access.
|
|
| FullText | Links: – Type: pdflink Text: Availability: 1 |
|---|---|
| Header | DbId: pbh DbLabel: Psychology and Behavioral Sciences Collection An: 87620958 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: The “Conducting Master”: An Interactive, Real-Time Gesture Monitoring System Based on Spatiotemporal Motion Templates. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Maes%2C+Pieter-Jan%22">Maes, Pieter-Jan</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Amelynck%2C+Denis%22">Amelynck, Denis</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Lesaffre%2C+Micheline%22">Lesaffre, Micheline</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Leman%2C+Marc%22">Leman, Marc</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Arvind%2C+D%2EK%2E%22">Arvind, D.K.</searchLink> (AUTHOR) – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22International+Journal+of+Human-Computer+Interaction%22">International Journal of Human-Computer Interaction</searchLink>. Jul2013, Vol. 29 Issue 7, p471-487. 17p. 1 Color Photograph, 7 Diagrams, 1 Chart, 7 Graphs. – Name: Subject Label: Subjects Group: Su Data: <searchLink fieldCode="DE" term="%22Spatiotemporal+processes%22">Spatiotemporal processes</searchLink><br /><searchLink fieldCode="DE" term="%22Human-computer+interaction%22">Human-computer interaction</searchLink><br /><searchLink fieldCode="DE" term="%22Mathematical+models%22">Mathematical models</searchLink><br /><searchLink fieldCode="DE" term="%22Musical+meter+%26+rhythm%22">Musical meter & rhythm</searchLink><br /><searchLink fieldCode="DE" term="%22Body+movement%22">Body movement</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: Research in the field of embodied music cognition has shown the importance of coupled processes of body activity (action) and multimodal representations of these actions (perception) in how music is processed. Technologies in the field of human–computer interaction (HCI) provide excellent means to intervene into, and extend, these coupled action-perception processes. In this article this model is applied to a concrete HCI application, called the “Conducting Master.” The application facilitates multiple users to interact in real time with the system in order to explore and learn how musical meter can be articulated into body movements (i.e., meter-mimicking gestures). Techniques are provided to model and automatically recognize these gestures in order to provide multimodal feedback streams back to the users. These techniques are based on template-based methods that allow approaching meter-mimicking gestures explicitly from a spatiotemporal account. To conclude, some concrete setups are presented in which the functionality of the Conducting Master was evaluated. [ABSTRACT FROM PUBLISHER] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of International Journal of Human-Computer Interaction is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=pbh&AN=87620958 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1080/10447318.2012.720197 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 17 StartPage: 471 Subjects: – SubjectFull: Spatiotemporal processes Type: general – SubjectFull: Human-computer interaction Type: general – SubjectFull: Mathematical models Type: general – SubjectFull: Musical meter & rhythm Type: general – SubjectFull: Body movement Type: general Titles: – TitleFull: The “Conducting Master”: An Interactive, Real-Time Gesture Monitoring System Based on Spatiotemporal Motion Templates. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Maes, Pieter-Jan – PersonEntity: Name: NameFull: Amelynck, Denis – PersonEntity: Name: NameFull: Lesaffre, Micheline – PersonEntity: Name: NameFull: Leman, Marc – PersonEntity: Name: NameFull: Arvind, D.K. IsPartOfRelationships: – BibEntity: Dates: – D: 03 M: 07 Text: Jul2013 Type: published Y: 2013 Identifiers: – Type: issn-print Value: 10447318 Numbering: – Type: volume Value: 29 – Type: issue Value: 7 Titles: – TitleFull: International Journal of Human-Computer Interaction Type: main |
| ResultId | 1 |