Vocal and Facial Behavior during Affect Production in Autism Spectrum Disorder

Saved in:
Bibliographic Details
Title: Vocal and Facial Behavior during Affect Production in Autism Spectrum Disorder
Language: English
Authors: Hardik Kothare (ORCID 0000-0003-4305-0334), Vikram Ramanarayanan (ORCID 0000-0001-7810-2769), Michael Neumann, Jackson Liscombe, Vanessa Richter, Linnea Lampinen, Alison Bai, Cristian Preciado, Katherine Brogan, Carly Demopoulos
Source: Journal of Speech, Language, and Hearing Research. 2025 68(2):419-434.
Availability: American Speech-Language-Hearing Association. 2200 Research Blvd #250, Rockville, MD 20850. Tel: 301-296-5700; Fax: 301-296-8580; e-mail: slhr@asha.org; Web site: http://jslhr.pubs.asha.org
Peer Reviewed: Y
Page Count: 16
Publication Date: 2025
Sponsoring Agency: National Institutes of Health (NIH) (DHHS)
Contract Number: K23DC016637
R01DC019167
Document Type: Journal Articles
Reports - Research
Descriptors: Children, Autism Spectrum Disorders, Affective Behavior, Affective Objectives, Psychological Patterns, Verbal Communication, Nonverbal Communication, Speech Communication, Biofeedback
Geographic Terms: California (San Francisco)
DOI: 10.1044/2024_JSLHR-23-00080
ISSN: 1092-4388
1558-9102
Abstract: Purpose: We investigate the extent to which automated audiovisual metrics extracted during an affect production task show statistically significant differences between a cohort of children diagnosed with autism spectrum disorder (ASD) and typically developing controls. Method: Forty children with ASD and 21 neurotypical controls interacted with a multimodal conversational platform with a virtual agent, Tina, who guided them through tasks prompting facial and vocal communication of four emotions--happy, angry, sad, and afraid--under conditions of high and low verbal and social cognitive task demands. Results: Individuals with ASD exhibited greater standard deviation of the fundamental frequency of the voice with the minima and maxima of the pitch contour occurring at an earlier time point as compared to controls. The intensity and voice quality of emotional speech were also different between the two cohorts in certain conditions. Additionally, facial metrics capturing the acceleration of the lower lip, lip width, eye opening, and vertical displacement of the eyebrows were also important markers to distinguish between children with ASD and neurotypical controls. Both facial and speech metrics performed well above chance in group classification accuracy. Conclusion: Speech acoustic and facial metrics associated with affect production were effective in distinguishing between children with ASD and neurotypical controls.
Abstractor: As Provided
Entry Date: 2025
Accession Number: EJ1462971
Database: ERIC
Description
Abstract:Purpose: We investigate the extent to which automated audiovisual metrics extracted during an affect production task show statistically significant differences between a cohort of children diagnosed with autism spectrum disorder (ASD) and typically developing controls. Method: Forty children with ASD and 21 neurotypical controls interacted with a multimodal conversational platform with a virtual agent, Tina, who guided them through tasks prompting facial and vocal communication of four emotions--happy, angry, sad, and afraid--under conditions of high and low verbal and social cognitive task demands. Results: Individuals with ASD exhibited greater standard deviation of the fundamental frequency of the voice with the minima and maxima of the pitch contour occurring at an earlier time point as compared to controls. The intensity and voice quality of emotional speech were also different between the two cohorts in certain conditions. Additionally, facial metrics capturing the acceleration of the lower lip, lip width, eye opening, and vertical displacement of the eyebrows were also important markers to distinguish between children with ASD and neurotypical controls. Both facial and speech metrics performed well above chance in group classification accuracy. Conclusion: Speech acoustic and facial metrics associated with affect production were effective in distinguishing between children with ASD and neurotypical controls.
ISSN:1092-4388
1558-9102
DOI:10.1044/2024_JSLHR-23-00080