Vocal and Facial Behavior during Affect Production in Autism Spectrum Disorder

Saved in:
Bibliographic Details
Title: Vocal and Facial Behavior during Affect Production in Autism Spectrum Disorder
Language: English
Authors: Hardik Kothare (ORCID 0000-0003-4305-0334), Vikram Ramanarayanan (ORCID 0000-0001-7810-2769), Michael Neumann, Jackson Liscombe, Vanessa Richter, Linnea Lampinen, Alison Bai, Cristian Preciado, Katherine Brogan, Carly Demopoulos
Source: Journal of Speech, Language, and Hearing Research. 2025 68(2):419-434.
Availability: American Speech-Language-Hearing Association. 2200 Research Blvd #250, Rockville, MD 20850. Tel: 301-296-5700; Fax: 301-296-8580; e-mail: slhr@asha.org; Web site: http://jslhr.pubs.asha.org
Peer Reviewed: Y
Page Count: 16
Publication Date: 2025
Sponsoring Agency: National Institutes of Health (NIH) (DHHS)
Contract Number: K23DC016637
R01DC019167
Document Type: Journal Articles
Reports - Research
Descriptors: Children, Autism Spectrum Disorders, Affective Behavior, Affective Objectives, Psychological Patterns, Verbal Communication, Nonverbal Communication, Speech Communication, Biofeedback
Geographic Terms: California (San Francisco)
DOI: 10.1044/2024_JSLHR-23-00080
ISSN: 1092-4388
1558-9102
Abstract: Purpose: We investigate the extent to which automated audiovisual metrics extracted during an affect production task show statistically significant differences between a cohort of children diagnosed with autism spectrum disorder (ASD) and typically developing controls. Method: Forty children with ASD and 21 neurotypical controls interacted with a multimodal conversational platform with a virtual agent, Tina, who guided them through tasks prompting facial and vocal communication of four emotions--happy, angry, sad, and afraid--under conditions of high and low verbal and social cognitive task demands. Results: Individuals with ASD exhibited greater standard deviation of the fundamental frequency of the voice with the minima and maxima of the pitch contour occurring at an earlier time point as compared to controls. The intensity and voice quality of emotional speech were also different between the two cohorts in certain conditions. Additionally, facial metrics capturing the acceleration of the lower lip, lip width, eye opening, and vertical displacement of the eyebrows were also important markers to distinguish between children with ASD and neurotypical controls. Both facial and speech metrics performed well above chance in group classification accuracy. Conclusion: Speech acoustic and facial metrics associated with affect production were effective in distinguishing between children with ASD and neurotypical controls.
Abstractor: As Provided
Entry Date: 2025
Accession Number: EJ1462971
Database: ERIC
FullText Links:
  – Type: pdflink
    Url: https://content.ebscohost.com/cds/retrieve?content=AQICAHj0k_4E0hTGH8RJwT4gCJyBsGNe_WN95AvKlDbXJGqwxwHQfxZWmYZCk8LBnlcoI_gZAAAA4jCB3wYJKoZIhvcNAQcGoIHRMIHOAgEAMIHIBgkqhkiG9w0BBwEwHgYJYIZIAWUDBAEuMBEEDPlXTZJzxvUNPzv7PQIBEICBmk0Qa7O2oaYj4HMWG_HJn-SM2GhBYhgWwjJTIOSe2CO-NTk5iPbuTxTVsLiRg-yGCbKEbCFDU2ZT8fFTkjikBlqZm8HhlOQC-f0eFhlBFA0dR1D0H3vmKP8D7yH3pgoWL6463urHI3ets4iVAqMt69xpJ8DOz3Ep-gg3hgEIMHl4QEU3yOmFjTp5P0JARPWlHEAZL0Gy50pLqAc=
Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1462971
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Vocal and Facial Behavior during Affect Production in Autism Spectrum Disorder
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Hardik+Kothare%22">Hardik Kothare</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-4305-0334">0000-0003-4305-0334</externalLink>)<br /><searchLink fieldCode="AR" term="%22Vikram+Ramanarayanan%22">Vikram Ramanarayanan</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-7810-2769">0000-0001-7810-2769</externalLink>)<br /><searchLink fieldCode="AR" term="%22Michael+Neumann%22">Michael Neumann</searchLink><br /><searchLink fieldCode="AR" term="%22Jackson+Liscombe%22">Jackson Liscombe</searchLink><br /><searchLink fieldCode="AR" term="%22Vanessa+Richter%22">Vanessa Richter</searchLink><br /><searchLink fieldCode="AR" term="%22Linnea+Lampinen%22">Linnea Lampinen</searchLink><br /><searchLink fieldCode="AR" term="%22Alison+Bai%22">Alison Bai</searchLink><br /><searchLink fieldCode="AR" term="%22Cristian+Preciado%22">Cristian Preciado</searchLink><br /><searchLink fieldCode="AR" term="%22Katherine+Brogan%22">Katherine Brogan</searchLink><br /><searchLink fieldCode="AR" term="%22Carly+Demopoulos%22">Carly Demopoulos</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Journal+of+Speech%2C+Language%2C+and+Hearing+Research%22"><i>Journal of Speech, Language, and Hearing Research</i></searchLink>. 2025 68(2):419-434.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: American Speech-Language-Hearing Association. 2200 Research Blvd #250, Rockville, MD 20850. Tel: 301-296-5700; Fax: 301-296-8580; e-mail: slhr@asha.org; Web site: http://jslhr.pubs.asha.org
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 16
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2025
– Name: SourceSuprt
  Label: Sponsoring Agency
  Group: SrcSuprt
  Data: National Institutes of Health (NIH) (DHHS)
– Name: NumberContract
  Label: Contract Number
  Group: NumCntrct
  Data: K23DC016637<br />R01DC019167
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Children%22">Children</searchLink><br /><searchLink fieldCode="DE" term="%22Autism+Spectrum+Disorders%22">Autism Spectrum Disorders</searchLink><br /><searchLink fieldCode="DE" term="%22Affective+Behavior%22">Affective Behavior</searchLink><br /><searchLink fieldCode="DE" term="%22Affective+Objectives%22">Affective Objectives</searchLink><br /><searchLink fieldCode="DE" term="%22Psychological+Patterns%22">Psychological Patterns</searchLink><br /><searchLink fieldCode="DE" term="%22Verbal+Communication%22">Verbal Communication</searchLink><br /><searchLink fieldCode="DE" term="%22Nonverbal+Communication%22">Nonverbal Communication</searchLink><br /><searchLink fieldCode="DE" term="%22Speech+Communication%22">Speech Communication</searchLink><br /><searchLink fieldCode="DE" term="%22Biofeedback%22">Biofeedback</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22California+%28San+Francisco%29%22">California (San Francisco)</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1044/2024_JSLHR-23-00080
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 1092-4388<br />1558-9102
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Purpose: We investigate the extent to which automated audiovisual metrics extracted during an affect production task show statistically significant differences between a cohort of children diagnosed with autism spectrum disorder (ASD) and typically developing controls. Method: Forty children with ASD and 21 neurotypical controls interacted with a multimodal conversational platform with a virtual agent, Tina, who guided them through tasks prompting facial and vocal communication of four emotions--happy, angry, sad, and afraid--under conditions of high and low verbal and social cognitive task demands. Results: Individuals with ASD exhibited greater standard deviation of the fundamental frequency of the voice with the minima and maxima of the pitch contour occurring at an earlier time point as compared to controls. The intensity and voice quality of emotional speech were also different between the two cohorts in certain conditions. Additionally, facial metrics capturing the acceleration of the lower lip, lip width, eye opening, and vertical displacement of the eyebrows were also important markers to distinguish between children with ASD and neurotypical controls. Both facial and speech metrics performed well above chance in group classification accuracy. Conclusion: Speech acoustic and facial metrics associated with affect production were effective in distinguishing between children with ASD and neurotypical controls.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2025
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1462971
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1462971
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1044/2024_JSLHR-23-00080
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 16
        StartPage: 419
    Subjects:
      – SubjectFull: Children
        Type: general
      – SubjectFull: Autism Spectrum Disorders
        Type: general
      – SubjectFull: Affective Behavior
        Type: general
      – SubjectFull: Affective Objectives
        Type: general
      – SubjectFull: Psychological Patterns
        Type: general
      – SubjectFull: Verbal Communication
        Type: general
      – SubjectFull: Nonverbal Communication
        Type: general
      – SubjectFull: Speech Communication
        Type: general
      – SubjectFull: Biofeedback
        Type: general
      – SubjectFull: California (San Francisco)
        Type: general
    Titles:
      – TitleFull: Vocal and Facial Behavior during Affect Production in Autism Spectrum Disorder
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Hardik Kothare
      – PersonEntity:
          Name:
            NameFull: Vikram Ramanarayanan
      – PersonEntity:
          Name:
            NameFull: Michael Neumann
      – PersonEntity:
          Name:
            NameFull: Jackson Liscombe
      – PersonEntity:
          Name:
            NameFull: Vanessa Richter
      – PersonEntity:
          Name:
            NameFull: Linnea Lampinen
      – PersonEntity:
          Name:
            NameFull: Alison Bai
      – PersonEntity:
          Name:
            NameFull: Cristian Preciado
      – PersonEntity:
          Name:
            NameFull: Katherine Brogan
      – PersonEntity:
          Name:
            NameFull: Carly Demopoulos
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-print
              Value: 1092-4388
            – Type: issn-electronic
              Value: 1558-9102
          Numbering:
            – Type: volume
              Value: 68
            – Type: issue
              Value: 2
          Titles:
            – TitleFull: Journal of Speech, Language, and Hearing Research
              Type: main
ResultId 1