Leveraging Communication Partner Speech to Automate Augmented Input for Children on the Autism Spectrum Who Are Minimally Verbal: Prototype Development and Preliminary Efficacy Investigation.

Saved in:
Bibliographic Details
Title: Leveraging Communication Partner Speech to Automate Augmented Input for Children on the Autism Spectrum Who Are Minimally Verbal: Prototype Development and Preliminary Efficacy Investigation.
Authors: Holyfield, Christine1 ceholyfi@uark.edu, MacNeil, Stephen2, Caldwell, Nicolette1, Zimmerman, Tara O’Neill1, Lorah, Elizabeth3, Dragut, Eduard2, Vucetic, Slobodan2
Source: American Journal of Speech-Language Pathology. May2024, Vol. 33 Issue 3, p1174-1192. 19p.
Subject Terms: *Diffusion of innovations, *Autism, *Artificial intelligence, *Attention, *Communication, *Automation, *Speech disorders, *Inter-observer reliability, Speech, Facilitated communication, Linguistics
Abstract: Purpose: Augmentative and alternative communication (AAC) technology innovation is urgently needed to improve outcomes for children on the autism spectrum who are minimally verbal. One potential technology innovation is applying artificial intelligence (AI) to automate strategies such as augmented input to increase language learning opportunities while mitigating communication partner time and learning barriers. Innovation in AAC research and design methodology is also needed to empirically explore this and other applications of AI to AAC. The purpose of this report was to describe (a) the development of an AAC prototype using a design methodology new to AAC research and (b) a preliminary investigation of the efficacy of this potential new AAC capability. Method: The prototype was developed using a Wizard-of-Oz prototyping approach that allows for initial exploration of a new technology capability without the time and effort required for full-scale development. The preliminary investigation with three children on the autism spectrum who were minimally verbal used an adapted alternating treatment design to compare the effects of a Wizard-of-Oz prototype that provided automated augmented input (i.e., pairing color photos with speech) to a standard topic display (i.e., a grid display with line drawings) on visual attention, linguistic participation, and (for one participant) word learning during a circle activity. Results: Preliminary investigation results were variable, but overall participants increased visual attention and linguistic participation when using the prototype. Conclusions: Wizard-of-Oz prototyping could be a valuable approach to spur much needed innovation in AAC. Further research into efficacy, reliability, validity, and attitudes is required to more comprehensively evaluate the use of AI to automate augmented input in AAC. [ABSTRACT FROM AUTHOR]
Copyright of American Journal of Speech-Language Pathology is the property of American Speech-Language-Hearing Association and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Education Research Complete
FullText Links:
  – Type: pdflink
Text:
  Availability: 0
Header DbId: ehh
DbLabel: Education Research Complete
An: 177020401
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Leveraging Communication Partner Speech to Automate Augmented Input for Children on the Autism Spectrum Who Are Minimally Verbal: Prototype Development and Preliminary Efficacy Investigation.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Holyfield%2C+Christine%22">Holyfield, Christine</searchLink><relatesTo>1</relatesTo><i> ceholyfi@uark.edu</i><br /><searchLink fieldCode="AR" term="%22MacNeil%2C+Stephen%22">MacNeil, Stephen</searchLink><relatesTo>2</relatesTo><br /><searchLink fieldCode="AR" term="%22Caldwell%2C+Nicolette%22">Caldwell, Nicolette</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Zimmerman%2C+Tara+O’Neill%22">Zimmerman, Tara O’Neill</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Lorah%2C+Elizabeth%22">Lorah, Elizabeth</searchLink><relatesTo>3</relatesTo><br /><searchLink fieldCode="AR" term="%22Dragut%2C+Eduard%22">Dragut, Eduard</searchLink><relatesTo>2</relatesTo><br /><searchLink fieldCode="AR" term="%22Vucetic%2C+Slobodan%22">Vucetic, Slobodan</searchLink><relatesTo>2</relatesTo>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22American+Journal+of+Speech-Language+Pathology%22">American Journal of Speech-Language Pathology</searchLink>. May2024, Vol. 33 Issue 3, p1174-1192. 19p.
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: *<searchLink fieldCode="DE" term="%22Diffusion+of+innovations%22">Diffusion of innovations</searchLink><br />*<searchLink fieldCode="DE" term="%22Autism%22">Autism</searchLink><br />*<searchLink fieldCode="DE" term="%22Artificial+intelligence%22">Artificial intelligence</searchLink><br />*<searchLink fieldCode="DE" term="%22Attention%22">Attention</searchLink><br />*<searchLink fieldCode="DE" term="%22Communication%22">Communication</searchLink><br />*<searchLink fieldCode="DE" term="%22Automation%22">Automation</searchLink><br />*<searchLink fieldCode="DE" term="%22Speech+disorders%22">Speech disorders</searchLink><br />*<searchLink fieldCode="DE" term="%22Inter-observer+reliability%22">Inter-observer reliability</searchLink><br /><searchLink fieldCode="DE" term="%22Speech%22">Speech</searchLink><br /><searchLink fieldCode="DE" term="%22Facilitated+communication%22">Facilitated communication</searchLink><br /><searchLink fieldCode="DE" term="%22Linguistics%22">Linguistics</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Purpose: Augmentative and alternative communication (AAC) technology innovation is urgently needed to improve outcomes for children on the autism spectrum who are minimally verbal. One potential technology innovation is applying artificial intelligence (AI) to automate strategies such as augmented input to increase language learning opportunities while mitigating communication partner time and learning barriers. Innovation in AAC research and design methodology is also needed to empirically explore this and other applications of AI to AAC. The purpose of this report was to describe (a) the development of an AAC prototype using a design methodology new to AAC research and (b) a preliminary investigation of the efficacy of this potential new AAC capability. Method: The prototype was developed using a Wizard-of-Oz prototyping approach that allows for initial exploration of a new technology capability without the time and effort required for full-scale development. The preliminary investigation with three children on the autism spectrum who were minimally verbal used an adapted alternating treatment design to compare the effects of a Wizard-of-Oz prototype that provided automated augmented input (i.e., pairing color photos with speech) to a standard topic display (i.e., a grid display with line drawings) on visual attention, linguistic participation, and (for one participant) word learning during a circle activity. Results: Preliminary investigation results were variable, but overall participants increased visual attention and linguistic participation when using the prototype. Conclusions: Wizard-of-Oz prototyping could be a valuable approach to spur much needed innovation in AAC. Further research into efficacy, reliability, validity, and attitudes is required to more comprehensively evaluate the use of AI to automate augmented input in AAC. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of American Journal of Speech-Language Pathology is the property of American Speech-Language-Hearing Association and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=177020401
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1044/2023_AJSLP-23-00224
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 19
        StartPage: 1174
    Subjects:
      – SubjectFull: Diffusion of innovations
        Type: general
      – SubjectFull: Autism
        Type: general
      – SubjectFull: Artificial intelligence
        Type: general
      – SubjectFull: Attention
        Type: general
      – SubjectFull: Communication
        Type: general
      – SubjectFull: Automation
        Type: general
      – SubjectFull: Speech disorders
        Type: general
      – SubjectFull: Inter-observer reliability
        Type: general
      – SubjectFull: Speech
        Type: general
      – SubjectFull: Facilitated communication
        Type: general
      – SubjectFull: Linguistics
        Type: general
    Titles:
      – TitleFull: Leveraging Communication Partner Speech to Automate Augmented Input for Children on the Autism Spectrum Who Are Minimally Verbal: Prototype Development and Preliminary Efficacy Investigation.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Holyfield, Christine
      – PersonEntity:
          Name:
            NameFull: MacNeil, Stephen
      – PersonEntity:
          Name:
            NameFull: Caldwell, Nicolette
      – PersonEntity:
          Name:
            NameFull: Zimmerman, Tara O’Neill
      – PersonEntity:
          Name:
            NameFull: Lorah, Elizabeth
      – PersonEntity:
          Name:
            NameFull: Dragut, Eduard
      – PersonEntity:
          Name:
            NameFull: Vucetic, Slobodan
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 05
              Text: May2024
              Type: published
              Y: 2024
          Identifiers:
            – Type: issn-print
              Value: 10580360
          Numbering:
            – Type: volume
              Value: 33
            – Type: issue
              Value: 3
          Titles:
            – TitleFull: American Journal of Speech-Language Pathology
              Type: main
ResultId 1