View in EDS

Enhancing online speech and language assessment: Item development for the remote adult language experiment (ReAL-E) tool.

Saved in:
Bibliographic Details
Title: Enhancing online speech and language assessment: Item development for the remote adult language experiment (ReAL-E) tool.
Authors: Lancaster, Hope Sparks1 (AUTHOR) hope.lancaster@boystown.org, Parks, Ryan1 (AUTHOR), Bashford, Seth2 (AUTHOR), Fitzpatrick, Denis2 (AUTHOR), Buttner, Alicia1 (AUTHOR)
Source: Journal of Communication Disorders. Mar2025, Vol. 114, pN.PAG-N.PAG. 1p.
Subject Terms: *Communicative competence, *Content analysis, *Speech evaluation, *Evaluation, *Adults, Task performance, Pilot projects, Research evaluation, Telemedicine
Abstract: • The ReAL-E adapts seven productive speech and language tasks for online delivery. • Refinements were made through an iterative feedback process with experts and users. • Adults performed within expected ranges on five of the seven tasks. • Five tasks had acceptable reliability, with mixed evidence of concurrent validity. • Results indicate feasibility of the ReAL-E while identifying areas for refinement. Purpose : Recent technological advancements in psychology have yielded multiple unsupervised online tools for measuring cognitive skills. However, these tools do not measure key features of communication abilities in adults, such as productive speech or oral language. To address this gap, we developed the Remote Adult Language Experiment (ReAL-E) using a three-step approach that incorporates domain identification, expert evaluation, and piloting testing. Method : Step 1 focused on domain and task identification by collaborating with experts and reviewing the literature. Step 2 included two rounds of evaluation by content and lay experts to assess the initial tool design, identify areas for refinement, and solicit feedback for desired features. Step 3 involved piloting the tool in a sample of adults recruited online. Results : The ReAL-E tool adapted three speech planning and production tasks and four oral and written language tasks into online versions. Feedback from content and lay experts led to significant improvements, including enhanced task instructions, presentation modifications, and the incorporation of features to address potential confounds. Pilot testing demonstrated that adults perform within expected ranges, and five out of seven tasks had good to excellent preliminary reliability. Conclusion : The development of the ReAL-E tool contributes to the field by offering a scalable, efficient method for assessing a broad range of communication skills in adults, paving the way for future research and clinical applications in developmental communication disorders. Our study underscores the collaborative effort and innovative approach required for creating a digital assessment tool that promises to expand research capabilities and improve diagnostic processes in the discipline. [ABSTRACT FROM AUTHOR]
Copyright of Journal of Communication Disorders is the property of Elsevier B.V. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Education Research Complete
FullText Text:
  Availability: 0
Header DbId: ehh
DbLabel: Education Research Complete
An: 183599860
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Enhancing online speech and language assessment: Item development for the remote adult language experiment (ReAL-E) tool.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Lancaster%2C+Hope+Sparks%22">Lancaster, Hope Sparks</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> hope.lancaster@boystown.org</i><br /><searchLink fieldCode="AR" term="%22Parks%2C+Ryan%22">Parks, Ryan</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Bashford%2C+Seth%22">Bashford, Seth</searchLink><relatesTo>2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Fitzpatrick%2C+Denis%22">Fitzpatrick, Denis</searchLink><relatesTo>2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Buttner%2C+Alicia%22">Buttner, Alicia</searchLink><relatesTo>1</relatesTo> (AUTHOR)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Journal+of+Communication+Disorders%22">Journal of Communication Disorders</searchLink>. Mar2025, Vol. 114, pN.PAG-N.PAG. 1p.
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: *<searchLink fieldCode="DE" term="%22Communicative+competence%22">Communicative competence</searchLink><br />*<searchLink fieldCode="DE" term="%22Content+analysis%22">Content analysis</searchLink><br />*<searchLink fieldCode="DE" term="%22Speech+evaluation%22">Speech evaluation</searchLink><br />*<searchLink fieldCode="DE" term="%22Evaluation%22">Evaluation</searchLink><br />*<searchLink fieldCode="DE" term="%22Adults%22">Adults</searchLink><br /><searchLink fieldCode="DE" term="%22Task+performance%22">Task performance</searchLink><br /><searchLink fieldCode="DE" term="%22Pilot+projects%22">Pilot projects</searchLink><br /><searchLink fieldCode="DE" term="%22Research+evaluation%22">Research evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Telemedicine%22">Telemedicine</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: • The ReAL-E adapts seven productive speech and language tasks for online delivery. • Refinements were made through an iterative feedback process with experts and users. • Adults performed within expected ranges on five of the seven tasks. • Five tasks had acceptable reliability, with mixed evidence of concurrent validity. • Results indicate feasibility of the ReAL-E while identifying areas for refinement. Purpose : Recent technological advancements in psychology have yielded multiple unsupervised online tools for measuring cognitive skills. However, these tools do not measure key features of communication abilities in adults, such as productive speech or oral language. To address this gap, we developed the Remote Adult Language Experiment (ReAL-E) using a three-step approach that incorporates domain identification, expert evaluation, and piloting testing. Method : Step 1 focused on domain and task identification by collaborating with experts and reviewing the literature. Step 2 included two rounds of evaluation by content and lay experts to assess the initial tool design, identify areas for refinement, and solicit feedback for desired features. Step 3 involved piloting the tool in a sample of adults recruited online. Results : The ReAL-E tool adapted three speech planning and production tasks and four oral and written language tasks into online versions. Feedback from content and lay experts led to significant improvements, including enhanced task instructions, presentation modifications, and the incorporation of features to address potential confounds. Pilot testing demonstrated that adults perform within expected ranges, and five out of seven tasks had good to excellent preliminary reliability. Conclusion : The development of the ReAL-E tool contributes to the field by offering a scalable, efficient method for assessing a broad range of communication skills in adults, paving the way for future research and clinical applications in developmental communication disorders. Our study underscores the collaborative effort and innovative approach required for creating a digital assessment tool that promises to expand research capabilities and improve diagnostic processes in the discipline. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Journal of Communication Disorders is the property of Elsevier B.V. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=183599860
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1016/j.jcomdis.2025.106496
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 1
        StartPage: N.PAG
    Subjects:
      – SubjectFull: Communicative competence
        Type: general
      – SubjectFull: Content analysis
        Type: general
      – SubjectFull: Speech evaluation
        Type: general
      – SubjectFull: Evaluation
        Type: general
      – SubjectFull: Adults
        Type: general
      – SubjectFull: Task performance
        Type: general
      – SubjectFull: Pilot projects
        Type: general
      – SubjectFull: Research evaluation
        Type: general
      – SubjectFull: Telemedicine
        Type: general
    Titles:
      – TitleFull: Enhancing online speech and language assessment: Item development for the remote adult language experiment (ReAL-E) tool.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Lancaster, Hope Sparks
      – PersonEntity:
          Name:
            NameFull: Parks, Ryan
      – PersonEntity:
          Name:
            NameFull: Bashford, Seth
      – PersonEntity:
          Name:
            NameFull: Fitzpatrick, Denis
      – PersonEntity:
          Name:
            NameFull: Buttner, Alicia
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 03
              Text: Mar2025
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-print
              Value: 00219924
          Numbering:
            – Type: volume
              Value: 114
          Titles:
            – TitleFull: Journal of Communication Disorders
              Type: main
ResultId 1