View in EDS

Enhancing online speech and language assessment: Item development for the remote adult language experiment (ReAL-E) tool.

Saved in:
Bibliographic Details
Title: Enhancing online speech and language assessment: Item development for the remote adult language experiment (ReAL-E) tool.
Authors: Lancaster, Hope Sparks1 (AUTHOR) hope.lancaster@boystown.org, Parks, Ryan1 (AUTHOR), Bashford, Seth2 (AUTHOR), Fitzpatrick, Denis2 (AUTHOR), Buttner, Alicia1 (AUTHOR)
Source: Journal of Communication Disorders. Mar2025, Vol. 114, pN.PAG-N.PAG. 1p.
Subject Terms: *Communicative competence, *Content analysis, *Speech evaluation, *Evaluation, *Adults, Task performance, Pilot projects, Research evaluation, Telemedicine
Abstract: • The ReAL-E adapts seven productive speech and language tasks for online delivery. • Refinements were made through an iterative feedback process with experts and users. • Adults performed within expected ranges on five of the seven tasks. • Five tasks had acceptable reliability, with mixed evidence of concurrent validity. • Results indicate feasibility of the ReAL-E while identifying areas for refinement. Purpose : Recent technological advancements in psychology have yielded multiple unsupervised online tools for measuring cognitive skills. However, these tools do not measure key features of communication abilities in adults, such as productive speech or oral language. To address this gap, we developed the Remote Adult Language Experiment (ReAL-E) using a three-step approach that incorporates domain identification, expert evaluation, and piloting testing. Method : Step 1 focused on domain and task identification by collaborating with experts and reviewing the literature. Step 2 included two rounds of evaluation by content and lay experts to assess the initial tool design, identify areas for refinement, and solicit feedback for desired features. Step 3 involved piloting the tool in a sample of adults recruited online. Results : The ReAL-E tool adapted three speech planning and production tasks and four oral and written language tasks into online versions. Feedback from content and lay experts led to significant improvements, including enhanced task instructions, presentation modifications, and the incorporation of features to address potential confounds. Pilot testing demonstrated that adults perform within expected ranges, and five out of seven tasks had good to excellent preliminary reliability. Conclusion : The development of the ReAL-E tool contributes to the field by offering a scalable, efficient method for assessing a broad range of communication skills in adults, paving the way for future research and clinical applications in developmental communication disorders. Our study underscores the collaborative effort and innovative approach required for creating a digital assessment tool that promises to expand research capabilities and improve diagnostic processes in the discipline. [ABSTRACT FROM AUTHOR]
Copyright of Journal of Communication Disorders is the property of Elsevier B.V. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Education Research Complete
Description
Abstract:• The ReAL-E adapts seven productive speech and language tasks for online delivery. • Refinements were made through an iterative feedback process with experts and users. • Adults performed within expected ranges on five of the seven tasks. • Five tasks had acceptable reliability, with mixed evidence of concurrent validity. • Results indicate feasibility of the ReAL-E while identifying areas for refinement. Purpose : Recent technological advancements in psychology have yielded multiple unsupervised online tools for measuring cognitive skills. However, these tools do not measure key features of communication abilities in adults, such as productive speech or oral language. To address this gap, we developed the Remote Adult Language Experiment (ReAL-E) using a three-step approach that incorporates domain identification, expert evaluation, and piloting testing. Method : Step 1 focused on domain and task identification by collaborating with experts and reviewing the literature. Step 2 included two rounds of evaluation by content and lay experts to assess the initial tool design, identify areas for refinement, and solicit feedback for desired features. Step 3 involved piloting the tool in a sample of adults recruited online. Results : The ReAL-E tool adapted three speech planning and production tasks and four oral and written language tasks into online versions. Feedback from content and lay experts led to significant improvements, including enhanced task instructions, presentation modifications, and the incorporation of features to address potential confounds. Pilot testing demonstrated that adults perform within expected ranges, and five out of seven tasks had good to excellent preliminary reliability. Conclusion : The development of the ReAL-E tool contributes to the field by offering a scalable, efficient method for assessing a broad range of communication skills in adults, paving the way for future research and clinical applications in developmental communication disorders. Our study underscores the collaborative effort and innovative approach required for creating a digital assessment tool that promises to expand research capabilities and improve diagnostic processes in the discipline. [ABSTRACT FROM AUTHOR]
ISSN:00219924
DOI:10.1016/j.jcomdis.2025.106496