Development and validation of an episodic memory measure in the Mobile Toolbox (MTB): Arranging Pictures.
Saved in:
| Title: | Development and validation of an episodic memory measure in the Mobile Toolbox (MTB): Arranging Pictures. |
|---|---|
| Authors: | Young, Stephanie Ruth (AUTHOR), Dworak, Elizabeth M. (AUTHOR), Novack, Miriam A. (AUTHOR), Kaat, Aaron J. (AUTHOR), Adam, Hubert (AUTHOR), Nowinski, Cindy J. (AUTHOR), Hosseinian, Zahra (AUTHOR), Slotkin, Jerry (AUTHOR), Stoeger, Jordan (AUTHOR), Amagai, Saki (AUTHOR), Varela Diaz, Maria (AUTHOR), Almonte Correa, Anyelo (AUTHOR), Alperin, Keith (AUTHOR), Omberg, Larsson (AUTHOR), Kellen, Michael (AUTHOR), Camacho, Monica R. (AUTHOR), Landavazo, Bernard (AUTHOR), Nosheny, Rachel L. (AUTHOR), Weiner, Michael W. (AUTHOR), Gershon, Richard (AUTHOR) |
| Source: | Journal of Clinical & Experimental Neuropsychology. May2024, Vol. 46 Issue 4, p364-373. 10p. |
| Subjects: | Cognitive testing, Cognitive aging, Psychometrics, Statistical reliability, Memory testing |
| Abstract: | Arranging Pictures is a new episodic memory test based on the NIH Toolbox (NIHTB) Picture Sequence Memory measure and optimized for self-administration on a personal smartphone within the Mobile Toolbox (MTB). We describe evidence from three distinct validation studies. In Study 1, 92 participants self-administered Arranging Pictures on study-provided smartphones in the lab and were administered external measures of similar and dissimilar constructs by trained examiners to assess validity under controlled circumstances. In Study 2, 1,021 participants completed the external measures in the lab and self-administered Arranging Pictures remotely on their personal smartphones to assess validity in real-world contexts. In Study 3, 141 participants self-administered Arranging Pictures remotely twice with a two-week delay on personal iOS smartphones to assess test-retest reliability and practice effects. Internal consistency was good across samples (ρxx =.80 to.85, p <.001). Test-retest reliability was marginal (ICC =.49, p <.001) and there were significant practice effects after a two-week delay (ΔM = 3.21 (95% CI [2.56, 3.88]). As expected, correlations with convergent measures were significant and moderate to large in magnitude (ρ =.44 to.76, p <.001), while correlations with discriminant measures were small (ρ =.23 to.27, p <.05) or nonsignificant. Scores demonstrated significant negative correlations with age (ρ = -.32 to −.21, p <.001). Mean performance was slightly higher in the iOS compared to the Android group (MiOS = 18.80, NiOS = 635; MAndroid = 17.11, NAndroid = 386; t(757.73) = 4.17, p <.001), but device type did not significantly influence the psychometric properties of the measure. Indicators of potential cheating were mixed; average scores were significantly higher in the remote samples (F(2, 850) = 11.415, p <.001), but there were not significantly more perfect scores. The MTB Arranging Pictures measure demonstrated evidence of reliability and validity when self-administered on personal device. Future research should examine the potential for cheating in remote settings and the properties of the measure in clinical samples. [ABSTRACT FROM AUTHOR] |
| Copyright of Journal of Clinical & Experimental Neuropsychology is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Psychology and Behavioral Sciences Collection |
|
Full text is not displayed to guests.
Login for full access.
|
|
| Abstract: | Arranging Pictures is a new episodic memory test based on the NIH Toolbox (NIHTB) Picture Sequence Memory measure and optimized for self-administration on a personal smartphone within the Mobile Toolbox (MTB). We describe evidence from three distinct validation studies. In Study 1, 92 participants self-administered Arranging Pictures on study-provided smartphones in the lab and were administered external measures of similar and dissimilar constructs by trained examiners to assess validity under controlled circumstances. In Study 2, 1,021 participants completed the external measures in the lab and self-administered Arranging Pictures remotely on their personal smartphones to assess validity in real-world contexts. In Study 3, 141 participants self-administered Arranging Pictures remotely twice with a two-week delay on personal iOS smartphones to assess test-retest reliability and practice effects. Internal consistency was good across samples (ρxx =.80 to.85, p <.001). Test-retest reliability was marginal (ICC =.49, p <.001) and there were significant practice effects after a two-week delay (ΔM = 3.21 (95% CI [2.56, 3.88]). As expected, correlations with convergent measures were significant and moderate to large in magnitude (ρ =.44 to.76, p <.001), while correlations with discriminant measures were small (ρ =.23 to.27, p <.05) or nonsignificant. Scores demonstrated significant negative correlations with age (ρ = -.32 to −.21, p <.001). Mean performance was slightly higher in the iOS compared to the Android group (MiOS = 18.80, NiOS = 635; MAndroid = 17.11, NAndroid = 386; t(757.73) = 4.17, p <.001), but device type did not significantly influence the psychometric properties of the measure. Indicators of potential cheating were mixed; average scores were significantly higher in the remote samples (F(2, 850) = 11.415, p <.001), but there were not significantly more perfect scores. The MTB Arranging Pictures measure demonstrated evidence of reliability and validity when self-administered on personal device. Future research should examine the potential for cheating in remote settings and the properties of the measure in clinical samples. [ABSTRACT FROM AUTHOR] |
|---|---|
| ISSN: | 13803395 |
| DOI: | 10.1080/13803395.2024.2353945 |
