Development and validation of an episodic memory measure in the Mobile Toolbox (MTB): Arranging Pictures.
Saved in:
| Title: | Development and validation of an episodic memory measure in the Mobile Toolbox (MTB): Arranging Pictures. |
|---|---|
| Authors: | Young, Stephanie Ruth (AUTHOR), Dworak, Elizabeth M. (AUTHOR), Novack, Miriam A. (AUTHOR), Kaat, Aaron J. (AUTHOR), Adam, Hubert (AUTHOR), Nowinski, Cindy J. (AUTHOR), Hosseinian, Zahra (AUTHOR), Slotkin, Jerry (AUTHOR), Stoeger, Jordan (AUTHOR), Amagai, Saki (AUTHOR), Varela Diaz, Maria (AUTHOR), Almonte Correa, Anyelo (AUTHOR), Alperin, Keith (AUTHOR), Omberg, Larsson (AUTHOR), Kellen, Michael (AUTHOR), Camacho, Monica R. (AUTHOR), Landavazo, Bernard (AUTHOR), Nosheny, Rachel L. (AUTHOR), Weiner, Michael W. (AUTHOR), Gershon, Richard (AUTHOR) |
| Source: | Journal of Clinical & Experimental Neuropsychology. May2024, Vol. 46 Issue 4, p364-373. 10p. |
| Subjects: | Cognitive testing, Cognitive aging, Psychometrics, Statistical reliability, Memory testing |
| Abstract: | Arranging Pictures is a new episodic memory test based on the NIH Toolbox (NIHTB) Picture Sequence Memory measure and optimized for self-administration on a personal smartphone within the Mobile Toolbox (MTB). We describe evidence from three distinct validation studies. In Study 1, 92 participants self-administered Arranging Pictures on study-provided smartphones in the lab and were administered external measures of similar and dissimilar constructs by trained examiners to assess validity under controlled circumstances. In Study 2, 1,021 participants completed the external measures in the lab and self-administered Arranging Pictures remotely on their personal smartphones to assess validity in real-world contexts. In Study 3, 141 participants self-administered Arranging Pictures remotely twice with a two-week delay on personal iOS smartphones to assess test-retest reliability and practice effects. Internal consistency was good across samples (ρxx =.80 to.85, p <.001). Test-retest reliability was marginal (ICC =.49, p <.001) and there were significant practice effects after a two-week delay (ΔM = 3.21 (95% CI [2.56, 3.88]). As expected, correlations with convergent measures were significant and moderate to large in magnitude (ρ =.44 to.76, p <.001), while correlations with discriminant measures were small (ρ =.23 to.27, p <.05) or nonsignificant. Scores demonstrated significant negative correlations with age (ρ = -.32 to −.21, p <.001). Mean performance was slightly higher in the iOS compared to the Android group (MiOS = 18.80, NiOS = 635; MAndroid = 17.11, NAndroid = 386; t(757.73) = 4.17, p <.001), but device type did not significantly influence the psychometric properties of the measure. Indicators of potential cheating were mixed; average scores were significantly higher in the remote samples (F(2, 850) = 11.415, p <.001), but there were not significantly more perfect scores. The MTB Arranging Pictures measure demonstrated evidence of reliability and validity when self-administered on personal device. Future research should examine the potential for cheating in remote settings and the properties of the measure in clinical samples. [ABSTRACT FROM AUTHOR] |
| Copyright of Journal of Clinical & Experimental Neuropsychology is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Psychology and Behavioral Sciences Collection |
|
Full text is not displayed to guests.
Login for full access.
|
|
| FullText | Links: – Type: pdflink Text: Availability: 1 |
|---|---|
| Header | DbId: pbh DbLabel: Psychology and Behavioral Sciences Collection An: 178910869 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Development and validation of an episodic memory measure in the Mobile Toolbox (MTB): Arranging Pictures. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Young%2C+Stephanie+Ruth%22">Young, Stephanie Ruth</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Dworak%2C+Elizabeth+M%2E%22">Dworak, Elizabeth M.</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Novack%2C+Miriam+A%2E%22">Novack, Miriam A.</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Kaat%2C+Aaron+J%2E%22">Kaat, Aaron J.</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Adam%2C+Hubert%22">Adam, Hubert</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Nowinski%2C+Cindy+J%2E%22">Nowinski, Cindy J.</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Hosseinian%2C+Zahra%22">Hosseinian, Zahra</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Slotkin%2C+Jerry%22">Slotkin, Jerry</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Stoeger%2C+Jordan%22">Stoeger, Jordan</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Amagai%2C+Saki%22">Amagai, Saki</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Varela+Diaz%2C+Maria%22">Varela Diaz, Maria</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Almonte+Correa%2C+Anyelo%22">Almonte Correa, Anyelo</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Alperin%2C+Keith%22">Alperin, Keith</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Omberg%2C+Larsson%22">Omberg, Larsson</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Kellen%2C+Michael%22">Kellen, Michael</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Camacho%2C+Monica+R%2E%22">Camacho, Monica R.</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Landavazo%2C+Bernard%22">Landavazo, Bernard</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Nosheny%2C+Rachel+L%2E%22">Nosheny, Rachel L.</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Weiner%2C+Michael+W%2E%22">Weiner, Michael W.</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Gershon%2C+Richard%22">Gershon, Richard</searchLink> (AUTHOR) – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Journal+of+Clinical+%26+Experimental+Neuropsychology%22">Journal of Clinical & Experimental Neuropsychology</searchLink>. May2024, Vol. 46 Issue 4, p364-373. 10p. – Name: Subject Label: Subjects Group: Su Data: <searchLink fieldCode="DE" term="%22Cognitive+testing%22">Cognitive testing</searchLink><br /><searchLink fieldCode="DE" term="%22Cognitive+aging%22">Cognitive aging</searchLink><br /><searchLink fieldCode="DE" term="%22Psychometrics%22">Psychometrics</searchLink><br /><searchLink fieldCode="DE" term="%22Statistical+reliability%22">Statistical reliability</searchLink><br /><searchLink fieldCode="DE" term="%22Memory+testing%22">Memory testing</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: Arranging Pictures is a new episodic memory test based on the NIH Toolbox (NIHTB) Picture Sequence Memory measure and optimized for self-administration on a personal smartphone within the Mobile Toolbox (MTB). We describe evidence from three distinct validation studies. In Study 1, 92 participants self-administered Arranging Pictures on study-provided smartphones in the lab and were administered external measures of similar and dissimilar constructs by trained examiners to assess validity under controlled circumstances. In Study 2, 1,021 participants completed the external measures in the lab and self-administered Arranging Pictures remotely on their personal smartphones to assess validity in real-world contexts. In Study 3, 141 participants self-administered Arranging Pictures remotely twice with a two-week delay on personal iOS smartphones to assess test-retest reliability and practice effects. Internal consistency was good across samples (ρxx =.80 to.85, p <.001). Test-retest reliability was marginal (ICC =.49, p <.001) and there were significant practice effects after a two-week delay (ΔM = 3.21 (95% CI [2.56, 3.88]). As expected, correlations with convergent measures were significant and moderate to large in magnitude (ρ =.44 to.76, p <.001), while correlations with discriminant measures were small (ρ =.23 to.27, p <.05) or nonsignificant. Scores demonstrated significant negative correlations with age (ρ = -.32 to −.21, p <.001). Mean performance was slightly higher in the iOS compared to the Android group (MiOS = 18.80, NiOS = 635; MAndroid = 17.11, NAndroid = 386; t(757.73) = 4.17, p <.001), but device type did not significantly influence the psychometric properties of the measure. Indicators of potential cheating were mixed; average scores were significantly higher in the remote samples (F(2, 850) = 11.415, p <.001), but there were not significantly more perfect scores. The MTB Arranging Pictures measure demonstrated evidence of reliability and validity when self-administered on personal device. Future research should examine the potential for cheating in remote settings and the properties of the measure in clinical samples. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Journal of Clinical & Experimental Neuropsychology is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=pbh&AN=178910869 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1080/13803395.2024.2353945 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 10 StartPage: 364 Subjects: – SubjectFull: Cognitive testing Type: general – SubjectFull: Cognitive aging Type: general – SubjectFull: Psychometrics Type: general – SubjectFull: Statistical reliability Type: general – SubjectFull: Memory testing Type: general Titles: – TitleFull: Development and validation of an episodic memory measure in the Mobile Toolbox (MTB): Arranging Pictures. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Young, Stephanie Ruth – PersonEntity: Name: NameFull: Dworak, Elizabeth M. – PersonEntity: Name: NameFull: Novack, Miriam A. – PersonEntity: Name: NameFull: Kaat, Aaron J. – PersonEntity: Name: NameFull: Adam, Hubert – PersonEntity: Name: NameFull: Nowinski, Cindy J. – PersonEntity: Name: NameFull: Hosseinian, Zahra – PersonEntity: Name: NameFull: Slotkin, Jerry – PersonEntity: Name: NameFull: Stoeger, Jordan – PersonEntity: Name: NameFull: Amagai, Saki – PersonEntity: Name: NameFull: Varela Diaz, Maria – PersonEntity: Name: NameFull: Almonte Correa, Anyelo – PersonEntity: Name: NameFull: Alperin, Keith – PersonEntity: Name: NameFull: Omberg, Larsson – PersonEntity: Name: NameFull: Kellen, Michael – PersonEntity: Name: NameFull: Camacho, Monica R. – PersonEntity: Name: NameFull: Landavazo, Bernard – PersonEntity: Name: NameFull: Nosheny, Rachel L. – PersonEntity: Name: NameFull: Weiner, Michael W. – PersonEntity: Name: NameFull: Gershon, Richard IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 05 Text: May2024 Type: published Y: 2024 Identifiers: – Type: issn-print Value: 13803395 Numbering: – Type: volume Value: 46 – Type: issue Value: 4 Titles: – TitleFull: Journal of Clinical & Experimental Neuropsychology Type: main |
| ResultId | 1 |