Development and validation of an episodic memory measure in the Mobile Toolbox (MTB): Arranging Pictures.

Saved in:
Bibliographic Details
Title: Development and validation of an episodic memory measure in the Mobile Toolbox (MTB): Arranging Pictures.
Authors: Young, Stephanie Ruth (AUTHOR), Dworak, Elizabeth M. (AUTHOR), Novack, Miriam A. (AUTHOR), Kaat, Aaron J. (AUTHOR), Adam, Hubert (AUTHOR), Nowinski, Cindy J. (AUTHOR), Hosseinian, Zahra (AUTHOR), Slotkin, Jerry (AUTHOR), Stoeger, Jordan (AUTHOR), Amagai, Saki (AUTHOR), Varela Diaz, Maria (AUTHOR), Almonte Correa, Anyelo (AUTHOR), Alperin, Keith (AUTHOR), Omberg, Larsson (AUTHOR), Kellen, Michael (AUTHOR), Camacho, Monica R. (AUTHOR), Landavazo, Bernard (AUTHOR), Nosheny, Rachel L. (AUTHOR), Weiner, Michael W. (AUTHOR), Gershon, Richard (AUTHOR)
Source: Journal of Clinical & Experimental Neuropsychology. May2024, Vol. 46 Issue 4, p364-373. 10p.
Subjects: Cognitive testing, Cognitive aging, Psychometrics, Statistical reliability, Memory testing
Abstract: Arranging Pictures is a new episodic memory test based on the NIH Toolbox (NIHTB) Picture Sequence Memory measure and optimized for self-administration on a personal smartphone within the Mobile Toolbox (MTB). We describe evidence from three distinct validation studies. In Study 1, 92 participants self-administered Arranging Pictures on study-provided smartphones in the lab and were administered external measures of similar and dissimilar constructs by trained examiners to assess validity under controlled circumstances. In Study 2, 1,021 participants completed the external measures in the lab and self-administered Arranging Pictures remotely on their personal smartphones to assess validity in real-world contexts. In Study 3, 141 participants self-administered Arranging Pictures remotely twice with a two-week delay on personal iOS smartphones to assess test-retest reliability and practice effects. Internal consistency was good across samples (ρxx =.80 to.85, p <.001). Test-retest reliability was marginal (ICC =.49, p <.001) and there were significant practice effects after a two-week delay (ΔM = 3.21 (95% CI [2.56, 3.88]). As expected, correlations with convergent measures were significant and moderate to large in magnitude (ρ =.44 to.76, p <.001), while correlations with discriminant measures were small (ρ =.23 to.27, p <.05) or nonsignificant. Scores demonstrated significant negative correlations with age (ρ = -.32 to −.21, p <.001). Mean performance was slightly higher in the iOS compared to the Android group (MiOS = 18.80, NiOS = 635; MAndroid = 17.11, NAndroid = 386; t(757.73) = 4.17, p <.001), but device type did not significantly influence the psychometric properties of the measure. Indicators of potential cheating were mixed; average scores were significantly higher in the remote samples (F(2, 850) = 11.415, p <.001), but there were not significantly more perfect scores. The MTB Arranging Pictures measure demonstrated evidence of reliability and validity when self-administered on personal device. Future research should examine the potential for cheating in remote settings and the properties of the measure in clinical samples. [ABSTRACT FROM AUTHOR]
Copyright of Journal of Clinical & Experimental Neuropsychology is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Psychology and Behavioral Sciences Collection
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: pbh
DbLabel: Psychology and Behavioral Sciences Collection
An: 178910869
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Development and validation of an episodic memory measure in the Mobile Toolbox (MTB): Arranging Pictures.
– Name: Author
  Label: Authors
  Group: Au
  Data: &lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Young%2C+Stephanie+Ruth%22&quot;&gt;Young, Stephanie Ruth&lt;/searchLink&gt; (AUTHOR)&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Dworak%2C+Elizabeth+M%2E%22&quot;&gt;Dworak, Elizabeth M.&lt;/searchLink&gt; (AUTHOR)&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Novack%2C+Miriam+A%2E%22&quot;&gt;Novack, Miriam A.&lt;/searchLink&gt; (AUTHOR)&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Kaat%2C+Aaron+J%2E%22&quot;&gt;Kaat, Aaron J.&lt;/searchLink&gt; (AUTHOR)&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Adam%2C+Hubert%22&quot;&gt;Adam, Hubert&lt;/searchLink&gt; (AUTHOR)&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Nowinski%2C+Cindy+J%2E%22&quot;&gt;Nowinski, Cindy J.&lt;/searchLink&gt; (AUTHOR)&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Hosseinian%2C+Zahra%22&quot;&gt;Hosseinian, Zahra&lt;/searchLink&gt; (AUTHOR)&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Slotkin%2C+Jerry%22&quot;&gt;Slotkin, Jerry&lt;/searchLink&gt; (AUTHOR)&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Stoeger%2C+Jordan%22&quot;&gt;Stoeger, Jordan&lt;/searchLink&gt; (AUTHOR)&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Amagai%2C+Saki%22&quot;&gt;Amagai, Saki&lt;/searchLink&gt; (AUTHOR)&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Varela+Diaz%2C+Maria%22&quot;&gt;Varela Diaz, Maria&lt;/searchLink&gt; (AUTHOR)&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Almonte+Correa%2C+Anyelo%22&quot;&gt;Almonte Correa, Anyelo&lt;/searchLink&gt; (AUTHOR)&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Alperin%2C+Keith%22&quot;&gt;Alperin, Keith&lt;/searchLink&gt; (AUTHOR)&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Omberg%2C+Larsson%22&quot;&gt;Omberg, Larsson&lt;/searchLink&gt; (AUTHOR)&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Kellen%2C+Michael%22&quot;&gt;Kellen, Michael&lt;/searchLink&gt; (AUTHOR)&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Camacho%2C+Monica+R%2E%22&quot;&gt;Camacho, Monica R.&lt;/searchLink&gt; (AUTHOR)&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Landavazo%2C+Bernard%22&quot;&gt;Landavazo, Bernard&lt;/searchLink&gt; (AUTHOR)&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Nosheny%2C+Rachel+L%2E%22&quot;&gt;Nosheny, Rachel L.&lt;/searchLink&gt; (AUTHOR)&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Weiner%2C+Michael+W%2E%22&quot;&gt;Weiner, Michael W.&lt;/searchLink&gt; (AUTHOR)&lt;br /&gt;&lt;searchLink fieldCode=&quot;AR&quot; term=&quot;%22Gershon%2C+Richard%22&quot;&gt;Gershon, Richard&lt;/searchLink&gt; (AUTHOR)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: &lt;searchLink fieldCode=&quot;JN&quot; term=&quot;%22Journal+of+Clinical+%26+Experimental+Neuropsychology%22&quot;&gt;Journal of Clinical &amp; Experimental Neuropsychology&lt;/searchLink&gt;. May2024, Vol. 46 Issue 4, p364-373. 10p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: &lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Cognitive+testing%22&quot;&gt;Cognitive testing&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Cognitive+aging%22&quot;&gt;Cognitive aging&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Psychometrics%22&quot;&gt;Psychometrics&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Statistical+reliability%22&quot;&gt;Statistical reliability&lt;/searchLink&gt;&lt;br /&gt;&lt;searchLink fieldCode=&quot;DE&quot; term=&quot;%22Memory+testing%22&quot;&gt;Memory testing&lt;/searchLink&gt;
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Arranging Pictures is a new episodic memory test based on the NIH Toolbox (NIHTB) Picture Sequence Memory measure and optimized for self-administration on a personal smartphone within the Mobile Toolbox (MTB). We describe evidence from three distinct validation studies. In Study 1, 92 participants self-administered Arranging Pictures on study-provided smartphones in the lab and were administered external measures of similar and dissimilar constructs by trained examiners to assess validity under controlled circumstances. In Study 2, 1,021 participants completed the external measures in the lab and self-administered Arranging Pictures remotely on their personal smartphones to assess validity in real-world contexts. In Study 3, 141 participants self-administered Arranging Pictures remotely twice with a two-week delay on personal iOS smartphones to assess test-retest reliability and practice effects. Internal consistency was good across samples (ρxx =.80 to.85, p &lt;.001). Test-retest reliability was marginal (ICC =.49, p &lt;.001) and there were significant practice effects after a two-week delay (ΔM = 3.21 (95% CI [2.56, 3.88]). As expected, correlations with convergent measures were significant and moderate to large in magnitude (ρ =.44 to.76, p &lt;.001), while correlations with discriminant measures were small (ρ =.23 to.27, p &lt;.05) or nonsignificant. Scores demonstrated significant negative correlations with age (ρ = -.32 to −.21, p &lt;.001). Mean performance was slightly higher in the iOS compared to the Android group (MiOS = 18.80, NiOS = 635; MAndroid = 17.11, NAndroid = 386; t(757.73) = 4.17, p &lt;.001), but device type did not significantly influence the psychometric properties of the measure. Indicators of potential cheating were mixed; average scores were significantly higher in the remote samples (F(2, 850) = 11.415, p &lt;.001), but there were not significantly more perfect scores. The MTB Arranging Pictures measure demonstrated evidence of reliability and validity when self-administered on personal device. Future research should examine the potential for cheating in remote settings and the properties of the measure in clinical samples. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: &lt;i&gt;Copyright of Journal of Clinical &amp; Experimental Neuropsychology is the property of Taylor &amp; Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder&#39;s express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.&lt;/i&gt; (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=pbh&AN=178910869
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1080/13803395.2024.2353945
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 10
        StartPage: 364
    Subjects:
      – SubjectFull: Cognitive testing
        Type: general
      – SubjectFull: Cognitive aging
        Type: general
      – SubjectFull: Psychometrics
        Type: general
      – SubjectFull: Statistical reliability
        Type: general
      – SubjectFull: Memory testing
        Type: general
    Titles:
      – TitleFull: Development and validation of an episodic memory measure in the Mobile Toolbox (MTB): Arranging Pictures.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Young, Stephanie Ruth
      – PersonEntity:
          Name:
            NameFull: Dworak, Elizabeth M.
      – PersonEntity:
          Name:
            NameFull: Novack, Miriam A.
      – PersonEntity:
          Name:
            NameFull: Kaat, Aaron J.
      – PersonEntity:
          Name:
            NameFull: Adam, Hubert
      – PersonEntity:
          Name:
            NameFull: Nowinski, Cindy J.
      – PersonEntity:
          Name:
            NameFull: Hosseinian, Zahra
      – PersonEntity:
          Name:
            NameFull: Slotkin, Jerry
      – PersonEntity:
          Name:
            NameFull: Stoeger, Jordan
      – PersonEntity:
          Name:
            NameFull: Amagai, Saki
      – PersonEntity:
          Name:
            NameFull: Varela Diaz, Maria
      – PersonEntity:
          Name:
            NameFull: Almonte Correa, Anyelo
      – PersonEntity:
          Name:
            NameFull: Alperin, Keith
      – PersonEntity:
          Name:
            NameFull: Omberg, Larsson
      – PersonEntity:
          Name:
            NameFull: Kellen, Michael
      – PersonEntity:
          Name:
            NameFull: Camacho, Monica R.
      – PersonEntity:
          Name:
            NameFull: Landavazo, Bernard
      – PersonEntity:
          Name:
            NameFull: Nosheny, Rachel L.
      – PersonEntity:
          Name:
            NameFull: Weiner, Michael W.
      – PersonEntity:
          Name:
            NameFull: Gershon, Richard
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 05
              Text: May2024
              Type: published
              Y: 2024
          Identifiers:
            – Type: issn-print
              Value: 13803395
          Numbering:
            – Type: volume
              Value: 46
            – Type: issue
              Value: 4
          Titles:
            – TitleFull: Journal of Clinical & Experimental Neuropsychology
              Type: main
ResultId 1