View in EDS PDF Full Text

Accuracy of Naming Error Profiles Elicited From Adaptive Short Forms of the Philadelphia Naming Test.

Saved in:
Bibliographic Details
Title: Accuracy of Naming Error Profiles Elicited From Adaptive Short Forms of the Philadelphia Naming Test.
Authors: Swiderski, Alexander M.1,2,3 Alexander.Swiderski@va.gov, Hul, William D.1,2,3, Fergadiotis, Gerasimos4
Source: Journal of Speech, Language & Hearing Research. Apr2023, Vol. 66 Issue 4, p1351-1364. 14p. 4 Charts, 4 Graphs.
Subject Terms: *Computer adaptive testing, *Phonological awareness, *Research methodology evaluation, *Research methodology, *Aphasia, *Inter-observer reliability, *Statistical correlation, Semantics, Confidence intervals, Cronbach's alpha, Visual acuity, Descriptive statistics, Research funding, Statistical sampling
Abstract: Purpose: The purpose of this study was to evaluate whether a short-form computerized adaptive testing (CAT) version of the Philadelphia Naming Test (PNT) provides error profiles and model-based estimates of semantic and phonological processing that agree with the full test. Method: Twenty-four persons with aphasia took the PNT-CAT and the full version of the PNT (hereinafter referred to as the “full PNT”) at least 2 weeks apart. The PNT-CAT proceeded in two stages: (a) the PNT-CAT30, in which 30 items were selected to match the evolving ability estimate with the goal of producing a 50% error rate, and (b) the PNT-CAT60, in which an additional 30 items were selected to produce a 75% error rate. Agreement was evaluated in terms of the root-mean-square deviation of the response-type proportions and, for individual response types, in terms of agreement coefficients and bias. We also evaluated agreement and bias for estimates of semantic and phonological processing derived from the semantic–phonological interactive two-step model (SP model) of word production. Results: The results suggested that agreement was poorest for semantic, formal, mixed, and unrelated errors, all of which were underestimated by the short forms. Better agreement was observed for correct and nonword responses. SP model weights estimated by the short forms demonstrated no substantial bias but generally inadequate agreement with the full PNT, which itself showed acceptable test–retest reliability for SP model weights and all response types except for formal errors. Discussion: Results suggest that the PNT-CAT30 and the PNT-CAT60 are generally inadequate for generating naming error profiles or model-derived estimates of semantic and phonological processing ability. Post hoc analyses suggested that increasing the number of stimuli available in the CAT item bank may improve the utility of adaptive short forms for generating error profiles, but the underlying theory also suggests that there are limitations to this approach based on a unidimensional measurement model. [ABSTRACT FROM AUTHOR]
Copyright of Journal of Speech, Language & Hearing Research is the property of American Speech-Language-Hearing Association and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Education Research Complete
FullText Links:
  – Type: pdflink
Text:
  Availability: 0
Header DbId: ehh
DbLabel: Education Research Complete
An: 163147711
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Accuracy of Naming Error Profiles Elicited From Adaptive Short Forms of the Philadelphia Naming Test.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Swiderski%2C+Alexander+M%2E%22">Swiderski, Alexander M.</searchLink><relatesTo>1,2,3</relatesTo><i> Alexander.Swiderski@va.gov</i><br /><searchLink fieldCode="AR" term="%22Hul%2C+William+D%2E%22">Hul, William D.</searchLink><relatesTo>1,2,3</relatesTo><br /><searchLink fieldCode="AR" term="%22Fergadiotis%2C+Gerasimos%22">Fergadiotis, Gerasimos</searchLink><relatesTo>4</relatesTo>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Journal+of+Speech%2C+Language+%26+Hearing+Research%22">Journal of Speech, Language & Hearing Research</searchLink>. Apr2023, Vol. 66 Issue 4, p1351-1364. 14p. 4 Charts, 4 Graphs.
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: *<searchLink fieldCode="DE" term="%22Computer+adaptive+testing%22">Computer adaptive testing</searchLink><br />*<searchLink fieldCode="DE" term="%22Phonological+awareness%22">Phonological awareness</searchLink><br />*<searchLink fieldCode="DE" term="%22Research+methodology+evaluation%22">Research methodology evaluation</searchLink><br />*<searchLink fieldCode="DE" term="%22Research+methodology%22">Research methodology</searchLink><br />*<searchLink fieldCode="DE" term="%22Aphasia%22">Aphasia</searchLink><br />*<searchLink fieldCode="DE" term="%22Inter-observer+reliability%22">Inter-observer reliability</searchLink><br />*<searchLink fieldCode="DE" term="%22Statistical+correlation%22">Statistical correlation</searchLink><br /><searchLink fieldCode="DE" term="%22Semantics%22">Semantics</searchLink><br /><searchLink fieldCode="DE" term="%22Confidence+intervals%22">Confidence intervals</searchLink><br /><searchLink fieldCode="DE" term="%22Cronbach's+alpha%22">Cronbach's alpha</searchLink><br /><searchLink fieldCode="DE" term="%22Visual+acuity%22">Visual acuity</searchLink><br /><searchLink fieldCode="DE" term="%22Descriptive+statistics%22">Descriptive statistics</searchLink><br /><searchLink fieldCode="DE" term="%22Research+funding%22">Research funding</searchLink><br /><searchLink fieldCode="DE" term="%22Statistical+sampling%22">Statistical sampling</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Purpose: The purpose of this study was to evaluate whether a short-form computerized adaptive testing (CAT) version of the Philadelphia Naming Test (PNT) provides error profiles and model-based estimates of semantic and phonological processing that agree with the full test. Method: Twenty-four persons with aphasia took the PNT-CAT and the full version of the PNT (hereinafter referred to as the “full PNT”) at least 2 weeks apart. The PNT-CAT proceeded in two stages: (a) the PNT-CAT30, in which 30 items were selected to match the evolving ability estimate with the goal of producing a 50% error rate, and (b) the PNT-CAT60, in which an additional 30 items were selected to produce a 75% error rate. Agreement was evaluated in terms of the root-mean-square deviation of the response-type proportions and, for individual response types, in terms of agreement coefficients and bias. We also evaluated agreement and bias for estimates of semantic and phonological processing derived from the semantic–phonological interactive two-step model (SP model) of word production. Results: The results suggested that agreement was poorest for semantic, formal, mixed, and unrelated errors, all of which were underestimated by the short forms. Better agreement was observed for correct and nonword responses. SP model weights estimated by the short forms demonstrated no substantial bias but generally inadequate agreement with the full PNT, which itself showed acceptable test–retest reliability for SP model weights and all response types except for formal errors. Discussion: Results suggest that the PNT-CAT30 and the PNT-CAT60 are generally inadequate for generating naming error profiles or model-derived estimates of semantic and phonological processing ability. Post hoc analyses suggested that increasing the number of stimuli available in the CAT item bank may improve the utility of adaptive short forms for generating error profiles, but the underlying theory also suggests that there are limitations to this approach based on a unidimensional measurement model. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Journal of Speech, Language & Hearing Research is the property of American Speech-Language-Hearing Association and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=163147711
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1044/2023_jslhr-22-00439
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 14
        StartPage: 1351
    Subjects:
      – SubjectFull: Computer adaptive testing
        Type: general
      – SubjectFull: Phonological awareness
        Type: general
      – SubjectFull: Research methodology evaluation
        Type: general
      – SubjectFull: Research methodology
        Type: general
      – SubjectFull: Aphasia
        Type: general
      – SubjectFull: Inter-observer reliability
        Type: general
      – SubjectFull: Statistical correlation
        Type: general
      – SubjectFull: Semantics
        Type: general
      – SubjectFull: Confidence intervals
        Type: general
      – SubjectFull: Cronbach's alpha
        Type: general
      – SubjectFull: Visual acuity
        Type: general
      – SubjectFull: Descriptive statistics
        Type: general
      – SubjectFull: Research funding
        Type: general
      – SubjectFull: Statistical sampling
        Type: general
    Titles:
      – TitleFull: Accuracy of Naming Error Profiles Elicited From Adaptive Short Forms of the Philadelphia Naming Test.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Swiderski, Alexander M.
      – PersonEntity:
          Name:
            NameFull: Hul, William D.
      – PersonEntity:
          Name:
            NameFull: Fergadiotis, Gerasimos
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 04
              Text: Apr2023
              Type: published
              Y: 2023
          Identifiers:
            – Type: issn-print
              Value: 10924388
          Numbering:
            – Type: volume
              Value: 66
            – Type: issue
              Value: 4
          Titles:
            – TitleFull: Journal of Speech, Language & Hearing Research
              Type: main
ResultId 1