Online Computerized Adaptive Tests of Children's Vocabulary Development in English and Mexican Spanish

Saved in:
Bibliographic Details
Title: Online Computerized Adaptive Tests of Children's Vocabulary Development in English and Mexican Spanish
Language: English
Authors: Kachergis, George (ORCID 0000-0003-4153-4167), Marchman, Virginia A. (ORCID 0000-0001-7183-6743), Dale, Philip S. (ORCID 0000-0002-7697-8510), Mankewitz, Jessica, Frank, Michael C. (ORCID 0000-0002-7551-4378)
Source: Journal of Speech, Language, and Hearing Research. Jun 2022 65(6):2288-2308.
Availability: American Speech-Language-Hearing Association. 2200 Research Blvd #250, Rockville, MD 20850. Tel: 301-296-5700; Fax: 301-296-8580; e-mail: slhr@asha.org; Web site: http://jslhr.pubs.asha.org
Peer Reviewed: Y
Page Count: 21
Publication Date: 2022
Sponsoring Agency: National Institutes of Health (NIH) (DHHS)
Contract Number: 2R01HD069150
R01HD092343
Document Type: Journal Articles
Reports - Research
Descriptors: Computer Assisted Testing, Vocabulary Development, English, Spanish, Language Skills, Receptive Language, Expressive Language, Toddlers, Foreign Countries, Comprehension, Test Reliability, Test Validity
Geographic Terms: United States, Mexico
Assessment and Survey Identifiers: MacArthur Communicative Development Inventory
DOI: 10.1044/2022_JSLHR-21-00372
ISSN: 1092-4388
1558-9102
Abstract: Purpose: Measuring the growth of young children's vocabulary is important for researchers seeking to understand language learning as well as for clinicians aiming to identify early deficits. The MacArthur-Bates Communicative Development Inventories (CDIs) are parent report instruments that offer a reliable and valid method for measuring early productive and receptive vocabulary across a number of languages. CDI forms typically include hundreds of words, however, and so the burden of completion is significant. We address this limitation by building on previous work using item response theory (IRT) models to create computer adaptive test (CAT) versions of the CDIs. We created CDI-CATs for both comprehension and production vocabulary, for both American English and Mexican Spanish. Method: Using a data set of 7,633 English-speaking children ages 12-36 months and 1,692 Spanish-speaking children ages 12-30 months, across three CDI forms (Words & Gestures, Words & Sentences, and CDI-III), we found that a 2-parameter logistic IRT model fits well for a majority of the 680 pooled vocabulary items. We conducted CAT simulations on this data set, assessing simulated tests of varying length (25-400 items). Results: Even very short CATs recovered participant abilities very well with little bias across ages. An empirical validation study with N = 204 children ages 15-36 months showed a correlation of r = 0.92 between language ability estimated from full CDI versus CDI-CAT forms. Conclusion: We provide our item bank along with fitted parameters and other details, offer recommendations for how to construct CDI-CATs in new languages, and suggest when this type of assessment may or may not be appropriate.
Abstractor: As Provided
Entry Date: 2022
Accession Number: EJ1347512
Database: ERIC
FullText Links:
  – Type: pdflink
    Url: https://content.ebscohost.com/cds/retrieve?content=AQICAHj0k_4E0hTGH8RJwT4gCJyBsGNe_WN95AvKlDbXJGqwxwHnzU-Wf0136y4o0kUXvfKrAAAA4jCB3wYJKoZIhvcNAQcGoIHRMIHOAgEAMIHIBgkqhkiG9w0BBwEwHgYJYIZIAWUDBAEuMBEEDGx-qPbzTG3d00-L2AIBEICBmpILhnJP8hdUYxjYTIMfzfgdvvF-LIkHpnfckSM3wzn75ynzmq4AAssyFCKk1Pby9VrDV5E5fUD4gwmALkfzpantCtuAhI5C-Jb3LxgH8-s65cEHq3K8EKk3XrjsTBlCBHaLus1D01bJn6GCtNREdut8eYlpJr14_IU13T7YuvmKi-T2Ylray5pBc2KnEfv0ZHWPUiyKpVCdpZ4=
Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1347512
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Online Computerized Adaptive Tests of Children's Vocabulary Development in English and Mexican Spanish
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Kachergis%2C+George%22">Kachergis, George</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-4153-4167">0000-0003-4153-4167</externalLink>)<br /><searchLink fieldCode="AR" term="%22Marchman%2C+Virginia+A%2E%22">Marchman, Virginia A.</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-7183-6743">0000-0001-7183-6743</externalLink>)<br /><searchLink fieldCode="AR" term="%22Dale%2C+Philip+S%2E%22">Dale, Philip S.</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-7697-8510">0000-0002-7697-8510</externalLink>)<br /><searchLink fieldCode="AR" term="%22Mankewitz%2C+Jessica%22">Mankewitz, Jessica</searchLink><br /><searchLink fieldCode="AR" term="%22Frank%2C+Michael+C%2E%22">Frank, Michael C.</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-7551-4378">0000-0002-7551-4378</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Journal+of+Speech%2C+Language%2C+and+Hearing+Research%22"><i>Journal of Speech, Language, and Hearing Research</i></searchLink>. Jun 2022 65(6):2288-2308.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: American Speech-Language-Hearing Association. 2200 Research Blvd #250, Rockville, MD 20850. Tel: 301-296-5700; Fax: 301-296-8580; e-mail: slhr@asha.org; Web site: http://jslhr.pubs.asha.org
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 21
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2022
– Name: SourceSuprt
  Label: Sponsoring Agency
  Group: SrcSuprt
  Data: National Institutes of Health (NIH) (DHHS)
– Name: NumberContract
  Label: Contract Number
  Group: NumCntrct
  Data: 2R01HD069150<br />R01HD092343
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Computer+Assisted+Testing%22">Computer Assisted Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Vocabulary+Development%22">Vocabulary Development</searchLink><br /><searchLink fieldCode="DE" term="%22English%22">English</searchLink><br /><searchLink fieldCode="DE" term="%22Spanish%22">Spanish</searchLink><br /><searchLink fieldCode="DE" term="%22Language+Skills%22">Language Skills</searchLink><br /><searchLink fieldCode="DE" term="%22Receptive+Language%22">Receptive Language</searchLink><br /><searchLink fieldCode="DE" term="%22Expressive+Language%22">Expressive Language</searchLink><br /><searchLink fieldCode="DE" term="%22Toddlers%22">Toddlers</searchLink><br /><searchLink fieldCode="DE" term="%22Foreign+Countries%22">Foreign Countries</searchLink><br /><searchLink fieldCode="DE" term="%22Comprehension%22">Comprehension</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Reliability%22">Test Reliability</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Validity%22">Test Validity</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22United+States%22">United States</searchLink><br /><searchLink fieldCode="DE" term="%22Mexico%22">Mexico</searchLink>
– Name: SubjectThesaurus
  Label: Assessment and Survey Identifiers
  Group: Su
  Data: <searchLink fieldCode="SU" term="%22MacArthur+Communicative+Development+Inventory%22">MacArthur Communicative Development Inventory</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1044/2022_JSLHR-21-00372
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 1092-4388<br />1558-9102
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Purpose: Measuring the growth of young children's vocabulary is important for researchers seeking to understand language learning as well as for clinicians aiming to identify early deficits. The MacArthur-Bates Communicative Development Inventories (CDIs) are parent report instruments that offer a reliable and valid method for measuring early productive and receptive vocabulary across a number of languages. CDI forms typically include hundreds of words, however, and so the burden of completion is significant. We address this limitation by building on previous work using item response theory (IRT) models to create computer adaptive test (CAT) versions of the CDIs. We created CDI-CATs for both comprehension and production vocabulary, for both American English and Mexican Spanish. Method: Using a data set of 7,633 English-speaking children ages 12-36 months and 1,692 Spanish-speaking children ages 12-30 months, across three CDI forms (Words & Gestures, Words & Sentences, and CDI-III), we found that a 2-parameter logistic IRT model fits well for a majority of the 680 pooled vocabulary items. We conducted CAT simulations on this data set, assessing simulated tests of varying length (25-400 items). Results: Even very short CATs recovered participant abilities very well with little bias across ages. An empirical validation study with N = 204 children ages 15-36 months showed a correlation of r = 0.92 between language ability estimated from full CDI versus CDI-CAT forms. Conclusion: We provide our item bank along with fitted parameters and other details, offer recommendations for how to construct CDI-CATs in new languages, and suggest when this type of assessment may or may not be appropriate.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2022
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1347512
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1347512
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1044/2022_JSLHR-21-00372
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 21
        StartPage: 2288
    Subjects:
      – SubjectFull: Computer Assisted Testing
        Type: general
      – SubjectFull: Vocabulary Development
        Type: general
      – SubjectFull: English
        Type: general
      – SubjectFull: Spanish
        Type: general
      – SubjectFull: Language Skills
        Type: general
      – SubjectFull: Receptive Language
        Type: general
      – SubjectFull: Expressive Language
        Type: general
      – SubjectFull: Toddlers
        Type: general
      – SubjectFull: Foreign Countries
        Type: general
      – SubjectFull: Comprehension
        Type: general
      – SubjectFull: Test Reliability
        Type: general
      – SubjectFull: Test Validity
        Type: general
      – SubjectFull: United States
        Type: general
      – SubjectFull: Mexico
        Type: general
      – SubjectFull: MacArthur Communicative Development Inventory
        Type: general
    Titles:
      – TitleFull: Online Computerized Adaptive Tests of Children's Vocabulary Development in English and Mexican Spanish
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Kachergis, George
      – PersonEntity:
          Name:
            NameFull: Marchman, Virginia A.
      – PersonEntity:
          Name:
            NameFull: Dale, Philip S.
      – PersonEntity:
          Name:
            NameFull: Mankewitz, Jessica
      – PersonEntity:
          Name:
            NameFull: Frank, Michael C.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 06
              Type: published
              Y: 2022
          Identifiers:
            – Type: issn-print
              Value: 1092-4388
            – Type: issn-electronic
              Value: 1558-9102
          Numbering:
            – Type: volume
              Value: 65
            – Type: issue
              Value: 6
          Titles:
            – TitleFull: Journal of Speech, Language, and Hearing Research
              Type: main
ResultId 1