View in EDS PDF Full Text

Online Administration of the Test of Narrative Language--Second Edition: Psychometrics and Considerations for Remote Assessment

Saved in:
Bibliographic Details
Title: Online Administration of the Test of Narrative Language--Second Edition: Psychometrics and Considerations for Remote Assessment
Language: English
Authors: Magimairaj, Beula M. (ORCID 0000-0002-7834-4335), Capin, Philip (ORCID 0000-0003-4955-9879), Gillam, Sandra L. (ORCID 0000-0003-4401-4669), Vaughn, Sharon (ORCID 0000-0001-8305-5549), Roberts, Greg (ORCID 0000-0002-7680-8757), Fall, Anna-Maria, Gillam, Ronald B.
Source: Grantee Submission. Apr 2022 Language(2):404-416.
Peer Reviewed: Y
Page Count: 13
Publication Date: 2022
Sponsoring Agency: National Center for Education Research (NCER) (ED/IES)
Contract Number: R305A170111
Document Type: Journal Articles
Reports - Research
Descriptors: Computer Assisted Testing, Language Tests, Story Telling, Language Impairments, Children, Psychometrics, Diagnostic Tests, At Risk Students, Test Reliability, Interrater Reliability, Test Validity, Videoconferencing, Narration, Reading Comprehension, Scoring, Error of Measurement, Goodness of Fit, Correlation
DOI: 10.1044/2021_LSHSS-21-00129
Abstract: Purpose: Our aim was to evaluate the psychometric properties of the online administered format of the Test of Narrative Language--Second Edition (TNL-2; Gillam & Pearson, 2017), given the importance of assessing children's narrative ability and considerable absence of psychometric studies of spoken language assessments administered online. Method: The TNL-2 was administered to 357 school-age children at risk for language and literacy difficulties as part of a randomized controlled trial, across three annual cohorts, at three time points (pretest, posttest, and 5-month follow-up). Cohort 3 students were tested using an online format at posttest and at follow-up. We compared the Cronbach's alpha internal consistency reliability of the TNL-2 online testing scores with in-person scores from TNL-2 normative data and Cohort 3 in-person testing at pretest, and interrater reliability for Cohort 3 across test points. In addition, we examined measurement invariance across test occasions and the criterion validity of the TNL-2, the latter based on its correlations with narrative sample measures (Mean Length of Utterance in words and the Monitoring Indicators of Scholarly Language rubric). Results: Internal consistency reliability, interrater reliability, and measurement invariance analyses of the online and in-person administration of the TNL-2 yielded similar outcomes. The criterion validity of the TNL-2 was found to be good. Conclusions: TNL-2 psychometric properties from online administration were generally in the "good" range and were not significantly different from in-person testing. When administered online using standardized procedures, the TNL-2 is valid and reliable for use in assessing narrative language proficiency in school-age children at risk for language and learning difficulties.
Abstractor: As Provided
IES Funded: Yes
Entry Date: 2022
Accession Number: ED620387
Database: ERIC
FullText Links:
  – Type: pdflink
    Url: https://content.ebscohost.com/cds/retrieve?content=AQICAHj0k_4E0hTGH8RJwT4gCJyBsGNe_WN95AvKlDbXJGqwxwFEAGbVzXJjMYw0WBNx6fO3AAAA4zCB4AYJKoZIhvcNAQcGoIHSMIHPAgEAMIHJBgkqhkiG9w0BBwEwHgYJYIZIAWUDBAEuMBEEDGCbY0sxpnpQkICUdQIBEICBm0OXzZzp_ekb8vHnX_Ad2pzbV6E6Y3NHK6F06AcisHE5N0AcGyB50z8dU1QWv7P4ASuvssPtXiedxB_ssG-xlJF3rY-NsRZK6J4FMWXrZ_Xn_dc4MqwhV_JLQqmugU46oU-sYcDJo0PWZ8qAN4NdZQ600DCxZ5B26W0sjzOgjaGQHu-GlF3-pKmIeGMDhY2zeauXAoQgh4METePm
Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED620387
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED620387
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Online Administration of the Test of Narrative Language--Second Edition: Psychometrics and Considerations for Remote Assessment
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Magimairaj%2C+Beula+M%2E%22">Magimairaj, Beula M.</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-7834-4335">0000-0002-7834-4335</externalLink>)<br /><searchLink fieldCode="AR" term="%22Capin%2C+Philip%22">Capin, Philip</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-4955-9879">0000-0003-4955-9879</externalLink>)<br /><searchLink fieldCode="AR" term="%22Gillam%2C+Sandra+L%2E%22">Gillam, Sandra L.</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-4401-4669">0000-0003-4401-4669</externalLink>)<br /><searchLink fieldCode="AR" term="%22Vaughn%2C+Sharon%22">Vaughn, Sharon</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-8305-5549">0000-0001-8305-5549</externalLink>)<br /><searchLink fieldCode="AR" term="%22Roberts%2C+Greg%22">Roberts, Greg</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-7680-8757">0000-0002-7680-8757</externalLink>)<br /><searchLink fieldCode="AR" term="%22Fall%2C+Anna-Maria%22">Fall, Anna-Maria</searchLink><br /><searchLink fieldCode="AR" term="%22Gillam%2C+Ronald+B%2E%22">Gillam, Ronald B.</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Grantee+Submission%22"><i>Grantee Submission</i></searchLink>. Apr 2022 Language(2):404-416.
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 13
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2022
– Name: SourceSuprt
  Label: Sponsoring Agency
  Group: SrcSuprt
  Data: National Center for Education Research (NCER) (ED/IES)
– Name: NumberContract
  Label: Contract Number
  Group: NumCntrct
  Data: R305A170111
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Computer+Assisted+Testing%22">Computer Assisted Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Language+Tests%22">Language Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Story+Telling%22">Story Telling</searchLink><br /><searchLink fieldCode="DE" term="%22Language+Impairments%22">Language Impairments</searchLink><br /><searchLink fieldCode="DE" term="%22Children%22">Children</searchLink><br /><searchLink fieldCode="DE" term="%22Psychometrics%22">Psychometrics</searchLink><br /><searchLink fieldCode="DE" term="%22Diagnostic+Tests%22">Diagnostic Tests</searchLink><br /><searchLink fieldCode="DE" term="%22At+Risk+Students%22">At Risk Students</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Reliability%22">Test Reliability</searchLink><br /><searchLink fieldCode="DE" term="%22Interrater+Reliability%22">Interrater Reliability</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Validity%22">Test Validity</searchLink><br /><searchLink fieldCode="DE" term="%22Videoconferencing%22">Videoconferencing</searchLink><br /><searchLink fieldCode="DE" term="%22Narration%22">Narration</searchLink><br /><searchLink fieldCode="DE" term="%22Reading+Comprehension%22">Reading Comprehension</searchLink><br /><searchLink fieldCode="DE" term="%22Scoring%22">Scoring</searchLink><br /><searchLink fieldCode="DE" term="%22Error+of+Measurement%22">Error of Measurement</searchLink><br /><searchLink fieldCode="DE" term="%22Goodness+of+Fit%22">Goodness of Fit</searchLink><br /><searchLink fieldCode="DE" term="%22Correlation%22">Correlation</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1044/2021_LSHSS-21-00129
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Purpose: Our aim was to evaluate the psychometric properties of the online administered format of the Test of Narrative Language--Second Edition (TNL-2; Gillam & Pearson, 2017), given the importance of assessing children's narrative ability and considerable absence of psychometric studies of spoken language assessments administered online. Method: The TNL-2 was administered to 357 school-age children at risk for language and literacy difficulties as part of a randomized controlled trial, across three annual cohorts, at three time points (pretest, posttest, and 5-month follow-up). Cohort 3 students were tested using an online format at posttest and at follow-up. We compared the Cronbach's alpha internal consistency reliability of the TNL-2 online testing scores with in-person scores from TNL-2 normative data and Cohort 3 in-person testing at pretest, and interrater reliability for Cohort 3 across test points. In addition, we examined measurement invariance across test occasions and the criterion validity of the TNL-2, the latter based on its correlations with narrative sample measures (Mean Length of Utterance in words and the Monitoring Indicators of Scholarly Language rubric). Results: Internal consistency reliability, interrater reliability, and measurement invariance analyses of the online and in-person administration of the TNL-2 yielded similar outcomes. The criterion validity of the TNL-2 was found to be good. Conclusions: TNL-2 psychometric properties from online administration were generally in the "good" range and were not significantly different from in-person testing. When administered online using standardized procedures, the TNL-2 is valid and reliable for use in assessing narrative language proficiency in school-age children at risk for language and learning difficulties.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: CodeSource
  Label: IES Funded
  Group: SrcInfo
  Data: Yes
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2022
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED620387
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED620387
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1044/2021_LSHSS-21-00129
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 13
        StartPage: 404
    Subjects:
      – SubjectFull: Computer Assisted Testing
        Type: general
      – SubjectFull: Language Tests
        Type: general
      – SubjectFull: Story Telling
        Type: general
      – SubjectFull: Language Impairments
        Type: general
      – SubjectFull: Children
        Type: general
      – SubjectFull: Psychometrics
        Type: general
      – SubjectFull: Diagnostic Tests
        Type: general
      – SubjectFull: At Risk Students
        Type: general
      – SubjectFull: Test Reliability
        Type: general
      – SubjectFull: Interrater Reliability
        Type: general
      – SubjectFull: Test Validity
        Type: general
      – SubjectFull: Videoconferencing
        Type: general
      – SubjectFull: Narration
        Type: general
      – SubjectFull: Reading Comprehension
        Type: general
      – SubjectFull: Scoring
        Type: general
      – SubjectFull: Error of Measurement
        Type: general
      – SubjectFull: Goodness of Fit
        Type: general
      – SubjectFull: Correlation
        Type: general
    Titles:
      – TitleFull: Online Administration of the Test of Narrative Language--Second Edition: Psychometrics and Considerations for Remote Assessment
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Magimairaj, Beula M.
      – PersonEntity:
          Name:
            NameFull: Capin, Philip
      – PersonEntity:
          Name:
            NameFull: Gillam, Sandra L.
      – PersonEntity:
          Name:
            NameFull: Vaughn, Sharon
      – PersonEntity:
          Name:
            NameFull: Roberts, Greg
      – PersonEntity:
          Name:
            NameFull: Fall, Anna-Maria
      – PersonEntity:
          Name:
            NameFull: Gillam, Ronald B.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 04
              Type: published
              Y: 2022
          Numbering:
            – Type: volume
              Value: Language
            – Type: issue
              Value: 2
          Titles:
            – TitleFull: Grantee Submission
              Type: main
ResultId 1