View in EDS

Using instructor judgment, learner corpora, and DIF to develop a placement test for Spanish L2 and heritage learners.

Saved in:
Bibliographic Details
Title: Using instructor judgment, learner corpora, and DIF to develop a placement test for Spanish L2 and heritage learners.
Authors: Bowles, Melissa A.1 bowlesm@illinois.edu
Source: Language Testing. Jul2022, Vol. 39 Issue 3, p355-376. 22p.
Subject Terms: *Placement testing in universities & colleges, *Bilingual students, *Bilingual education, *Universities & colleges, *Higher education, *Adults, Differential item functioning (Research bias)
Abstract: This study details the development of a local test designed to place university Spanish students (n = 719) into one of the four different course levels and to distinguish between traditional L2 learners and early bilinguals on the basis of their linguistic knowledge, regardless of the variety of Spanish they were exposed to. Early bilinguals include two groups—heritage learners (HLs), who were exposed to Spanish in their homes and communities growing up, and early L2 learners with extensive Spanish exposure, often through dual immersion education, who are increasingly enrolling in university Spanish courses and tend to pattern with HLs. Expert instructor judgment and learner corpora contributed to item development, and 12 of 15 written multiple-choice test items targeting early-acquired vocabulary had differential item functioning (DIF) according to the Mantel–Haenszel procedure, favoring HLs. Recursive partitioning revealed that vocabulary score correctly identified 597/603 (99%) of L2 learners as such, and the six HLs whose vocabulary scores incorrectly identified them as L2 learners were in the lowest placement groups. Vocabulary scores also correctly identified 100% of the early L2 learners in the sample (n = 7) as having a heritage profile. Implications for the local context and for placement testing in general are provided. [ABSTRACT FROM AUTHOR]
Copyright of Language Testing is the property of Sage Publications, Ltd. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Education Research Complete
FullText Text:
  Availability: 0
Header DbId: ehh
DbLabel: Education Research Complete
An: 158058673
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Using instructor judgment, learner corpora, and DIF to develop a placement test for Spanish L2 and heritage learners.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Bowles%2C+Melissa+A%2E%22">Bowles, Melissa A.</searchLink><relatesTo>1</relatesTo><i> bowlesm@illinois.edu</i>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Language+Testing%22">Language Testing</searchLink>. Jul2022, Vol. 39 Issue 3, p355-376. 22p.
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: *<searchLink fieldCode="DE" term="%22Placement+testing+in+universities+%26+colleges%22">Placement testing in universities & colleges</searchLink><br />*<searchLink fieldCode="DE" term="%22Bilingual+students%22">Bilingual students</searchLink><br />*<searchLink fieldCode="DE" term="%22Bilingual+education%22">Bilingual education</searchLink><br />*<searchLink fieldCode="DE" term="%22Universities+%26+colleges%22">Universities & colleges</searchLink><br />*<searchLink fieldCode="DE" term="%22Higher+education%22">Higher education</searchLink><br />*<searchLink fieldCode="DE" term="%22Adults%22">Adults</searchLink><br /><searchLink fieldCode="DE" term="%22Differential+item+functioning+%28Research+bias%29%22">Differential item functioning (Research bias)</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: This study details the development of a local test designed to place university Spanish students (n = 719) into one of the four different course levels and to distinguish between traditional L2 learners and early bilinguals on the basis of their linguistic knowledge, regardless of the variety of Spanish they were exposed to. Early bilinguals include two groups—heritage learners (HLs), who were exposed to Spanish in their homes and communities growing up, and early L2 learners with extensive Spanish exposure, often through dual immersion education, who are increasingly enrolling in university Spanish courses and tend to pattern with HLs. Expert instructor judgment and learner corpora contributed to item development, and 12 of 15 written multiple-choice test items targeting early-acquired vocabulary had differential item functioning (DIF) according to the Mantel–Haenszel procedure, favoring HLs. Recursive partitioning revealed that vocabulary score correctly identified 597/603 (99%) of L2 learners as such, and the six HLs whose vocabulary scores incorrectly identified them as L2 learners were in the lowest placement groups. Vocabulary scores also correctly identified 100% of the early L2 learners in the sample (n = 7) as having a heritage profile. Implications for the local context and for placement testing in general are provided. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Language Testing is the property of Sage Publications, Ltd. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=158058673
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1177/02655322221076033
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 22
        StartPage: 355
    Subjects:
      – SubjectFull: Placement testing in universities & colleges
        Type: general
      – SubjectFull: Bilingual students
        Type: general
      – SubjectFull: Bilingual education
        Type: general
      – SubjectFull: Universities & colleges
        Type: general
      – SubjectFull: Higher education
        Type: general
      – SubjectFull: Adults
        Type: general
      – SubjectFull: Differential item functioning (Research bias)
        Type: general
    Titles:
      – TitleFull: Using instructor judgment, learner corpora, and DIF to develop a placement test for Spanish L2 and heritage learners.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Bowles, Melissa A.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 07
              Text: Jul2022
              Type: published
              Y: 2022
          Identifiers:
            – Type: issn-print
              Value: 02655322
          Numbering:
            – Type: volume
              Value: 39
            – Type: issue
              Value: 3
          Titles:
            – TitleFull: Language Testing
              Type: main
ResultId 1