Naturalization Test Redesign Project: Civics Item Selection Analysis

Saved in:
Bibliographic Details
Title: Naturalization Test Redesign Project: Civics Item Selection Analysis
Language: English
Authors: US Citizenship and Immigration Services
Source: US Citizenship and Immigration Services. 2008.
Availability: US Citizenship and Immigration Services. P.O. Box 7134, London, KY 40742-7134. Tel: 800-375-5283; Web site: http://www.uscis.gov/
Peer Reviewed: N
Page Count: 236
Publication Date: 2008
Document Type: Numerical/Quantitative Data
Reports - Research
Tests/Questionnaires
Education Level: Adult Education
Descriptors: History, Test Items, Citizenship, Individual Testing, Civics, Item Analysis, Immigrants, United States History, Public Agencies, English (Second Language), Second Language Learning, Citizenship Education, Interviews, Comparative Analysis, Test Coaching, Test Construction, Test Wiseness, Test Results
Abstract: "Naturalization Test Redesign Project: Civics Item Selection Analysis" provides an overview of the development of content items for the U.S. history and government (civics) portion of the redesigned naturalization test. This document also reviews the process used to gather and analyze data from multiple studies to determine which civics test items to maintain, revise, or eliminate. The data presented was compiled from two sources: a Pilot Study and a Supplemental Study. The Pilot Study serves as the primary source of data and was conducted at ten randomly selected U.S. Citizenship and Immigration Services (USCIS) offices throughout the nation. In the Pilot Study, applicants who chose to participate had ample time to study the civics questions for the naturalization test. Taking into account the regulatory mandate requiring "due consideration" (8 CFR 312.2(c)(2)), a Supplemental Study was conducted to identify items that would be appropriate for low and high-beginning students. The Supplemental Study was conducted at English as a second language (ESL)/citizenship classes where prospective applicants were pursuing classroom education to prepare for the naturalization test and interview. In this study, USCIS focused on lower-level adult civics and citizenship classes. The purpose was to examine how individuals who were preparing for the English and civics portions of the naturalization test would compare with applicants who had already filed for naturalization and were, therefore, more likely ready to take the test. Data from this study provided USCIS with an indicator to determine item difficulty for a specific population. Lastly, this document presents performance ranges on individual test items for both studies as well as selection codes to indicate the rationale for keeping an item "as is," revising the item, or discarding the item completely. Appendices include: (1) Civics (History and Government) Items for the Pilot Naturalization Test; (2) Final Civics (History and Government) Items for the Redesigned Naturalization Test; and (3) List of Supporting Tables. (Contains 46 tables.
Abstractor: ERIC
Entry Date: 2010
Accession Number: ED508141
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED508141
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED508141
AccessLevel: 3
PubType: Electronic Resource
PubTypeId: electronicResource
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Naturalization Test Redesign Project: Civics Item Selection Analysis
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22US+Citizenship+and+Immigration+Services%22">US Citizenship and Immigration Services</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22US+Citizenship+and+Immigration+Services%22"><i>US Citizenship and Immigration Services</i></searchLink>. 2008.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: US Citizenship and Immigration Services. P.O. Box 7134, London, KY 40742-7134. Tel: 800-375-5283; Web site: http://www.uscis.gov/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: N
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 236
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2008
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Numerical/Quantitative Data<br />Reports - Research<br />Tests/Questionnaires
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Adult+Education%22">Adult Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22History%22">History</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Items%22">Test Items</searchLink><br /><searchLink fieldCode="DE" term="%22Citizenship%22">Citizenship</searchLink><br /><searchLink fieldCode="DE" term="%22Individual+Testing%22">Individual Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Civics%22">Civics</searchLink><br /><searchLink fieldCode="DE" term="%22Item+Analysis%22">Item Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Immigrants%22">Immigrants</searchLink><br /><searchLink fieldCode="DE" term="%22United+States+History%22">United States History</searchLink><br /><searchLink fieldCode="DE" term="%22Public+Agencies%22">Public Agencies</searchLink><br /><searchLink fieldCode="DE" term="%22English+%28Second+Language%29%22">English (Second Language)</searchLink><br /><searchLink fieldCode="DE" term="%22Second+Language+Learning%22">Second Language Learning</searchLink><br /><searchLink fieldCode="DE" term="%22Citizenship+Education%22">Citizenship Education</searchLink><br /><searchLink fieldCode="DE" term="%22Interviews%22">Interviews</searchLink><br /><searchLink fieldCode="DE" term="%22Comparative+Analysis%22">Comparative Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Coaching%22">Test Coaching</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Construction%22">Test Construction</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Wiseness%22">Test Wiseness</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Results%22">Test Results</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: "Naturalization Test Redesign Project: Civics Item Selection Analysis" provides an overview of the development of content items for the U.S. history and government (civics) portion of the redesigned naturalization test. This document also reviews the process used to gather and analyze data from multiple studies to determine which civics test items to maintain, revise, or eliminate. The data presented was compiled from two sources: a Pilot Study and a Supplemental Study. The Pilot Study serves as the primary source of data and was conducted at ten randomly selected U.S. Citizenship and Immigration Services (USCIS) offices throughout the nation. In the Pilot Study, applicants who chose to participate had ample time to study the civics questions for the naturalization test. Taking into account the regulatory mandate requiring "due consideration" (8 CFR 312.2(c)(2)), a Supplemental Study was conducted to identify items that would be appropriate for low and high-beginning students. The Supplemental Study was conducted at English as a second language (ESL)/citizenship classes where prospective applicants were pursuing classroom education to prepare for the naturalization test and interview. In this study, USCIS focused on lower-level adult civics and citizenship classes. The purpose was to examine how individuals who were preparing for the English and civics portions of the naturalization test would compare with applicants who had already filed for naturalization and were, therefore, more likely ready to take the test. Data from this study provided USCIS with an indicator to determine item difficulty for a specific population. Lastly, this document presents performance ranges on individual test items for both studies as well as selection codes to indicate the rationale for keeping an item "as is," revising the item, or discarding the item completely. Appendices include: (1) Civics (History and Government) Items for the Pilot Naturalization Test; (2) Final Civics (History and Government) Items for the Redesigned Naturalization Test; and (3) List of Supporting Tables. (Contains 46 tables.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: ERIC
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2010
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED508141
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED508141
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 236
    Subjects:
      – SubjectFull: History
        Type: general
      – SubjectFull: Test Items
        Type: general
      – SubjectFull: Citizenship
        Type: general
      – SubjectFull: Individual Testing
        Type: general
      – SubjectFull: Civics
        Type: general
      – SubjectFull: Item Analysis
        Type: general
      – SubjectFull: Immigrants
        Type: general
      – SubjectFull: United States History
        Type: general
      – SubjectFull: Public Agencies
        Type: general
      – SubjectFull: English (Second Language)
        Type: general
      – SubjectFull: Second Language Learning
        Type: general
      – SubjectFull: Citizenship Education
        Type: general
      – SubjectFull: Interviews
        Type: general
      – SubjectFull: Comparative Analysis
        Type: general
      – SubjectFull: Test Coaching
        Type: general
      – SubjectFull: Test Construction
        Type: general
      – SubjectFull: Test Wiseness
        Type: general
      – SubjectFull: Test Results
        Type: general
    Titles:
      – TitleFull: Naturalization Test Redesign Project: Civics Item Selection Analysis
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: US Citizenship and Immigration Services
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2008
          Titles:
            – TitleFull: US Citizenship and Immigration Services
              Type: main
ResultId 1