Naturalization Test Redesign Project: Civics Item Selection Analysis

Saved in:
Bibliographic Details
Title: Naturalization Test Redesign Project: Civics Item Selection Analysis
Language: English
Authors: US Citizenship and Immigration Services
Source: US Citizenship and Immigration Services. 2008.
Availability: US Citizenship and Immigration Services. P.O. Box 7134, London, KY 40742-7134. Tel: 800-375-5283; Web site: http://www.uscis.gov/
Peer Reviewed: N
Page Count: 236
Publication Date: 2008
Document Type: Numerical/Quantitative Data
Reports - Research
Tests/Questionnaires
Education Level: Adult Education
Descriptors: History, Test Items, Citizenship, Individual Testing, Civics, Item Analysis, Immigrants, United States History, Public Agencies, English (Second Language), Second Language Learning, Citizenship Education, Interviews, Comparative Analysis, Test Coaching, Test Construction, Test Wiseness, Test Results
Abstract: "Naturalization Test Redesign Project: Civics Item Selection Analysis" provides an overview of the development of content items for the U.S. history and government (civics) portion of the redesigned naturalization test. This document also reviews the process used to gather and analyze data from multiple studies to determine which civics test items to maintain, revise, or eliminate. The data presented was compiled from two sources: a Pilot Study and a Supplemental Study. The Pilot Study serves as the primary source of data and was conducted at ten randomly selected U.S. Citizenship and Immigration Services (USCIS) offices throughout the nation. In the Pilot Study, applicants who chose to participate had ample time to study the civics questions for the naturalization test. Taking into account the regulatory mandate requiring "due consideration" (8 CFR 312.2(c)(2)), a Supplemental Study was conducted to identify items that would be appropriate for low and high-beginning students. The Supplemental Study was conducted at English as a second language (ESL)/citizenship classes where prospective applicants were pursuing classroom education to prepare for the naturalization test and interview. In this study, USCIS focused on lower-level adult civics and citizenship classes. The purpose was to examine how individuals who were preparing for the English and civics portions of the naturalization test would compare with applicants who had already filed for naturalization and were, therefore, more likely ready to take the test. Data from this study provided USCIS with an indicator to determine item difficulty for a specific population. Lastly, this document presents performance ranges on individual test items for both studies as well as selection codes to indicate the rationale for keeping an item "as is," revising the item, or discarding the item completely. Appendices include: (1) Civics (History and Government) Items for the Pilot Naturalization Test; (2) Final Civics (History and Government) Items for the Redesigned Naturalization Test; and (3) List of Supporting Tables. (Contains 46 tables.
Abstractor: ERIC
Entry Date: 2010
Accession Number: ED508141
Database: ERIC
Description
Abstract:"Naturalization Test Redesign Project: Civics Item Selection Analysis" provides an overview of the development of content items for the U.S. history and government (civics) portion of the redesigned naturalization test. This document also reviews the process used to gather and analyze data from multiple studies to determine which civics test items to maintain, revise, or eliminate. The data presented was compiled from two sources: a Pilot Study and a Supplemental Study. The Pilot Study serves as the primary source of data and was conducted at ten randomly selected U.S. Citizenship and Immigration Services (USCIS) offices throughout the nation. In the Pilot Study, applicants who chose to participate had ample time to study the civics questions for the naturalization test. Taking into account the regulatory mandate requiring "due consideration" (8 CFR 312.2(c)(2)), a Supplemental Study was conducted to identify items that would be appropriate for low and high-beginning students. The Supplemental Study was conducted at English as a second language (ESL)/citizenship classes where prospective applicants were pursuing classroom education to prepare for the naturalization test and interview. In this study, USCIS focused on lower-level adult civics and citizenship classes. The purpose was to examine how individuals who were preparing for the English and civics portions of the naturalization test would compare with applicants who had already filed for naturalization and were, therefore, more likely ready to take the test. Data from this study provided USCIS with an indicator to determine item difficulty for a specific population. Lastly, this document presents performance ranges on individual test items for both studies as well as selection codes to indicate the rationale for keeping an item "as is," revising the item, or discarding the item completely. Appendices include: (1) Civics (History and Government) Items for the Pilot Naturalization Test; (2) Final Civics (History and Government) Items for the Redesigned Naturalization Test; and (3) List of Supporting Tables. (Contains 46 tables.