Comparison of MSP and Non-MSP Schools in Six States

Saved in:
Bibliographic Details
Title: Comparison of MSP and Non-MSP Schools in Six States
Language: English
Authors: Wong, Kenneth K., Boben, Megan, Kim, Chisoo
Source: Journal of Educational Research & Policy Studies. Fall 2009 9(2):73-95.
Availability: National Office for Research on Measurement and Evaluation Systems. University of Arkansas, 346 North West Avenue, 302 WAAX, Fayetteville, AR 72701. Tel: 479-575-5593; Fax: 479-575-5185; e-mail: normes@uark.edu; Web site: http://normes.uark.edu/erps/resources.html
Peer Reviewed: Y
Physical Description: PDF
Page Count: 23
Publication Date: 2009
Document Type: Journal Articles
Reports - Evaluative
Education Level: Elementary Education
Elementary Secondary Education
High Schools
Middle Schools
Secondary Education
Descriptors: Standardized Tests, Academic Achievement, Comparative Analysis, Cohort Analysis, Predictor Variables, Scores, Achievement Gains, Mathematics Achievement, Science Achievement, Science Education, Mathematics Education, Program Evaluation, Program Effectiveness, Teacher Effectiveness, Partnerships in Education, Demography
ISSN: 1934-6875
Abstract: This pilot study proposes a set of analytical steps for comparing schools that participate in the National Science Foundation's Math and Science Partnership (MSP) Program and their intrastate non-participating peers. This pilot is part of a larger effort to evaluate the MSP Program's role in student achievement, along with two companion analyses. While our pilot study uses a comparative approach, the paper by Dimiter Dimitrov (this volume) follows a within-group design. The third analysis by Robert K. Yin (this volume) covers the varied designs used by the MSPs themselves in their own evaluations. As this pilot study has progressed, there has emerged three distinct phases of analysis. Phase I focused on the participating schools within four Math and Science Partnerships (MSPs) located in three states. Phase II expanded Phase I to focus on three more MSPs in three additional states. The Phase III study was conducted using six cohort I MSPs in four states, and will eventually include the nine cohort I MSPs in all six states from Phase I and Phase II. For each phase, the MSP participating schools were carefully matched with the non-participating schools on eight demographic variables to form a comparison group. This paper offers detailed documentation on how we operationalize matching methods for comparative purposes. We conclude that carefully executed matching methods are promising for large-scale comparative analysis on the effects of the MSP Program across all involved states. The study draws on publicly accessible school-level standardized test data from six states and from data available at the National Center for Education Statistics' Common Core of Data (NCES CCD). In addition, the study uses documents available via MSPnet, and Web site information reported by the individual MSPs in the MSP Program accessible through the school year 2005-06. (Contains 7 tables and 3 endnotes.)
Abstractor: As Provided
Number of References: 20
Entry Date: 2010
Accession Number: EJ896284
Database: ERIC
Description
Abstract:This pilot study proposes a set of analytical steps for comparing schools that participate in the National Science Foundation's Math and Science Partnership (MSP) Program and their intrastate non-participating peers. This pilot is part of a larger effort to evaluate the MSP Program's role in student achievement, along with two companion analyses. While our pilot study uses a comparative approach, the paper by Dimiter Dimitrov (this volume) follows a within-group design. The third analysis by Robert K. Yin (this volume) covers the varied designs used by the MSPs themselves in their own evaluations. As this pilot study has progressed, there has emerged three distinct phases of analysis. Phase I focused on the participating schools within four Math and Science Partnerships (MSPs) located in three states. Phase II expanded Phase I to focus on three more MSPs in three additional states. The Phase III study was conducted using six cohort I MSPs in four states, and will eventually include the nine cohort I MSPs in all six states from Phase I and Phase II. For each phase, the MSP participating schools were carefully matched with the non-participating schools on eight demographic variables to form a comparison group. This paper offers detailed documentation on how we operationalize matching methods for comparative purposes. We conclude that carefully executed matching methods are promising for large-scale comparative analysis on the effects of the MSP Program across all involved states. The study draws on publicly accessible school-level standardized test data from six states and from data available at the National Center for Education Statistics' Common Core of Data (NCES CCD). In addition, the study uses documents available via MSPnet, and Web site information reported by the individual MSPs in the MSP Program accessible through the school year 2005-06. (Contains 7 tables and 3 endnotes.)
ISSN:1934-6875