Detecting the Impact of Remote Proctored At-Home Testing Using Propensity Score Weighting. Research Report. ETS RR-24-11
Saved in:
| Title: | Detecting the Impact of Remote Proctored At-Home Testing Using Propensity Score Weighting. Research Report. ETS RR-24-11 |
|---|---|
| Language: | English |
| Authors: | Jing Miao, Yi Cao, Michael E. Walker |
| Source: | ETS Research Report Series. Dec 2024. |
| Availability: | ETS. Rosedale Road, Mailstop 19R, Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; e-mail: RDweb@ets.org; Web site: https://www.ets.org/ |
| Peer Reviewed: | Y |
| Page Count: | 34 |
| Publication Date: | 2024 |
| Document Type: | Journal Articles Reports - Research |
| Descriptors: | Testing, Test Format, Computer Assisted Testing, Home Study, Distance Education, Weighted Scores, Student Diversity, Comparative Testing |
| ISSN: | 2330-8516 |
| Abstract: | Studies of test score comparability have been conducted at different stages in the history of testing to ensure that test results carry the same meaning regardless of test conditions. The expansion of at-home testing via remote proctoring sparked another round of interest. This study uses data from three licensure tests to assess potential mode effects associated with the dual option of on-site testing at test centers and at-home testing via remote proctoring. We generated propensity score weights to balance the two self-selected groups in order to detect the mode effect on the test outcomes. We also assessed the potential impact of omitted variables on the estimated mode effect. Results of the study indicate that the demographic compositions of the test takers are similar before and after the introduction of the RP option. Examinees under the two testing modes differ slightly on certain background variables. Once the group differences are adjusted by propensity score weighting, the estimated mode effects are small and nonsystematic across test titles overall. We note some variations across subgroups based on gender and race. |
| Abstractor: | As Provided |
| Entry Date: | 2025 |
| Accession Number: | EJ1459574 |
| Database: | ERIC |
Be the first to leave a comment!
