The Effect of Communication Emails on Web Survey Response Rate, Representativeness, and Response Bias: Results from a Factorial Randomized Control Trial in a College Student Population

Saved in:
Bibliographic Details
Title: The Effect of Communication Emails on Web Survey Response Rate, Representativeness, and Response Bias: Results from a Factorial Randomized Control Trial in a College Student Population
Language: English
Authors: Paula Clasing-Manquian (ORCID 0000-0003-2367-2486), John Gonzalez
Source: Field Methods. 2025 37(4):291-304.
Availability: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com
Peer Reviewed: Y
Page Count: 14
Publication Date: 2025
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Online Surveys, Doctoral Students, Intervention, Response Rates (Questionnaires), Response Style (Tests), Student Behavior, Intention, Barriers, Social Influences
DOI: 10.1177/1525822X241286341
ISSN: 1525-822X
1552-3969
Abstract: Web surveys are popular in social sciences for reaching a large audience at a low cost and in a short period. However, response rates and nonresponse bias are still issues of concern. Using a factorial randomized control trial design, this study explores whether different communication emails affect response rates, representativeness, and response bias in a web survey of doctoral students enrolled in a U.S. university. A total of 5,539 doctoral students were stratified and randomly assigned to one of six groups. Results showed that none of the interventions increased the overall response rate. Moreover, interventions affect the representativeness of the sample and are associated with response bias.
Abstractor: As Provided
Entry Date: 2025
Accession Number: EJ1488082
Database: ERIC
Description
Abstract:Web surveys are popular in social sciences for reaching a large audience at a low cost and in a short period. However, response rates and nonresponse bias are still issues of concern. Using a factorial randomized control trial design, this study explores whether different communication emails affect response rates, representativeness, and response bias in a web survey of doctoral students enrolled in a U.S. university. A total of 5,539 doctoral students were stratified and randomly assigned to one of six groups. Results showed that none of the interventions increased the overall response rate. Moreover, interventions affect the representativeness of the sample and are associated with response bias.
ISSN:1525-822X
1552-3969
DOI:10.1177/1525822X241286341