The Effect of Communication Emails on Web Survey Response Rate, Representativeness, and Response Bias: Results from a Factorial Randomized Control Trial in a College Student Population

Saved in:
Bibliographic Details
Title: The Effect of Communication Emails on Web Survey Response Rate, Representativeness, and Response Bias: Results from a Factorial Randomized Control Trial in a College Student Population
Language: English
Authors: Paula Clasing-Manquian (ORCID 0000-0003-2367-2486), John Gonzalez
Source: Field Methods. 2025 37(4):291-304.
Availability: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com
Peer Reviewed: Y
Page Count: 14
Publication Date: 2025
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Online Surveys, Doctoral Students, Intervention, Response Rates (Questionnaires), Response Style (Tests), Student Behavior, Intention, Barriers, Social Influences
DOI: 10.1177/1525822X241286341
ISSN: 1525-822X
1552-3969
Abstract: Web surveys are popular in social sciences for reaching a large audience at a low cost and in a short period. However, response rates and nonresponse bias are still issues of concern. Using a factorial randomized control trial design, this study explores whether different communication emails affect response rates, representativeness, and response bias in a web survey of doctoral students enrolled in a U.S. university. A total of 5,539 doctoral students were stratified and randomly assigned to one of six groups. Results showed that none of the interventions increased the overall response rate. Moreover, interventions affect the representativeness of the sample and are associated with response bias.
Abstractor: As Provided
Entry Date: 2025
Accession Number: EJ1488082
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1488082
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: The Effect of Communication Emails on Web Survey Response Rate, Representativeness, and Response Bias: Results from a Factorial Randomized Control Trial in a College Student Population
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Paula+Clasing-Manquian%22">Paula Clasing-Manquian</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-2367-2486">0000-0003-2367-2486</externalLink>)<br /><searchLink fieldCode="AR" term="%22John+Gonzalez%22">John Gonzalez</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Field+Methods%22"><i>Field Methods</i></searchLink>. 2025 37(4):291-304.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 14
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2025
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Online+Surveys%22">Online Surveys</searchLink><br /><searchLink fieldCode="DE" term="%22Doctoral+Students%22">Doctoral Students</searchLink><br /><searchLink fieldCode="DE" term="%22Intervention%22">Intervention</searchLink><br /><searchLink fieldCode="DE" term="%22Response+Rates+%28Questionnaires%29%22">Response Rates (Questionnaires)</searchLink><br /><searchLink fieldCode="DE" term="%22Response+Style+%28Tests%29%22">Response Style (Tests)</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Behavior%22">Student Behavior</searchLink><br /><searchLink fieldCode="DE" term="%22Intention%22">Intention</searchLink><br /><searchLink fieldCode="DE" term="%22Barriers%22">Barriers</searchLink><br /><searchLink fieldCode="DE" term="%22Social+Influences%22">Social Influences</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1177/1525822X241286341
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 1525-822X<br />1552-3969
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Web surveys are popular in social sciences for reaching a large audience at a low cost and in a short period. However, response rates and nonresponse bias are still issues of concern. Using a factorial randomized control trial design, this study explores whether different communication emails affect response rates, representativeness, and response bias in a web survey of doctoral students enrolled in a U.S. university. A total of 5,539 doctoral students were stratified and randomly assigned to one of six groups. Results showed that none of the interventions increased the overall response rate. Moreover, interventions affect the representativeness of the sample and are associated with response bias.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2025
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1488082
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1488082
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1177/1525822X241286341
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 14
        StartPage: 291
    Subjects:
      – SubjectFull: Online Surveys
        Type: general
      – SubjectFull: Doctoral Students
        Type: general
      – SubjectFull: Intervention
        Type: general
      – SubjectFull: Response Rates (Questionnaires)
        Type: general
      – SubjectFull: Response Style (Tests)
        Type: general
      – SubjectFull: Student Behavior
        Type: general
      – SubjectFull: Intention
        Type: general
      – SubjectFull: Barriers
        Type: general
      – SubjectFull: Social Influences
        Type: general
    Titles:
      – TitleFull: The Effect of Communication Emails on Web Survey Response Rate, Representativeness, and Response Bias: Results from a Factorial Randomized Control Trial in a College Student Population
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Paula Clasing-Manquian
      – PersonEntity:
          Name:
            NameFull: John Gonzalez
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 11
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-print
              Value: 1525-822X
            – Type: issn-electronic
              Value: 1552-3969
          Numbering:
            – Type: volume
              Value: 37
            – Type: issue
              Value: 4
          Titles:
            – TitleFull: Field Methods
              Type: main
ResultId 1