View in EDS

The Devil Is in the Details: A Randomized Experiment Assessing the Effect of Providing Examples in a Survey Question across Countries

Saved in:
Bibliographic Details
Title: The Devil Is in the Details: A Randomized Experiment Assessing the Effect of Providing Examples in a Survey Question across Countries
Language: English
Authors: Aizpurua, Eva (ORCID 0000-0001-7045-5535), Bottoni, Gianmaria, Fitzgerald, Rory
Source: Field Methods. Aug 2023 35(3):198-218.
Availability: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com
Peer Reviewed: Y
Page Count: 21
Publication Date: 2023
Document Type: Journal Articles
Reports - Research
Descriptors: Foreign Countries, Surveys, Response Rates (Questionnaires), Test Items, Confidence Testing, Social Media, Effect Size, Models, Cross Cultural Studies
Geographic Terms: Estonia, United Kingdom (Great Britain), Slovenia
DOI: 10.1177/1525822X221115506
ISSN: 1525-822X
1552-3969
Abstract: Despite the widespread use of examples in survey questions, very few studies have examined their impact on survey responses, and the evidence is mainly based on data collected in the United States using questionnaires in English. This study builds on previous research by examining the effects of providing examples using data from a cross-national probability-based web panel implemented in Estonia (n = 730), Great Britain (n = 685), and Slovenia (n = 529) during Round 8 of the European Social Survey (2017/18). Respondents were randomly assigned a survey question measuring confidence in social media using Facebook and Twitter as examples, or another condition in which no examples were offered. The results show that confidence in social media was significantly lower in the example condition, although the effect size was small. Confidence in social media varied across countries, and the effect of providing examples was heterogeneous across countries and education levels. The implications of these findings are discussed.
Abstractor: As Provided
Entry Date: 2023
Accession Number: EJ1384068
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1384068
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: The Devil Is in the Details: A Randomized Experiment Assessing the Effect of Providing Examples in a Survey Question across Countries
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Aizpurua%2C+Eva%22">Aizpurua, Eva</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-7045-5535">0000-0001-7045-5535</externalLink>)<br /><searchLink fieldCode="AR" term="%22Bottoni%2C+Gianmaria%22">Bottoni, Gianmaria</searchLink><br /><searchLink fieldCode="AR" term="%22Fitzgerald%2C+Rory%22">Fitzgerald, Rory</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Field+Methods%22"><i>Field Methods</i></searchLink>. Aug 2023 35(3):198-218.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 21
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2023
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Foreign+Countries%22">Foreign Countries</searchLink><br /><searchLink fieldCode="DE" term="%22Surveys%22">Surveys</searchLink><br /><searchLink fieldCode="DE" term="%22Response+Rates+%28Questionnaires%29%22">Response Rates (Questionnaires)</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Items%22">Test Items</searchLink><br /><searchLink fieldCode="DE" term="%22Confidence+Testing%22">Confidence Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Social+Media%22">Social Media</searchLink><br /><searchLink fieldCode="DE" term="%22Effect+Size%22">Effect Size</searchLink><br /><searchLink fieldCode="DE" term="%22Models%22">Models</searchLink><br /><searchLink fieldCode="DE" term="%22Cross+Cultural+Studies%22">Cross Cultural Studies</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Estonia%22">Estonia</searchLink><br /><searchLink fieldCode="DE" term="%22United+Kingdom+%28Great+Britain%29%22">United Kingdom (Great Britain)</searchLink><br /><searchLink fieldCode="DE" term="%22Slovenia%22">Slovenia</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1177/1525822X221115506
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 1525-822X<br />1552-3969
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Despite the widespread use of examples in survey questions, very few studies have examined their impact on survey responses, and the evidence is mainly based on data collected in the United States using questionnaires in English. This study builds on previous research by examining the effects of providing examples using data from a cross-national probability-based web panel implemented in Estonia (n = 730), Great Britain (n = 685), and Slovenia (n = 529) during Round 8 of the European Social Survey (2017/18). Respondents were randomly assigned a survey question measuring confidence in social media using Facebook and Twitter as examples, or another condition in which no examples were offered. The results show that confidence in social media was significantly lower in the example condition, although the effect size was small. Confidence in social media varied across countries, and the effect of providing examples was heterogeneous across countries and education levels. The implications of these findings are discussed.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2023
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1384068
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1384068
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1177/1525822X221115506
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 21
        StartPage: 198
    Subjects:
      – SubjectFull: Foreign Countries
        Type: general
      – SubjectFull: Surveys
        Type: general
      – SubjectFull: Response Rates (Questionnaires)
        Type: general
      – SubjectFull: Test Items
        Type: general
      – SubjectFull: Confidence Testing
        Type: general
      – SubjectFull: Social Media
        Type: general
      – SubjectFull: Effect Size
        Type: general
      – SubjectFull: Models
        Type: general
      – SubjectFull: Cross Cultural Studies
        Type: general
      – SubjectFull: Estonia
        Type: general
      – SubjectFull: United Kingdom (Great Britain)
        Type: general
      – SubjectFull: Slovenia
        Type: general
    Titles:
      – TitleFull: The Devil Is in the Details: A Randomized Experiment Assessing the Effect of Providing Examples in a Survey Question across Countries
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Aizpurua, Eva
      – PersonEntity:
          Name:
            NameFull: Bottoni, Gianmaria
      – PersonEntity:
          Name:
            NameFull: Fitzgerald, Rory
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 08
              Type: published
              Y: 2023
          Identifiers:
            – Type: issn-print
              Value: 1525-822X
            – Type: issn-electronic
              Value: 1552-3969
          Numbering:
            – Type: volume
              Value: 35
            – Type: issue
              Value: 3
          Titles:
            – TitleFull: Field Methods
              Type: main
ResultId 1