View in EDS

Comparison of Population-Representative and Volunteer Experiments: Lessons from the Social Security Administration's Benefit Offset National Demonstration (BOND)

Saved in:
Bibliographic Details
Title: Comparison of Population-Representative and Volunteer Experiments: Lessons from the Social Security Administration's Benefit Offset National Demonstration (BOND)
Language: English
Authors: Stapleton, David C. (ORCID 0000-0001-9147-3046), Bell, Stephen H. (ORCID 0000-0002-2286-5887), Hoffman, Denise, Wood, Michelle
Source: American Journal of Evaluation. Dec 2020 41(4):547-563.
Availability: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Peer Reviewed: Y
Page Count: 17
Publication Date: 2020
Sponsoring Agency: Social Security Administration
Contract Number: SS001060011
Document Type: Journal Articles
Reports - Evaluative
Descriptors: Federal Programs, Public Policy, Experiments, Comparative Analysis, Volunteers, Research Problems, Ethics, Costs, Research Design, Validity, Communication (Thought Transfer)
Laws, Policies and Program Identifiers: Social Security
DOI: 10.1177/1098214020944236
ISSN: 1098-2140
Abstract: The Benefit Offset National Demonstration (BOND) tested a $1 reduction in benefits per $2 earnings increase above the level at which Social Security Disability Insurance benefits drop from full to zero under current law. BOND included a rare and large "population-representative" experiment: It applied the rule to a nationwide, random sample of beneficiaries. BOND also included a parallel "volunteer" experiment: The same offset rules applied to a nationwide random sample of volunteers. BOND's dual experiments offer a unique opportunity to consider the merits and limitations of these two types of experiments. The findings provide a way to illustrate the limitations of volunteer experiments relative to population experiments when, as in BOND, the goal is to produce impact estimates that are valid for the entire population, not just would be volunteers. We also highlight and compare ethical issues, outreach challenges, and cost considerations for the two types of designs.
Abstractor: As Provided
Entry Date: 2020
Accession Number: EJ1274854
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1274854
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Comparison of Population-Representative and Volunteer Experiments: Lessons from the Social Security Administration's Benefit Offset National Demonstration (BOND)
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Stapleton%2C+David+C%2E%22">Stapleton, David C.</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-9147-3046">0000-0001-9147-3046</externalLink>)<br /><searchLink fieldCode="AR" term="%22Bell%2C+Stephen+H%2E%22">Bell, Stephen H.</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-2286-5887">0000-0002-2286-5887</externalLink>)<br /><searchLink fieldCode="AR" term="%22Hoffman%2C+Denise%22">Hoffman, Denise</searchLink><br /><searchLink fieldCode="AR" term="%22Wood%2C+Michelle%22">Wood, Michelle</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22American+Journal+of+Evaluation%22"><i>American Journal of Evaluation</i></searchLink>. Dec 2020 41(4):547-563.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 17
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2020
– Name: SourceSuprt
  Label: Sponsoring Agency
  Group: SrcSuprt
  Data: Social Security Administration
– Name: NumberContract
  Label: Contract Number
  Group: NumCntrct
  Data: SS001060011
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Evaluative
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Federal+Programs%22">Federal Programs</searchLink><br /><searchLink fieldCode="DE" term="%22Public+Policy%22">Public Policy</searchLink><br /><searchLink fieldCode="DE" term="%22Experiments%22">Experiments</searchLink><br /><searchLink fieldCode="DE" term="%22Comparative+Analysis%22">Comparative Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Volunteers%22">Volunteers</searchLink><br /><searchLink fieldCode="DE" term="%22Research+Problems%22">Research Problems</searchLink><br /><searchLink fieldCode="DE" term="%22Ethics%22">Ethics</searchLink><br /><searchLink fieldCode="DE" term="%22Costs%22">Costs</searchLink><br /><searchLink fieldCode="DE" term="%22Research+Design%22">Research Design</searchLink><br /><searchLink fieldCode="DE" term="%22Validity%22">Validity</searchLink><br /><searchLink fieldCode="DE" term="%22Communication+%28Thought+Transfer%29%22">Communication (Thought Transfer)</searchLink>
– Name: SubjectThesaurus
  Label: Laws, Policies and Program Identifiers
  Group: Su
  Data: <searchLink fieldCode="SU" term="%22Social+Security%22">Social Security</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1177/1098214020944236
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 1098-2140
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: The Benefit Offset National Demonstration (BOND) tested a $1 reduction in benefits per $2 earnings increase above the level at which Social Security Disability Insurance benefits drop from full to zero under current law. BOND included a rare and large "population-representative" experiment: It applied the rule to a nationwide, random sample of beneficiaries. BOND also included a parallel "volunteer" experiment: The same offset rules applied to a nationwide random sample of volunteers. BOND's dual experiments offer a unique opportunity to consider the merits and limitations of these two types of experiments. The findings provide a way to illustrate the limitations of volunteer experiments relative to population experiments when, as in BOND, the goal is to produce impact estimates that are valid for the entire population, not just would be volunteers. We also highlight and compare ethical issues, outreach challenges, and cost considerations for the two types of designs.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2020
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1274854
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1274854
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1177/1098214020944236
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 17
        StartPage: 547
    Subjects:
      – SubjectFull: Federal Programs
        Type: general
      – SubjectFull: Public Policy
        Type: general
      – SubjectFull: Experiments
        Type: general
      – SubjectFull: Comparative Analysis
        Type: general
      – SubjectFull: Volunteers
        Type: general
      – SubjectFull: Research Problems
        Type: general
      – SubjectFull: Ethics
        Type: general
      – SubjectFull: Costs
        Type: general
      – SubjectFull: Research Design
        Type: general
      – SubjectFull: Validity
        Type: general
      – SubjectFull: Communication (Thought Transfer)
        Type: general
      – SubjectFull: Social Security
        Type: general
    Titles:
      – TitleFull: Comparison of Population-Representative and Volunteer Experiments: Lessons from the Social Security Administration's Benefit Offset National Demonstration (BOND)
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Stapleton, David C.
      – PersonEntity:
          Name:
            NameFull: Bell, Stephen H.
      – PersonEntity:
          Name:
            NameFull: Hoffman, Denise
      – PersonEntity:
          Name:
            NameFull: Wood, Michelle
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 12
              Type: published
              Y: 2020
          Identifiers:
            – Type: issn-print
              Value: 1098-2140
          Numbering:
            – Type: volume
              Value: 41
            – Type: issue
              Value: 4
          Titles:
            – TitleFull: American Journal of Evaluation
              Type: main
ResultId 1