Comparison of Population-Representative and Volunteer Experiments: Lessons from the Social Security Administration's Benefit Offset National Demonstration (BOND)
Saved in:
| Title: | Comparison of Population-Representative and Volunteer Experiments: Lessons from the Social Security Administration's Benefit Offset National Demonstration (BOND) |
|---|---|
| Language: | English |
| Authors: | Stapleton, David C. (ORCID |
| Source: | American Journal of Evaluation. Dec 2020 41(4):547-563. |
| Availability: | SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com |
| Peer Reviewed: | Y |
| Page Count: | 17 |
| Publication Date: | 2020 |
| Sponsoring Agency: | Social Security Administration |
| Contract Number: | SS001060011 |
| Document Type: | Journal Articles Reports - Evaluative |
| Descriptors: | Federal Programs, Public Policy, Experiments, Comparative Analysis, Volunteers, Research Problems, Ethics, Costs, Research Design, Validity, Communication (Thought Transfer) |
| Laws, Policies and Program Identifiers: | Social Security |
| DOI: | 10.1177/1098214020944236 |
| ISSN: | 1098-2140 |
| Abstract: | The Benefit Offset National Demonstration (BOND) tested a $1 reduction in benefits per $2 earnings increase above the level at which Social Security Disability Insurance benefits drop from full to zero under current law. BOND included a rare and large "population-representative" experiment: It applied the rule to a nationwide, random sample of beneficiaries. BOND also included a parallel "volunteer" experiment: The same offset rules applied to a nationwide random sample of volunteers. BOND's dual experiments offer a unique opportunity to consider the merits and limitations of these two types of experiments. The findings provide a way to illustrate the limitations of volunteer experiments relative to population experiments when, as in BOND, the goal is to produce impact estimates that are valid for the entire population, not just would be volunteers. We also highlight and compare ethical issues, outreach challenges, and cost considerations for the two types of designs. |
| Abstractor: | As Provided |
| Entry Date: | 2020 |
| Accession Number: | EJ1274854 |
| Database: | ERIC |
| Abstract: | The Benefit Offset National Demonstration (BOND) tested a $1 reduction in benefits per $2 earnings increase above the level at which Social Security Disability Insurance benefits drop from full to zero under current law. BOND included a rare and large "population-representative" experiment: It applied the rule to a nationwide, random sample of beneficiaries. BOND also included a parallel "volunteer" experiment: The same offset rules applied to a nationwide random sample of volunteers. BOND's dual experiments offer a unique opportunity to consider the merits and limitations of these two types of experiments. The findings provide a way to illustrate the limitations of volunteer experiments relative to population experiments when, as in BOND, the goal is to produce impact estimates that are valid for the entire population, not just would be volunteers. We also highlight and compare ethical issues, outreach challenges, and cost considerations for the two types of designs. |
|---|---|
| ISSN: | 1098-2140 |
| DOI: | 10.1177/1098214020944236 |
