Survey Follow-Up in Randomized Trials with Dual Long- and Short-Form Instruments
Saved in:
| Title: | Survey Follow-Up in Randomized Trials with Dual Long- and Short-Form Instruments |
|---|---|
| Language: | English |
| Authors: | David Ross Judkins (ORCID |
| Source: | Evaluation Review. 2026 50(4):643-673. |
| Availability: | SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com |
| Peer Reviewed: | Y |
| Page Count: | 31 |
| Publication Date: | 2026 |
| Sponsoring Agency: | Administration for Children and Families (ACF) (DHHS), Office of Planning, Research and Evaluation (OPRE) |
| Contract Number: | 75ACF121C00095 |
| Document Type: | Journal Articles Reports - Research |
| Descriptors: | Followup Studies, Surveys, Randomized Controlled Trials, Response Rates (Questionnaires) |
| DOI: | 10.1177/0193841X261416558 |
| ISSN: | 0193-841X 1552-3926 |
| Abstract: | Many evaluations of human services programs rely heavily on survey follow-up to collect outcome data from randomized controlled trials. Evidence clearinghouses will give their highest grade of evidence quality to such evaluations if attrition is low. Declining survey response rates, particularly in the control group, are making it more difficult for evaluators to meet this clearinghouse standard. Hendra and Hill (2019) suggested that it might be better to settle for substantially lower response rates, finding that the pursuit of high target response rates adds time and money while reducing nonresponse bias little if at all. This paper reports on a new approach to boosting response rates that allows reluctant respondents to complete a shortened version of the data collection instrument. Although the method is effective at increasing the response rate and costs less than traditional approaches for boosting response rates, this paper suggests that the data collected from reluctant respondents with the new method probably did not substantially reduce nonresponse bias on impacts, a finding broadly consistent with that of Hendra and Hill. On the other hand, the method did find some important differences in the means of some outcomes within the study arms, a finding that is could be important for descriptive surveys. |
| Abstractor: | As Provided |
| Entry Date: | 2026 |
| Accession Number: | EJ1506420 |
| Database: | ERIC |
| Abstract: | Many evaluations of human services programs rely heavily on survey follow-up to collect outcome data from randomized controlled trials. Evidence clearinghouses will give their highest grade of evidence quality to such evaluations if attrition is low. Declining survey response rates, particularly in the control group, are making it more difficult for evaluators to meet this clearinghouse standard. Hendra and Hill (2019) suggested that it might be better to settle for substantially lower response rates, finding that the pursuit of high target response rates adds time and money while reducing nonresponse bias little if at all. This paper reports on a new approach to boosting response rates that allows reluctant respondents to complete a shortened version of the data collection instrument. Although the method is effective at increasing the response rate and costs less than traditional approaches for boosting response rates, this paper suggests that the data collected from reluctant respondents with the new method probably did not substantially reduce nonresponse bias on impacts, a finding broadly consistent with that of Hendra and Hill. On the other hand, the method did find some important differences in the means of some outcomes within the study arms, a finding that is could be important for descriptive surveys. |
|---|---|
| ISSN: | 0193-841X 1552-3926 |
| DOI: | 10.1177/0193841X261416558 |
