View in EDS

Single-Case Synthesis Tools II: Comparing Quantitative Outcome Measures

Saved in:
Bibliographic Details
Title: Single-Case Synthesis Tools II: Comparing Quantitative Outcome Measures
Language: English
Authors: Zimmerman, Kathleen N., Pustejovsky, James E., Ledford, Jennifer R., Barton, Erin E., Severini, Katherine E., Lloyd, Blair P.
Source: Grantee Submission. 2018.
Peer Reviewed: Y
Page Count: 38
Publication Date: 2018
Sponsoring Agency: Institute of Education Sciences (ED)
Contract Number: R305D160002
Document Type: Reports - Research
Descriptors: Research Design, Evaluation Methods, Synthesis, Intervention, Program Effectiveness, Sensory Training, Behavior Modification, Effect Size, Meta Analysis, Outcome Measures, Comparative Analysis, Statistical Analysis
DOI: 10.1016/j.ridd.2018.02.001
Abstract: Varying methods for evaluating the outcomes of single case research designs (SCD) are currently used in reviews and meta-analyses of interventions. Quantitative effect size measures are often presented alongside visual analysis conclusions. Six measures across two classes--overlap measures (percentage non-overlapping data, improvement rate difference, and Tau) and parametric within-case effect sizes (standardized mean difference and log response ratio [increasing and decreasing])--were compared to determine if choice of synthesis method within and across classes impacts conclusions regarding effectiveness. The effectiveness of sensory-based interventions (SBI), a commonly used class of treatments for young children, was evaluated. Separately from evaluations of rigor and quality, authors evaluated behavior change between baseline and SBI conditions. SBI were unlikely to result in positive behavior change across all measures except IRD. However, subgroup analyses resulted in variable conclusions, indicating that the choice of measures for SCD meta-analyses can impact conclusions. Suggestions for using the log response ratio in SCD meta-analyses and considerations for understanding variability in SCD meta-analysis conclusions are discussed. [This is the in press version of an article published in "Research in Developmental Disabilities." For Part I, see ED599350.]
Abstractor: As Provided
IES Funded: Yes
Entry Date: 2019
Accession Number: ED599351
Database: ERIC
Description
Abstract:Varying methods for evaluating the outcomes of single case research designs (SCD) are currently used in reviews and meta-analyses of interventions. Quantitative effect size measures are often presented alongside visual analysis conclusions. Six measures across two classes--overlap measures (percentage non-overlapping data, improvement rate difference, and Tau) and parametric within-case effect sizes (standardized mean difference and log response ratio [increasing and decreasing])--were compared to determine if choice of synthesis method within and across classes impacts conclusions regarding effectiveness. The effectiveness of sensory-based interventions (SBI), a commonly used class of treatments for young children, was evaluated. Separately from evaluations of rigor and quality, authors evaluated behavior change between baseline and SBI conditions. SBI were unlikely to result in positive behavior change across all measures except IRD. However, subgroup analyses resulted in variable conclusions, indicating that the choice of measures for SCD meta-analyses can impact conclusions. Suggestions for using the log response ratio in SCD meta-analyses and considerations for understanding variability in SCD meta-analysis conclusions are discussed. [This is the in press version of an article published in "Research in Developmental Disabilities." For Part I, see ED599350.]
DOI:10.1016/j.ridd.2018.02.001