View in EDS

Single-Case Synthesis Tools II: Comparing Quantitative Outcome Measures

Saved in:
Bibliographic Details
Title: Single-Case Synthesis Tools II: Comparing Quantitative Outcome Measures
Language: English
Authors: Zimmerman, Kathleen N., Pustejovsky, James E., Ledford, Jennifer R., Barton, Erin E., Severini, Katherine E., Lloyd, Blair P.
Source: Grantee Submission. 2018.
Peer Reviewed: Y
Page Count: 38
Publication Date: 2018
Sponsoring Agency: Institute of Education Sciences (ED)
Contract Number: R305D160002
Document Type: Reports - Research
Descriptors: Research Design, Evaluation Methods, Synthesis, Intervention, Program Effectiveness, Sensory Training, Behavior Modification, Effect Size, Meta Analysis, Outcome Measures, Comparative Analysis, Statistical Analysis
DOI: 10.1016/j.ridd.2018.02.001
Abstract: Varying methods for evaluating the outcomes of single case research designs (SCD) are currently used in reviews and meta-analyses of interventions. Quantitative effect size measures are often presented alongside visual analysis conclusions. Six measures across two classes--overlap measures (percentage non-overlapping data, improvement rate difference, and Tau) and parametric within-case effect sizes (standardized mean difference and log response ratio [increasing and decreasing])--were compared to determine if choice of synthesis method within and across classes impacts conclusions regarding effectiveness. The effectiveness of sensory-based interventions (SBI), a commonly used class of treatments for young children, was evaluated. Separately from evaluations of rigor and quality, authors evaluated behavior change between baseline and SBI conditions. SBI were unlikely to result in positive behavior change across all measures except IRD. However, subgroup analyses resulted in variable conclusions, indicating that the choice of measures for SCD meta-analyses can impact conclusions. Suggestions for using the log response ratio in SCD meta-analyses and considerations for understanding variability in SCD meta-analysis conclusions are discussed. [This is the in press version of an article published in "Research in Developmental Disabilities." For Part I, see ED599350.]
Abstractor: As Provided
IES Funded: Yes
Entry Date: 2019
Accession Number: ED599351
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED599351
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED599351
AccessLevel: 3
PubType: Report
PubTypeId: report
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Single-Case Synthesis Tools II: Comparing Quantitative Outcome Measures
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Zimmerman%2C+Kathleen+N%2E%22">Zimmerman, Kathleen N.</searchLink><br /><searchLink fieldCode="AR" term="%22Pustejovsky%2C+James+E%2E%22">Pustejovsky, James E.</searchLink><br /><searchLink fieldCode="AR" term="%22Ledford%2C+Jennifer+R%2E%22">Ledford, Jennifer R.</searchLink><br /><searchLink fieldCode="AR" term="%22Barton%2C+Erin+E%2E%22">Barton, Erin E.</searchLink><br /><searchLink fieldCode="AR" term="%22Severini%2C+Katherine+E%2E%22">Severini, Katherine E.</searchLink><br /><searchLink fieldCode="AR" term="%22Lloyd%2C+Blair+P%2E%22">Lloyd, Blair P.</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Grantee+Submission%22"><i>Grantee Submission</i></searchLink>. 2018.
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 38
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2018
– Name: SourceSuprt
  Label: Sponsoring Agency
  Group: SrcSuprt
  Data: Institute of Education Sciences (ED)
– Name: NumberContract
  Label: Contract Number
  Group: NumCntrct
  Data: R305D160002
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Reports - Research
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Research+Design%22">Research Design</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluation+Methods%22">Evaluation Methods</searchLink><br /><searchLink fieldCode="DE" term="%22Synthesis%22">Synthesis</searchLink><br /><searchLink fieldCode="DE" term="%22Intervention%22">Intervention</searchLink><br /><searchLink fieldCode="DE" term="%22Program+Effectiveness%22">Program Effectiveness</searchLink><br /><searchLink fieldCode="DE" term="%22Sensory+Training%22">Sensory Training</searchLink><br /><searchLink fieldCode="DE" term="%22Behavior+Modification%22">Behavior Modification</searchLink><br /><searchLink fieldCode="DE" term="%22Effect+Size%22">Effect Size</searchLink><br /><searchLink fieldCode="DE" term="%22Meta+Analysis%22">Meta Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Outcome+Measures%22">Outcome Measures</searchLink><br /><searchLink fieldCode="DE" term="%22Comparative+Analysis%22">Comparative Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Statistical+Analysis%22">Statistical Analysis</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1016/j.ridd.2018.02.001
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Varying methods for evaluating the outcomes of single case research designs (SCD) are currently used in reviews and meta-analyses of interventions. Quantitative effect size measures are often presented alongside visual analysis conclusions. Six measures across two classes--overlap measures (percentage non-overlapping data, improvement rate difference, and Tau) and parametric within-case effect sizes (standardized mean difference and log response ratio [increasing and decreasing])--were compared to determine if choice of synthesis method within and across classes impacts conclusions regarding effectiveness. The effectiveness of sensory-based interventions (SBI), a commonly used class of treatments for young children, was evaluated. Separately from evaluations of rigor and quality, authors evaluated behavior change between baseline and SBI conditions. SBI were unlikely to result in positive behavior change across all measures except IRD. However, subgroup analyses resulted in variable conclusions, indicating that the choice of measures for SCD meta-analyses can impact conclusions. Suggestions for using the log response ratio in SCD meta-analyses and considerations for understanding variability in SCD meta-analysis conclusions are discussed. [This is the in press version of an article published in "Research in Developmental Disabilities." For Part I, see ED599350.]
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: CodeSource
  Label: IES Funded
  Group: SrcInfo
  Data: Yes
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2019
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED599351
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED599351
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1016/j.ridd.2018.02.001
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 38
    Subjects:
      – SubjectFull: Research Design
        Type: general
      – SubjectFull: Evaluation Methods
        Type: general
      – SubjectFull: Synthesis
        Type: general
      – SubjectFull: Intervention
        Type: general
      – SubjectFull: Program Effectiveness
        Type: general
      – SubjectFull: Sensory Training
        Type: general
      – SubjectFull: Behavior Modification
        Type: general
      – SubjectFull: Effect Size
        Type: general
      – SubjectFull: Meta Analysis
        Type: general
      – SubjectFull: Outcome Measures
        Type: general
      – SubjectFull: Comparative Analysis
        Type: general
      – SubjectFull: Statistical Analysis
        Type: general
    Titles:
      – TitleFull: Single-Case Synthesis Tools II: Comparing Quantitative Outcome Measures
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Zimmerman, Kathleen N.
      – PersonEntity:
          Name:
            NameFull: Pustejovsky, James E.
      – PersonEntity:
          Name:
            NameFull: Ledford, Jennifer R.
      – PersonEntity:
          Name:
            NameFull: Barton, Erin E.
      – PersonEntity:
          Name:
            NameFull: Severini, Katherine E.
      – PersonEntity:
          Name:
            NameFull: Lloyd, Blair P.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 02
              M: 01
              Type: published
              Y: 2018
          Titles:
            – TitleFull: Grantee Submission
              Type: main
ResultId 1