Beyond Jacobson and Truax: Estimation of Clinical Significance Trajectories in the Coping Power Intervention Using Measurement Error-Corrected Multilevel Modeling

Saved in:
Bibliographic Details
Title: Beyond Jacobson and Truax: Estimation of Clinical Significance Trajectories in the Coping Power Intervention Using Measurement Error-Corrected Multilevel Modeling
Language: English
Authors: Antonio A. Morgan-López, Lissette M. Saavedra, Heather L. McDaniel, Stephen G. West, Nicholas S. Ialongo, Catherine P. Bradshaw, Alexandra T. Tonigan, Barrett W. Montgomery, Nicole P. Powell, Lixin Qu, Anna C. Yaros, John E. Lochman
Source: Grantee Submission. 2024.
Peer Reviewed: Y
Page Count: 43
Publication Date: 2024
Sponsoring Agency: Institute of Education Sciences (ED)
National Institute of Mental Health (NIMH) (DHHS/NIH)
National Institute on Drug Abuse (NIDA) (DHHS/PHS)
Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD) (DHHS/NIH)
Contract Number: R305A220244
R01MH124438
Document Type: Reports - Research
Education Level: Elementary Education
Secondary Education
Descriptors: Coping, Prevention, Intervention, Child Behavior, Behavior Problems, Hierarchical Linear Modeling, Student Behavior, Elementary School Students, Secondary School Students, Behavior Patterns, Behavior Disorders, At Risk Students, Aggression, Growth Models
DOI: 10.1016/j.beth.2024.08.003
Abstract: Coping Power (CP) is a preventive intervention that focuses on reducing child externalizing problems. Although it is typically delivered in a group format (GCP), individually-delivered CP (ICP) has produced greater mean reductions in externalizing problems. However, standard analysis of randomized trials loses individual-level information regarding which youth improve, fail to improve, or get worse, whereas clinically significant change (CSC) metrics capture information on individual change. The present study is a secondary analysis of an ICP/GCP trial (N=360) that examines differences in CSC-based individual-level inferences on externalizing. A novel method for assessing CSC under measurement error-corrected multilevel modeling was used, overcoming three limitations of traditional CSC methods: a) restriction to two timepoints, b) use of total scores, and c) assumption of constant reliability across time and participants. Because of concerns about Type II errors with all CSC methods, an individual-level effect size metric for CSC was also developed. Based on individualized Cohen's d estimates, individual-level improvements in externalizing from 4th through 11th grades of d [greater than or equal to] 0.5 were significantly greater in ICP (73%) versus GCP (45%). Further, GCP saw significantly higher percentages of youth with worsening of externalizing, underscoring concerns about diminished effects for GCP. Half of the sample had improvement that was not statistically significant but exceeded d [greater than or equal to] 0.5, highlighting the susceptibility to Type II errors of CSCs results based on statistical significance. An examination of ICP/GCP differences under advanced CSC analysis gives more nuanced information than conventional RCT analysis and greater precision in estimating individual-level outcomes than standard CSC methodologies. [This paper will be published in "Behavior Therapy."]
Abstractor: As Provided
IES Funded: Yes
Entry Date: 2025
Accession Number: ED672279
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: ED672279
AccessLevel: 3
PubType: Report
PubTypeId: report
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Beyond Jacobson and Truax: Estimation of Clinical Significance Trajectories in the Coping Power Intervention Using Measurement Error-Corrected Multilevel Modeling
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Antonio+A%2E+Morgan-López%22">Antonio A. Morgan-López</searchLink><br /><searchLink fieldCode="AR" term="%22Lissette+M%2E+Saavedra%22">Lissette M. Saavedra</searchLink><br /><searchLink fieldCode="AR" term="%22Heather+L%2E+McDaniel%22">Heather L. McDaniel</searchLink><br /><searchLink fieldCode="AR" term="%22Stephen+G%2E+West%22">Stephen G. West</searchLink><br /><searchLink fieldCode="AR" term="%22Nicholas+S%2E+Ialongo%22">Nicholas S. Ialongo</searchLink><br /><searchLink fieldCode="AR" term="%22Catherine+P%2E+Bradshaw%22">Catherine P. Bradshaw</searchLink><br /><searchLink fieldCode="AR" term="%22Alexandra+T%2E+Tonigan%22">Alexandra T. Tonigan</searchLink><br /><searchLink fieldCode="AR" term="%22Barrett+W%2E+Montgomery%22">Barrett W. Montgomery</searchLink><br /><searchLink fieldCode="AR" term="%22Nicole+P%2E+Powell%22">Nicole P. Powell</searchLink><br /><searchLink fieldCode="AR" term="%22Lixin+Qu%22">Lixin Qu</searchLink><br /><searchLink fieldCode="AR" term="%22Anna+C%2E+Yaros%22">Anna C. Yaros</searchLink><br /><searchLink fieldCode="AR" term="%22John+E%2E+Lochman%22">John E. Lochman</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Grantee+Submission%22"><i>Grantee Submission</i></searchLink>. 2024.
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 43
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2024
– Name: SourceSuprt
  Label: Sponsoring Agency
  Group: SrcSuprt
  Data: Institute of Education Sciences (ED)<br />National Institute of Mental Health (NIMH) (DHHS/NIH)<br />National Institute on Drug Abuse (NIDA) (DHHS/PHS)<br />Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD) (DHHS/NIH)
– Name: NumberContract
  Label: Contract Number
  Group: NumCntrct
  Data: R305A220244<br />R01MH124438
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Elementary+Education%22">Elementary Education</searchLink><br /><searchLink fieldCode="EL" term="%22Secondary+Education%22">Secondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Coping%22">Coping</searchLink><br /><searchLink fieldCode="DE" term="%22Prevention%22">Prevention</searchLink><br /><searchLink fieldCode="DE" term="%22Intervention%22">Intervention</searchLink><br /><searchLink fieldCode="DE" term="%22Child+Behavior%22">Child Behavior</searchLink><br /><searchLink fieldCode="DE" term="%22Behavior+Problems%22">Behavior Problems</searchLink><br /><searchLink fieldCode="DE" term="%22Hierarchical+Linear+Modeling%22">Hierarchical Linear Modeling</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Behavior%22">Student Behavior</searchLink><br /><searchLink fieldCode="DE" term="%22Elementary+School+Students%22">Elementary School Students</searchLink><br /><searchLink fieldCode="DE" term="%22Secondary+School+Students%22">Secondary School Students</searchLink><br /><searchLink fieldCode="DE" term="%22Behavior+Patterns%22">Behavior Patterns</searchLink><br /><searchLink fieldCode="DE" term="%22Behavior+Disorders%22">Behavior Disorders</searchLink><br /><searchLink fieldCode="DE" term="%22At+Risk+Students%22">At Risk Students</searchLink><br /><searchLink fieldCode="DE" term="%22Aggression%22">Aggression</searchLink><br /><searchLink fieldCode="DE" term="%22Growth+Models%22">Growth Models</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1016/j.beth.2024.08.003
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Coping Power (CP) is a preventive intervention that focuses on reducing child externalizing problems. Although it is typically delivered in a group format (GCP), individually-delivered CP (ICP) has produced greater mean reductions in externalizing problems. However, standard analysis of randomized trials loses individual-level information regarding which youth improve, fail to improve, or get worse, whereas clinically significant change (CSC) metrics capture information on individual change. The present study is a secondary analysis of an ICP/GCP trial (N=360) that examines differences in CSC-based individual-level inferences on externalizing. A novel method for assessing CSC under measurement error-corrected multilevel modeling was used, overcoming three limitations of traditional CSC methods: a) restriction to two timepoints, b) use of total scores, and c) assumption of constant reliability across time and participants. Because of concerns about Type II errors with all CSC methods, an individual-level effect size metric for CSC was also developed. Based on individualized Cohen's d estimates, individual-level improvements in externalizing from 4th through 11th grades of d [greater than or equal to] 0.5 were significantly greater in ICP (73%) versus GCP (45%). Further, GCP saw significantly higher percentages of youth with worsening of externalizing, underscoring concerns about diminished effects for GCP. Half of the sample had improvement that was not statistically significant but exceeded d [greater than or equal to] 0.5, highlighting the susceptibility to Type II errors of CSCs results based on statistical significance. An examination of ICP/GCP differences under advanced CSC analysis gives more nuanced information than conventional RCT analysis and greater precision in estimating individual-level outcomes than standard CSC methodologies. [This paper will be published in "Behavior Therapy."]
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: CodeSource
  Label: IES Funded
  Group: SrcInfo
  Data: Yes
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2025
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED672279
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED672279
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1016/j.beth.2024.08.003
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 43
    Subjects:
      – SubjectFull: Coping
        Type: general
      – SubjectFull: Prevention
        Type: general
      – SubjectFull: Intervention
        Type: general
      – SubjectFull: Child Behavior
        Type: general
      – SubjectFull: Behavior Problems
        Type: general
      – SubjectFull: Hierarchical Linear Modeling
        Type: general
      – SubjectFull: Student Behavior
        Type: general
      – SubjectFull: Elementary School Students
        Type: general
      – SubjectFull: Secondary School Students
        Type: general
      – SubjectFull: Behavior Patterns
        Type: general
      – SubjectFull: Behavior Disorders
        Type: general
      – SubjectFull: At Risk Students
        Type: general
      – SubjectFull: Aggression
        Type: general
      – SubjectFull: Growth Models
        Type: general
    Titles:
      – TitleFull: Beyond Jacobson and Truax: Estimation of Clinical Significance Trajectories in the Coping Power Intervention Using Measurement Error-Corrected Multilevel Modeling
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Antonio A. Morgan-López
      – PersonEntity:
          Name:
            NameFull: Lissette M. Saavedra
      – PersonEntity:
          Name:
            NameFull: Heather L. McDaniel
      – PersonEntity:
          Name:
            NameFull: Stephen G. West
      – PersonEntity:
          Name:
            NameFull: Nicholas S. Ialongo
      – PersonEntity:
          Name:
            NameFull: Catherine P. Bradshaw
      – PersonEntity:
          Name:
            NameFull: Alexandra T. Tonigan
      – PersonEntity:
          Name:
            NameFull: Barrett W. Montgomery
      – PersonEntity:
          Name:
            NameFull: Nicole P. Powell
      – PersonEntity:
          Name:
            NameFull: Lixin Qu
      – PersonEntity:
          Name:
            NameFull: Anna C. Yaros
      – PersonEntity:
          Name:
            NameFull: John E. Lochman
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 08
              Type: published
              Y: 2024
          Titles:
            – TitleFull: Grantee Submission
              Type: main
ResultId 1