Beyond Jacobson and Truax: Estimation of Clinical Significance Trajectories in the Coping Power Intervention Using Measurement Error-Corrected Multilevel Modeling
Saved in:
| Title: | Beyond Jacobson and Truax: Estimation of Clinical Significance Trajectories in the Coping Power Intervention Using Measurement Error-Corrected Multilevel Modeling |
|---|---|
| Language: | English |
| Authors: | Antonio A. Morgan-López, Lissette M. Saavedra, Heather L. McDaniel, Stephen G. West, Nicholas S. Ialongo, Catherine P. Bradshaw, Alexandra T. Tonigan, Barrett W. Montgomery, Nicole P. Powell, Lixin Qu, Anna C. Yaros, John E. Lochman |
| Source: | Grantee Submission. 2024. |
| Peer Reviewed: | Y |
| Page Count: | 43 |
| Publication Date: | 2024 |
| Sponsoring Agency: | Institute of Education Sciences (ED) National Institute of Mental Health (NIMH) (DHHS/NIH) National Institute on Drug Abuse (NIDA) (DHHS/PHS) Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD) (DHHS/NIH) |
| Contract Number: | R305A220244 R01MH124438 |
| Document Type: | Reports - Research |
| Education Level: | Elementary Education Secondary Education |
| Descriptors: | Coping, Prevention, Intervention, Child Behavior, Behavior Problems, Hierarchical Linear Modeling, Student Behavior, Elementary School Students, Secondary School Students, Behavior Patterns, Behavior Disorders, At Risk Students, Aggression, Growth Models |
| DOI: | 10.1016/j.beth.2024.08.003 |
| Abstract: | Coping Power (CP) is a preventive intervention that focuses on reducing child externalizing problems. Although it is typically delivered in a group format (GCP), individually-delivered CP (ICP) has produced greater mean reductions in externalizing problems. However, standard analysis of randomized trials loses individual-level information regarding which youth improve, fail to improve, or get worse, whereas clinically significant change (CSC) metrics capture information on individual change. The present study is a secondary analysis of an ICP/GCP trial (N=360) that examines differences in CSC-based individual-level inferences on externalizing. A novel method for assessing CSC under measurement error-corrected multilevel modeling was used, overcoming three limitations of traditional CSC methods: a) restriction to two timepoints, b) use of total scores, and c) assumption of constant reliability across time and participants. Because of concerns about Type II errors with all CSC methods, an individual-level effect size metric for CSC was also developed. Based on individualized Cohen's d estimates, individual-level improvements in externalizing from 4th through 11th grades of d [greater than or equal to] 0.5 were significantly greater in ICP (73%) versus GCP (45%). Further, GCP saw significantly higher percentages of youth with worsening of externalizing, underscoring concerns about diminished effects for GCP. Half of the sample had improvement that was not statistically significant but exceeded d [greater than or equal to] 0.5, highlighting the susceptibility to Type II errors of CSCs results based on statistical significance. An examination of ICP/GCP differences under advanced CSC analysis gives more nuanced information than conventional RCT analysis and greater precision in estimating individual-level outcomes than standard CSC methodologies. [This paper will be published in "Behavior Therapy."] |
| Abstractor: | As Provided |
| IES Funded: | Yes |
| Entry Date: | 2025 |
| Accession Number: | ED672279 |
| Database: | ERIC |
| FullText | Text: Availability: 0 |
|---|---|
| Header | DbId: eric DbLabel: ERIC An: ED672279 AccessLevel: 3 PubType: Report PubTypeId: report PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Beyond Jacobson and Truax: Estimation of Clinical Significance Trajectories in the Coping Power Intervention Using Measurement Error-Corrected Multilevel Modeling – Name: Language Label: Language Group: Lang Data: English – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Antonio+A%2E+Morgan-López%22">Antonio A. Morgan-López</searchLink><br /><searchLink fieldCode="AR" term="%22Lissette+M%2E+Saavedra%22">Lissette M. Saavedra</searchLink><br /><searchLink fieldCode="AR" term="%22Heather+L%2E+McDaniel%22">Heather L. McDaniel</searchLink><br /><searchLink fieldCode="AR" term="%22Stephen+G%2E+West%22">Stephen G. West</searchLink><br /><searchLink fieldCode="AR" term="%22Nicholas+S%2E+Ialongo%22">Nicholas S. Ialongo</searchLink><br /><searchLink fieldCode="AR" term="%22Catherine+P%2E+Bradshaw%22">Catherine P. Bradshaw</searchLink><br /><searchLink fieldCode="AR" term="%22Alexandra+T%2E+Tonigan%22">Alexandra T. Tonigan</searchLink><br /><searchLink fieldCode="AR" term="%22Barrett+W%2E+Montgomery%22">Barrett W. Montgomery</searchLink><br /><searchLink fieldCode="AR" term="%22Nicole+P%2E+Powell%22">Nicole P. Powell</searchLink><br /><searchLink fieldCode="AR" term="%22Lixin+Qu%22">Lixin Qu</searchLink><br /><searchLink fieldCode="AR" term="%22Anna+C%2E+Yaros%22">Anna C. Yaros</searchLink><br /><searchLink fieldCode="AR" term="%22John+E%2E+Lochman%22">John E. Lochman</searchLink> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="SO" term="%22Grantee+Submission%22"><i>Grantee Submission</i></searchLink>. 2024. – Name: PeerReviewed Label: Peer Reviewed Group: SrcInfo Data: Y – Name: Pages Label: Page Count Group: Src Data: 43 – Name: DatePubCY Label: Publication Date Group: Date Data: 2024 – Name: SourceSuprt Label: Sponsoring Agency Group: SrcSuprt Data: Institute of Education Sciences (ED)<br />National Institute of Mental Health (NIMH) (DHHS/NIH)<br />National Institute on Drug Abuse (NIDA) (DHHS/PHS)<br />Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD) (DHHS/NIH) – Name: NumberContract Label: Contract Number Group: NumCntrct Data: R305A220244<br />R01MH124438 – Name: TypeDocument Label: Document Type Group: TypDoc Data: Reports - Research – Name: Audience Label: Education Level Group: Audnce Data: <searchLink fieldCode="EL" term="%22Elementary+Education%22">Elementary Education</searchLink><br /><searchLink fieldCode="EL" term="%22Secondary+Education%22">Secondary Education</searchLink> – Name: Subject Label: Descriptors Group: Su Data: <searchLink fieldCode="DE" term="%22Coping%22">Coping</searchLink><br /><searchLink fieldCode="DE" term="%22Prevention%22">Prevention</searchLink><br /><searchLink fieldCode="DE" term="%22Intervention%22">Intervention</searchLink><br /><searchLink fieldCode="DE" term="%22Child+Behavior%22">Child Behavior</searchLink><br /><searchLink fieldCode="DE" term="%22Behavior+Problems%22">Behavior Problems</searchLink><br /><searchLink fieldCode="DE" term="%22Hierarchical+Linear+Modeling%22">Hierarchical Linear Modeling</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Behavior%22">Student Behavior</searchLink><br /><searchLink fieldCode="DE" term="%22Elementary+School+Students%22">Elementary School Students</searchLink><br /><searchLink fieldCode="DE" term="%22Secondary+School+Students%22">Secondary School Students</searchLink><br /><searchLink fieldCode="DE" term="%22Behavior+Patterns%22">Behavior Patterns</searchLink><br /><searchLink fieldCode="DE" term="%22Behavior+Disorders%22">Behavior Disorders</searchLink><br /><searchLink fieldCode="DE" term="%22At+Risk+Students%22">At Risk Students</searchLink><br /><searchLink fieldCode="DE" term="%22Aggression%22">Aggression</searchLink><br /><searchLink fieldCode="DE" term="%22Growth+Models%22">Growth Models</searchLink> – Name: DOI Label: DOI Group: ID Data: 10.1016/j.beth.2024.08.003 – Name: Abstract Label: Abstract Group: Ab Data: Coping Power (CP) is a preventive intervention that focuses on reducing child externalizing problems. Although it is typically delivered in a group format (GCP), individually-delivered CP (ICP) has produced greater mean reductions in externalizing problems. However, standard analysis of randomized trials loses individual-level information regarding which youth improve, fail to improve, or get worse, whereas clinically significant change (CSC) metrics capture information on individual change. The present study is a secondary analysis of an ICP/GCP trial (N=360) that examines differences in CSC-based individual-level inferences on externalizing. A novel method for assessing CSC under measurement error-corrected multilevel modeling was used, overcoming three limitations of traditional CSC methods: a) restriction to two timepoints, b) use of total scores, and c) assumption of constant reliability across time and participants. Because of concerns about Type II errors with all CSC methods, an individual-level effect size metric for CSC was also developed. Based on individualized Cohen's d estimates, individual-level improvements in externalizing from 4th through 11th grades of d [greater than or equal to] 0.5 were significantly greater in ICP (73%) versus GCP (45%). Further, GCP saw significantly higher percentages of youth with worsening of externalizing, underscoring concerns about diminished effects for GCP. Half of the sample had improvement that was not statistically significant but exceeded d [greater than or equal to] 0.5, highlighting the susceptibility to Type II errors of CSCs results based on statistical significance. An examination of ICP/GCP differences under advanced CSC analysis gives more nuanced information than conventional RCT analysis and greater precision in estimating individual-level outcomes than standard CSC methodologies. [This paper will be published in "Behavior Therapy."] – Name: AbstractInfo Label: Abstractor Group: Ab Data: As Provided – Name: CodeSource Label: IES Funded Group: SrcInfo Data: Yes – Name: DateEntry Label: Entry Date Group: Date Data: 2025 – Name: AN Label: Accession Number Group: ID Data: ED672279 |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED672279 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1016/j.beth.2024.08.003 Languages: – Text: English PhysicalDescription: Pagination: PageCount: 43 Subjects: – SubjectFull: Coping Type: general – SubjectFull: Prevention Type: general – SubjectFull: Intervention Type: general – SubjectFull: Child Behavior Type: general – SubjectFull: Behavior Problems Type: general – SubjectFull: Hierarchical Linear Modeling Type: general – SubjectFull: Student Behavior Type: general – SubjectFull: Elementary School Students Type: general – SubjectFull: Secondary School Students Type: general – SubjectFull: Behavior Patterns Type: general – SubjectFull: Behavior Disorders Type: general – SubjectFull: At Risk Students Type: general – SubjectFull: Aggression Type: general – SubjectFull: Growth Models Type: general Titles: – TitleFull: Beyond Jacobson and Truax: Estimation of Clinical Significance Trajectories in the Coping Power Intervention Using Measurement Error-Corrected Multilevel Modeling Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Antonio A. Morgan-López – PersonEntity: Name: NameFull: Lissette M. Saavedra – PersonEntity: Name: NameFull: Heather L. McDaniel – PersonEntity: Name: NameFull: Stephen G. West – PersonEntity: Name: NameFull: Nicholas S. Ialongo – PersonEntity: Name: NameFull: Catherine P. Bradshaw – PersonEntity: Name: NameFull: Alexandra T. Tonigan – PersonEntity: Name: NameFull: Barrett W. Montgomery – PersonEntity: Name: NameFull: Nicole P. Powell – PersonEntity: Name: NameFull: Lixin Qu – PersonEntity: Name: NameFull: Anna C. Yaros – PersonEntity: Name: NameFull: John E. Lochman IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 08 Type: published Y: 2024 Titles: – TitleFull: Grantee Submission Type: main |
| ResultId | 1 |