Caregiver Behavioral Changes Mediate the Effects of Naturalistic Developmental Behavioral Interventions: Combining Evidence from Three Randomized Controlled Trials
Saved in:
| Title: | Caregiver Behavioral Changes Mediate the Effects of Naturalistic Developmental Behavioral Interventions: Combining Evidence from Three Randomized Controlled Trials |
|---|---|
| Language: | English |
| Authors: | Deanna Swain (ORCID |
| Source: | Autism: The International Journal of Research and Practice. 2025 29(7):1835-1848. |
| Availability: | SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com |
| Peer Reviewed: | Y |
| Page Count: | 14 |
| Publication Date: | 2025 |
| Sponsoring Agency: | National Institute of Mental Health (NIMH) (DHHS/NIH) Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD) (DHHS/NIH) Health Resources and Services Administration (HRSA) (DHHS) |
| Contract Number: | R01MH114925 R01081757 |
| Document Type: | Journal Articles Reports - Research |
| Descriptors: | Child Caregivers, Behavior Change, Intervention, Behavior Modification, Young Children, Autism Spectrum Disorders, Child Development, Behavior Development, Interpersonal Communication, Program Effectiveness |
| Geographic Terms: | Michigan, California, Washington, Florida |
| DOI: | 10.1177/13623613251328463 |
| ISSN: | 1362-3613 1461-7005 |
| Abstract: | Naturalistic developmental behavioral interventions target developmentally appropriate skills in young children with autism spectrum disorders using behavioral techniques in naturalistic interactions. Naturalistic developmental behavioral interventions demonstrate strong empirical support and frequently utilize caregiver training of intervention strategies. However, our understanding of the mechanisms of change linked to naturalistic developmental behavioral interventions remains limited. Based on retrospective, secondary data analyses from three previously conducted randomized controlled trials of caregiver-mediated naturalistic developmental behavioral interventions, this study examined the direct effect of intervention on caregiver naturalistic developmental behavioral intervention strategy use and how caregiver changes mediate intervention effects on children's social communication. A total of 419 videos from 229 dyads consisting of autistic children (M = 32.5 months/ages 1-5 years) and caregivers were included in analyses using the masked ratings of the measure of naturalistic developmental behavioral intervention strategy implementation-caregiver changes (MONSI-CC) and brief observation of social communication change (BOSCC-SC). Using longitudinal mediation analyses, we examined the mediation effect of caregiver behavioral changes on children's outcomes. Results demonstrated a significant intervention effect on changes of caregiver naturalistic developmental behavioral intervention strategy use (MONSI-CC) and of changes of caregiver strategy use (MONSI-CC) on child social communication change (BOSCC-SC) scores, but no overall total effect of intervention on changes of child social communication (BOSCC-SC). This study demonstrates the mediating role of caregiver behavior on the child intervention response, a first step toward better understanding underlying mechanisms in naturalistic developmental behavioral interventions. |
| Abstractor: | As Provided |
| Entry Date: | 2025 |
| Accession Number: | EJ1474885 |
| Database: | ERIC |
|
Full text is not displayed to guests.
Login for full access.
|
|
| FullText | Links: – Type: pdflink Url: https://content.ebscohost.com/cds/retrieve?content=AQICAHj0k_4E0hTGH8RJwT4gCJyBsGNe_WN95AvKlDbXJGqwxwFerMkcuQz6qSvCVB0tpFSKAAAA4jCB3wYJKoZIhvcNAQcGoIHRMIHOAgEAMIHIBgkqhkiG9w0BBwEwHgYJYIZIAWUDBAEuMBEEDLTTzVnBjha2Z41GqQIBEICBmqETJzHvOzb0sWJWVvqOIdWktXANBWYLtWkjwgrUkRn00-bNEVxJd7Aaiw6X2iIAB2Xz3rz6V-j6uamwwfXjpPI6qAysSfgcmHWVRv9TgUm2gAlhiDPZQrqeVE5Hx49u3IidtQvnBex7dYjAL2VO1XZX1lh94w-8Iw42vGZOEyqIO0_nMCfGd1G08aHyvwvRrAnMifeuW3Ei4lM= Text: Availability: 1 Value: <anid>AN0185859371;f9d01jul.25;2025Jun13.01:17;v2.2.500</anid> <title id="AN0185859371-1">Caregiver behavioral changes mediate the effects of naturalistic developmental behavioral interventions: Combining evidence from three randomized controlled trials </title> <p>Naturalistic developmental behavioral interventions target developmentally appropriate skills in young children with autism spectrum disorders using behavioral techniques in naturalistic interactions. Naturalistic developmental behavioral interventions demonstrate strong empirical support and frequently utilize caregiver training of intervention strategies. However, our understanding of the mechanisms of change linked to naturalistic developmental behavioral interventions remains limited. Based on retrospective, secondary data analyses from three previously conducted randomized controlled trials of caregiver-mediated naturalistic developmental behavioral interventions, this study examined the direct effect of intervention on caregiver naturalistic developmental behavioral intervention strategy use and how caregiver changes mediate intervention effects on children's social communication. A total of 419 videos from 229 dyads consisting of autistic children (M = 32.5 months/ages 1–5 years) and caregivers were included in analyses using the masked ratings of the measure of naturalistic developmental behavioral intervention strategy implementation-caregiver changes (MONSI-CC) and brief observation of social communication change (BOSCC-SC). Using longitudinal mediation analyses, we examined the mediation effect of caregiver behavioral changes on children's outcomes. Results demonstrated a significant intervention effect on changes of caregiver naturalistic developmental behavioral intervention strategy use (MONSI-CC) and of changeds of caregiver strategy use (MONSI-CC) on child social communication change (BOSCC-SC) scores, but no overall total effect of intervention on changes of child social communication (BOSCC-SC). This study demonstrates the mediating role of caregiver behavior on the child intervention response, a first step toward better understanding underlying mechanisms in naturalistic developmental behavioral interventions. Naturalistic developmental behavioral interventions use behavioral techniques in naturalistic interactions and settings. Naturalistic developmental behavioral interventions also teach caregivers to use strategies to enhance social communication in their children with autism spectrum disorder. Naturalistic developmental behavioral interventions are effective in supporting young autistic children but how naturalistic developmental behavioral interventions work ("underlying mechanisms") is not known yet. Therefore, by applying new instruments to videos already collected from the three previously conducted randomized controlled trials of caregiver-mediated naturalistic developmental behavioral interventions, we examined how caregivers change in their strategy use over the course of intervention and how that relates to changes in social communication in their autistic children. A total of 419 videos from 229 dyads consisting of autistic children (M = 32.5 months/ages 1–5 years) and caregivers were included in analyses using two measures, one for the caregiver behavioral changes (the measure of naturalistic developmental behavioral intervention strategy implementation-caregiver changes [MONSI-CC]), and another for the children's social communication (the brief observation of social communication change [BOSCC-SC]). We found that naturalistic developmental behavioral interventions were effective in leading to increased mastery of caregiver naturalistic developmental behavioral intervention strategy use, which then affected the changes in child's social communication skills. However, we found no direct effect of treatment for child social communication skills. This study highlights the mediating role of caregiver behavior on the child intervention response, supporting the importance of involving caregivers as partners in the intervention for young autistic children.</p> <p>Keywords: autism; naturalistic developmental behavioral interventions; treatment mechanisms</p> <p>Naturalistic developmental behavioral interventions (NDBIs) include a series of interventions based on similar principles that teach behavioral strategies to target developmentally appropriate skills in young children with autism spectrum disorder (ASD) in naturalistic settings ([<reflink idref="bib24" id="ref1">24</reflink>]). Recent meta-analyses for NDBIs demonstrate promising effects for child expressive language, play skills, social communication, and cognitive development ([<reflink idref="bib3" id="ref2">3</reflink>]; [<reflink idref="bib23" id="ref3">23</reflink>]). Although NDBIs, such as Early Start Denver Model (ESDM) and Joint Attention Symbolic Play Engagement and Regulation (JASPER), have been independently created and validated; they share common teaching elements, such as natural reinforcement, child-initiated teaching episodes, modeling, prompting, and imitating, as well as intervention targets, such as social communication, engagement, and play skills). Combining evidence from different studies and comparing intervention effects across those studies have not been feasible due to lack of a standardized outcome measures that can be applied uniformly across trials.</p> <p>Another core component of many NDBIs is caregiver training or coaching. Interventions that focus on these approaches, rather than intervention directly delivered by a professional, are commonly referred to as caregiver-mediated. Caregiver involvement in ASD intervention, especially with very young children, has long been recommended by experts and federal policy because it significantly enhances generalization and maintenance of skills attained ([<reflink idref="bib12" id="ref4">12</reflink>]; [<reflink idref="bib17" id="ref5">17</reflink>]; [<reflink idref="bib19" id="ref6">19</reflink>]; [<reflink idref="bib24" id="ref7">24</reflink>]; [<reflink idref="bib32" id="ref8">32</reflink>]). Caregiver-mediated interventions build upon a transactional model of development, in which the behaviors of the caregiver reciprocally shape the behaviors of the child ([<reflink idref="bib27" id="ref9">27</reflink>]). In caregiver-mediated NDBIs, providers teach caregiver strategies to increase child social communication abilities, which can lead to positive downstream developmental gains. Despite strong theoretical justification and support for teaching caregivers specific intervention techniques, understanding of mechanisms or mediators of child change in caregiver-mediated NDBIs remains relatively limited partly due to small sample sizes in previously conducted randomized controlled trials (RCTs). Furthermore, no studies have examined changes in caregiver gains by combining evidence across various NDBIs.</p> <p>Recently, [<reflink idref="bib30" id="ref10">30</reflink>] conducted a systematic review of factors that influence the outcomes of caregiver-mediated interventions for young autistic children. Approximately 36% of included studies explored potential mediating or moderating factors, with significant variability noted regarding identified caregiver and child factors. One of the common caregiver factors in NDBI studies was caregiver implementation of NDBI strategies, mostly measured by study-specific fidelity ratings. However, this approach limits generalizability across studies because it focuses on adherence to the full intervention protocol versus common or overlapping elements, a necessary step required to understand active ingredients or mediators of change across various NDBIs ([<reflink idref="bib6" id="ref11">6</reflink>]). Given that a few studies have shown promising results on the potential mediating role of caregiver NDBI strategies (e.g. "mirrored pacing," "synchrony") on child social communication outcomes ([<reflink idref="bib11" id="ref12">11</reflink>]; [<reflink idref="bib18" id="ref13">18</reflink>]), combining evidence from multiple studies to examine the effects of caregiver behavioral changes as a mediator of child intervention outcomes is essential to improve our understanding of intervention mechanisms.</p> <p>Measurement tools that allow for the examination of common strategies across studies of different NDBIs can help answer these imperative questions regarding overarching intervention mechanisms. The Measure of NDBI Strategy Implementation-Caregiver Changes (MONSI-CC) was recently developed and tested across various early autism intervention models ([<reflink idref="bib31" id="ref14">31</reflink>]), showing promise to examine caregiver changes in three distinct yet similar NDBIs. Similarly, the Brief Observation of Social Communication Change (BOSCC) has been used to examine changes in broad social communication skills over the course of intervention in children with ASD across various NDBIs ([<reflink idref="bib10" id="ref15">10</reflink>], [<reflink idref="bib29" id="ref16">29</reflink>]). This study quantitatively examines the impact of caregiver NDBI strategy use (via MONSI-CC) on child social communication abilities (via BOSCC) across a sample of young autistic children who participated in one of three RCTs of caregiver-mediated NDBIs. These data were not meant to compare effects of different models since the RCTs varied in targets, length, and setting. Rather, through secondary analyses of data obtained from previously published studies, we aimed to examine (<reflink idref="bib1" id="ref17">1</reflink>) whether caregivers receiving active intervention would show significantly larger increases in their NDBI caregiver strategy use compared to controls (both active and intervention as usual) and (<reflink idref="bib2" id="ref18">2</reflink>) whether changes in child behaviors would be mediated by the changes in caregiver behaviors.</p> <hd id="AN0185859371-2">Method</hd> <p></p> <hd id="AN0185859371-3">Participants</hd> <p>Participants consisted of caregiver and child dyads who were enrolled in one of the following studies: ESDM (original sample <emph>n</emph> = 118; [<reflink idref="bib22" id="ref19">22</reflink>]), early social interaction (ESI; original sample <emph>n</emph> = 82; [<reflink idref="bib32" id="ref20">32</reflink>]), and JASPER (original sample <emph>n</emph> = 112; [<reflink idref="bib13" id="ref21">13</reflink>]). Participants came from multiple sites, including University of Michigan Autism and Communication Disorders Center (ESI, JASPER, ESDM), University of California, Davis (ESDM), University of Washington (ESDM), University of California Los Angeles (JASPER), Kennedy Kreiger (JASPER), and Florida State University (JASPER). This study and data sharing were approved (IRB#1707018417). The comparison groups in each study were receiving group-based (compared to individual) playgroups and education sessions (JASPER and ESI), or community-based, "as usual" interventions (ESDM; See Supplemental materials for more details). Informed consent was obtained from all families included in this study at each institute, and all data were shared after data-sharing agreements were executed among institutes.</p> <p>Out of participants from the above studies (<emph>n</emph> = 312), 229 dyads were selected for this study that met inclusion and exclusion criteria (see procedures below). Children were between the ages of 1 and 5 years, predominantly White (<emph>n</emph> = 117, 51.1%) and demonstrated variability in regard to baseline language and nonverbal abilities. Caregivers ranged in age from 20.6 to 56.6 years, were predominantly female and college-educated (50.2%). See Table 1 for additional details.</p> <p>Table 1. Baseline demographic information.</p> <p>Graph</p> <p> <ephtml> &lt;table&gt;&lt;colgroup&gt;&lt;col align="left" /&gt;&lt;col align="char" char="." /&gt;&lt;col align="char" char="." /&gt;&lt;col align="char" char="." /&gt;&lt;/colgroup&gt;&lt;thead&gt;&lt;tr&gt;&lt;th /&gt;&lt;th align="left"&gt;Intervention&lt;/th&gt;&lt;th align="left"&gt;Control&lt;/th&gt;&lt;th align="left"&gt;Total&lt;/th&gt;&lt;/tr&gt;&lt;tr&gt;&lt;th /&gt;&lt;th align="left"&gt;&lt;italic&gt;n&lt;/italic&gt; (%)&lt;/th&gt;&lt;th align="left"&gt;&lt;italic&gt;n&lt;/italic&gt; (%)&lt;/th&gt;&lt;th align="left"&gt;&lt;italic&gt;n&lt;/italic&gt; (%)&lt;/th&gt;&lt;/tr&gt;&lt;/thead&gt;&lt;tbody&gt;&lt;tr&gt;&lt;td&gt;Child sex: Female&lt;/td&gt;&lt;td&gt;26 (21.8)&lt;/td&gt;&lt;td&gt;21 (19.1%)&lt;/td&gt;&lt;td&gt;47 (20.5%)&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td colspan="4"&gt;Child race/Ethnicity&lt;xref ref-type="table-fn" rid="tfn3"&gt;**&lt;/xref&gt;&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; Asian&lt;/td&gt;&lt;td&gt;6 (5.0%)&lt;/td&gt;&lt;td&gt;5 (4.5%)&lt;/td&gt;&lt;td&gt;11 (4.8%)&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; Biracial&lt;/td&gt;&lt;td&gt;8 (6.7%)&lt;/td&gt;&lt;td&gt;6 (5.5%)&lt;/td&gt;&lt;td&gt;14 (6.1%)&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; Black/African American&lt;/td&gt;&lt;td&gt;13 (10.9%)&lt;/td&gt;&lt;td&gt;21 (19.1%)&lt;/td&gt;&lt;td&gt;34 (14.8%)&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; Latinx&lt;/td&gt;&lt;td&gt;16 (13.4%)&lt;/td&gt;&lt;td&gt;13 (11.8%)&lt;/td&gt;&lt;td&gt;29 (12.7%)&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; Other&lt;/td&gt;&lt;td&gt;11 (9.2%)&lt;/td&gt;&lt;td&gt;8 (7.3%)&lt;/td&gt;&lt;td&gt;19(8.3%)&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; White/Caucasian&lt;/td&gt;&lt;td&gt;61 (51.3%)&lt;/td&gt;&lt;td&gt;56 (50.9%)&lt;/td&gt;&lt;td&gt;117 (51.1%)&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; Missing&lt;/td&gt;&lt;td&gt;4 (3.4%)&lt;/td&gt;&lt;td&gt;1 (0.9%)&lt;/td&gt;&lt;td&gt;5 (2.2%)&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td colspan="4"&gt;Language level&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; No words&lt;/td&gt;&lt;td&gt;42 (35.3%)&lt;/td&gt;&lt;td&gt;37 (33.6%)&lt;/td&gt;&lt;td&gt;80 (34.9%)&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; 1&amp;#8211;5 words&lt;/td&gt;&lt;td&gt;36 (30.3%)&lt;/td&gt;&lt;td&gt;38 (34.5%)&lt;/td&gt;&lt;td&gt;74 (32.3%)&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; Single words&lt;/td&gt;&lt;td&gt;19 (16.0%)&lt;/td&gt;&lt;td&gt;11 (10.0%)&lt;/td&gt;&lt;td&gt;30 (13.1%)&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; Occasional phrases&lt;/td&gt;&lt;td&gt;5 (4.2%)&lt;/td&gt;&lt;td&gt;11 (10.0%)&lt;/td&gt;&lt;td&gt;16 (7.0%)&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; 2+ word utterances&lt;/td&gt;&lt;td&gt;12(10.0%)&lt;/td&gt;&lt;td&gt;8 (7.3%)&lt;/td&gt;&lt;td&gt;19 (8.3)&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; 3+ word utterances&lt;/td&gt;&lt;td&gt;3 (2.5%)&lt;/td&gt;&lt;td&gt;3 (2.7%)&lt;/td&gt;&lt;td&gt;6 (2.6%)&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; Complex speech&lt;/td&gt;&lt;td&gt;2 (1.6%)&lt;/td&gt;&lt;td&gt;2 (1.8%)&lt;/td&gt;&lt;td&gt;4 (1.8%)&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; Interactant/Caregiver sex: Female&lt;/td&gt;&lt;td&gt;104 (87.4%)&lt;/td&gt;&lt;td&gt;97 (88.2%)&lt;/td&gt;&lt;td&gt;201 (87.8%)&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td colspan="4"&gt;Interactant/Caregiver education&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; &amp;#60; Bachelor's degree&lt;/td&gt;&lt;td&gt;62 (52.1%)&lt;/td&gt;&lt;td&gt;53 (48.2%)&lt;/td&gt;&lt;td&gt;115 (50.2%)&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; Missing&lt;/td&gt;&lt;td&gt;7 (5.9%)&lt;/td&gt;&lt;td&gt;6 (5.4%)&lt;/td&gt;&lt;td&gt;13 (5.7%)&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td /&gt;&lt;td&gt;&lt;italic&gt;M&lt;/italic&gt; (&lt;italic&gt;SD&lt;/italic&gt;)&lt;/td&gt;&lt;td&gt;&lt;italic&gt;M&lt;/italic&gt; (&lt;italic&gt;SD&lt;/italic&gt;)&lt;/td&gt;&lt;td&gt;&lt;italic&gt;M&lt;/italic&gt; (&lt;italic&gt;SD&lt;/italic&gt;)&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Child age (months)&lt;xref ref-type="table-fn" rid="tfn3"&gt;**&lt;/xref&gt;&lt;/td&gt;&lt;td&gt;32.68 (12.14)&lt;/td&gt;&lt;td&gt;32.33 (12.40)&lt;/td&gt;&lt;td&gt;32.51 (12.24)&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;NVIQ&lt;xref ref-type="table-fn" rid="tfn3"&gt;**&lt;/xref&gt;&lt;/td&gt;&lt;td&gt;76.94 (23.84)&lt;/td&gt;&lt;td&gt;76.74 (20.38)&lt;/td&gt;&lt;td&gt;76.84 (22.20)&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;CSS-SA&lt;/td&gt;&lt;td&gt;7.14 (1.98)&lt;/td&gt;&lt;td&gt;7.51 (1.96)&lt;/td&gt;&lt;td&gt;7.19 (1.86)&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;CSS-RRB&lt;xref ref-type="table-fn" rid="tfn3"&gt;*&lt;/xref&gt;&lt;/td&gt;&lt;td&gt;7.54 (1.77)&lt;/td&gt;&lt;td&gt;7.51 (1.87)&lt;/td&gt;&lt;td&gt;7.32 (1.97)&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;BOSCC-SC&lt;/td&gt;&lt;td&gt;27.37 (7.64)&lt;/td&gt;&lt;td&gt;28.03 (7.66)&lt;/td&gt;&lt;td&gt;27.68 (7.63)&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;BOSCC-RRB&lt;/td&gt;&lt;td&gt;6.41 (3.04)&lt;/td&gt;&lt;td&gt;5.92 (2.54)&lt;/td&gt;&lt;td&gt;6.17 (2.81)&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Interactant/Caregiver age (years)&lt;xref ref-type="table-fn" rid="tfn2"&gt;a&lt;/xref&gt;&lt;/td&gt;&lt;td&gt;35.23 (6.53)&lt;/td&gt;&lt;td&gt;34.18 (6.73)&lt;/td&gt;&lt;td&gt;34.73 (6.63)&lt;/td&gt;&lt;/tr&gt;&lt;/tbody&gt;&lt;/table&gt; </ephtml> </p> <p>1 NVIQ: nonverbal intelligence quotient; CSS-SA: calibrated severity scores-social affect; RRB: restricted and repetitive behaviors; BOSCC-SC: brief observation of social communication change-social communication.</p> <ulist> <item>2 Caregiver age was missing for 18 caregivers in the intervention group and 19 in the control group.</item> <item>3 <emph>p</emph> &lt; 0.05, **<emph>p</emph> &lt; 0.01; significant differences emerged from Chi-square or analysis of variance (ANOVA) tests.</item> </ulist> <hd id="AN0185859371-4">Measures</hd> <p></p> <hd id="AN0185859371-5">Measure of NDBI strategy implementation-caregiver change (MONSI-CC)</hd> <p>The MONSI-CC was recently developed and validated as a measure of changes in caregiver implementation of common NDBI strategies over the course of early autism intervention ([<reflink idref="bib31" id="ref22">31</reflink>]). The MONSI-CC is coded by assigning scores to each of two 5-min video segments and averaging the codes from the two segments, parallel to the model of Brief Observation of Social Communication (BOSCC; [<reflink idref="bib10" id="ref23">10</reflink>]) procedures described below. Item scores on each of the strategies are then summed within five domain scores (i.e. environmental set-up, child-guided interactions, active teaching and learning, opportunities for engagement, and natural reinforcement and scaffolding; see [<reflink idref="bib31" id="ref24">31</reflink>] for details about the items included in each domain). The domain scores are then summed to produce a single MONSI-CC total score. The MONSI-CC was validated based on a subset of the sample included in this study, and showed promising psychometric properties, including high inter-rater reliability and validity ([<reflink idref="bib31" id="ref25">31</reflink>]). Higher scores indicate more frequent and effective implementation of the strategies. This study used MONSI-CC total scores for all analyses.</p> <hd id="AN0185859371-6">Brief Observation of Social Communicaton Change (BOSCC), minimally verbal version</hd> <p>The BOSCC consists of two domains social communication (BOSCC-SC) and restricted and repetitive behaviors (BOSCC-RRB) as well as an overall ASD total (BOSCC-ASD). Lower scores across domains indicate better social communication skills and fewer RRBs. Different versions of the BOSCC have been developed to account for various language levels (e.g. minimally verbal (BOSCC-MV; [<reflink idref="bib10" id="ref26">10</reflink>]), phrase speech, fluent; [<reflink idref="bib2" id="ref27">2</reflink>]). The BOSCC-MV demonstrates high inter-rater reliability and validity and has been used internationally in several behavioral and pharmacological intervention studies ([<reflink idref="bib2" id="ref28">2</reflink>]; [<reflink idref="bib9" id="ref29">9</reflink>]; [<reflink idref="bib10" id="ref30">10</reflink>]; [<reflink idref="bib15" id="ref31">15</reflink>]; [<reflink idref="bib20" id="ref32">20</reflink>]). However, variability has been found in changes captured by the BOSCC, with one intervention study reporting no significant changes in BOSCC scores ([<reflink idref="bib9" id="ref33">9</reflink>]) although the same intervention model resulted in modest changes in social communication measured by the BOSCC in another population ([<reflink idref="bib4" id="ref34">4</reflink>]). Thus, the magnitude of changes in BOSCC scores may vary by individuals as well as intervention dosage, intensity, and duration.</p> <p>In addition, studies have found pronounced social communication symptom changes using the BOSCC but less change in RRBs ([<reflink idref="bib10" id="ref35">10</reflink>]; [<reflink idref="bib14" id="ref36">14</reflink>]). Thus, this study focuses on BOSCC-SC domain from the minimally verbal version (i.e. eye contact, facial expressions, gestures, vocalizations, integration of vocal and non-vocal, social overtures, social responses, engagement). While it is possible that NDBIs may result in an indirect effect of repetitive behaviors (e.g. increasing flexibility in play routines, partners, and materials may decrease a child's tendency for repetitive play), we focused on the primary (and overlapping) intervention outcomes and skills targeted across all three NDBIs analyzed in this study (e.g. social communication, play skills, engagement), which is best captured by the social communication domain of the BOSCC (BOSCC-SC).</p> <hd id="AN0185859371-7">Baseline clinical features</hd> <p>Baseline nonverbal intelligence quotient (NVIQ) was computed based on the Mullen Scales of Early Learning (MSEL) fine motor and visual reception domains ([<reflink idref="bib1" id="ref37">1</reflink>]). Baseline autism symptom severity was measured by ADOS-2 calibrated severity scores (CSS; [<reflink idref="bib5" id="ref38">5</reflink>]; [<reflink idref="bib8" id="ref39">8</reflink>]). In addition, baseline language levels were computed based on the observed spontaneous expressive language scores from the ADOS-2 using a standardized and validated metric ([<reflink idref="bib16" id="ref40">16</reflink>]). Values ranged from 1 (i.e., no words or word approximations) to 8 (i.e., uses sentences in a largely correct manner, including some complex speech), with higher scores reflecting increasingly mature verbal language abilities. Caregivers reported the child's biological sex, race/ethnicity, and age as well as their own sex, age, and education level at intervention entry.</p> <hd id="AN0185859371-8">Procedures</hd> <p>A total of 1166 videos for 285 caregiver and child dyads were made available for this study across the RCTs for all sites, excluding one of two sites from the ESI study, which did not contribute videos (see Figure 1). Of note, the ESI study did not show significant differences in outcome measures across sites ([<reflink idref="bib32" id="ref41">32</reflink>]). Because this article focused on caregiver-mediated NDBIs and the RCT studies of ESDM, ESI and JASPER varied in their designs (e.g. caregiver- versus therapist-mediated), intensity, and length of enrollment, a subset of videos and dyads (i.e. 419 videos from 229 dyads) were selected for this study that met the following specific inclusion and exclusion criteria (see Figure 1 Adapted CONSORT Diagram). First, videos recorded within approximately 3 months from the beginning of the caregiver-mediated intervention or active control period were included as this was the intervention duration for JASPER and ESDM. Although the ESI trial was 9 months in length, only videos from the first 3 months were included. Similarly, after 3 months of caregiver-mediated ESDM, families were provided 2 years of therapist-implemented ESDM; these additional videos during the therapist-implemented ESDM sessions were excluded. For each dyad, a total of four videos maximum were included to account for baseline, Month 1, Month 2, and Month 3. For any dyad with more than one observation within a time period, the first video was selected to reduce the extent of imbalance in the data (mean number of videos per dyad = 1.8, <emph>SD</emph> = 0.6, range = 1–4; see Supplemental materials for additional details). Individual videos were excluded if any of the following occurred: child cried or had a pacifier in mouth for more than half of the video segment; the main adult interactant in the video was not identified as a primary caregiver; the caregiver was not visible for more than 70% of the interaction. For various reasons (e.g. intervention duration extended to make up for missed sessions due to family and clinician availability, vacation, and illness to ensure the full dosage), the timing of the Month 3 video varied with a mean of 15.29 weeks and standard deviation of 2.60 months from the intervention entry. All videos included in Month 3 time point were labeled as exit visits; none were from follow-up after treatment was completed. As the main focus was to examine the mediation effect of caregiver changes on the children who received intervention using the secondary data analytic approach, we excluded videos of children who dropped out of the intervention from the original studies. All interactions coded for each child were based on one main caregiver.</p> <p>Graph: Figure 1. CONSORT for sample selection from the original RCTs.ESDM: Early Start Devern Model; RCT: randomized control trial; JASPER: joint attention, symbolic play, engagement, and regulation; ESI: early social interaction; CMM: caregiver-mediated module; CEM: caregiver education module.aOnly videos for one site in the ESI RCT were provided and included in the final data analysis.bParticipant videos provided to the study team included those who were randomized as well as those who were excluded during the assessment for eligibility process.</p> <p>The BOSCC and MONSI-CC coders included 21 post-baccalaureate research assistants and post-doctoral research associates. All coders were supervised by a licensed clinical psychologist. The coders underwent 4–6 weeks of training and joint coding (about 10–20 videos) and established scoring reliability above 80% agreement with previously coded videos for BOSCC and MONSI-CC codes across three consecutive videos. The criteria for reliability were the following: (<reflink idref="bib1" id="ref42">1</reflink>) at least 80% reliability on all items within each segment (no more than four items could be different by more than 1 point), (<reflink idref="bib2" id="ref43">2</reflink>) 80% accuracy on each domain score within each segment, and (<reflink idref="bib3" id="ref44">3</reflink>) 90% agreement for total scores. Consensus codes were used for analysis when multiple codes were available for each video, but not for inter-rater reliability. To maintain and monitor fidelity, bi-weekly consensus coding sessions were conducted. Two-way random absolute intraclass correlation coefficient (ICCs) was computed to calculate inter-rater reliability. Inter-rater ICC was good for MONSI-CC total at <emph>r</emph> = 0.79, 95% confidence interval = [0.47–0.92] and high for BOSCC-SC domain at <emph>r</emph> = 0.96, 95% confidence interval = [0.88–0.98].</p> <p>Videos were de-identified and randomized to ensure coders remained masked to study, site, intervention allocation, and time point (i.e. "de-identification" did NOT mean video was blurred but the coders did not have any intervention-related information). A single coder was not allowed to code both MONSI and BOSCC for the same child to minimize the bias; the information from the other measure was masked. Video length was standardized at 10 min; for those over 10 min in length, a 10-min segment was extracted from the point when the examiner or study personnel left the room for the caregiver to start interacting with the child independently. The same segments were used for both the MONSI-CC and BOSCC coding. The videos were gathered during participation in the intervention trials, and most interactions were collected in a clinic setting (<emph>n</emph> = 401, 96.4%) while the remaining observations were collected in participants' homes. Although the exact set of toys used in the interactions varied across the three studies, they were all age-appropriate, engaging, and very similar, allowing for play levels ranging from cause-and-effect (less mature) to construction and pretend (more mature). All caregivers were given similar instructions (i.e. play and engage with your child as you normally would). Videos were rated for audio and video quality to maximize the validity of the coding on a scale from 1 (Poor) to 5 (Very Good). The mean quality for audio and visual codes were 3.68 (<emph>SD</emph> = 0.88) and 3.23 (<emph>SD</emph> = 0.86), respectively. Community members were not involved in the study.</p> <hd id="AN0185859371-9">Statistical analyses</hd> <p>Our mediation analysis was intended to determine whether change in caregiver behavior (as measured by the MONSI-CC) as a result of the intervention resulted in observed changes in child behavior (as measured by the BOSCC-SC). Intervention proceeded over an extended period and the number of assessments of caregiver and child behavior varied between families. We examined two structural equation models, one simpler, that used only the baseline and final eligible assessments (see Figure 2, <emph>n</emph> = 121), and another, more complex model for longitudinal mediation analyses of trials by [<reflink idref="bib7" id="ref45">7</reflink>], Figure 3), that exploited all available assessments (<emph>n</emph> = 229; 149 baseline, 48 Month 1, 31 Month 2, 189 Month 3). In the latter model, we examined the progressive relationship of experience of intervention accumulating over time to progressive change in caregiver behavior (solid red lines) and the consequent incremental change in child behavior (solid black lines) and any other effects of intervention on the child (dashed red lines). Thus, the random intercept latent growth curve model examined intervention effects on the caregiver, which could be mediated by cross-lagged effects. At baseline, each interaction of caregivers and children was allowed to vary with the study site, child's age at first assessment, their ADOS CSS total score, their NVIQ, and their level of language, which were entered into the model as fixed effects with random intercepts for each caregiver and child. Error variances for the repeated measurements of the MONSI-CC were set as equal and similarly for the BOSCC-SC scores. We first estimated models separately for the child BOSCC-SC and the caregivers' MONSI-CC videos. Potential heterogeneity of intervention effects by study (ESDM, ESI, vs JASPER studies) was assessed by Wald tests of added interaction terms. We then estimated a joint caregiver and child model in which the direct effect of change in caregiver behavior on change in the child behavior could be assessed. We fitted three models. In the first model, intervention effects on the caregiver were assumed to increase linearly with time as therapy progressed and all intervention effects on the child were forced to be mediated through changes in the care behavior. In the second model, a direct intervention effect on the child was allowed, an effect that also was assumed to increase linearly with time since the start of the intervention. A penultimate model removed the linearity assumption for the intervention effects. A final sensitivity analysis examined how robust the results were to correlated measurement error between contemporaneous MONSI-CC and BOSCC-SC scores.</p> <p>Graph: Figure 2. Simple mediation model.BOSCC-SC: brief observation of social communication-social communication; MONSI-CC: measure of NDBI (naturalistic developmental behavioral interventions) strategy implementation-caregiver change; "a" path (solid red line): effect of intervention on caregiver NDBI strategy implementation; "b" path (solid black line): the consequent change in child behavior; "c′" path (dashed red line): any other effects of intervention on child.</p> <p>Graph: Figure 3. Full longitudinal mediation model.ADOS CSS: Autism Diagnostic Observation Schedule calibrated severity scores; BOSCC-SC: brief observation of social communication-social communication; MONSI-CC: measure of NDBI (naturalistic developmental behavioral interventions) strategy implementation-caregiver change; NVIQ: nonverbal IQ. Lines represent the following; a1–3 paths (solid red line): progressive relationship of experience of intervention accumulating over time to progressive change in caregiver behavior; b1–3 paths (solid black lines): the consequent incremental change in child behavior; c′1–3 paths (dashed red lines): any other effects of intervention on the child.</p> <p>All models were estimated in Stata v16.0 ([<reflink idref="bib28" id="ref46">28</reflink>]) using the gsem command ([<reflink idref="bib21" id="ref47">21</reflink>]). Most of the imbalance in data availability arose from missing data, where different studies had different time points of assessment (see Supplemental materials for more details). Including dummy variables for study among the covariates and using maximum-likelihood estimation allowed account to be taken of both the imbalance by design and attrition-related missingness associated with baseline and any later observed interaction assessments and covariates. Direct and indirect effects were estimated using the product of coefficients method with confidence interval estimated by empirical bootstrap for the simple model and the delta-method for the more complex model (bootstrap was not practical due to constraints of computation and model convergence reliability).</p> <hd id="AN0185859371-10">Results</hd> <p></p> <hd id="AN0185859371-11">Mediation based on the subset of sample with pre- and post-intervention data</hd> <p>Table 2 shows descriptive statistics for the dyads with baseline (pre-intervention) and 3-month endpoint (post-intervention) data (<emph>n</emph> = 121) by intervention group. There was no significant intervention group difference in the baseline MONSI-CC and BOSCC-SC scores (<emph>t</emph> = 0.7, <emph>p</emph> = 0.332 and <emph>t</emph> = –1.66, <emph>p</emph> = 0.100, respectively). There was a clear increase in MONSI-CC scores (increased mastery in caregiver NDBI strategy implementation) from pre- to post-intervention in the intervention group, although the decrease in the BOSCC-SC scores (reduction in child social communication symptoms) was more modest. Simple regression analysis of the complete baseline-endpoint data pairs for the intervention effect covarying for baseline and study (i.e. ESDM, ESI vs JASPER) gave estimates of 6.42 (95% CI = [2.08, 10.76]; <emph>p</emph> = 0.004) for the MONSI-CC scores and –0.61 (95% CI = [–2.93, 1.71]; <emph>p</emph> = 0.605) for the BOSCC-SC. The simple mediation model of Figure 1 (paths using traditional a, b, and c′ labels) fitted by maximum-likelihood structural equation modeling (SEM) estimated a significant (<emph>p</emph> = 0.017) indirect effect of intervention through the MONSI-CC (a × b) on the endpoint BOSCC-SC of –1.39 (95% CI = [–2.53, –0.24]). The residual direct effect of intervention on the BOSCC-SC though not significant (c′ of 0.870, 95% CI = [1.34, 3.08], <emph>p</emph> = 0.440) was in the opposite direction. At baseline, MONSI-CC and BOSCC-SC scores were correlated –0.39 (<emph>p</emph> = 0.001) in the controls but only 0.05 (<emph>p</emph> = 0.680) among the intervention group. At endpoint, the correlation was –0.438 (<emph>p</emph> &lt; 0.001) in the controls and –0.317 (<emph>p</emph> = 0.001) for the intervention group. As both BOSCC-SC and MONSI-CC scores were changing over time, and the correlation became stronger for the intervention group but not for the comparison group, these results suggest that there might have been an increase in the strength of the synchrony of caregiver and child.</p> <p>Table 2. MONSI-CC and BOSCC-SC scores at pre- and post-intervention data points and change scores (post–pre intervention).</p> <p>Graph</p> <p> <ephtml> &lt;table&gt;&lt;colgroup&gt;&lt;col align="left" /&gt;&lt;col align="char" char="." /&gt;&lt;col align="char" char="." /&gt;&lt;col align="char" char="." /&gt;&lt;col align="char" char="." /&gt;&lt;/colgroup&gt;&lt;thead&gt;&lt;tr&gt;&lt;th /&gt;&lt;th align="left"&gt;&lt;italic&gt;n&lt;/italic&gt; observations&lt;/th&gt;&lt;th align="left"&gt;Mean (&lt;italic&gt;SD&lt;/italic&gt;)&lt;/th&gt;&lt;th align="left"&gt;Min&lt;/th&gt;&lt;th align="left"&gt;Max&lt;/th&gt;&lt;/tr&gt;&lt;/thead&gt;&lt;tbody&gt;&lt;tr&gt;&lt;td colspan="5"&gt;Intervention group&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; MONSI-CC Pre&lt;/td&gt;&lt;td&gt;80&lt;/td&gt;&lt;td&gt;59.44 (11.92)&lt;/td&gt;&lt;td&gt;34&lt;/td&gt;&lt;td&gt;87&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; MONSI-CC Post&lt;/td&gt;&lt;td&gt;100&lt;/td&gt;&lt;td&gt;71.61 (11.77)&lt;/td&gt;&lt;td&gt;41&lt;/td&gt;&lt;td&gt;90&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; MONSI-CC Change&lt;/td&gt;&lt;td&gt;66&lt;/td&gt;&lt;td&gt;13.00 (15.14)&lt;/td&gt;&lt;td&gt;&amp;#8211;26&lt;/td&gt;&lt;td&gt;49&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; BOSCC-SC Pre&lt;/td&gt;&lt;td&gt;80&lt;/td&gt;&lt;td&gt;30.23 (6.81)&lt;/td&gt;&lt;td&gt;10&lt;/td&gt;&lt;td&gt;40&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; BOSCC-SC Post&lt;/td&gt;&lt;td&gt;100&lt;/td&gt;&lt;td&gt;26.62 (7.88)&lt;/td&gt;&lt;td&gt;9&lt;/td&gt;&lt;td&gt;39&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; BOSCC-SC Change&lt;/td&gt;&lt;td&gt;66&lt;/td&gt;&lt;td&gt;&amp;#8211;3.30 (6.47)&lt;/td&gt;&lt;td&gt;&amp;#8211;18&lt;/td&gt;&lt;td&gt;18&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td colspan="5"&gt;Control group&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; MONSI-CC Pre&lt;/td&gt;&lt;td&gt;69&lt;/td&gt;&lt;td&gt;62.74 (12.35)&lt;/td&gt;&lt;td&gt;27&lt;/td&gt;&lt;td&gt;91&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; MONSI-CC Post&lt;/td&gt;&lt;td&gt;90&lt;/td&gt;&lt;td&gt;65.43 (12.61)&lt;/td&gt;&lt;td&gt;26&lt;/td&gt;&lt;td&gt;88&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; MONSI-CC Change&lt;/td&gt;&lt;td&gt;55&lt;/td&gt;&lt;td&gt;4.59 (13.72)&lt;/td&gt;&lt;td&gt;&amp;#8211;29&lt;/td&gt;&lt;td&gt;35&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; BOSCC-SC Pre&lt;/td&gt;&lt;td&gt;69&lt;/td&gt;&lt;td&gt;29.05 (8.00)&lt;/td&gt;&lt;td&gt;4&lt;/td&gt;&lt;td&gt;40&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; BOSCC-SC Post&lt;/td&gt;&lt;td&gt;90&lt;/td&gt;&lt;td&gt;27.95 (7.90)&lt;/td&gt;&lt;td&gt;8&lt;/td&gt;&lt;td&gt;40&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; BOSCC-SC Change&lt;/td&gt;&lt;td&gt;55&lt;/td&gt;&lt;td&gt;&amp;#8211;2.66 (7.28)&lt;/td&gt;&lt;td&gt;&amp;#8211;19&lt;/td&gt;&lt;td&gt;14&lt;/td&gt;&lt;/tr&gt;&lt;/tbody&gt;&lt;/table&gt; </ephtml> </p> <p>4 MONSI-CC: measure of NDBI (naturalistic developmental behavioral interventions) strategy implementation-caregiver change; BOSCC-SC: brief observation of social communication change-social communication.</p> <hd id="AN0185859371-12">Mediation based on all available data (across the four observed assessment points)</hd> <p>We next conducted analyses using all available repeated observations. Table 3 shows descriptive statistics for the whole study sample (<emph>n</emph> = 229) by intervention models included in the analysis over the four assessment points. There was variability in the number of observations available due to differing assessment time points by the study (ESDM, ESI vs JASPER).</p> <p>Table 3. MONSI-CC and BOSCC-SC scores at all available data points.</p> <p>Graph</p> <p> <ephtml> &lt;table&gt;&lt;colgroup&gt;&lt;col align="left" /&gt;&lt;col align="char" char="." /&gt;&lt;col align="char" char="." /&gt;&lt;col align="char" char="." /&gt;&lt;col align="char" char="." /&gt;&lt;/colgroup&gt;&lt;thead&gt;&lt;tr&gt;&lt;th /&gt;&lt;th align="left"&gt;&lt;italic&gt;n&lt;/italic&gt; observations&lt;/th&gt;&lt;th align="left"&gt;Mean (&lt;italic&gt;SD&lt;/italic&gt;)&lt;/th&gt;&lt;th align="left"&gt;Min&lt;/th&gt;&lt;th align="left"&gt;Max&lt;/th&gt;&lt;/tr&gt;&lt;/thead&gt;&lt;tbody&gt;&lt;tr&gt;&lt;td colspan="5"&gt;Intervention group&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; MONSI-CC at Time 0&lt;/td&gt;&lt;td&gt;80&lt;/td&gt;&lt;td&gt;59.44 (11.92)&lt;/td&gt;&lt;td&gt;34&lt;/td&gt;&lt;td&gt;87&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; MONSI-CC at Time 1&lt;/td&gt;&lt;td&gt;30&lt;/td&gt;&lt;td&gt;62.67 (14.28)&lt;/td&gt;&lt;td&gt;37&lt;/td&gt;&lt;td&gt;88&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; MONSI-CC at Time 2&lt;/td&gt;&lt;td&gt;14&lt;/td&gt;&lt;td&gt;61.87 (14.27)&lt;/td&gt;&lt;td&gt;40&lt;/td&gt;&lt;td&gt;83&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; MONSI-CC at Time 3&lt;/td&gt;&lt;td&gt;100&lt;/td&gt;&lt;td&gt;71.59 (12.07)&lt;/td&gt;&lt;td&gt;37&lt;/td&gt;&lt;td&gt;90&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; BOSCC-SC at Time 0&lt;/td&gt;&lt;td&gt;80&lt;/td&gt;&lt;td&gt;30.23 (6.81)&lt;/td&gt;&lt;td&gt;10&lt;/td&gt;&lt;td&gt;40&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; BOSCC-SC at Time 1&lt;/td&gt;&lt;td&gt;30&lt;/td&gt;&lt;td&gt;27.50 (7.88)&lt;/td&gt;&lt;td&gt;12&lt;/td&gt;&lt;td&gt;39&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; BOSCC-SC at Time 2&lt;/td&gt;&lt;td&gt;14&lt;/td&gt;&lt;td&gt;24.61 (8.78)&lt;/td&gt;&lt;td&gt;6&lt;/td&gt;&lt;td&gt;39&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; BOSCC-SC at Time 3&lt;/td&gt;&lt;td&gt;100&lt;/td&gt;&lt;td&gt;26.50 (7.86)&lt;/td&gt;&lt;td&gt;9&lt;/td&gt;&lt;td&gt;39&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td colspan="5"&gt;Control group&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; MONSI-CC at Time 0&lt;/td&gt;&lt;td&gt;69&lt;/td&gt;&lt;td&gt;62.74 (12.35)&lt;/td&gt;&lt;td&gt;27&lt;/td&gt;&lt;td&gt;91&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; MONSI-CC at Time 1&lt;/td&gt;&lt;td&gt;18&lt;/td&gt;&lt;td&gt;60.78 (12.66)&lt;/td&gt;&lt;td&gt;34&lt;/td&gt;&lt;td&gt;15&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; MONSI-CC at Time 2&lt;/td&gt;&lt;td&gt;18&lt;/td&gt;&lt;td&gt;64.36 (11.15)&lt;/td&gt;&lt;td&gt;40&lt;/td&gt;&lt;td&gt;81&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; MONSI-CC at Time 3&lt;/td&gt;&lt;td&gt;90&lt;/td&gt;&lt;td&gt;65.43 (12.61)&lt;/td&gt;&lt;td&gt;26&lt;/td&gt;&lt;td&gt;88&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; BOSCC-SC at Time 0&lt;/td&gt;&lt;td&gt;69&lt;/td&gt;&lt;td&gt;29.05 (8.00)&lt;/td&gt;&lt;td&gt;4&lt;/td&gt;&lt;td&gt;40&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; BOSCC-SC at Time 1&lt;/td&gt;&lt;td&gt;18&lt;/td&gt;&lt;td&gt;30.22 (6.87)&lt;/td&gt;&lt;td&gt;15&lt;/td&gt;&lt;td&gt;39&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; BOSCC-SC at Time 2&lt;/td&gt;&lt;td&gt;18&lt;/td&gt;&lt;td&gt;26.67 (7.77)&lt;/td&gt;&lt;td&gt;12&lt;/td&gt;&lt;td&gt;39&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; BOSCC-SC at Time 3&lt;/td&gt;&lt;td&gt;90&lt;/td&gt;&lt;td&gt;27.88 (8.00)&lt;/td&gt;&lt;td&gt;8&lt;/td&gt;&lt;td&gt;40&lt;/td&gt;&lt;/tr&gt;&lt;/tbody&gt;&lt;/table&gt; </ephtml> </p> <p>5 MONSI-CC: measure of NDBI (naturalistic developmental behavioral interventions) strategy implementation-caregiver change; BOSCC-SC: brief observation of social communication change-social communication.</p> <p>Figure 4 shows spaghetti plots for the raw caregiver and child assessment data for the whole sample. The graphs suggest an increase in MONSI-CC caregiver scores over the course of intervention, and a decrease in the BOSCC-SC scores, with these changes being larger in the group receiving intervention. The model-predicted time paths were obtained from growth curve models with nonlinear time trend but linear time by intervention interactions. Fitted separately to each caregiver (MONSI-CC) and child score (BOSCC-SC), the caregiver MONSI-CC scores for the intervention group increased significantly more than controls (<emph>p</emph> = 0.047), while the greater decrease under intervention of the BOSCC-SC scores was nonsignificant (<emph>p</emph> = 0.194). Interactions testing intervention effect differences by intervention model (ESDM vs ESI vs JASPER) were not significant for the MONSI-CC or BOSCC-SC (2<emph>df p</emph> = 0.630 and 0.969, respectively). Subsequent analyses assumed intervention effects common across study.</p> <p>Graph: Figure 4. Raw and model-based caregiver MONSI-CC and child BOSCC-SC scores.BOSCC-SC: brief observation of social communication-social communication; MONSI-CC: measure of NDBI (naturalistic developmental behavioral interventions) strategy implementation-caregiver change.</p> <p>Figure 3 shows the mediation model fitted to make use of all the MONSI-CC and BOSCC-SC scores available. The model allowed caregiver and child random intercepts to be correlated at baseline (<emph>r</emph> = –0.49), for intervention to influence caregiver behavior (solid red paths) and for the change in caregiver interaction to effect change in child interaction (solid black lines). The intervention effect on the MONSI-CC was assumed to increase linearly with the duration of the intervention (i.e. a2 = two times a1, and a3 = three times a1), and each incremental change in the MONSI-CC was assumed to have the same effect on the BOSCC-SC (b1 = b2 = b3). Though caregivers were the proximal target of caregiver-mediated intervention components, some direct effect of intervention on the child was also allowed (red dashed lines), and this was also assumed to increase linearly with duration of intervention. Shown in Table 4, and as when analyzed separately, the direct effect of intervention on caregiver MONSI-CC (a1) was significant (<emph>p</emph> &lt; 0.001) and the direct effect of intervention on child BOSCC (c′1) was not (<emph>p</emph> = 0.561). However, the mediation effect of caregiver MONSI-CC scores on child BOSCC-SC scores was highly significant (<emph>p</emph> &lt; 0.001). Together, these estimates gave an indirect effect of each month of intervention on the child of 1.99 × –0.12 = –0.23 (95% CI = [–0.41, –0.06], <emph>p</emph> = 0.010) and a total effect from the sum –0.23 + (–0.15) = –0.38 (95% CI = [–0.90, 0.14], <emph>p</emph> = 0.148). In addition, the effects of the child's initial autism symptom and language levels as well as NVIQ on the BOSCC-SC scores were significant. Specifically, lower autism symptom severity (ADOS CSS), more mature language skills (higher scores), and higher NVIQs were associated with lower BOSCC-SC scores (higher social communication skills), and those who received the ESDM and JASPER (compared to ESI) showed higher MONSI-CC (higher NDBI skill implementation) and higher BOSCC-SC scores (higher social communication symptom levels).</p> <p>Table 4. Bivariate growth curve model with direct intervention effects on change from baseline (slope) for the MONSI-CC and the BOSCC-SC and indirect intervention effect on the BOSCC via the MONSI-CC (parameter labels in square parentheses correspond to Figure 3).</p> <p>Graph</p> <p> <ephtml> &lt;table&gt;&lt;colgroup&gt;&lt;col align="left" /&gt;&lt;col align="char" char="." /&gt;&lt;col align="char" char="." /&gt;&lt;col align="char" char="." /&gt;&lt;col align="char" char="." /&gt;&lt;col align="char" char="." /&gt;&lt;col align="char" char="." /&gt;&lt;/colgroup&gt;&lt;thead&gt;&lt;tr&gt;&lt;th /&gt;&lt;th align="left" colspan="3"&gt;Caregiver MONSI-CC scores&lt;/th&gt;&lt;th align="left" colspan="3"&gt;Child BOSCC-SC scores&lt;/th&gt;&lt;/tr&gt;&lt;tr&gt;&lt;th /&gt;&lt;th align="left"&gt;Estimate&lt;/th&gt;&lt;th align="left"&gt;95% CI&lt;/th&gt;&lt;th align="left"&gt;&lt;italic&gt;p&lt;/italic&gt;-value&lt;/th&gt;&lt;th align="left"&gt;Estimate&lt;/th&gt;&lt;th align="left"&gt;95% CI&lt;/th&gt;&lt;th align="left"&gt;&lt;italic&gt;p&lt;/italic&gt;-value&lt;/th&gt;&lt;/tr&gt;&lt;/thead&gt;&lt;tbody&gt;&lt;tr&gt;&lt;td colspan="7"&gt;Coefficient&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; Intercept factor variance&lt;/td&gt;&lt;td&gt;1.0&lt;/td&gt;&lt;td /&gt;&lt;td /&gt;&lt;td&gt;1.0&lt;/td&gt;&lt;td /&gt;&lt;td /&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; Intercept loading&lt;/td&gt;&lt;td&gt;5.67&lt;/td&gt;&lt;td&gt;4.18 to 7.16&lt;/td&gt;&lt;td&gt;&amp;#60; 0.001&lt;/td&gt;&lt;td&gt;3.41&lt;/td&gt;&lt;td&gt;2.71 to 4.12&lt;/td&gt;&lt;td&gt;&amp;#60; 0.001&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; Error variance&lt;/td&gt;&lt;td&gt;93.0&lt;/td&gt;&lt;td /&gt;&lt;td /&gt;&lt;td&gt;19.3&lt;/td&gt;&lt;td /&gt;&lt;td /&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; Intervention effect per month&lt;/td&gt;&lt;td&gt;1.99 [a1]&lt;/td&gt;&lt;td&gt;0.97 to 3.01&lt;/td&gt;&lt;td&gt;&amp;#60; 0.001&lt;/td&gt;&lt;td&gt;&amp;#8211;0.15 [c&amp;#8242;1]&lt;/td&gt;&lt;td&gt;&amp;#8211;0.66 to 0.36&lt;/td&gt;&lt;td&gt;0.561&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; Caregiver on child&lt;/td&gt;&lt;td /&gt;&lt;td /&gt;&lt;td /&gt;&lt;td&gt;&amp;#8211;0.12 [b1]&lt;/td&gt;&lt;td&gt;&amp;#8211;0.18 to &amp;#8211;0.05&lt;/td&gt;&lt;td&gt;&amp;#60; 0.001&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td colspan="7"&gt;Baseline/Intercept covariates&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; ADOS CSS&lt;/td&gt;&lt;td&gt;&amp;#8211;0.12&lt;/td&gt;&lt;td&gt;&amp;#8211;0.25 to 0.00&lt;/td&gt;&lt;td&gt;0.056&lt;/td&gt;&lt;td&gt;0.13&lt;/td&gt;&lt;td&gt;0.02 to 0.24&lt;/td&gt;&lt;td&gt;0.021&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; Language level&lt;/td&gt;&lt;td&gt;0.18&lt;/td&gt;&lt;td&gt;&amp;#8211;0.05 to 0.41&lt;/td&gt;&lt;td&gt;0.127&lt;/td&gt;&lt;td&gt;&amp;#8211;0.66&lt;/td&gt;&lt;td&gt;&amp;#8211;0.90 to &amp;#8211;0.42&lt;/td&gt;&lt;td&gt;&amp;#60; 0.001&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; Nonverbal IQ&lt;/td&gt;&lt;td&gt;0.27&lt;/td&gt;&lt;td&gt;&amp;#8211;0.06 to 0.60&lt;/td&gt;&lt;td&gt;0.114&lt;/td&gt;&lt;td&gt;&amp;#8211;0.50&lt;/td&gt;&lt;td&gt;&amp;#8211;0.80 to &amp;#8211;0.21&lt;/td&gt;&lt;td&gt;0.001&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; Age&lt;/td&gt;&lt;td&gt;1.69&lt;/td&gt;&lt;td&gt;&amp;#8211;2.33 to 5.71&lt;/td&gt;&lt;td&gt;0.410&lt;/td&gt;&lt;td&gt;&amp;#8211;1.66&lt;/td&gt;&lt;td&gt;&amp;#8211;5.09 to 1.77&lt;/td&gt;&lt;td&gt;0.343&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; ESDM study&lt;/td&gt;&lt;td&gt;2.10&lt;/td&gt;&lt;td&gt;12.5 to 2.94&lt;/td&gt;&lt;td&gt;&amp;#60; 0.001&lt;/td&gt;&lt;td&gt;1.22&lt;/td&gt;&lt;td&gt;0.59 to 1.84&lt;/td&gt;&lt;td&gt;&amp;#60; 0.001&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt; JASPER study&lt;/td&gt;&lt;td&gt;1.38&lt;/td&gt;&lt;td&gt;0.36 to 2.40&lt;/td&gt;&lt;td&gt;0.008&lt;/td&gt;&lt;td&gt;1.03&lt;/td&gt;&lt;td&gt;0.17 to 1.88&lt;/td&gt;&lt;td&gt;0.019&lt;/td&gt;&lt;/tr&gt;&lt;/tbody&gt;&lt;/table&gt; </ephtml> </p> <ulist> <item>6 MONSI-CC: measure of NDBI (naturalistic developmental behavioral interventions) strategy implementation-caregiver change; BOSCC: brief observation of social communication change; CI: confidence interval; ADOS: Autism Diagnostic Observation Schedule; CSS: calibrated severity scores; IQ: intelligence quotient; ESDM: Early Start Denver Model; JASPER: joint attention symbolic play engagement and regulation.</item> <item>7 MONSI-CC and BOSCC baseline/intercept correlation –0.49; [a1][b1][c′1] are parameters shown on Figure 3.</item> </ulist> <hd id="AN0185859371-13">Robustness of results to possible correlated measurement error in caregiver and child ratings</hd> <p>[<reflink idref="bib7" id="ref48">7</reflink>] point out that though randomization helps considerably in recovering an unbiased estimate of the intervention on the mediator, there remains the risk of the path from mediator to outcome being biased by the presence of omitted variables. In this instance, the fact that both caregiver and child behavior are obtained from the same segments of interaction means that ephemeral aspects of behavior of the dyadic partners that are correlated (and potentially the result of such omitted variables) could contribute to the correlation from which we are trying to recover the causal effect of caregiver on child. To account for this possibility, rarely considered in standard mediation models, we re-estimated the model of Figure 3, this time allowing for correlated errors for the four pairs of contemporaneous caregiver and child behavior measures. Although this did not give rise to a significant improvement in model fit (LR c2 <emph>p</emph> = 0.064) nor materially change any of the coefficient estimates for the covariates or factor loadings, the inclusion of the error correlation resulted in the estimated causal effect (b1) of MONSI-CC on BOSCC-SC reducing from –0.12 to –0.07 (<emph>p</emph> = 0.096), and the indirect effect of intervention on child BOSCC-SC (a1 × b1) being reduced by 40% to a nonsignificant –0.14 (<emph>p</emph> = 0.117). The total effect remained little changed at –0.36 per month (<emph>p</emph> = 0.179).</p> <p>Additional model specification tests were conducted to allow the intervention (vs control) to have a nonlinear effect over time. This gave entirely nonsignificant improvements in model fit. Models of the form of [<reflink idref="bib18" id="ref49">18</reflink>] that adjusted for measurement error in the mediator failed to converge, likely due to the extent of data imbalance. However, given the high inter-rater reliability for the BOSCC-SC and MONSI-CC reported in the past ([<reflink idref="bib10" id="ref50">10</reflink>]; [<reflink idref="bib14" id="ref51">14</reflink>]; [<reflink idref="bib31" id="ref52">31</reflink>]), the models might not have been expected to alter estimates much.</p> <hd id="AN0185859371-14">Discussion</hd> <p>This study serves as a first step toward better understanding underlying mechanisms in caregiver-mediated NDBIs based on secondary analyses of data obtained from previously conducted RCTs. By combining evidence from studies of three different NDBIs, we found a significant effect of intervention on caregivers, demonstrating that caregivers assigned to the intervention condition showed increased mastery in NDBI strategy implementation than those in the active control group. Second, we found a significant indirect effect of intervention on child outcomes mediated by caregiver NDBI strategy use. Third, we did not find any overall total effect of intervention on child social communication outcomes. The results demonstrate that changes in caregiver implementation of NDBI strategy led to changes in child social communication, with no other significant paths that resulted in intervention-related change in child social communication. Only when models were re-estimated to test extreme scenarios with caregiver–child rating error correlations to account for all possible confounders, rarely considered in standard mediation models, did this become nonsignificant.</p> <p>The residual direct effect of intervention on the BOSCC-SC indicated an unexpected increase in scores (less mature social communication) although the effect was nonsignificant. A caregiver-mediated intervention is built on the assumption that caregiver changes are key to changes in child behaviors, and thus, examining the changes in NDBI implementation in response to the caregiver-mediated NDBIs as a mediator of child outcomes was an essential step, even in the absence of expected, direct effect of intervention on child outcomes. Put another way, child improvement in social communication symptoms was not merely a result of being randomized to the intervention condition, but rather through the mechanism of caregiver mastery of NDBI skills. The results indeed support that targeting caregiver behaviors positively impacts child outcomes and can be accomplished with interventions varying in intensity and dosage, starting with a low-intensity (i.e. 1–3 h per week) to high-intensity (i.e. 10–15 h per week) model. Identifying high-impact, low-intensity models may be particularly important for caregivers supporting intervention programing for their autistic children who frequently report high levels of stress ([<reflink idref="bib26" id="ref53">26</reflink>]). In addition, increased correlations between the caregiver and child scores over time may suggest an increase in the strength of the dyadic synchrony for the intervention group as well. As such, caregivers successfully learning core NDBI strategies taught through each specific NDBI intervention package may be a key mechanism of child reduction in social communication symptoms over the course of caregiver-mediated NDBIs.</p> <p>There are many strengths and limitations of the study. To our knowledge, this is one of the largest examinations of NDBI mechanisms as it relates to caregiver influences on child outcome. This study would not be possible without the willingness of trialist authors to pool data across studies. Although we focused on post hoc harmonization of data, we hope this study serves as a call for future studies to standardize data elements a priori in an effort to build more extensive datasets to better explore mechanisms of caregiver-mediated NDBIs. We used a masked objective coding system targeting core features of ASD, a broad range of social communication behaviors that were common across trials. This study was limited by the use of a single outcome measure (BOSCC) due to no other overlapping outcome measures being used across the three trials. Future studies need to examine whether "specific" caregiver NDBI strategies can also impact more "specific" child outcomes, such as caregiver–child engagement and joint attention. Intervention effects may be also moderated by family and child characteristics. Furthermore, because this study only evaluated three different NDBI packages, it will be important to understand whether outcomes extend to other specific NDBIs; although a recent study has revealed similar results with a pilot RCT ([<reflink idref="bib25" id="ref54">25</reflink>]). For better data harmonization among RCTs of varying lengths and dosage, we selected the data from the first 3 months of caregiver-mediated intervention, the extent of time believed to be required to enact such change. Thus, we do not know whether the effects observed in this study extend beyond the first 3 months.</p> <p>Imbalance and timing variation in the assessments was inevitable because we retrospectively combined a subset of data to apply a uniform coding system across studies with variations in protocols, selection criteria and the relatively low priority given to quality of video of the original studies for coding. This resulted in a large sample size reduction from those originally randomized. Thus, this report can only be considered as an analysis of the intervention mechanism within families where a higher level of study participation was achieved. These challenges were somewhat mitigated by the analyses in this study, which used all available data under the ignorable missing data properties of maximum-likelihood SEM. When the mediation effects were tested while controlling for correlated errors for the four pairs of contemporaneous caregiver and child behavior measures, the evidence was not robust. On the assumption that a causal effect on the child arises from exposure to an improved caregiver interaction over an extended period, we should exclude occasion-specific synchrony between mediator and outcome when calculating the mediated effect. On one hand, permitting correlated errors accounts for both measurement errors and transient influences on the caregiver–child interaction videos, such as temporary mood or health states. On the other hand, using masked behavioral coding techniques should have minimized these effects. This cautious approach comes at the cost of statistical power, leading to broader confidence intervals in any mediated effect estimate. For comparison with other studies, the results from the simpler model, where a significant mediated effect is observed, are most appropriate for interpretation. Meanwhile, the results from the model accounting for correlated errors serve as a cautionary note, underscoring the need for larger consortia to achieve greater confidence in our findings. Furthermore, although almost every child was minimally verbal (or preverbal), 11% to 14% of each study sample consisted of children with phrase or fluent speech, which may have limited the ability of the BOSCC to detect meaningful change in this small subset of children. At the time of behavioral coding, the BOSCC version for phrase speech and verbally fluent young children (PSYF) was still under development. The BOSCC-MV was also used for all cases as scores across different versions of the BOSCC are not standardized. However, future studies will benefit from implementing the different versions of the BOSCC when sample sizes are large enough for different language levels for separate analyses. In addition, although clinician fidelity for all data included in this study was high (all above 75%), we did not have direct access to the clinician fidelity data. Thus, future studies can also examine the association between clinician fidelity and caregiver skill changes and their impact on child outcomes. Finally, the BOSCC and MONSI-CC have shown high reliability and validity in past studies ([<reflink idref="bib10" id="ref55">10</reflink>]; [<reflink idref="bib14" id="ref56">14</reflink>]), including convergent validity with other clinical outcome measures, and thus changes we observed in the past studies and this study have important clinical implications as mentioned above. However, we also acknowledge that there are individual differences in the response rates that are clinically meaningful and the family's perception of these changes. Further studies could examine individual variability in behavioral changes and solicit direct feedback from families about their impression of change, and how these relate to the information gained from more objective measures such as the BOSCC and MONSI-CC.</p> <hd id="AN0185859371-15">Conclusion</hd> <p>This is one of the largest secondary data analyses based on multiple previously conducted RCTs examining the mechanism of NDBIs for young autistic children. Specifically, the results support the mediating role of caregiver mastery in strategy implementation over the course of NDBIs, shedding light on how caregiver-mediated interventions can empower social communication skills in autistic children. Supporting caregivers to increase the use of intervention strategies in NDBI packages is thus an essential component to improve a broad range of social communication, the core need of young autistic children.</p> <hd id="AN0185859371-16">Supplemental Material</hd> <p>Graph: Supplemental material, sj-docx-1-aut-10.1177_13623613251328463 for Caregiver behavioral changes mediate the effects of naturalistic developmental behavioral interventions: Combining evidence from three randomized controlled trials by Deanna Swain, Ji Eun Han, Hallie Brown, Catherine Lord, Sally Rogers, Annette Estes, Connie Kasari, Andrew Pickles and So Hyun Kim in Autism</p> <p>We thank Hannah Thomas at University of Connecticut, Claire Klein at University of North Carolina, and Elysha Clark Whitney at University of Sydney for their contribution with data collection.</p> <ref id="AN0185859371-17"> <title> References </title> <blist> <bibl id="bib1" idref="ref17" type="bt">1</bibl> <bibtext> Bishop S. L., Guthrie W., Coffing M., Lord C. (2011). Convergent validity of the Mullen Scales of Early Learning and the differential ability scales in children with autism spectrum disorders. American Association on Intellectual and Developmental Disabilities, 116, 331–343.</bibtext> </blist> <blist> <bibl id="bib2" idref="ref18" type="bt">2</bibl> <bibtext> Byrne K., Sterrett K., Holbrook A., Kim S. H., Grzadzinski R., Lord C. (2022). Extending the Usefulness of the Brief Observation of Social Communication Change (BOSCC): Validating the phrase speech and young fluent version. Journal of Autism and Developmental Disorders, 54, 1009–1023.</bibtext> </blist> <blist> <bibl id="bib3" idref="ref2" type="bt">3</bibl> <bibtext> Crank J. E., Sandbank M., Dunham K., Crowley S., Bottema-Beutel K., Feldman J., Woynaroski T. G. (2021). Understanding the effects of naturalistic developmental behavioral interventions: A project AIM meta-analysis. Autism Research, 14(4), 817–834.</bibtext> </blist> <blist> <bibl id="bib4" idref="ref34" type="bt">4</bibl> <bibtext> Divan G., Vajaratkar V., Cardozo P., Huzurbazar S., Verma M., Howarth E., Emsley R., Taylor C., Patel V., Green J. (2019). The feasibility and effectiveness of PASS plus, A lay health worker delivered comprehensive intervention for autism spectrum disorders: Pilot RCT in a rural low and middle income country setting. Autism Research, 12(2), 328–339. https://doi.org/10.1002/aur.1978</bibtext> </blist> <blist> <bibl id="bib5" idref="ref38" type="bt">5</bibl> <bibtext> Esler A. N., Bal V. H., Guthrie W., Wetherby A., Weismer S. E., Lord C. (2015). The autism diagnostic observation schedule, toddler module: Standardized severity scores. Journal of Autism and Developmental Disorders, 45(9), 2704–2720. https://doi.org/10.1007/s10803-015-2432-7</bibtext> </blist> <blist> <bibl id="bib6" idref="ref11" type="bt">6</bibl> <bibtext> Frost K. M., Brian J., Gengoux G. W., Hardan A., Rieth S. R., Stahmer A., Ingersoll B. (2020). Identifying and measuring the common elements of naturalistic developmental behavioral interventions for autism spectrum disorder: Development of the NDBI-Fi. Autism, 24(8), 2285–2297.</bibtext> </blist> <blist> <bibl id="bib7" idref="ref45" type="bt">7</bibl> <bibtext> Goldsmith K., MacKinnon D. P., Chalder T., White P. D., Sharpe M., Pickles A. (2018). Tutorial: The practical application of longitudinal structural equation mediation models in clinical trials. Psychological Methods, 23(2), 191.</bibtext> </blist> <blist> <bibl id="bib8" idref="ref39" type="bt">8</bibl> <bibtext> Gotham K., Pickles A., Lord C. (2009). Standardizing ADOS scores for a measure of severity in autism spectrum disorders. Journal of Autism and Developmental Disorders, 39, 693–705.</bibtext> </blist> <blist> <bibl id="bib9" idref="ref29" type="bt">9</bibl> <bibtext> Green J., Leadbitter K., Ellis C., Taylor L., Moore H. L., Carruthers S., James K., Taylor C., Balabanovska M., Langhorne S. (2022). Combined social communication therapy at home and in education for young autistic children in England (PACT-G): A parallel, single-blind, randomised controlled trial. The Lancet Psychiatry, 9(4), 307–320.</bibtext> </blist> <blist> <bibtext> Grzadzinski R., Carr T., Colombi C., McGuire K., Dufek S., Pickles A., Lord C. (2016). Measuring changes in social communication behaviors: Preliminary development of the Brief Observation of Social Communication Change (BOSCC). Journal of Autism and Developmental Disorders, 46, 2464–2479.</bibtext> </blist> <blist> <bibtext> Gulsrud A. C., Hellemann G., Shire S., Kasari C. (2016). Isolating active ingredients in a parent-mediated social communication intervention for toddlers with autism spectrum disorder. Journal of Child Psychology and Psychiatry, 57(5), 606–613.</bibtext> </blist> <blist> <bibtext> Individuals with Disabilities Education Act (IDEA). 20 U.S.C. (2004). §, 1400.</bibtext> </blist> <blist> <bibtext> Kasari C., Lawton K., Shih W., Barker T. V., Landa R., Lord C., Orlich F., King B., Wetherby A., Senturk D. (2014). Caregiver-mediated intervention for low-resourced preschoolers with autism: An RCT. Pediatrics, 134(1), 72–79.</bibtext> </blist> <blist> <bibtext> Kim S. H., Grzadzinski R., Martinez K., Lord C. (2019). Measuring treatment response in children with autism spectrum disorder: Applications of the brief observation of social communication change to the autism diagnostic observation schedule. Autism, 23(5), 1176–1185.</bibtext> </blist> <blist> <bibtext> Kitzerow J., Teufel K., Wilker C., Freitag C. M. (2016). Using the brief observation of social communication change (BOSCC) to measure autism-specific development. Autism Research, 9(9), 940–950.</bibtext> </blist> <blist> <bibtext> Mazurek M. O., Baker-Ericzén M., Kanne S. M. (2019). Brief Report: Calculation and Convergent and Divergent Validity of a New ADOS-2 Expressive Language Score. American Association on Intellectual and Developmental Disabilities, 124, 438–449.</bibtext> </blist> <blist> <bibtext> National Research Council. (2001). Educating children with autism. National Academies Press.</bibtext> </blist> <blist> <bibtext> Pickles A., Harris V., Green J., Aldred C., McConachie H., Slonims V., Le Couteur A., Hudry K., Charman T., Consortium P. (2015). Treatment mechanism in the MRC preschool autism communication trial: Implications for study design and parent-focussed therapy for children. Journal of Child Psychology and Psychiatry, 56(2), 162–170.</bibtext> </blist> <blist> <bibtext> Pickles A., Le Couteur A., Leadbitter K., Salomone E., Cole-Fletcher R., Tobin H., Gammer I., Lowry J., Vamvakas G., Byford S. (2016). Parent-mediated social communication therapy for young children with autism (PACT): Long-term follow-up of a randomised controlled trial. The Lancet, 388(10059), 2501–2509.</bibtext> </blist> <blist> <bibtext> Pijl M. K., Rommelse N. N., Hendriks M., Korte M. W., Buitelaar J. K., Oosterling I. J. (2018). Does the Brief Observation of Social Communication Change help moving forward in measuring change in early autism intervention studies? Autism, 22(2), 216–226.</bibtext> </blist> <blist> <bibtext> Rabe-Hesketh S., Skrondal A., Pickles A. (2004). Generalized multilevel structural equation modeling. Psychometrika, 69, 167–190.</bibtext> </blist> <blist> <bibtext> Rogers S. J., Estes A., Lord C., Munson J., Rocha M., Winter J., Greenson J., Colombi C., Dawson G., Vismara L. A. (2019). A multisite randomized controlled two-phase trial of the Early Start Denver Model compared to treatment as usual. Journal of the American Academy of Child &amp; Adolescent Psychiatry, 58(9), 853–865.</bibtext> </blist> <blist> <bibtext> Sandbank M., Bottema-Beutel K., LaPoint S. C., Feldman J. I., Barrett D. J., Caldwell N., Woynaroski T. (2023). Autism intervention meta-analysis of early childhood studies (Project AIM): Updated systematic review and secondary analysis. British Medical Journal, 383, Article e076733. https://doi.org/10.1136/bmj-2023-076733</bibtext> </blist> <blist> <bibtext> Schreibman L., Dawson G., Stahmer A. C., Landa R., Rogers S. J., McGee G. G., Kasari C., Ingersoll B., Kaiser A. P., Bruinsma Y. (2015). Naturalistic developmental behavioral interventions: Empirically validated treatments for autism spectrum disorder. Journal of Autism and Developmental Disorders, 45, 2411–2428.</bibtext> </blist> <blist> <bibtext> Settanni M., Suma K., Adamson L. B., McConachie H., Servili C., Salomone E. (2023). Treatment mechanism of the WHO caregiver skills training intervention for autism delivered in community settings. Autism Research, 17, 182–194. https://doi.org/10.1002/aur.3058</bibtext> </blist> <blist> <bibtext> Shepherd D., Landon J., Goedeke S. (2018). Symptom severity, caregiver stress and intervention helpfulness assessed using ratings from parents caring for a child with autism. Autism, 22(5), 585–596. https://doi.org/10.1177/1362361316688869</bibtext> </blist> <blist> <bibtext> Sone B. J., Lee J., Roberts M. Y. (2021). Comparing instructional approaches in caregiver-implemented intervention: An interdisciplinary systematic review and meta-analysis. Journal of Early Intervention, 43(4), 339–360.</bibtext> </blist> <blist> <bibtext> StataCorp LLC. (2019). Stata statistical software (Release, 16)</bibtext> </blist> <blist> <bibtext> Swain D., Li Y., Brown H., Petkova E., Lord C., Rogers S., Estes A., Kasari C., Kim S. H. (2024). Implementing a uniform outcome measurement approach for early interventions of autism spectrum disorders. Journal of the American Academy of Child &amp; Adolescent Psychiatry. https://doi.org/10.1016/j.jaac.2024.06.004</bibtext> </blist> <blist> <bibtext> Trembath D., Gurm M., Scheerer N. E., Trevisan D. A., Paynter J., Bohadana G., Roberts J., Iarocci G. (2019). Systematic review of factors that may influence the outcomes and generalizability of parent-mediated interventions for young children with autism spectrum disorder. Autism Research, 12(9), 1304–1321.</bibtext> </blist> <blist> <bibtext> Vibert B. A., Dufek S., Klein C. B., Choi Y. B., Winter J., Lord C., Kim S. H. (2020). Quantifying caregiver change across early autism interventions using the measure of NDBI strategy implementation: Caregiver change (MONSI-CC. Journal of Autism and Developmental Disorders, 50, 1364–1379.</bibtext> </blist> <blist> <bibtext> Wetherby A. M., Guthrie W., Woods J., Schatschneider C., Holland R. D., Morgan L., Lord C. (2014). Parent-implemented social intervention for toddlers with autism: An RCT. Pediatrics, 134(6), 1084–1093.</bibtext> </blist> </ref> <ref id="AN0185859371-18"> <title> Footnotes </title> <blist> <bibtext> DS was involved in the data curation, formal analysis, investigation, methodology visualization, writing—original draft, and writing—review &amp; editing. J.E.H. contributed to the writing—original draft and writing—review &amp; editing. H.B. contributed to the methodology and writing—original draft. C.L. was involved in the conceptualization, data curation, formal analysis, funding acquisition, investigation, methodology, writing—original draft, and writing—review &amp; editing. S.L., A.E., and C.K. were involved in the data curation, writing—original draft, and writing—review &amp; editing. A.P. contributed toward conceptualization, formal analysis, funding acquisition, investigation, methodology, visualization, writing—original draft, and writing—review &amp; editing. S.H.K. was involved in the conceptualization, data curation, formal analysis, funding acquisition, investigation, methodology, project administration, resources, software, supervision, validation, visualization, writing—original draft, and writing—review &amp; editing.</bibtext> </blist> <blist> <bibtext> The author(s) declared the following potential conflicts of interest with respect to the research, authorship, and/or publication of this article: Dr. Lord has received royalties from Western Psychological Services for publication of the Autism Diagnostic Observation Schedule (ADOS). Royalties related to this study were donated to a charity. Dr. Rogers is a developer of the ESDM and receives royalties from the sale of the published ESDM materials. Dr. Kasari is a developer of the JASPER. Dr. Kim received consultation fees from Neudive for the work unrelated to this study.</bibtext> </blist> <blist> <bibtext> The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: The study was funded by the NIMH (R01MH114925; PI Kim), NIMH/NICHD (R01081757; PI Rogers), HRSA/AIR-B (UA3MC11055; PI Kasari), SFARI (PIs Kim and Lord), and the Korean Ministry of Science and ICT of the National Research Foundation of Korea (RS-2023-00209635, RS-2023-00265410, PI Kim; 2023S1A5C2A0709598711, 2023S1A5C2A0709598712, RS-2024-00439474, Co-I Kim; RS-2024-00398768, Co-I Kim).</bibtext> </blist> <blist> <bibtext> Deanna Swain</bibtext> </blist> <blist> <bibtext>Graph</bibtext> </blist> <blist> <bibtext>https://orcid.org/0000-0002-1527-2944 Ji Eun Han</bibtext> </blist> <blist> <bibtext>Graph</bibtext> </blist> <blist> <bibtext>https://orcid.org/0009-0008-4673-7274 Catherine Lord</bibtext> </blist> <blist> <bibtext>Graph</bibtext> </blist> <blist> <bibtext>https://orcid.org/0000-0001-5633-1253 Annette Estes</bibtext> </blist> <blist> <bibtext>Graph</bibtext> </blist> <blist> <bibtext>https://orcid.org/0000-0003-2687-4155 Connie Kasari</bibtext> </blist> <blist> <bibtext>Graph</bibtext> </blist> <blist> <bibl id="bib10" idref="ref15" type="bt"></bibl> <bibtext>https://orcid.org/0000-0003-2266-170X So Hyun Kim</bibtext> </blist> <blist> <bibl id="bib11" idref="ref12" type="bt"></bibl> <bibtext>Graph https://orcid.org/0000-0003-4269-0866</bibtext> </blist> <blist> <bibtext> Supplemental material for this article is available online.</bibtext> </blist> </ref> <aug> <p>By Deanna Swain; Ji Eun Han; Hallie Brown; Catherine Lord; Sally Rogers; Annette Estes; Connie Kasari; Andrew Pickles and So Hyun Kim</p> <p>Reported by Author; Author; Author; Author; Author; Author; Author; Author; Author</p> </aug> <nolink nlid="nl1" bibid="bib24" firstref="ref1"></nolink> <nolink nlid="nl2" bibid="bib23" firstref="ref3"></nolink> <nolink nlid="nl3" bibid="bib12" firstref="ref4"></nolink> <nolink nlid="nl4" bibid="bib17" firstref="ref5"></nolink> <nolink nlid="nl5" bibid="bib19" firstref="ref6"></nolink> <nolink nlid="nl6" bibid="bib32" firstref="ref8"></nolink> <nolink nlid="nl7" bibid="bib27" firstref="ref9"></nolink> <nolink nlid="nl8" bibid="bib30" firstref="ref10"></nolink> <nolink nlid="nl9" bibid="bib18" firstref="ref13"></nolink> <nolink nlid="nl10" bibid="bib31" firstref="ref14"></nolink> <nolink nlid="nl11" bibid="bib29" firstref="ref16"></nolink> <nolink nlid="nl12" bibid="bib22" firstref="ref19"></nolink> <nolink nlid="nl13" bibid="bib13" firstref="ref21"></nolink> <nolink nlid="nl14" bibid="bib15" firstref="ref31"></nolink> <nolink nlid="nl15" bibid="bib20" firstref="ref32"></nolink> <nolink nlid="nl16" bibid="bib14" firstref="ref36"></nolink> <nolink nlid="nl17" bibid="bib16" firstref="ref40"></nolink> <nolink nlid="nl18" bibid="bib28" firstref="ref46"></nolink> <nolink nlid="nl19" bibid="bib21" firstref="ref47"></nolink> <nolink nlid="nl20" bibid="bib26" firstref="ref53"></nolink> <nolink nlid="nl21" bibid="bib25" firstref="ref54"></nolink> |
|---|---|
| Header | DbId: eric DbLabel: ERIC An: EJ1474885 AccessLevel: 3 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Caregiver Behavioral Changes Mediate the Effects of Naturalistic Developmental Behavioral Interventions: Combining Evidence from Three Randomized Controlled Trials – Name: Language Label: Language Group: Lang Data: English – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Deanna+Swain%22">Deanna Swain</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-1527-2944">0000-0002-1527-2944</externalLink>)<br /><searchLink fieldCode="AR" term="%22Ji+Eun+Han%22">Ji Eun Han</searchLink> (ORCID <externalLink term="https://orcid.org/0009-0008-4673-7274">0009-0008-4673-7274</externalLink>)<br /><searchLink fieldCode="AR" term="%22Hallie+Brown%22">Hallie Brown</searchLink><br /><searchLink fieldCode="AR" term="%22Catherine+Lord%22">Catherine Lord</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-5633-1253">0000-0001-5633-1253</externalLink>)<br /><searchLink fieldCode="AR" term="%22Sally+Rogers%22">Sally Rogers</searchLink><br /><searchLink fieldCode="AR" term="%22Annette+Estes%22">Annette Estes</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-2687-4155">0000-0003-2687-4155</externalLink>)<br /><searchLink fieldCode="AR" term="%22Connie+Kasari%22">Connie Kasari</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-2266-170X">0000-0003-2266-170X</externalLink>)<br /><searchLink fieldCode="AR" term="%22Andrew+Pickles%22">Andrew Pickles</searchLink><br /><searchLink fieldCode="AR" term="%22So+Hyun+Kim%22">So Hyun Kim</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-4269-0866">0000-0003-4269-0866</externalLink>) – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="SO" term="%22Autism%3A+The+International+Journal+of+Research+and+Practice%22"><i>Autism: The International Journal of Research and Practice</i></searchLink>. 2025 29(7):1835-1848. – Name: Avail Label: Availability Group: Avail Data: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com – Name: PeerReviewed Label: Peer Reviewed Group: SrcInfo Data: Y – Name: Pages Label: Page Count Group: Src Data: 14 – Name: DatePubCY Label: Publication Date Group: Date Data: 2025 – Name: SourceSuprt Label: Sponsoring Agency Group: SrcSuprt Data: National Institute of Mental Health (NIMH) (DHHS/NIH)<br />Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD) (DHHS/NIH)<br />Health Resources and Services Administration (HRSA) (DHHS) – Name: NumberContract Label: Contract Number Group: NumCntrct Data: R01MH114925<br />R01081757 – Name: TypeDocument Label: Document Type Group: TypDoc Data: Journal Articles<br />Reports - Research – Name: Subject Label: Descriptors Group: Su Data: <searchLink fieldCode="DE" term="%22Child+Caregivers%22">Child Caregivers</searchLink><br /><searchLink fieldCode="DE" term="%22Behavior+Change%22">Behavior Change</searchLink><br /><searchLink fieldCode="DE" term="%22Intervention%22">Intervention</searchLink><br /><searchLink fieldCode="DE" term="%22Behavior+Modification%22">Behavior Modification</searchLink><br /><searchLink fieldCode="DE" term="%22Young+Children%22">Young Children</searchLink><br /><searchLink fieldCode="DE" term="%22Autism+Spectrum+Disorders%22">Autism Spectrum Disorders</searchLink><br /><searchLink fieldCode="DE" term="%22Child+Development%22">Child Development</searchLink><br /><searchLink fieldCode="DE" term="%22Behavior+Development%22">Behavior Development</searchLink><br /><searchLink fieldCode="DE" term="%22Interpersonal+Communication%22">Interpersonal Communication</searchLink><br /><searchLink fieldCode="DE" term="%22Program+Effectiveness%22">Program Effectiveness</searchLink> – Name: Subject Label: Geographic Terms Group: Su Data: <searchLink fieldCode="DE" term="%22Michigan%22">Michigan</searchLink><br /><searchLink fieldCode="DE" term="%22California%22">California</searchLink><br /><searchLink fieldCode="DE" term="%22Washington%22">Washington</searchLink><br /><searchLink fieldCode="DE" term="%22Florida%22">Florida</searchLink> – Name: DOI Label: DOI Group: ID Data: 10.1177/13623613251328463 – Name: ISSN Label: ISSN Group: ISSN Data: 1362-3613<br />1461-7005 – Name: Abstract Label: Abstract Group: Ab Data: Naturalistic developmental behavioral interventions target developmentally appropriate skills in young children with autism spectrum disorders using behavioral techniques in naturalistic interactions. Naturalistic developmental behavioral interventions demonstrate strong empirical support and frequently utilize caregiver training of intervention strategies. However, our understanding of the mechanisms of change linked to naturalistic developmental behavioral interventions remains limited. Based on retrospective, secondary data analyses from three previously conducted randomized controlled trials of caregiver-mediated naturalistic developmental behavioral interventions, this study examined the direct effect of intervention on caregiver naturalistic developmental behavioral intervention strategy use and how caregiver changes mediate intervention effects on children's social communication. A total of 419 videos from 229 dyads consisting of autistic children (M = 32.5 months/ages 1-5 years) and caregivers were included in analyses using the masked ratings of the measure of naturalistic developmental behavioral intervention strategy implementation-caregiver changes (MONSI-CC) and brief observation of social communication change (BOSCC-SC). Using longitudinal mediation analyses, we examined the mediation effect of caregiver behavioral changes on children's outcomes. Results demonstrated a significant intervention effect on changes of caregiver naturalistic developmental behavioral intervention strategy use (MONSI-CC) and of changes of caregiver strategy use (MONSI-CC) on child social communication change (BOSCC-SC) scores, but no overall total effect of intervention on changes of child social communication (BOSCC-SC). This study demonstrates the mediating role of caregiver behavior on the child intervention response, a first step toward better understanding underlying mechanisms in naturalistic developmental behavioral interventions. – Name: AbstractInfo Label: Abstractor Group: Ab Data: As Provided – Name: DateEntry Label: Entry Date Group: Date Data: 2025 – Name: AN Label: Accession Number Group: ID Data: EJ1474885 |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1474885 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1177/13623613251328463 Languages: – Text: English PhysicalDescription: Pagination: PageCount: 14 StartPage: 1835 Subjects: – SubjectFull: Child Caregivers Type: general – SubjectFull: Behavior Change Type: general – SubjectFull: Intervention Type: general – SubjectFull: Behavior Modification Type: general – SubjectFull: Young Children Type: general – SubjectFull: Autism Spectrum Disorders Type: general – SubjectFull: Child Development Type: general – SubjectFull: Behavior Development Type: general – SubjectFull: Interpersonal Communication Type: general – SubjectFull: Program Effectiveness Type: general – SubjectFull: Michigan Type: general – SubjectFull: California Type: general – SubjectFull: Washington Type: general – SubjectFull: Florida Type: general Titles: – TitleFull: Caregiver Behavioral Changes Mediate the Effects of Naturalistic Developmental Behavioral Interventions: Combining Evidence from Three Randomized Controlled Trials Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Deanna Swain – PersonEntity: Name: NameFull: Ji Eun Han – PersonEntity: Name: NameFull: Hallie Brown – PersonEntity: Name: NameFull: Catherine Lord – PersonEntity: Name: NameFull: Sally Rogers – PersonEntity: Name: NameFull: Annette Estes – PersonEntity: Name: NameFull: Connie Kasari – PersonEntity: Name: NameFull: Andrew Pickles – PersonEntity: Name: NameFull: So Hyun Kim IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 07 Type: published Y: 2025 Identifiers: – Type: issn-print Value: 1362-3613 – Type: issn-electronic Value: 1461-7005 Numbering: – Type: volume Value: 29 – Type: issue Value: 7 Titles: – TitleFull: Autism: The International Journal of Research and Practice Type: main |
| ResultId | 1 |