Factors Associated with Implementation of a School-Based Comprehensive Program for Students with Autism

Saved in:
Bibliographic Details
Title: Factors Associated with Implementation of a School-Based Comprehensive Program for Students with Autism
Language: English
Authors: Odom, Samuel L. (ORCID 0000-0003-1745-7915), Sam, Ann M. (ORCID 0000-0003-3808-445X), Tomaszewski, Brianne
Source: Autism: The International Journal of Research and Practice. Apr 2022 26(3):703-715.
Availability: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Peer Reviewed: Y
Page Count: 13
Publication Date: 2022
Sponsoring Agency: Institute of Education Sciences (ED)
Contract Number: R324A150047
Document Type: Journal Articles
Reports - Research
Education Level: Elementary Education
Descriptors: Students with Disabilities, Autism, Pervasive Developmental Disorders, Intervention, Elementary School Students, Program Implementation, Transformational Leadership, Principals, Racial Composition, Coaching (Performance), Professional Development, Teamwork, Evidence Based Practice
DOI: 10.1177/13623613211070340
ISSN: 1362-3613
1461-7005
Abstract: The purpose of this study was to examine influences on the implementation of a school-based comprehensive program for autistic children. Following the conceptual framework suggested by the Exploration, Preparation, Implementation, Sustainment (EPIS) model, variables from the outer context, inner context, and also that were part of the comprehensive program were explored. An index approach was employed for assessing implementation. The study was part of a larger cluster randomized control trial and took place in 39 elementary schools in a southeastern state within the United States. Variables associated with implementation were transformational leadership style of the principal, percentage of students in the school who were white, and adequacy of coaching. Implications for practice and future research were identified.
Abstractor: As Provided
IES Funded: Yes
Entry Date: 2022
Accession Number: EJ1333811
Database: ERIC
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
    Url: https://content.ebscohost.com/cds/retrieve?content=AQICAHj0k_4E0hTGH8RJwT4gCJyBsGNe_WN95AvKlDbXJGqwxwEkMQdZc2-IiIaYH_E-cZYAAAAA4jCB3wYJKoZIhvcNAQcGoIHRMIHOAgEAMIHIBgkqhkiG9w0BBwEwHgYJYIZIAWUDBAEuMBEEDEfNCF2dfCCxY7NsOQIBEICBmmn7khJ9Zh8ipShYlKlV18mffV703doTOsn2wBsPldLDethTpBqVmlMYvuFckH-_NlrSR9z7dH4YruaNWVdUoEYtXkTcJocyWrOmk1MK0QzSWNF-u1gF6X3biQGxUtuTx2j3SNzBdkUcECXlbFgyxDFQBulOgxfqAsvQYWYG4ShC54I2JzDFEuPsGCJO_RfrUsaB5ei0Up9Np80=
Text:
  Availability: 1
  Value: <anid>AN0155828400;f9d01apr.22;2022Mar22.02:36;v2.2.500</anid> <title id="AN0155828400-1">Factors associated with implementation of a school-based comprehensive program for students with autism </title> <p>The purpose of this study was to examine influences on the implementation of a school-based comprehensive program for autistic children. Following the conceptual framework suggested by the Exploration, Preparation, Implementation, Sustainment (EPIS) model, variables from the outer context, inner context, and also that were part of the comprehensive program were explored. An index approach was employed for assessing implementation. The study was part of a larger cluster randomized control trial and took place in 39 elementary schools in a southeastern state within the United States. Variables associated with implementation were transformational leadership style of the principal, percentage of students in the school who were white, and adequacy of coaching. Implications for practice and future research were identified. The purpose of this study was to identify influences on the implementation of a school-based, comprehensive program for autistic students. Influences from the community context, from within the school organization, and from features of the intervention itself were examined. The study took place in 39 elementary schools in a southeastern state in the United States. Transformational leadership style of the building principal, percentage of white students at the school (which was proposed as a broader community socioeconomic variable), and adequacy of coaching were all associated with implementation.</p> <p>Keywords: autism; comprehensive program; education services; implementation; interventions; psychosocial/behavioral</p> <p>The rising prevalence of autism has created a pressing need for effective programs that address learning goals for autistic students attending public school programs.[<reflink idref="bib5" id="ref1">5</reflink>] Responding to this demand, researchers have designed comprehensive programs to promote autistic children's development and learning. As these comprehensive programs move out of their efficacy testing phases and into adoption by service providers in the community, they are only as good as their implementation. One of the primary community contexts in which children with autism spend significant time is public schools ([<reflink idref="bib24" id="ref2">24</reflink>]). To date, there have been few examinations of variables that are associated with implementation of a comprehensive program in a public school context. The purpose of the current study is to employ a frequently used conceptual model of implementation, the framework (EPIS; [<reflink idref="bib3" id="ref3">3</reflink>]), in the examination of factors associated with the implementation of a public school-based comprehensive program for autistic students.</p> <p>The prevalence of autism has accelerated over the past three decades, with the prevalence in the United States, reported by the Center on Disease Control and Intervention ([<reflink idref="bib26" id="ref4">26</reflink>]) being one in 44 elementary school-aged children. The defining impairments of autism, social, communication and restrictive/repetitive behavior ([<reflink idref="bib5" id="ref5">5</reflink>]), create lifelong challenges for many individuals with autism. Primary efforts and funding have been directed toward establishing practices and programs that are efficacious and generate positive effects for children and youth with autism. Two general classes of interventions exist—focused intervention practices and comprehensive programs ([<reflink idref="bib34" id="ref6">34</reflink>]).</p> <p>Focused intervention practices address targeted, individual goals for autistic children (e.g. a prompting practice to promote a peer social communication goal). In a recent review of the autism intervention literature, [<reflink idref="bib16" id="ref7">16</reflink>] identified 28 focused intervention practices that met their criteria for evidence-based practice (EBP). Comprehensive programs consist of specific focused intervention practices organized within a conceptual framework ([<reflink idref="bib33" id="ref8">33</reflink>]). Examples of comprehensive programs are the Early Start Denver Model ([<reflink idref="bib39" id="ref9">39</reflink>]), the LEAP model ([<reflink idref="bib48" id="ref10">48</reflink>]), the Lovaas model, and other similar early intensive behavioral interventions ([<reflink idref="bib25" id="ref11">25</reflink>]).</p> <p>As the number of children and youth with autism has increased markedly in public school settings ([<reflink idref="bib37" id="ref12">37</reflink>]), there is a corollary need for comprehensive programs to be employed in schools. There has been a long history of comprehensive programs employed in school contexts for preschool-aged children, with the LEAP model ([<reflink idref="bib48" id="ref13">48</reflink>]) being a primary example of such research. For older autistic children, the intervention research in school settings has tended to examine more the implementation of individual evidence-based practices and teachers' uses of those practices with fidelity ([<reflink idref="bib15" id="ref14">15</reflink>]). In the recent autism intervention literature, examinations of school-based comprehensive programs have begun to appear. For example, pivotal response treatment (PRT, [<reflink idref="bib20" id="ref15">20</reflink>]; [<reflink idref="bib42" id="ref16">42</reflink>]) is a comprehensive program originally used in clinic and community contexts. [<reflink idref="bib51" id="ref17">51</reflink>] extended their implementation of PRT to kindergarten classrooms in public schools, documenting the associations of contextual variables on implementation. In high-school programs, [<reflink idref="bib15" id="ref18">15</reflink>] examined the effectiveness of a comprehensive program for adolescents, finding effects on quality of the school program environment and autistic students' goal attainment. Similarly, in elementary schools, [<reflink idref="bib41" id="ref19">41</reflink>] tested the efficacy of a comprehensive program originally designed and evaluated by the National Professional Development Center on Autism Spectrum Disorders (NPDC, [<reflink idref="bib35" id="ref20">35</reflink>]) and found an increase in school staff fidelity of EBPs and autistic students' goal attainment.</p> <p>Examinations of implementation of comprehensive programs in public schools are unique in at least two ways. First, as [<reflink idref="bib17" id="ref21">17</reflink>] noted, the school context is itself dynamic (e.g. staff turnover and varying schedules) and complex (e.g. range of different implementers and autistic students having different learning goals). Second, comprehensive programs consist of a number of "moving parts" (e.g. multiple focused intervention practices, multiple implementers, etc.) that require an assessment of implementation that extends beyond only measurement of fidelity of one or two focused intervention practices. Third, because they are situated in a community context and also operate within a more immediate school building context, factors that are distal from and proximal to the settings in which teachers and service providers employ a comprehensive program may well affect implementation.</p> <p>In implementation science, formal models of implementation have proliferated over the last two decades ([<reflink idref="bib4" id="ref22">4</reflink>]). To examine factors affecting implementation of comprehensive programs in school-based contexts, the EPIS model developed by [<reflink idref="bib3" id="ref23">3</reflink>] provides a useful conceptual framework. The model consists of outer (distal) and inner (proximal) context factors, bridging factors, and innovation factors (i.e. specific features of the program or practice) that may affect the degree to which a program is implemented. Also, there are precedents for using the EPIS conceptual framework in examinations of implementation factors in school-based interventions ([<reflink idref="bib51" id="ref24">51</reflink>]), early intervention ([<reflink idref="bib9" id="ref25">9</reflink>]), and community-based mental health programs ([<reflink idref="bib7" id="ref26">7</reflink>]).</p> <p>For school-based comprehensive programs, outer context factors might include the urbanicity (e.g. urban and rural), which has been associated with autism program quality ([<reflink idref="bib21" id="ref27">21</reflink>]) and the socioeconomic status (SES) or by proxy the racial/ethnic demographic of students in the school (i.e. better-resourced schools may be better able to support implementation). Internal contextual factors could include the leadership style within the school, with the principal being the titular leader in the schools. The multifactor leadership questionnaire (MLQ; [<reflink idref="bib6" id="ref28">6</reflink>]) has been used to identify three leadership styles, with the transformational style expected to support implementation and the transactional and passive styles to be not or negatively associated with implementation ([<reflink idref="bib19" id="ref29">19</reflink>]; [<reflink idref="bib27" id="ref30">27</reflink>]). In addition, the quality of the overall autism program environment and specifically the quality of collaboration among professional team members could be inner environment constructs positively associated with implementation ([<reflink idref="bib12" id="ref31">12</reflink>]). Another inner context variable previously discussed as having a positive association with implementation is practitioner attitude toward evidence-based practices, as often measured by the Evidence-based Practices Attitude Scale (EBPAS; [<reflink idref="bib1" id="ref32">1</reflink>]; [<reflink idref="bib23" id="ref33">23</reflink>]). Last, coaching by project staff for teachers or other practitioners is often seen as an important construct significantly associated with implementation ([<reflink idref="bib49" id="ref34">49</reflink>]). The adequacy of coaching provided may be associated with the degree to which implementation occurred (i.e. adequate coaching positively associated with implementation and inadequate coaching negatively associated with implementation).</p> <p>The current study was conducted as part of a larger cluster randomized controlled trial (CRCT) that examined the efficacy of the comprehensive program developed by the NPDC, previously noted, and delivered in elementary schools in a southeastern part of the United States ([<reflink idref="bib41" id="ref35">41</reflink>]). Sixty elementary schools were randomly assigned on a 2:1 ratio to the NPDC (i.e. actually only 39 schools in this condition with one dropping out) or services as usual condition (SAU). Only the schools implementing the NPDC program are included in this study. A key feature of the NPDC program is the formation of an implementation team (i.e. called the autism team or A-team) before the school year begins. Members of the A-team were special and general education teachers, speech-language pathologists, school psychologist, other related service providers, and a member of the school administrative team (i.e. often an assistant principal). Other features of the NPDC program included initial training for the A-team before the school year, assessment of the autism program environment and development of an action plan for improving school quality, identification of autistic students' learning goals, linking specific EBPs to identified learning goals, monitoring progress and weekly coaching on use of EBPs with performance-based feedback on teacher fidelity (i.e. as measured by the percentage of steps completed correctly on EBP fidelity checklists). The program was implemented in inclusive and special education classrooms in the schools and involved autistic students across grade levels. A detailed description of the NPDC program and efficacy study may be found in [<reflink idref="bib41" id="ref36">41</reflink>].</p> <p>The aim of the current study was to examine variables associated with implementation of the NPDC program in elementary schools. The research questions were: (<reflink idref="bib1" id="ref37">1</reflink>) Are there outer context variables associated with implementation of the NPDC programs? We predicted that there would be a positive association between variables reflecting socioeconomic resources in the community and implementation. Based on previous research, also we anticipated a positive correlation between urbanity and implementation. (<reflink idref="bib2" id="ref38">2</reflink>) Are there inner context variables associated with implementation of the NPDC program? We predicted that leadership style (i.e. positive association for transformative, neutral or negative for transactional and passive), autism program environment quality and the specific domain of team collaboration (i.e. positive association), and teacher attitude toward EBPs (i.e. positive correlation). (<reflink idref="bib3" id="ref39">3</reflink>) Is there an association between the adequacy of coaching, as an innovation variable, and implementation? We predicted a significant association between adequacy of coaching and implementation.</p> <hd id="AN0155828400-2">Methods</hd> <p></p> <hd id="AN0155828400-3">Setting and community participation</hd> <p>As noted, the current study included the 39 publicly funded, community-based elementary schools in the NPDC program intervention condition from the study of [<reflink idref="bib41" id="ref40">41</reflink>]. These schools were purposively recruited to represent the demographics of the state in which it occurred and the diverse demographics of the students and families. Before random assignment in the CRCT, superintendents or district supervisors were first contacted and indicated their agreement to participate. They then referred the research staff on to principals, who communicated with their teachers and then agreed for their school to participate. The study was first approved by the Human Subjects Committee at the host university, and informed consent was obtained from all school personnel and for all autistic student participation (via parent consent and student assent).</p> <p>The schools were located in a southeastern state in the United States with representation from urban (n = 16), suburban (n = 12), and rural (n = 11) locales. An inclusion criterion was that schools provided special education services for children in both separate special education settings and inclusive general education settings. On average, 44% of schools' total student population was identified as white (i.e. 56% from various racial and/or ethnic groups), and 55% of students qualified for free and reduced lunch (FARL). The majority of schools (71.8%) were identified as Title One schools.</p> <p>As this study took place in a single state, investigators employed the Generalizability Index to determine the extent to which findings from the current study could be generalized to other schools in the United States ([<reflink idref="bib53" id="ref41">53</reflink>]). The Generalizability Index assesses the degree to which the sample is representative of a population ([<reflink idref="bib52" id="ref42">52</reflink>]). It produces scores which range from 0 to 1 with scores between 1.0 and 90 representing very high generalizability, 0.90 and 0.80 as high generalizability, 0.80 and 0.50 as medium generalizability, and scores below 0.50 as low generalizability. The schools in the current study were very highly representative of other schools in the United States with a Generalizability Index score of 0.92.</p> <hd id="AN0155828400-4">Participants</hd> <p>School personnel participants were the 369 members identified as members of the A-team. There was an average of 9.4 members per A-team. The majority of A-team members were white, non-Hispanic, and women (see Table 1). In the NPDC program study condition from the study of [<reflink idref="bib41" id="ref43">41</reflink>], 344 autistic children participated. The demographics for those children and their families appear in Table 2. Demographics for the entire sample were reported in [<reflink idref="bib41" id="ref44">41</reflink>].</p> <p>Graph</p> <p>Table 1. A-team demographics.</p> <p> <ephtml> <table><colgroup><col align="left" /><col align="char" char="." /><col align="char" char="." /></colgroup><thead><tr><th /><th align="left" colspan="2">Total</th></tr><tr><th /><th align="left">N</th><th align="left">%</th></tr></thead><tbody><tr><td colspan="3">Race and ethnicity</td></tr><tr><td> American Indian/Alaska native</td><td>2</td><td>0.50</td></tr><tr><td> Asian</td><td>4</td><td>1.1</td></tr><tr><td> Black</td><td>55</td><td>14.9</td></tr><tr><td> Hispanic</td><td>8</td><td>2.2</td></tr><tr><td> Multiracial</td><td>2</td><td>0.50</td></tr><tr><td> Other</td><td>1</td><td>0.30</td></tr><tr><td> White</td><td>305</td><td>82.7</td></tr><tr><td colspan="3">Gender</td></tr><tr><td> Male</td><td>19</td><td>5.1</td></tr><tr><td> Female</td><td>350</td><td>94.9</td></tr><tr><td colspan="3">Education</td></tr><tr><td> High-school diploma</td><td>2</td><td>0.5</td></tr><tr><td> Associates degree</td><td>4</td><td>1.1</td></tr><tr><td> Bachelor's degree</td><td>162</td><td>43.9</td></tr><tr><td> Master's degree</td><td>190</td><td>51.5</td></tr><tr><td> Above Master's degree</td><td>11</td><td>3.0</td></tr><tr><td colspan="3">Role</td></tr><tr><td> Special education teacher</td><td>142</td><td>38.5</td></tr><tr><td> General education teacher</td><td>147</td><td>39.8</td></tr><tr><td> Paraprofessional</td><td>6</td><td>1.6</td></tr><tr><td> Speech-language pathologist</td><td>35</td><td>9.5</td></tr><tr><td> Occupational therapist</td><td>7</td><td>1.9</td></tr><tr><td> Counselor</td><td>2</td><td>0.5</td></tr><tr><td> Psychologist</td><td>6</td><td>1.6</td></tr><tr><td> Administrator</td><td>17</td><td>4.6</td></tr><tr><td> District/building specialist</td><td>1</td><td>0.5</td></tr><tr><td> Other</td><td>5</td><td>1.4</td></tr></tbody></table> </ephtml> </p> <p>Graph</p> <p>Table 2. Child and family demographics.</p> <p> <ephtml> <table><colgroup><col align="left" /><col align="char" char="." /><col align="char" char="." /></colgroup><thead><tr><th /><th align="left" colspan="2">NPDC</th></tr><tr><th /><th align="left">N</th><th align="left">%</th></tr></thead><tbody><tr><td colspan="3">Child race and ethnicity<xref ref-type="table-fn" rid="tfn1">a</xref></td></tr><tr><td> Asian</td><td>21</td><td>6.1</td></tr><tr><td> Black</td><td>89</td><td>25.9</td></tr><tr><td> Hispanic<xref ref-type="table-fn" rid="tfn2">b</xref></td><td>56</td><td>16.3</td></tr><tr><td> Multiracial</td><td>22</td><td>6.4</td></tr><tr><td> Other</td><td>6</td><td>1.7</td></tr><tr><td> White</td><td>150</td><td>43.6</td></tr><tr><td colspan="3">Child gender</td></tr><tr><td> Male</td><td>266</td><td>77.3</td></tr><tr><td> Female</td><td>78</td><td>22.7</td></tr><tr><td colspan="3">Child grade</td></tr><tr><td> Kindergarten</td><td>53</td><td>15.4</td></tr><tr><td> 1st</td><td>59</td><td>17.2</td></tr><tr><td> 2nd</td><td>69</td><td>20.1</td></tr><tr><td> 3rd</td><td>53</td><td>15.4</td></tr><tr><td> 4th</td><td>53</td><td>15.4</td></tr><tr><td> 5th</td><td>55</td><td>16.0</td></tr><tr><td> Other</td><td>2</td><td>0.6</td></tr><tr><th /><th align="left">M</th><th align="left">SD</th></tr><tr><td>Child age</td><td>8.40</td><td>1.83</td></tr><tr><td>Estimate of annual household income<xref ref-type="table-fn" rid="tfn3">c</xref></td><td>58,533</td><td>24,558</td></tr><tr><td>Nonverbal IQ</td><td>78.91</td><td>24.89</td></tr><tr><td>Adaptive behavior ABC</td><td>68.72</td><td>17.40</td></tr><tr><td>Social communication questionnaire lifetime</td><td>20.97</td><td>7.03</td></tr></tbody></table> </ephtml> </p> <p>1 No report of race/ethnicity for one student.</p> <ulist> <item>2 Self identified as White/Hispanic.</item> <item>3 Annual household income estimated from families address and census information because of degree of missing data from parent self-report.</item> </ulist> <hd id="AN0155828400-5">Implementation variable</hd> <p>Given that an index approach is somewhat unique in autism intervention research, a short rationale is provided here. Comprehensive programs that are applied school-wide are like complex social interventions from other disciplines ([<reflink idref="bib17" id="ref45">17</reflink>]) in that they consist of multiple dimensions. The implementation index (IIdx) approach was designed to assess those multiple dimensions. Based on Cordray's ([<reflink idref="bib10" id="ref46">10</reflink>]; [<reflink idref="bib32" id="ref47">32</reflink>]) conceptualization of implementation of educational interventions in school context, the IIdx assesses (<reflink idref="bib1" id="ref48">1</reflink>) the intervention delivered to the school personnel (e.g. training and coaching); (<reflink idref="bib2" id="ref49">2</reflink>) the intervention that the school personnel deliver to the student; and (<reflink idref="bib3" id="ref50">3</reflink>) the intervention received by the individual students. Reflecting this conceptualization, the current IIdx included information at the school (e.g. training and coaching provided), staff (e.g. fidelity and teaming), and student (e.g. planning and dosage) levels. In a previous study, [<reflink idref="bib47" id="ref51">47</reflink>] designed and employed an index like this for a comprehensive program for autistic adolescents in high schools, and [<reflink idref="bib15" id="ref52">15</reflink>] found that it discriminated between schools employing the intervention programs and schools under the SAU condition.</p> <p>For the current study, the IIdx consists of six core features of the NPDC program: (<reflink idref="bib1" id="ref53">1</reflink>) A team formation; (<reflink idref="bib2" id="ref54">2</reflink>) participation on the A-team; (<reflink idref="bib3" id="ref55">3</reflink>) professional development for the A team; (<reflink idref="bib4" id="ref56">4</reflink>) program quality activities; (<reflink idref="bib5" id="ref57">5</reflink>) goal attainment scaling (GAS) goal development; and (<reflink idref="bib6" id="ref58">6</reflink>) EBPs (see [<reflink idref="bib41" id="ref59">41</reflink>] for more detailed information). Each item was scored on a 3-point rating scale with 1 as incomplete, 2 as partially complete, and 3 as complete. Research staff collected records and information needed to complete the scale across the entire year. Examples of data are consent forms, attendance at training academies, and completion of GAS. The specific data sources may be found on the IIdx form itself, located in the Supplementary Materials. In the spring of the year, the research team assembled the data, and the research project director used the data to score a rating for each item (see [<reflink idref="bib41" id="ref60">41</reflink>] for additional details). The internal consistency reliability of the scale, as measured by Cronbach's alpha, was 0.88. To assess discriminant validity, [<reflink idref="bib41" id="ref61">41</reflink>] completed the IIdx rating on 20 elementary schools that served as the SAU comparison in the CRCT. They found significantly higher IIdx ratings for schools under the NPDC program condition as compared with school under the SAU condition.</p> <hd id="AN0155828400-6">Predictor variables</hd> <p>As noted, in the EPIS model, [<reflink idref="bib3" id="ref62">3</reflink>] identified critical implementation influences that occur in the outer and inner contexts as well as innovation practices. In the efficacy study described in [<reflink idref="bib41" id="ref63">41</reflink>], variables that reflected some of these implementation influences were collected, which allowed an examination of their association with implementation of the NPDC program.</p> <hd id="AN0155828400-7">EPIS variables (outer context)</hd> <p>The outer context variables describe the community setting demographics, the racial diversity of the school student body, the socioeconomic demographics of the community, and relatedly the state's classification of the school as a Title 1 school (or not). These data were collected at the beginning of the academic year. The community in which the school resided was classified as urban or rural (as defined by the National Center on Educational Statistics, https://nces.ed.gov/programs/maped/LocaleLookup/). The racial/ethnic diversity of the school was defined as the percentage of the study body identified as white, which by inference indicates the percentage of students from diverse (nonwhite or Hispanic) racial/ethnic groups. The data sources did not provide a further breakdown of race/ethnicity demographics at the school level. However, the number of autistic students in specific ethnic groups in this implementation study is reported in Table 2. The percentage of children qualifying for FARL reflected the socioeconomic status of families from the community that was the catchment area for the school. State criteria for qualification for FARL were based on federal eligibility guidelines for the year the school participated in the study (see https://<ulink href="http://www.fns.usda.gov/cn/income-eligibility-guidelines">www.fns.usda.gov/cn/income-eligibility-guidelines</ulink>). Similarly, the state designated schools as Title 1 based on the student socioeconomic and achievement factors, which provides the schools with additional resources (than non-Title 1 schools) for the educational mission for all students.</p> <hd id="AN0155828400-8">EPIS variables (inner context)</hd> <p>To explore the inner context of the EPIS model, variables related to school leadership, A-team staff attitudes toward EBPs, and program quality were used. Leadership was measured using the MLQ ([<reflink idref="bib6" id="ref64">6</reflink>]). The MLQ assesses behaviors representative of key leadership and effectiveness behaviors. It includes 45 items rated on a 5-point scale indicating the frequency of specific leader behaviors. The MLQ has demonstrated high internal consistency in the normative sample (α's = 0.63–0.92; [<reflink idref="bib6" id="ref65">6</reflink>]) and implementation studies (α's = 0.68–0.96; [<reflink idref="bib45" id="ref66">45</reflink>]) of EBPs in elementary schools for students with autism. In the current sample, the MLQ demonstrated high internal consistency (Cronbach's alphas = 0.88–0.93). The MLQ generates three leadership styles: (<reflink idref="bib1" id="ref67">1</reflink>) transformational (characterized as charismatic and intellectually stimulating); (<reflink idref="bib2" id="ref68">2</reflink>) transactional (characterized as individualized consideration and contingent reward); and (<reflink idref="bib3" id="ref69">3</reflink>) passive (characterized as laissez-faire and reactive). Members of the A-team completed the MLQ (N = 358) on the school principal, who is the traditional educational leader at the school building level, in the spring semester of the academic year. Because individual A team members are nested within schools, the MLQ scores were averaged across respondents, generating one profile for each school.</p> <p>To assess A-team members' attitudes about EBPs, A-team members completed the EBPAS ([<reflink idref="bib1" id="ref70">1</reflink>]) in the fall of the academic year. The EBPAS is a 15-item scale, with the items having a 0–4 rating Likert-type form. It provides a total score and scores for four subscales, with both having strong psychometric evidence. The EBPAS has been used previously to examine the association of teacher attitude and use of interventions for autistic children (e.g. [<reflink idref="bib51" id="ref71">51</reflink>]). For the purposes of this study, the total score was used.</p> <p>It was possible that implementation might be related to the existing quality of the schools before the implementation began (e.g. high-quality schools might be higher implementers than low-quality schools). For this study, quality was defined as the degree to which school program features and service meet the learning needs and characteristics of autistic students. To examine program quality at the beginning of the year, research staff used the preschool/elementary version of the autism program environment rating scale (APERS-PE) ([<reflink idref="bib36" id="ref72">36</reflink>]). The APERS-PE is a 59-item rating scale organized into 10 domains (learning environment, positive learning climate, assessment and IEP development, curriculum and instruction, communication, social competence, personal independence, family involvement, and teaming). Items are scored on a 5-point Likert-type rating continuum with a "1" rating indicating poor quality, a "3" rating indicating acceptable quality, and a "5" item indicating excellent quality. Raters complete the scale after observing in classes, interviewing key informants (e.g. teachers, parents, and A-team members), and reviewing documents. The APERS-PE was collected in both separate special education and inclusive settings at each school by research staff, and a weighted total APERS-PE score was calculated (see [<reflink idref="bib41" id="ref73">41</reflink>]). In previous research, [<reflink idref="bib36" id="ref74">36</reflink>] found high levels of internal consistency, adequate interrater agreement, and evidence of construct validity (i.e. from exploratory and confirmatory factor analyses) for the APERS. Similar internal consistency (<emph>a</emph> = 0.93 and 0.96 for special education and inclusive setting) and high interrater agreement from 20% of the classes (intraclass correlation coefficient (ICCs) = 0.97 and 0.98 for special education and inclusive classes) for the current study were previously reported in [<reflink idref="bib41" id="ref75">41</reflink>].</p> <p>The APERS total score was the metric employed for the school quality variable, with a prediction of a positive association with implementation. Also, the APERS has a domain identified as teaming, which reflected general collaboration among school personnel providing services to autistic students, and it was possible that schools with pre-existing high-quality teaming and collaboration among staff could have been better implementers, which was the prediction for this study.</p> <hd id="AN0155828400-9">Innovation</hd> <p>Implementation science indicates that coaching is a key influence on program implementation ([<reflink idref="bib54" id="ref76">54</reflink>]). The adequacy of coaching was used as an indicator of the innovation feature of the EPIS model. For the NPDC program, coaches were to spend 6 hours/week at each intervention school and followed the NPDC professional development program for coaching (see [<reflink idref="bib41" id="ref77">41</reflink>]). Coaching consisted of a preobservation meeting, observations, and postobservation debriefs (see [<reflink idref="bib22" id="ref78">22</reflink>]). Thirteen professionals with previous experience in schools were recruited to be coaches, trained to deliver the coaching feature of the program, and supervised by the project director and a second coaching supervisor. Despite initial training, the two supervisors determined that inadequate coaching was occurring for four of the coaches who were responsible for nine schools. The inadequacies in coaching were defined by failing to follow coaching protocol, inadequate coaching plans and engaging in interactions that resulted in complaints from teachers about professional behavior. This resulted in termination for one staff member, retraining other staff members, and surveillance with direct feedback for the staff members that remained. Given the importance of coaching, this disruption could have affected the overall implementation of the NPDC program. A dichotomous variable (0–1 coding) was established as a school that had adequate (0) or not-adequate coaching (<reflink idref="bib1" id="ref79">1</reflink>) support across the year. As such, we predicted a negative association between disruption in coaching and implementation (i.e. because of this reverse scoring, it also inferred a positive association of adequate coaching and implementation).</p> <hd id="AN0155828400-10">Data analysis</hd> <p>Descriptive statistics were used to examine the distribution of the IIdx items and domains across the NPDC schools. Bivariate correlations were first examined among the IIdx, and predictor variables as just defined. In that associations were predicted to occur in a specific direction (i.e. positive or negative), one-tailed tests were used with an alpha of <emph>p</emph> < 0.05. In a subsequent table, the predicted direction of the analysis is noted. It is important to note that measures completed by individual respondents in the school (e.g. EBPASs, MLQ) were aggregated (i.e. nested) at the school level to create comparability with other school-level variables (i.e. APERS-PE and IIdx). Significant predictors of IIdx scores from the bivariate correlation analysis were then selected for a final multiple regression analysis.</p> <hd id="AN0155828400-11">Results</hd> <p></p> <hd id="AN0155828400-12">Implementation index</hd> <p>The mean IIdx rating for the NPDC classes was 2.50, with a range of 2.09–2.91 across schools. However, the IIdx provides more detailed information about the specific features of implementation that were relatively strong or a challenge, which is found on the profile in Figure 1. The mean ratings (with one standard deviations range) indicated that the relatively strong features of implementation were the A-team, preparation of the A-team, program quality, and using EBPs. Professional development and measurement of student outcomes were the lower scoring domains. Disaggregating the scores into the percentage of schools that received ratings on individual items allows a closer examination of program features that were relatively strong and those that were more limited in implementation (see Table 3). For example, for 17 or the 22 implementation items (i.e. bolded in the table), over 80% of the schools were rated either two or three levels of implementation. Features of implementation that were low (i.e. more than 20% of school scored a "1") were involvement of related services professionals on the A-team, completing autism-focused intervention materials and resources modules (AFIRMs, [<reflink idref="bib40" id="ref80">40</reflink>]; https://afirm.fpg.unc.edu/), and goal writing. Notably, a high percentage of schools' staff did not collect sufficient data to establish baseline performance on the GAS, but conversely, when research staff checked the accuracy of the GAS rating by observing and completing the GAS independently, the levels of agreement were high.</p> <p>Graph: Figure 1. Mean rating with one standard deviation range for IIdx profile and total ratings.</p> <p>Graph</p> <p>Table 3. Frequency of schools (percentage of schools) for each implementation index rating.</p> <p> <ephtml> <table><colgroup><col align="left" /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /></colgroup><thead><tr><th align="left">Implementation index item</th><th align="left">1</th><th align="left">2</th><th align="left">3</th></tr></thead><tbody><tr><td><bold>1. Included program teacher representatives of study students with ASD</bold></td><td><bold>1 (2.6)</bold></td><td><bold>8 (20.5)</bold></td><td><bold>30 (76.0)</bold></td></tr><tr><td><bold>2. Included at least one administrator or representative from school</bold></td><td><bold>2 (5.1)</bold></td><td><bold>0 (0)</bold></td><td><bold>37 (94.9)</bold></td></tr><tr><td> 3. Included relevant related service professionals for study students</td><td>8 (20.5)</td><td>2 (5.1)</td><td>29 (74.4)</td></tr><tr><td><bold>4. % of A-team members attending team meetings during the year</bold></td><td><bold>6 (15.4)</bold></td><td><bold>11 (28.2)</bold></td><td><bold>22 (56.4)</bold></td></tr><tr><td><bold>5. A-team met at least 4 times during the school year</bold></td><td><bold>0 (0)</bold></td><td><bold>1 (2.6)</bold></td><td><bold>38 (97.4)</bold></td></tr><tr><td><bold>6. % of A-team attending training academy</bold></td><td><bold>7 (17.9)</bold></td><td><bold>9 (23.1)</bold></td><td><bold>23 (59.0)</bold></td></tr><tr><td><bold>7. % A-team members completed 4 online sessions on ASD</bold></td><td><bold>7 (17.9)</bold></td><td><bold>8 (20.5)</bold></td><td><bold>24 (61.5)</bold></td></tr><tr><td> 8. % of staff responsible for writing study student goals attending GAS training/coaching</td><td>23 (59.0)</td><td>7 (17.9)</td><td>9 (23.1)</td></tr><tr><td> 9. A-team members complete at least one AFIRM web-based EBP training</td><td>20 (51.3)</td><td>6 (15.4)</td><td>13 (33.3)</td></tr><tr><td><bold>10. Pre-APERS/debrief completed within 10</bold><bold>weeks of start of school year</bold></td><td><bold>3 (7.7)</bold></td><td><bold>2 (5.1)</bold></td><td><bold>34 (87.2)</bold></td></tr><tr><td><bold>11. SIAP developed in 2 needs areas based on APERS results</bold></td><td><bold>0 (0)</bold></td><td><bold>3 (7.7)</bold></td><td><bold>36 (92.3)</bold></td></tr><tr><td><bold>12. % of SIAP activities completed</bold></td><td><bold>6 (15.4)</bold></td><td><bold>8 (20.5)</bold></td><td><bold>25 (64.1)</bold></td></tr><tr><td><bold>13. Post-APERS completed within 8</bold><bold>weeks of end of school year</bold></td><td><bold>0 (0)</bold></td><td><bold>0 (0)</bold></td><td><bold>100 (39)</bold></td></tr><tr><td><bold>14. Student team (primary teacher(s), research staff) identified three priority IEP goals across each student's need areas (e.g. academic, behavior, social, and communication)</bold></td><td><bold>0 (0)</bold></td><td><bold>24 (61.5)</bold></td><td><bold>15 (38.5)</bold></td></tr><tr><td>15. Student team wrote priority goals (single target) in measurable and observable manner</td><td>11 (28.2)</td><td>14 (35.9)</td><td>14 (35.9)</td></tr><tr><td><bold>16. Student team scaled priority goals using PET-Goal Attainment Scaling following criteria</bold></td><td><bold>4 (10.3)</bold></td><td><bold>14 (35.9)</bold></td><td><bold>24 (53.8)</bold></td></tr><tr><td>17. Student team scaled priority goals based on stable baseline data (trend with 3 data points)</td><td>35 (89.7)</td><td>3 (7.7)</td><td>1 (2.6)</td></tr><tr><td><bold>18. Teacher GAS ratings found to be consistent with observational checks of 20% of goals</bold></td><td><bold>2 (5.1)</bold></td><td><bold>5 (12.8)</bold></td><td><bold>32 (82.1)</bold></td></tr><tr><td><bold>19. Student team identified EBPs to address student goals (at least one EBP per goal) at the beginning of the school year</bold></td><td><bold>0 (0)</bold></td><td><bold>1 (2.6)</bold></td><td><bold>35 (97.4)</bold></td></tr><tr><td><bold>20. NPDC coach spends an average of 6 hours/week at each intervention school when school is in session (not assessment times)</bold></td><td><bold>0 (0)</bold></td><td><bold>12 (30.8)</bold></td><td><bold>27 (69.2)</bold></td></tr><tr><td><bold>21. Coach communicates (maintains contact) every week with each student team to address needs during coaching and intervention time (not assessment times)</bold></td><td><bold>4 (10.3)</bold></td><td><bold>3 (7.7)</bold></td><td><bold>32 (82.1)</bold></td></tr><tr><td><bold>22. Coach and team assessed EBP fidelity of implementation</bold></td><td><bold>7 (17.9)</bold></td><td><bold>7 (17.9)</bold></td><td><bold>25 (64.1)</bold></td></tr></tbody></table> </ephtml> </p> <p>4 AFIRM: autism-focused intervention materials and resources module; APERS: autism program environment rating scale; ASD: autism spectrum disorder; EBP: evidence-based practice; GAS: goal attainment scaling; IEP: Individualized Education Plan; NPDC: National Professional Development Center; SIAP: school improvement action plan. Bold indicates items for which over 80% of school scored 2 or 3 rating.</p> <hd id="AN0155828400-13">Bivariate correlation</hd> <p>Pearson product moment correlations were computed among the total IIdx rating and predictor variables. The predictor variables for were including the outer context were percentage of White students at schools, percentage of students qualifying for FARL, and urbanicity. For the inner context, the variables were leadership types (i.e. transformational, transactional, and passive leadership), attitudes about use of EBPs (EBPAS), and school program quality (APERS-PE total mean rating and teaming domain), The adequacy of coaching was the single innovation (see Table 4 for the correlation matrix). A "+" or "−" indicator signaled the anticipated direction of the correlation, with the anticipated hypothesized directions for the correlation noted in previous sections, which allowed us to conduct a one-tailed test of significance. The IIdx was significantly correlated with transformational leadership (<emph>r</emph> = 0.28, <emph>p</emph> = 0.04, R<sups>2</sups> = 0.078), Coaching (<emph>r</emph> = −0.29, <emph>p</emph> = 0.04, R<sups>2</sups> = 0.084), and percentage White students at the school (<emph>r</emph> = 0.31, <emph>p</emph> = 0.03, R<sups>2</sups> = 0.096). See Table 4 for the full correlation matrix. In addition, variables designed to assess similar constructs, such as leadership profiles, teacher beliefs, classroom quality, and community demographics often correlated with one another if not necessarily the IIdx. For example, the variables that were indicators of socioeconomic status of the community in which the schools were located (i.e. FARL, Title 1 schools) as well as percentage of white students in the school.</p> <p>Graph</p> <p>Table 4. Pearson product moment correlations between variables.</p> <p> <ephtml> <table><colgroup><col align="left" /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /></colgroup><thead><tr><th /><th align="left">IIdx</th><th align="left">Transformational leadership</th><th align="left">Transactional leadership</th><th align="left">Passive leadership</th><th align="left">EBPAStotal</th><th align="left">APERSteaming</th><th align="left">APERS total</th><th align="left">Coaching</th><th align="left">% White</th><th align="left">FARL</th><th align="left">Title 1</th><th align="left">urban</th></tr></thead><tbody><tr><td>Transformational leadership (+)</td><td>0.28<xref ref-type="table-fn" rid="tfn5">*</xref></td><td>1</td><td>.</td><td /><td /><td /><td /><td /><td /><td /><td /><td /></tr><tr><td>Transactional leadership (−)</td><td>0.12</td><td>0.63<xref ref-type="table-fn" rid="tfn5">**</xref></td><td>1</td><td /><td /><td /><td /><td /><td /><td /><td /><td /></tr><tr><td>Passive leadership (−)</td><td>−0.26</td><td>−0.70<xref ref-type="table-fn" rid="tfn5">**</xref></td><td>−0.23</td><td>1</td><td /><td /><td /><td /><td /><td /><td /><td /></tr><tr><td>EBPAS total (+)</td><td>0.08</td><td>0.20</td><td>−0.08</td><td>−0.29<xref ref-type="table-fn" rid="tfn5">*</xref></td><td>1</td><td /><td /><td /><td /><td /><td /><td /></tr><tr><td>APERS teaming (+)</td><td>0.26</td><td>0.18</td><td>−0.02</td><td>−0.28<xref ref-type="table-fn" rid="tfn5">*</xref></td><td>0.20</td><td>1</td><td /><td /><td /><td /><td /><td /></tr><tr><td>APERS total (+)</td><td>0.23</td><td>0.12</td><td>−0.04</td><td>−0.24</td><td>0.17</td><td>0.84<xref ref-type="table-fn" rid="tfn5">**</xref></td><td>1</td><td /><td /><td /><td /><td /></tr><tr><td>Coaching (−)</td><td>−0.29<xref ref-type="table-fn" rid="tfn5">*</xref></td><td>−0.08</td><td>0.08</td><td>0.12</td><td>0.09</td><td>−0.04</td><td>−0.01</td><td>1</td><td /><td /><td /><td /></tr><tr><td> % White (+)</td><td>0.31<xref ref-type="table-fn" rid="tfn5">*</xref></td><td>0.06</td><td>0.07</td><td>−0.01</td><td>−0.05</td><td>0.24</td><td>0.14</td><td>−0.00</td><td>1</td><td /><td /><td /></tr><tr><td> % FARL (−)</td><td>−0.04</td><td>−0.14</td><td>−0.01</td><td>0.08</td><td>−0.09</td><td>−0.40<xref ref-type="table-fn" rid="tfn5">**</xref></td><td>−0.43<xref ref-type="table-fn" rid="tfn5">**</xref></td><td>0.03</td><td>−0.56<xref ref-type="table-fn" rid="tfn5">**</xref></td><td>1</td><td /><td /></tr><tr><td>Title 1 (−)</td><td>−0.08</td><td>−0.31<xref ref-type="table-fn" rid="tfn5">*</xref></td><td>−0.15</td><td>0.18</td><td>−0.18</td><td>−0.27</td><td>−0.29<xref ref-type="table-fn" rid="tfn5">*</xref></td><td>0.01</td><td>−0.46<xref ref-type="table-fn" rid="tfn5">**</xref></td><td>0.72<xref ref-type="table-fn" rid="tfn5">**</xref></td><td>1</td><td>.</td></tr><tr><td>Urban (−)</td><td>−0.19</td><td>−0.10</td><td>−0.22</td><td>−0.064</td><td>0.23</td><td>−0.05</td><td>0.07</td><td>−0.18</td><td>−0.52<xref ref-type="table-fn" rid="tfn5">**</xref></td><td>0.08</td><td>0.06</td><td>1</td></tr><tr><td>Rural (+)</td><td>0.23</td><td>0.10</td><td>0.28<xref ref-type="table-fn" rid="tfn5">*</xref></td><td>−0.001</td><td>0.09</td><td>0.05</td><td>−0.17</td><td>0.11</td><td>0.60<xref ref-type="table-fn" rid="tfn5">**</xref></td><td>−0.02</td><td>−0.11</td><td>−0.52<xref ref-type="table-fn" rid="tfn5">**</xref></td></tr></tbody></table> </ephtml> </p> <p>5 EBPAS: Evidence-Based Practices Attitude Scale; FARL: free and reduced lunch; IIdx: implementation index.* = <emph>p</emph> <.05, ** = <emph>p</emph> <.01</p> <hd id="AN0155828400-14">Multiple regression</hd> <p>To understand the influences associated with implementation and suggested by the EPIS framework, a multiple regression analysis was conducted. Because this was a relatively small sample and power was an issue, we selected the three predictors that were significantly associated with the IIdx (i.e. transformational leadership, percentage of white students within a school, and coaching) rather than loading all predictor variables into the regression model. Overall, the regression analysis was significant, <emph>F</emph> (<reflink idref="bib3" id="ref81">3</reflink>, 35) = 3.66, <emph>p</emph> = 0.021. Together these predictors accounted for 17.4% of the variance in implementation. This percentage of variance was greater than for any of the single variable in isolation. Table 5 includes the coefficient parameters from the model.</p> <p>Graph</p> <p>Table 5. Coefficients of regression model of implementation index.</p> <p> <ephtml> <table><colgroup><col align="left" /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /></colgroup><thead><tr><th align="left" rowspan="2">Predictors</th><th align="left" colspan="2">Unstandardized coefficients</th><th align="left">Standardized coefficients</th><th align="left" rowspan="2">t</th><th align="left" rowspan="2"><italic>p</italic></th><th align="left" colspan="2">95% confidence interval for B</th></tr><tr><th align="left">B</th><th align="left">Std. error</th><th align="left">Beta</th><th align="left">Lower bound</th><th align="left">Upper bound</th></tr></thead><tbody><tr><td>(Constant)</td><td>2.09</td><td>0.20</td><td /><td>10.50</td><td><0.001</td><td>1.68</td><td>2.49</td></tr><tr><td>Transformational leadership</td><td>0.10</td><td>0.06</td><td>0.24</td><td>1.63</td><td>0.11</td><td>−0.03</td><td>0.23</td></tr><tr><td>% of white students at schools</td><td>0.003</td><td>0.001</td><td>0.30</td><td>2.00</td><td>0.05</td><td>0.00</td><td>0.01</td></tr><tr><td>Coaching</td><td>−0.12</td><td>0.06</td><td>−0.27</td><td>−1.85</td><td>0.07</td><td>−0.25</td><td>0.01</td></tr></tbody></table> </ephtml> </p> <hd id="AN0155828400-15">Discussion</hd> <p>Following the conceptual framework suggested by the EPIS model, this study examined a variety of variables associated with the implementation of the NPCD program for elementary-aged students with autism. The first research question asked if there were variables from the outer context associated with implementation. The single outer context variable associated significantly with implementation was the percentage of white students enrolled in the elementary schools. That is, implementation was more successfully accomplished in schools that had higher proportions of white students as compared with schools having a relatively higher proportion of students who were nonwhite. This variable may also be a proxy for a larger variable related to socioeconomic status of the community in that percentage of white students was significantly negatively correlated with FARL and Title 1 school classification. Outside of the autism literature, others have discussed the association between community socioeconomic status and resources available to schools ([<reflink idref="bib14" id="ref82">14</reflink>]; [<reflink idref="bib44" id="ref83">44</reflink>]). Alternatively, schools with a higher percentage of white students may have had greater pressure from the community (e.g. parents) to employ innovative services for children with autism. It is also possible that if implementation of a comprehensive program is a barometer, this could be an indirect reflection of inequities in services that might exist for students who have been historically marginalized. This issue should certainly be addressed in future work.</p> <p>The second research question was related to inner context factors. Inner context variables assessed in this study were leadership style, teacher attitude and beliefs about EBPs, and autism program quality. The single inner context variable significantly associated with the IIdx was transformational leadership style. This finding is consistent with other studies that have found leadership to be a primary influence on implementation ([<reflink idref="bib29" id="ref84">29</reflink>]; [<reflink idref="bib45" id="ref85">45</reflink>]; [<reflink idref="bib46" id="ref86">46</reflink>]; [<reflink idref="bib51" id="ref87">51</reflink>]). Notably, the type of leadership is the key factor. Authors of the MLQ ([<reflink idref="bib6" id="ref88">6</reflink>]) characterize transformational leadership as "a process (that)... changes their associates' awareness of what is important" and "seeks to optimize individual, group, and organizational development... not just to achieve performance at expectations" (p. 103). These qualities are quite consistent with the dimension of leadership that [<reflink idref="bib2" id="ref89">2</reflink>] identified as facilitative of implementation. Transactional leadership, while focusing on clear expectations and contingent rewards, lack the inspirational qualities of transformational leadership. In addition, passive/avoidant leadership "does not respond to situations or problems systematically" and "avoids specifying agreement, clarifying expectations, and providing goals and standards" (p. 105). As noted, the previous literature suggested that both of these styles of leadership are either neutrally or negatively associated with implementation ([<reflink idref="bib19" id="ref90">19</reflink>]; [<reflink idref="bib27" id="ref91">27</reflink>]). The results of this study are consistent with these previous findings.</p> <p>The other inner context variables were not associated with the IIdx. Previous literature and program developers have suggested that teachers' attitudes and beliefs about EBPs are associated with implementation ([<reflink idref="bib13" id="ref92">13</reflink>]; [<reflink idref="bib23" id="ref93">23</reflink>]; [<reflink idref="bib50" id="ref94">50</reflink>]). This association was not found in the current study, which does not mean that the relationship is not important or does not exist in other contexts. It is possible that the teacher belief-implementation relationship could be affected by other variables. In the current study, the EBPAS data were aggregated across members of the A-team to account for nesting within schools. Previous studies had analyzed data at the individual respondent level, and this methodological difference may have affected the results. Attitudes and beliefs are complex variables in the implementation equation and certainly deserve further focused study.</p> <p>The third question addressed the association between coaching and implementation. Coaching has been seen as a primary variable affecting implementation ([<reflink idref="bib49" id="ref95">49</reflink>]), but there has been little discussion in the education implementation literature about variation in the delivery of coaching. In the current study, a subset of coaches on this research project "under-performed" to the extent that an administrative decision was made to take corrective actions and this classification of inadequacy was associated negatively with implementation. The implication of the negative association of inadequate coaching with the II is that a certain level of "adequate" coaching may be associated with sufficient implementation. This was a serendipitous finding that deserves further study. Other researchers in the field are increasingly recognizing the importance of the knowledge about EBPs competencies needed for technical assistance providers ([<reflink idref="bib31" id="ref96">31</reflink>]), competencies needed for personnel supporting implementation ([<reflink idref="bib43" id="ref97">43</reflink>]), and training models for implementation teams ([<reflink idref="bib11" id="ref98">11</reflink>]).</p> <p>It is important to note that in this study implementation was not perfect nor would one expect it to be. Comprehensive, school-based programs, such as the NPDC program, are similar to complex service programs seen in other disciplines ([<reflink idref="bib17" id="ref99">17</reflink>]; [<reflink idref="bib28" id="ref100">28</reflink>]). Implementation consists of multiple features rather than a single implementation outcome such as a fidelity assessment of a single focused intervention practices. The advantage of the index approach used in this study is that it provides a summative metric of overall implementation and also displays the "peaks and valleys" of implementation components. The implementation profile indicated generally strong engagement (i.e. adoption) of the school personnel, which [<reflink idref="bib38" id="ref101">38</reflink>] have noted as an important implementation feature. Also, there was a strong focus on program quality, which [<reflink idref="bib35" id="ref102">35</reflink>] noted as a key feature of the NPDC program. The relatively less strong implementation features were delivery of professional development (i.e. A-team members attending training on goal attainment, completion of online trainings on autism and EBPs), and measurement of student outcomes (i.e. influenced mainly by the absence of teachers' data collection during instruction). However, even with these "valleys," in the [<reflink idref="bib41" id="ref103">41</reflink>] report, teachers' delivery of EBPs was relatively high (2.5/3.0).</p> <p>In their systematic review, [<reflink idref="bib30" id="ref104">30</reflink>] noted that there have not been empirical examinations of the association of the EPIS model with implementation. In the current study, the EPIS model served as the conceptual framework for examining variables associated with the implementation of the NPDC program in community schools. Outer, inner, and innovations variables proposed in the EPIS model were associated with implementation. While this study did not empirically validate the EPIS model, it did demonstrate the model's value as a heuristic process for examining variables related to influence on implementation.</p> <p>The current study had several limitations. The first primary limitation is that there were only 39 schools in the sample, which limited the power to detect some correlations that may have been significant if there have been more schools in the study. Second, all of the schools in the study were in one state, and although the context features of the schools as indicated by the Generalizability coefficient were representative of the larger population of schools in the United States. However, the Generalizer analysis does not assess state regulations or policies that are unique to this state and could affect external validity. Third, even when significant individual correlation coefficients tended to be relatively small. This indicated that other variables account for variance in implementation. Fourth, in this study of implementation authors were somewhat limited by the variables collected in the larger CRCT. A direction for future research could be to conduct a more prospective study in which variables could be more directly aligned with or reflective of the EPIS or other implementation model selected to guide the study. In addition, the modest correlations could be attributed to the error variance associated with the IIdx. However, the index did have a high level of internal consistency and some evidence of discriminative validity. Last, a large number of correlations were computed in this analysis, which could have led to, if it had been an experimental study, type 1 errors. Generally, the high correlations among variables within the outer and inner context variable, respectively, and the absence of significant correlations across the two context variable classes (and the innovation variable) could provide some confidence that the findings were not spurious.</p> <p>In conclusion, drawing practical implications and recommendations for future research from a correlational study is risky in that one is does not have causal evidence generated from experimental demonstrations of effects. Given that caveat, the findings from the current study reinforce the messages that have come out of the implementation science literature previously, but now as applied to school-based programs. First, the demographics of the community and students in a school may influence the success of implementation, possibly due to the availability of resources, although there could be other influential factors as well (e.g. school culture and parent advocacy). Second, leadership at the school level is important, with transformational leadership styles appearing to be most influential for implementation. Third, adequate coaching is important. The assumption that assigning a coach to a school and expecting implementation to automatically occur, without monitoring the quality of coaching, may be faulty. These are all factors about which school leaders should be aware when implementing new programs for autistic students in school settings and also important directions for future research.</p> <hd id="AN0155828400-16">Supplemental Material</hd> <p>sj-docx-1-aut-10.1177_13623613211070340.docx</p> <p>sj-docx-1-aut-10.1177_13623613211070340 – Supplemental material for Factors associated with implementation of a school-based comprehensive program for students with autism</p> <p></p> <p>Supplemental material, sj-docx-1-aut-10.1177_13623613211070340 for Factors associated with implementation of a school-based comprehensive program for students with autism by Samuel L Odom, Ann M Sam and Brianne Tomaszewski in Autism</p> <p></p> <ref id="AN0155828400-17"> <title> References </title> <blist> <bibl id="bib1" idref="ref32" type="bt">1</bibl> <bibtext> Aarons G. A., Cafri G., Lugo L., Sawitzky A. (2012). Expanding the domains of attitudes towards evidence-based practice: The Evidence-Based Practice Attitude Scale-50. Administration and Policy in Mental Health and Mental Health Services Research, 39(3), 331–340. https://doi.org/10.1007/s10488-010-0302-3</bibtext> </blist> <blist> <bibl id="bib2" idref="ref38" type="bt">2</bibl> <bibtext> Aarons G. A., Ehrhart M. G., Farahnak L. R., Sklar M. (2014). Aligning leadership across systems and organizations to develop a strategic climate for evidence-based practice implementation. Annual Review of Public Health, 35(1), 255–274. https://doi.org/10.1146/annurev-publhealth-032013-182447</bibtext> </blist> <blist> <bibl id="bib3" idref="ref3" type="bt">3</bibl> <bibtext> Aarons G. A., Hurlburt M., Horwitz S. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 4–23. https://doi.org/10.1007/s10488-010-0327-7</bibtext> </blist> <blist> <bibl id="bib4" idref="ref22" type="bt">4</bibl> <bibtext> Albers B., Milton R., Lyons A. R., Shlonsky A. (2017). Implementation frameworks in child, youth, and family services: Results from a scoping review. Child and Youth Services, 81, 101–116. https://doi.org/10.1016/j.childyouth.2017.07.003</bibtext> </blist> <blist> <bibl id="bib5" idref="ref1" type="bt">5</bibl> <bibtext> American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.).</bibtext> </blist> <blist> <bibl id="bib6" idref="ref28" type="bt">6</bibl> <bibtext> Bass B. M., Avolio B. J. (1995). MLQ: Multifactor Leadership Questionnaire (Technical report, Center for Leadership Studies, Binghamton University, Binghamton, NY).</bibtext> </blist> <blist> <bibl id="bib7" idref="ref26" type="bt">7</bibl> <bibtext> Brookman-Frazee L., Chlebowski C., Suhrheinrich J., Finn N., Dickson K. S., Aarons G. A., Stahmer A. (2020). Characterizing shared and unique implementation influences in two community services systems for autism: Applying the EPIS Framework to two large-scale autism intervention community effectiveness trials. Administration and Policy in Mental Health, 47(2), 176–187. https://doi.org/10.1007/s10488-019-00931-4</bibtext> </blist> <blist> <bibl id="bib8" type="bt">8</bibl> <bibtext> Brown L. (2011). The significance of semantics: Person-first language: Why it matters, 4 August. <ulink href="http://www.autistichoya.com/2011/08/significance-of-semantics-person-first.html">http://www.autistichoya.com/2011/08/significance-of-semantics-person-first.html</ulink></bibtext> </blist> <blist> <bibl id="bib9" idref="ref25" type="bt">9</bibl> <bibtext> Bustos T. A., Sridhar A., Drahota A. (2021). Implementation evaluation of an early intensive behavioral intervention program across three agencies serving young children with Autism: A mixed methods study. Children and Youth Services Review, 122, Article 105871. https://doi.org/10.1016/j.childyouth.2020.105871</bibtext> </blist> <blist> <bibtext> Cordray D. S., Pion G. M., Brandt C., Molefe A. (2013, March). The impact of the Measures of Academic Progress (MAP) program on student reading achievement [Paper presentation]. Spring Conference of the Society for Research on Educational Effectiveness, Washington, DC. https://files.eric.ed.gov/fulltext/ED564093.pdf</bibtext> </blist> <blist> <bibtext> Damschroder L. J., Yankey N. R., Robinson C. H., Freiag M. B., Burnes J. A., Raffa S. D., Lowery J. C. (2021). The LEAP Program: Quality improvement training to address team readiness gaps identified by implementation science findings. Journal of General Internal Medicine, 36(2), 288–295. https://doi.org/10.1007/s11606-020-06133-1</bibtext> </blist> <blist> <bibtext> Donaldson A. L., Stahmer A. C. (2014). Team collaboration: The use of behavior principles for serving students with ASD. Language, Speech, and Hearing Services in Schools, 45(4), 261–276. https://doi.org/10.1044/2014_LSHSS-14-0038</bibtext> </blist> <blist> <bibtext> Drahota A., Aarons G. A., Stahmer A. C. (2012). Developing the autism model of implementation for autism spectrum disorder community providers: Study protocol. Imple-mentation Science, 7, Article 85. https://doi.org/10.1186/1748-5908-7-85</bibtext> </blist> <blist> <bibtext> Hanson M. J., Miller A. D., Diamond K., Odom S., Lieber J., Butera G.,...Fleming K. (2011). Neighborhood community risk influences on preschool children's development and school readiness. Infants & Young Children, 24(1), 87–100.</bibtext> </blist> <blist> <bibtext> Hume K., Odom S. L., Steinbrenner J. R., DaWalt L. S., Kraemer B., Tomaszewski B., Brum C., Szidon K., Bolt D. (2021). Efficacy of a school-based comprehensive intervention program for adolescents with autism. Exceptional Children, online. https://doi:10.1177/00144029211062589</bibtext> </blist> <blist> <bibtext> Hume K., Steinbrenner J. R., Odom S. L., Morin K. L., Nowell S. W., Tomaszewski B., Szendrey S., McIntyre N. S., Yücesoy-Özkan S., Savage M. N. (2021). Evidence-based practices for children, youth, and young adults with autism: Third generation review. Journal of Autism and Developmental Disorders, 51, 4013–4032. https://doi.org/10.1007/s10803-020-04844-2</bibtext> </blist> <blist> <bibtext> Kainz K., Metz A., Yazejian N. (2021). Tools for evaluating the implementation of complex interventions. American Journal of Evaluation, 42(3), 399–414. https://doi.org/10.1177/1098214020958490</bibtext> </blist> <blist> <bibtext> Kenny L., Hattersley C., Molins B., Buckley C., Povey C., Pellicano E. (2016). Which terms should be used to describe autism? Perspectives from the UK autism community. Autism, 20(4), 442–462. https://doi.org/10.1177/1362361315588200</bibtext> </blist> <blist> <bibtext> Kensbock J. M., Boehm S. A. (2016). The role of transformational leadership in the mental health and job performance of employees with disabilities. The International Journal of Human Resource Management, 27(14), 1580–1609. https://doi.org/10.1080/09585192.2015.1079231</bibtext> </blist> <blist> <bibtext> Koegel R. L., Koegel L. (2019). Pivotal response treatment for autism spectrum disorders. Brookes.</bibtext> </blist> <blist> <bibtext> Kraemer B. R., Odom S. L., Tomaszewski B., Hall L. J., DaWalt L., Hume K. A., Steinbrenner J. R., Szidon K., Brum C. (2020). Quality of high school programs for students with autism spectrum disorder. Autism, 24(3), 707–717. https://doi.org/10.1177/1362361319887280</bibtext> </blist> <blist> <bibtext> Kucharczyk S., Shaw E., Myles B. S., Sullivan L., Szidon K., Tuchman-Ginsberg L. (2012). Guidance & coaching on evidence-based practices for learners with autism spectrum disorders [National Professional Development Center on Autism Spectrum Disorders, University of North Carolina at Chapel Hill]. https://autismpdc.fpg.unc.edu/sites/autismpdc.fpg.unc.edu/files/imce/documents/NPDC_CoachingManual.pdf</bibtext> </blist> <blist> <bibtext> Locke J., Lawson G. M., Beidas R. S., Aarons G. A., Xie M., Lyon A. R., Stahmer A., Seidman M., Fredrick L., Oh C., Spaulding C., Dorsey S., Mandell D. (2019). Individual and organizational factors that affect implementation of evidence-based practices for children with autism in public schools: A cross-sectional observational study. Implementation Science, 14, Article 29. https://doi.org/10.1186/s13012-019-0877-3</bibtext> </blist> <blist> <bibtext> Lord C., Charman T., Havdahl A., Carbone P., Anagnostou E., Boyd B., Carr T.,...McCauley J. B. (2021). The Lancet Commission on future care and clinical research in autism. Lancet. Advance online publication. https://doi.org/10.1016/S0140-6736(21)01541-5</bibtext> </blist> <blist> <bibtext> Lovaas O. I. (1987). Behavioral treatment and normal educational and intellectual functioning in young autistic children. Journal of Consulting and Clinical Psychology, 55(1), 3–9. https://doi.org/10.1037/0022-006x.55.1.3</bibtext> </blist> <blist> <bibtext> Maenner M. J., Shaw K. A., Bakian A. V., Bilder D. A., Durkin M. S., Esler A., Furnier S. M.,...Cogswell M. E. (2021). Prevalence and characteristics of autism spectrum disorder among children aged 8 years—Autism and developmental disabilities monitoring network, 11 sites, United States, 2018. Morbidity and Mortality Weekly Report, 70(11), 1–16. https://doi.org/10.15585/mmwr.ss7011a1</bibtext> </blist> <blist> <bibtext> Maier M. P., Pate J. L., Gibson N. M., Hilgert L., Hull K., Campbell P. C. (2016). A quantitative examination of school leadership and response to intervention. Learning Disabilities Research & Practice, 31, 103–112. https://doi.org/10.1111/ldrp.12100</bibtext> </blist> <blist> <bibtext> McGaghie W. C. (2011). Implementation science: Addressing complexity in medical education. Medical Teacher, 33, 97–98. https://doi.org/10.3109/0142159X</bibtext> </blist> <blist> <bibtext> Melgarejo M., Lind T., Stadnick N. A., Helm J. L., Locke J. (2020). Strengthening capacity for implementation of evidence-based practices for autism in schools: The roles of implementation climate, school leadership, and fidelity. American Psychologist, 75(8), 1105–1115. https://doi.org/10.1037/amp0000649</bibtext> </blist> <blist> <bibtext> Moullin J.C., Dickson K.S., Stadnick N.A., Rabin B., Aarons G. A. (2019). Systematic review of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework. Implementation Science, 14, 1. https://doi.org/10.1186/s13012-018-0842-6s13012-018-0842-6</bibtext> </blist> <blist> <bibtext> Morin K., Sam A. M., Tomaszewski B., Waters V., Odom S. (2021). Knowledge of evidence-based practices and frequency of selection among school-based professionals of students with autism. Journal of Special Education, 55(3), 143–152.</bibtext> </blist> <blist> <bibtext> Nelson M. C., Cordray D. S., Hulleman C. S., Darrow C. L., Sommer E. C. (2010). A procedure for assessing intervention fidelity in experiments testing educational and behavioral interventions. Journal of Behavioral Health Services & Research, 39 (4), 374–396. https://doi.org/10.1007/s11414-012-9295-x</bibtext> </blist> <blist> <bibtext> Odom S. L., Boyd B., Hall L., Hume K. (2014). Comprehensive treatment models for children and youth with autism spectrum disorders. In Volkmar F., Rogers S., Pelphrey K., Paul R. (Eds.), Handbook of autism and pervasive developmental disorders (Vol. 2, pp. 770–778). Wiley.</bibtext> </blist> <blist> <bibtext> Odom S. L., Collet-Klingenberg L., Rogers S., Hatton D. (2010). Evidence-based practices for children and youth with Autism Spectrum Disorders. Preventing School Failure, 54(4), 275–282. https://doi.org/10.1080/10459881003785506</bibtext> </blist> <blist> <bibtext> Odom S. L., Cox A., Brock M. (2013). Implementation science, professional development, and Autism Spectrum Disorders: National Professional Development Center on ASD. Exceptional Children, 79, 233–251. https://doi.org/10.1177/001440291307900207</bibtext> </blist> <blist> <bibtext> Odom S. L., Cox A., Sideris J., Hume K. A., Hedges S., Kucharczyk S., Shaw E., Boyd B. A., Reszka S., Neitzel J. (2018). Assessing quality of program environments for children and youth with autism: Autism Program Environment Rating Scale. Journal of Autism and Developmental Disorders, 48(3), 913–924. https://doi.org/10.1007/s10803-017-3379-7</bibtext> </blist> <blist> <bibtext> Office of Special Education Programs. (2020). 41st annual report to congress on the implementation of the individuals with disabilities education act, 2019 [U. S. Department of Education, Washington, D.C.].</bibtext> </blist> <blist> <bibtext> Proctor E., Silmere H., Raghavan R., Hovmand P., Aarons G., Bunger A., Griffey R., Hensley M. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Research, 38(2), 65–76. https://doi.org/10.1007/s10488-010-0319-7</bibtext> </blist> <blist> <bibtext> Rogers S. J., Dawson G. (2010). Early Start Denver Model for young children with autism: Promoting language, learning, and engagement. Guilford Press.</bibtext> </blist> <blist> <bibtext> Sam A. M., Cox A. W., Savage M. N., Waters V., Odom S. L. (2020). Disseminating information on evidence-based practices for children and youth with autism spectrum disorder: AFIRM. Journal of Autism and Developmental Disorders, 50(6), 1931–1940. https://doi.org/10.1007/s10803-019-03945-x</bibtext> </blist> <blist> <bibtext> Sam A. M., Odom S. L., Tomaszewski B., Perkins Y., Cox A. W. (2021). Employing evidence-based practices for children with autism in elementary schools. Journal of Autism and Developmental Disorders, 51, 2398–2323. https://doi.org/10.1007/s10803-020-04706-x</bibtext> </blist> <blist> <bibtext> Schreibman L., Koegel R. L. (2005). Training for parents of children with autism: Pivotal responses, generalization, and individualization of interventions. In Hibbs E. D., Jensen P. S. (Eds.), Psychosocial treatments for child and adolescent disorders: Empirically based strategies for clinical practice (2nd ed., pp. 605–631). American Psychological Association.</bibtext> </blist> <blist> <bibtext> Schultes M. T., Aijaz M., Klug J., Fixsen D. L. (2021). Competences for implementation science: What trainees need to learn and where they learn it. Advances in Health Science Education, 26(1), 19–35. https://doi.org/10.1007/s10459-020-09969-8</bibtext> </blist> <blist> <bibtext> Sirin S. R. (2005). Socioeconomic status and academic achievement: A meta-analysis review of research. Review of Education Research, 75(3), 417–453.</bibtext> </blist> <blist> <bibtext> Stadnick N. A., Meza R. D., Suhrheinrich J., Aarons G., Brookman-Frazee L., Lyon A. R., Mandwell D. S., Locke J. (2019). Leadership profiles associated with the implementation of behavioral health evidence-based practices for autism spectrum disorder in schools. Autism, 23(8), 1957–1968. https://doi.org/10.1177/1362361319834398</bibtext> </blist> <blist> <bibtext> Stahmer A. C., Dababnah S., Rieth S. R. (2019). Considerations in implementing evidence-based early autism spectrum disorder interventions in community settings. Pediatric Medicine (Hong Kong, China), 2, Article 18. https://doi.org/10.21037/pm.2019.05.01</bibtext> </blist> <blist> <bibtext> Steinbrenner J. D., Odom S. L., Hall L. J., Hume K. A. (2020). Moving beyond fidelity: Assessing implementation of a comprehensive treatment program for adolescents with autism spectrum disorder. Exceptional Children, 86(2), 137–145. https://doi.org/10.1177/0014402919855321</bibtext> </blist> <blist> <bibtext> Strain P. S., Bovey E. H. (2011). Randomized, controlled trial of the LEAP model of early intervention for young children with autism spectrum disorders. Topics in Early Childhood Special Education, 31(3), 133–154. https://doi.org/10.1177/0271121411408740</bibtext> </blist> <blist> <bibtext> Suhrheinrich J. (2011). Training teachers to use pivotal response training with children with autism: Coaching as a critical component. Teacher Education and Special Education, 34(4), 339–349. https://doi.org/10.1177/0888406411406553</bibtext> </blist> <blist> <bibtext> Suhrheinrich J., Melgarejo M., Root B., Aarons G. A., Brookman-Frazee L. (2021). Implementation of school-based services for students with autism: Barriers and facilitators across urban and rural districts and phases of implementation. Autism, 25(8), 2291–2304. https://doi.org/10.1177/13623613211016729</bibtext> </blist> <blist> <bibtext> Suhrheinrich J., Rieth S. R., Dickson K. S., Stahmer A. C. (2020). Exploring associations between inner-context factors and implementation outcomes. Exceptional Children, 86(2), 155–173. https://doi.org/10.1177/0014402919881354</bibtext> </blist> <blist> <bibtext> Tipton E. (2014). How generalizable is your experiment? An index for comparing experimental samples and populations. Journal of Educational and Behavioral Statistics, 39(6), 478–501. https://doi.org/10.3102/1076998614558486</bibtext> </blist> <blist> <bibtext> Tipton E., Miller K. (2016). The Generalizer: A webtool for improving the generalizability of results from experiments. <ulink href="http://www.thegeneralizer.org">http://www.thegeneralizer.org</ulink></bibtext> </blist> <blist> <bibtext> Walunas T. L., Ye J., Bannon J., Wang A., Kho A. N., Smith J. D., Soulakis N. (2021). Does coaching matter? Examining the impact of specific practice facilitation strategies on implementation of quality improvement interventions in the Healthy Hearts in the Heartland study. Implementation Science, 16(1), Article 33. https://doi.org/10.1186/s13012-021-01100-8</bibtext> </blist> </ref> <ref id="AN0155828400-18"> <title> Footnotes </title> <blist> <bibtext> The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.</bibtext> </blist> <blist> <bibtext> The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by the US Office of Education, Institute of Education Science, R324A150047.</bibtext> </blist> <blist> <bibtext> Samuel L Odom</bibtext> </blist> <blist> <bibtext>Graph</bibtext> </blist> <blist> <bibtext>https://orcid.org/0000-0003-1745-7915 Ann M Sam</bibtext> </blist> <blist> <bibtext>Graph https://orcid.org/0000-0003-3808-445X</bibtext> </blist> <blist> <bibtext> Supplemental material for this article is available online.</bibtext> </blist> <blist> <bibtext> In this document, we will use a mixture of terminology when referring to autism and persons identified as autistic. A common form of description has been called "person-first," in which the person (e.g. child) appears before the condition (e.g. autism), such as child with autism. Many autistic self-advocates and advocacy groups now prefer an identify-first form, such as autistic child ([8]; [18]). In addition, autistic advocates have spoken about the desirability of using the term "autism" rather than autism spectrum disorder ([8]). At the time of this writing, terminological issues have not been settled. To honor the advocates and professionals in the field, as well as other groups of individuals with disabilities who prefer the person-first term, we will be mixing terminology throughout the manuscript, using both person-first and identity-first terminology with the primary descriptor being autism or autistic.</bibtext> </blist> </ref> <aug> <p>By Samuel L Odom; Ann M Sam and Brianne Tomaszewski</p> <p>Reported by Author; Author; Author</p> </aug> <nolink nlid="nl1" bibid="bib24" firstref="ref2"></nolink> <nolink nlid="nl2" bibid="bib26" firstref="ref4"></nolink> <nolink nlid="nl3" bibid="bib34" firstref="ref6"></nolink> <nolink nlid="nl4" bibid="bib16" firstref="ref7"></nolink> <nolink nlid="nl5" bibid="bib33" firstref="ref8"></nolink> <nolink nlid="nl6" bibid="bib39" firstref="ref9"></nolink> <nolink nlid="nl7" bibid="bib48" firstref="ref10"></nolink> <nolink nlid="nl8" bibid="bib25" firstref="ref11"></nolink> <nolink nlid="nl9" bibid="bib37" firstref="ref12"></nolink> <nolink nlid="nl10" bibid="bib15" firstref="ref14"></nolink> <nolink nlid="nl11" bibid="bib20" firstref="ref15"></nolink> <nolink nlid="nl12" bibid="bib42" firstref="ref16"></nolink> <nolink nlid="nl13" bibid="bib51" firstref="ref17"></nolink> <nolink nlid="nl14" bibid="bib41" firstref="ref19"></nolink> <nolink nlid="nl15" bibid="bib35" firstref="ref20"></nolink> <nolink nlid="nl16" bibid="bib17" firstref="ref21"></nolink> <nolink nlid="nl17" bibid="bib21" firstref="ref27"></nolink> <nolink nlid="nl18" bibid="bib19" firstref="ref29"></nolink> <nolink nlid="nl19" bibid="bib27" firstref="ref30"></nolink> <nolink nlid="nl20" bibid="bib12" firstref="ref31"></nolink> <nolink nlid="nl21" bibid="bib23" firstref="ref33"></nolink> <nolink nlid="nl22" bibid="bib49" firstref="ref34"></nolink> <nolink nlid="nl23" bibid="bib53" firstref="ref41"></nolink> <nolink nlid="nl24" bibid="bib52" firstref="ref42"></nolink> <nolink nlid="nl25" bibid="bib10" firstref="ref46"></nolink> <nolink nlid="nl26" bibid="bib32" firstref="ref47"></nolink> <nolink nlid="nl27" bibid="bib47" firstref="ref51"></nolink> <nolink nlid="nl28" bibid="bib45" firstref="ref66"></nolink> <nolink nlid="nl29" bibid="bib36" firstref="ref72"></nolink> <nolink nlid="nl30" bibid="bib54" firstref="ref76"></nolink> <nolink nlid="nl31" bibid="bib22" firstref="ref78"></nolink> <nolink nlid="nl32" bibid="bib40" firstref="ref80"></nolink> <nolink nlid="nl33" bibid="bib14" firstref="ref82"></nolink> <nolink nlid="nl34" bibid="bib44" firstref="ref83"></nolink> <nolink nlid="nl35" bibid="bib29" firstref="ref84"></nolink> <nolink nlid="nl36" bibid="bib46" firstref="ref86"></nolink> <nolink nlid="nl37" bibid="bib13" firstref="ref92"></nolink> <nolink nlid="nl38" bibid="bib50" firstref="ref94"></nolink> <nolink nlid="nl39" bibid="bib31" firstref="ref96"></nolink> <nolink nlid="nl40" bibid="bib43" firstref="ref97"></nolink> <nolink nlid="nl41" bibid="bib11" firstref="ref98"></nolink> <nolink nlid="nl42" bibid="bib28" firstref="ref100"></nolink> <nolink nlid="nl43" bibid="bib38" firstref="ref101"></nolink> <nolink nlid="nl44" bibid="bib30" firstref="ref104"></nolink>
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1333811
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: EJ1333811
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Factors Associated with Implementation of a School-Based Comprehensive Program for Students with Autism
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Odom%2C+Samuel+L%2E%22">Odom, Samuel L.</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-1745-7915">0000-0003-1745-7915</externalLink>)<br /><searchLink fieldCode="AR" term="%22Sam%2C+Ann+M%2E%22">Sam, Ann M.</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-3808-445X">0000-0003-3808-445X</externalLink>)<br /><searchLink fieldCode="AR" term="%22Tomaszewski%2C+Brianne%22">Tomaszewski, Brianne</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Autism%3A+The+International+Journal+of+Research+and+Practice%22"><i>Autism: The International Journal of Research and Practice</i></searchLink>. Apr 2022 26(3):703-715.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 13
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2022
– Name: SourceSuprt
  Label: Sponsoring Agency
  Group: SrcSuprt
  Data: Institute of Education Sciences (ED)
– Name: NumberContract
  Label: Contract Number
  Group: NumCntrct
  Data: R324A150047
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Elementary+Education%22">Elementary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Students+with+Disabilities%22">Students with Disabilities</searchLink><br /><searchLink fieldCode="DE" term="%22Autism%22">Autism</searchLink><br /><searchLink fieldCode="DE" term="%22Pervasive+Developmental+Disorders%22">Pervasive Developmental Disorders</searchLink><br /><searchLink fieldCode="DE" term="%22Intervention%22">Intervention</searchLink><br /><searchLink fieldCode="DE" term="%22Elementary+School+Students%22">Elementary School Students</searchLink><br /><searchLink fieldCode="DE" term="%22Program+Implementation%22">Program Implementation</searchLink><br /><searchLink fieldCode="DE" term="%22Transformational+Leadership%22">Transformational Leadership</searchLink><br /><searchLink fieldCode="DE" term="%22Principals%22">Principals</searchLink><br /><searchLink fieldCode="DE" term="%22Racial+Composition%22">Racial Composition</searchLink><br /><searchLink fieldCode="DE" term="%22Coaching+%28Performance%29%22">Coaching (Performance)</searchLink><br /><searchLink fieldCode="DE" term="%22Professional+Development%22">Professional Development</searchLink><br /><searchLink fieldCode="DE" term="%22Teamwork%22">Teamwork</searchLink><br /><searchLink fieldCode="DE" term="%22Evidence+Based+Practice%22">Evidence Based Practice</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1177/13623613211070340
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 1362-3613<br />1461-7005
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: The purpose of this study was to examine influences on the implementation of a school-based comprehensive program for autistic children. Following the conceptual framework suggested by the Exploration, Preparation, Implementation, Sustainment (EPIS) model, variables from the outer context, inner context, and also that were part of the comprehensive program were explored. An index approach was employed for assessing implementation. The study was part of a larger cluster randomized control trial and took place in 39 elementary schools in a southeastern state within the United States. Variables associated with implementation were transformational leadership style of the principal, percentage of students in the school who were white, and adequacy of coaching. Implications for practice and future research were identified.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: CodeSource
  Label: IES Funded
  Group: SrcInfo
  Data: Yes
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2022
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1333811
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1333811
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1177/13623613211070340
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 13
        StartPage: 703
    Subjects:
      – SubjectFull: Students with Disabilities
        Type: general
      – SubjectFull: Autism
        Type: general
      – SubjectFull: Pervasive Developmental Disorders
        Type: general
      – SubjectFull: Intervention
        Type: general
      – SubjectFull: Elementary School Students
        Type: general
      – SubjectFull: Program Implementation
        Type: general
      – SubjectFull: Transformational Leadership
        Type: general
      – SubjectFull: Principals
        Type: general
      – SubjectFull: Racial Composition
        Type: general
      – SubjectFull: Coaching (Performance)
        Type: general
      – SubjectFull: Professional Development
        Type: general
      – SubjectFull: Teamwork
        Type: general
      – SubjectFull: Evidence Based Practice
        Type: general
    Titles:
      – TitleFull: Factors Associated with Implementation of a School-Based Comprehensive Program for Students with Autism
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Odom, Samuel L.
      – PersonEntity:
          Name:
            NameFull: Sam, Ann M.
      – PersonEntity:
          Name:
            NameFull: Tomaszewski, Brianne
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 04
              Type: published
              Y: 2022
          Identifiers:
            – Type: issn-print
              Value: 1362-3613
            – Type: issn-electronic
              Value: 1461-7005
          Numbering:
            – Type: volume
              Value: 26
            – Type: issue
              Value: 3
          Titles:
            – TitleFull: Autism: The International Journal of Research and Practice
              Type: main
ResultId 1