View in EDS HTML Full Text PDF Full Text

Factor Structure of the Scales for Assessing Emotional Disturbance -- 3 Rating Scale for Students Identified with Emotional Disturbance

Saved in:
Bibliographic Details
Title: Factor Structure of the Scales for Assessing Emotional Disturbance -- 3 Rating Scale for Students Identified with Emotional Disturbance
Language: English
Authors: Lambert, Matthew C., Cullinan, Douglas, Epstein, Michael H., Martin, Jodie
Source: Behavioral Disorders. May 2022 47(3):187-195.
Availability: SAGE Publications and Hammill Institute on Disabilities. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Peer Reviewed: Y
Page Count: 9
Publication Date: 2022
Document Type: Journal Articles
Reports - Research
Education Level: Elementary Secondary Education
Descriptors: Emotional Disturbances, Rating Scales, Students with Disabilities, Symptoms (Individual Disorders), Test Validity, Factor Structure, Disability Identification, Psychometrics, Elementary Secondary Education, Student Evaluation
DOI: 10.1177/01987429211012328
ISSN: 0198-7429
Abstract: This study examined the internal structure of the Scales for Assessing Emotional Disturbance-3 Rating Scale (RS), a teacher-completed RS developed to measure emotional disturbance (ED). As defined in U.S. law and regulations, ED involves five characteristics or patterns of behavioral and emotional maladaptation. RS data obtained on a sample of students with ED were used to examine validity evidence based on the internal structure of the assessment. Of particular interest was the extent to which multivariate factors derived from the RS data conform to the five characteristics of ED stated in the definition. Results indicate that the RS data fit a 5-factor model reasonably well. A subsequent bifactor analysis identified a considerable proportion of common variance across factors, suggesting the presence of a strong general ED factor, two distinct group factors (Inability to Learn and Inappropriate Behavior), and three weak group factors. The findings provided evidence of the validity of the SAED-3 RS based on internal structure and pointed to support for use of the RS in contributing to the process of determining whether a student qualifies for the ED education disability. Implications for improved research on the nature of ED and how students with ED can be better served are discussed.
Abstractor: As Provided
Entry Date: 2022
Accession Number: EJ1337993
Database: ERIC
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
    Url: https://content.ebscohost.com/cds/retrieve?content=AQICAHj0k_4E0hTGH8RJwT4gCJyBsGNe_WN95AvKlDbXJGqwxwFlDACDcfnrCKvKR7peDcX4AAAA4zCB4AYJKoZIhvcNAQcGoIHSMIHPAgEAMIHJBgkqhkiG9w0BBwEwHgYJYIZIAWUDBAEuMBEEDEJH1MSy6iEDIIrhVQIBEICBm1R5AAqYNTP3SIPeKpLB6jFP9HHvHJL7qze0NjZ-t-Tb7er_HhLZhi_37-j0fwymLjOLiO-b5701LvgNqMua2qgMo0cgociZcF6VHwF1bF3cI8ba7FYnOIfN-wtR5s2ug2NiExiyrU7-L3gglEY_uz9luEh7FhEneXpLBcsFFH-5iHk_9N6JD31BI1RtH4HkMIrq7UcTCKlAVhJ0
Text:
  Availability: 1
  Value: <anid>AN0156443030;bhd01may.22;2022Apr25.03:25;v2.2.500</anid> <title id="AN0156443030-1">Factor Structure of the Scales for Assessing Emotional Disturbance – 3 Rating Scale for Students Identified With Emotional Disturbance </title> <p>This study examined the internal structure of the Scales for Assessing Emotional Disturbance-3 Rating Scale (RS), a teacher-completed RS developed to measure emotional disturbance (ED). As defined in U.S. law and regulations, ED involves five characteristics or patterns of behavioral and emotional maladaptation. RS data obtained on a sample of students with ED were used to examine validity evidence based on the internal structure of the assessment. Of particular interest was the extent to which multivariate factors derived from the RS data conform to the five characteristics of ED stated in the definition. Results indicate that the RS data fit a 5-factor model reasonably well. A subsequent bifactor analysis identified a considerable proportion of common variance across factors, suggesting the presence of a strong general ED factor, two distinct group factors (Inability to Learn and Inappropriate Behavior), and three weak group factors. The findings provided evidence of the validity of the SAED-3 RS based on internal structure and pointed to support for use of the RS in contributing to the process of determining whether a student qualifies for the ED education disability. Implications for improved research on the nature of ED and how students with ED can be better served are discussed.</p> <p>Keywords: emotional disturbance; disorders/disabilities; assessment; psychometrics; descriptive design</p> <p>Research reports and government policy papers indicate that at least 20% of school-age children experience a mental health problem at some point before adulthood (e.g., [<reflink idref="bib28" id="ref1">28</reflink>]; [<reflink idref="bib35" id="ref2">35</reflink>]; [<reflink idref="bib41" id="ref3">41</reflink>]; [<reflink idref="bib49" id="ref4">49</reflink>]). Many of these children do not receive mental health services ([<reflink idref="bib22" id="ref5">22</reflink>]), and only a small number of children qualify for school services based on the guidelines stated in the [<reflink idref="bib27" id="ref6">27</reflink>]. Children who qualify for special education and related services under IDEA are those with a documented emotional or behavioral challenge that adversely affects their education performance. Approximately one-half of 1% of students are school identified with emotional disturbance (ED ([<reflink idref="bib29" id="ref7">29</reflink>]; [<reflink idref="bib48" id="ref8">48</reflink>]). Unfortunately, students with ED are likely to exhibit poor educational, academic, social, and life outcomes ([<reflink idref="bib6" id="ref9">6</reflink>]; [<reflink idref="bib29" id="ref10">29</reflink>]; [<reflink idref="bib50" id="ref11">50</reflink>]). The small number of students school identified with ED, together with the poor educational and life outcomes, indicate that efforts need to be focused on identifying and serving this student population.</p> <p>A key component of identifying and serving students with ED is for schools to implement evidence-based identification practices, using reliable and valid assessment procedures. Students whose emotional and behavioral challenges are not identified and served at an early point are at greater risk for academic and behavioral issues throughout school and poorer life outcomes ([<reflink idref="bib11" id="ref12">11</reflink>]; [<reflink idref="bib19" id="ref13">19</reflink>]). However, evidenced-based assessment and intervention services for students with ED can prevent or reduce the short- and long-term effects of emotional and behavioral challenges for students ([<reflink idref="bib10" id="ref14">10</reflink>]; [<reflink idref="bib38" id="ref15">38</reflink>]; [<reflink idref="bib41" id="ref16">41</reflink>]).Therefore, experts have identified several significant considerations in selecting assessment instruments, primarily acceptable reliability and validity functioning, but also the purpose of their intended use, and their usefulness and acceptability to consumers ([<reflink idref="bib23" id="ref17">23</reflink>]; [<reflink idref="bib40" id="ref18">40</reflink>]).</p> <p>In regard to the ED category of special education, school professionals need to select reliable and valid measurement instruments that adhere to the federal definition of ED outlined in IDEA. The IDEA definition identifies ED as a condition that has been present for a period of time, is not present in typical student peers, and negatively affects the student's educational performance. Five characteristics are listed as follows: (a) an inability to learn that cannot be explained by intellectual, sensory, or health factors. (b) An inability to build or maintain satisfactory interpersonal relationships with peers and teachers. (c) Inappropriate types of behavior or feelings under normal circumstances. (d) A general pervasive mood of unhappiness or depression. (e) A tendency to develop physical symptoms or fears associated with personal or school problems.</p> <p>Over the past 50 years, the IDEA definition of ED has received significant criticism ([<reflink idref="bib20" id="ref19">20</reflink>]; [<reflink idref="bib21" id="ref20">21</reflink>]; [<reflink idref="bib24" id="ref21">24</reflink>], [<reflink idref="bib25" id="ref22">25</reflink>]; [<reflink idref="bib36" id="ref23">36</reflink>]; [<reflink idref="bib46" id="ref24">46</reflink>]). The major objections are that the definition is dated, it does not have empirical support, has arbitrary exclusionary statements, and it is vague and ambiguous. On the contrary, that this definition originated five decades ago does not necessarily make it obsolete. Moreover, the federal definition stated in IDEA is to be followed by state and local education agencies in the identification of children to receive special education and related services for ED. Currently, a number of psychometrically sound tests exist to assess the emotional and behavior challenges of school-age students (see [<reflink idref="bib1" id="ref25">1</reflink>]; Goodman, 2001; [<reflink idref="bib44" id="ref26">44</reflink>]). However, few explicitly address the major components of the definition of ED as presented in the IDEA. Thus, the inability to directly link the characteristics of ED as specified in IDEA to assessment tools makes identifying students with ED particularly challenging (e.g., [<reflink idref="bib2" id="ref27">2</reflink>]; [<reflink idref="bib3" id="ref28">3</reflink>]; [<reflink idref="bib37" id="ref29">37</reflink>]).</p> <p>The Scales for Assessing Emotional Disturbance-3 (SAED-3; [<reflink idref="bib16" id="ref30">16</reflink>]) is a suite of four assessment instruments and procedures specifically developed to aid school personnel in the identification of students with ED. The SAED-3 Rating Scale (RS) is a 45-item standardized, norm-referenced instrument developed to operationally define the five primary characteristics of ED (39 items): <emph>Inability to Learn</emph>, <emph>Relationship Problems</emph>, <emph>Inappropriate Behavior</emph>, <emph>Unhappiness or Depression</emph>, and <emph>Physical Symptoms or Fears</emph>. The SAED RS also operationalizes the socially maladjusted concept found in the definition (6 items), as well as other parts of the IDEA definition of ED. The RS was designed to help in the process of identification of a student with ED.</p> <p>The SAED RS was developed in several stages (see [<reflink idref="bib14" id="ref31">14</reflink>]), all intended to identify teacher-rated items that, in combinations, operationally define the five characteristics of ED as stated and implied by the IDEA definition of ED. First, the research literature on the emotional and behavioral disorders, existing tests and RSs to measure children's behavior, and criticisms of the federal definition were reviewed and led to the development of 85 behavior problem items. Second, 30 teachers and school psychologists evaluated the 85 items in terms of relationship to ED, item readability, redundancy and overlap of items, and user acceptability, and resulted in removing 19 items. Third, the 66-problem item provisional scale was completed by 74 teachers on students with ED (<emph>n</emph> = 369) and without (<emph>n</emph> = 386) ED, and the analyses indicated that every one of the 66 items discriminated between the two student groups. Finally, the RS authors used exploratory factor analyses with the provisional scale data to help reduce the number of items while still producing a separate scale for each of the IDEA definition's five characteristics of ED, plus socially maladjusted.</p> <p>This process resulted in a final RS of 45 items, each contributing to one of the six RS subscales: Inability to Learn (8 items), Relationship Problems (6 items), Inappropriate Behavior (10 items), Unhappiness or Depression (7 items), Physical Symptoms or Fears (8 items), plus the supplemental scale, and Socially Maladjusted (6 items). Studies have demonstrated evidence that the scores from a previous version of the SAED-RS meet acceptable standards of reliability and validity ([<reflink idref="bib12" id="ref32">12</reflink>]; [<reflink idref="bib17" id="ref33">17</reflink>]; [<reflink idref="bib15" id="ref34">15</reflink>], [<reflink idref="bib16" id="ref35">16</reflink>]; [<reflink idref="bib18" id="ref36">18</reflink>]). Several recent studies have presented evidence that scores from the SAED-3 RS demonstrated acceptable classification accuracy for students with and without ED (area under the curve [AUC] =.81), adequate discrimination between students with ED and students with learning disabilities ([<reflink idref="bib30" id="ref37">30</reflink>]), acceptable convergent and divergent validity with scores from the Behavioral Assessment for Children-3 and the Strengths and Difficulties Questionnaire ([<reflink idref="bib16" id="ref38">16</reflink>]), and acceptable measurement invariance across groups of students from diverse backgrounds ([<reflink idref="bib31" id="ref39">31</reflink>]; [<reflink idref="bib32" id="ref40">32</reflink>]).</p> <p>However, researchers have not yet examined the evidence of validity of the scores based on the internal structure of the SAED-RS, and the degree to which the hypothetical 5-factor structure (based on the federal definition of ED) is empirically supported. Specifically, researchers need to explore the dimensionality of the SAED-RS scores with a new large sample of students with ED, and explore the extent to which the five characteristics of ED demonstrate discriminant validity. Thus, the purposes of the study were to conduct a confirmation factor analysis with students who were school-identified as ED to (a) determine the dimensionality of the SAED-3 RS scores, (b) measure the extent to which the constructs are interrelated, and (c) estimate score reliability based on confirmatory factor analysis (CFA) model parameters.</p> <hd id="AN0156443030-2">Method</hd> <p></p> <hd id="AN0156443030-3">Participants</hd> <p>Participants for this study were 491 students school-identified with ED who had an active Individualized Education Program. The sample was drawn from a larger normative study of the SAED-3. The sample was fairly geographically representative of the United States, with 34.2% of the students from the Northeast, 24.2% from the Midwest, 30.8% from the South, and 10.8% from the West. Participants were predominately male (67.6%; <emph>n</emph> = 332). In terms of race and ethnicity, the sample was 55.2% white/non-Hispanic (<emph>n</emph> = 271), 28.3% black/non-Hispanic (<emph>n</emph> = 139), 5.5% multiracial/non-Hispanic (<emph>n</emph> = 27), 3.3% other race (e.g., Asian, American Indian) (<emph>n</emph> = 16), and 7.7% Hispanic (<emph>n</emph> = 38). Students ranged in age from 5 to 18 with a mean age of 13.6 years (<emph>SD</emph> = 3.52). Data on school settings were unavailable for 12.4% of the sample (<emph>n</emph> = 61); of the remaining students, about 85% (<emph>n</emph> = 367) were enrolled in public schools. Less than 5% of the sample was identified as English language learners (<emph>n</emph> = 16). None of the students were identified with any disabilities other than ED.</p> <hd id="AN0156443030-4">Measure</hd> <p>The SAED-3 RS is a standardized, norm-referenced 45-item measure. The RS has five basic subscales (Inability to Learn, Relationship Problems, Inappropriate Behavior, Unhappiness or Depression, and Physical Symptoms or Fears) and one supplemental subscale (Socially Maladjusted). Each RS item is rated on a 4-point Likert-type scale (0 = "not a problem," 1 = "mild problem," 2 = "considerable problem," and 3 = "severe problem.") by a teacher familiar with the student's behavior for a minimum of 2 months. Items composing each of the subscales are summed to obtain a raw score which is transformed to a scaled score. For this study, the items from the supplemental scale (Socially Maladjusted) were not included in the analysis because only the five "core" subscales align with the five characteristics of the federal definition of ED.</p> <hd id="AN0156443030-5">Data Collection</hd> <p>Data were collected as part of the SAED-3 re-norming process ([<reflink idref="bib16" id="ref41">16</reflink>]). Prior to data collection, three university Internal Review Boards (University of Nebraska-Lincoln, University of Northern Colorado, and Elon University) approved sample recruitment and data collection procedures. Data were collected from fall 2015 through spring 2018.</p> <p>The test authors recruited educators from across the United States to represent the four major U.S. regions: Northeast, Midwest, South, and West. Teachers were contacted by one of the SAED-3 authors either by mail, email, or telephone and asked to participate in the norming process. Teachers who agreed to participate were asked to complete the RS on all students on their class roster(s), or to select an unbiased sample of their students using the following simple procedure:</p> <p>First, decide how many students you wish to rate. Then, start at the top or bottom of your class roster and rate every child. Do not skip any student unless you have known this student for less than two months. Stop selecting and rating students when you have reached the number of students you wished to rate.</p> <p>Each rater also provided demographic information for each student (e.g., grade level, age, race, ethnicity, etc.).</p> <hd id="AN0156443030-6">Data Analysis</hd> <p>Mplus v7.11 ([<reflink idref="bib39" id="ref42">39</reflink>]) was used to fit a series of CFA models to evaluate the internal structure and reliability of scores from the SAED 3 Rating Scale. The primary focus of the analysis was to examine the fit of the 5-factor hypothetical model proposed by the developers ([<reflink idref="bib14" id="ref43">14</reflink>]; [<reflink idref="bib16" id="ref44">16</reflink>]) based on the five characteristics of ED stated in the IDEA definition. Coefficient omega ([<reflink idref="bib34" id="ref45">34</reflink>]), which is an estimate of score reliability, was computed for the five factors based on the CFA model parameters. For comparison purposes (to examine the falsifiability of the hypothetical structure), two alternative factor models were also fit to the data: (a) single-factor model; (b) bifactor version of the 5-factor model including a general ED factor as well as the five group factors. A bifactor version of the 5-factor model was examined to obtain an additional perspective on scale structure by partitioning the item response variance into common sources (see [<reflink idref="bib42" id="ref46">42</reflink>] for an in-depth description of bifactor models).</p> <p>Bifactor models represent a structure with one general factor and several group factors, all orthogonal to each other (i.e., uncorrelated). Thus, the bifactor model allows each factor to directly influence the item responses independent of the other factors ([<reflink idref="bib13" id="ref47">13</reflink>]) and can complement a correlated factors model "by evaluating whether item response variance is due to a general construct versus group factors" ([<reflink idref="bib7" id="ref48">7</reflink>], p. 138). To assess the degree to which ratings are attributable to the <emph>general</emph> factor, we computed the explained common variance (ECV) index and the omega hierarchical estimate for the <emph>general</emph> factor. The ECV index provides information on the ratio of explained variance attributable to the general factor compared to the group factors of the bifactor model—higher values indicate a greater proportion of variance attributable to the general factor. The interpretation of ECV relies on the percentage of uncontaminated correlations (PUC; [<reflink idref="bib43" id="ref49">43</reflink>]), the percentage of correlations between items that are due to <emph>only</emph> the general factor. [<reflink idref="bib45" id="ref50">45</reflink>] suggest that scores are "essentially unidimensional" when EVC >.70 and PUC >.70. PUC for the SAED-3 bifactor model is.82—around 82% of correlations between RS items are due to only the general factor.</p> <p>The <emph>omega hierarchical</emph> (ω<subs>H</subs>; [<reflink idref="bib34" id="ref51">34</reflink>]) estimate provides information about how much <emph>raw</emph> score variance is attributable to the general factor <emph>or</emph> a specific group factor—that is to say, omega hierarchical represents the proportion of the observed score that reflects the latent factor variance (i.e., omega hierarchical is a model-based estimate of score reliability). When applied to the <emph>general</emph> factor, omega hierarchical provides information about the proportion of an <emph>overall scale score</emph> that is attributable to a single, common source of variance. When applied to a <emph>group</emph> factor, omega hierarchical provides information about the proportion of a <emph>subscale score</emph> that is attributable to a <emph>specific</emph> source of variance (accounting for the common variance).</p> <p>As items were measured on a 4-point Likert-type scale, we treated the ratings as ordinal rather than continuous indicators. To estimate the models, we used weighted least squares with mean and variance (WLSMV) adjustments, and the factors were scaled using a fixed mean and variance approach. All CFA models were specified without correlated residual variances between items because no item residuals are hypothesized to correlate. There were minimal missing data at the item-level (<.005%) and cases with missing data were included using a pairwise-present approach as is default in Mplus when using the WLSMV estimator.</p> <p>The indicators used to assess goodness-of-fit were the comparative fit index (CFI; [<reflink idref="bib4" id="ref52">4</reflink>]), Tucker–Lewis index (TLI), and the root mean square error of approximation (RMSEA; [<reflink idref="bib47" id="ref53">47</reflink>]) at its 90% confidence interval. CFI and TLI are comparative fit indices representing the degree of improvement over the worst fitting model ([<reflink idref="bib5" id="ref54">5</reflink>]). Both indexes are scaled from 0 to 1 with values closer to 1 indicating better fit. A <emph>close</emph> fitting model has CFI and TLI values greater than or equal to 0.95 ([<reflink idref="bib26" id="ref55">26</reflink>]) while earlier research suggested that an <emph>acceptable</emph> fitting model has values greater than or equal to 0.90 ([<reflink idref="bib9" id="ref56">9</reflink>]). RMSEA represents the degree of model misfit and is reported on a scale of 0 to 1; values closer to zero indicate better fit with values close to.06 indicating close fit while balancing Type I and Type II error rates ([<reflink idref="bib26" id="ref57">26</reflink>]); however, values less than.08 indicate acceptable fit while values over.10 indicate very poor fit to the model ([<reflink idref="bib33" id="ref58">33</reflink>]). In addition to examining the point estimate, the 90% confidence interval was also used to evaluate misfit with upper limits lower than.08 representing acceptable fit. The chi-square difference test (Δχ<sups>2</sups>) and CFI differences (ΔCFI) were computed to evaluate the fit of nested models (e.g., the 1-factor versus the 5-factor model). Nonsignificant chi-square difference tests and/or differences in CFI less than.01 indicate that the fit of the two models being compared are statistically equivalent.</p> <hd id="AN0156443030-7">Results</hd> <p>Table 1 reports the goodness-of-fit indicators for the three CFA models. The single-factor model did not exhibit acceptable fit (CFI =.753, TLI =.739, RMSEA =.135 [.132,.138]). Therefore, the SAED-3 RS data are not strictly unidimensional. The 5-factor model demonstrated acceptable fit (CFI ≥.90, TLI ≥.90, RMSEA <.08) with the upper limit of the RMSEA confidence interval also within the acceptable range (<.08). The 5-factor model demonstrated a statistically significant improvement in fit over the single-factor model, Δχ<sups>2</sups><subs>(<reflink idref="bib10" id="ref59">10</reflink>)</subs> = 929.99, <emph>p</emph> <.001; ΔCFI =.17. The five latent factors were moderately to highly correlated (see Table 2); the correlations ranged from.41 (Inappropriate Behavior with Unhappiness or Depression) to.85 (Unhappiness or Depression with Physical Symptoms or Fears). The high correlation between Unhappiness or Depression with Physical Symptoms or Fears suggests poor discriminant validity between the two scores, which limits the interpretability and implications of the scores ([<reflink idref="bib8" id="ref60">8</reflink>]). Omega reliability estimates for the five subscale scores ranged from.918 (Physical Symptoms or Fears) to.965 (Inappropriate Behavior) indicating high levels of reliability for each subscale score.</p> <p>Graph</p> <p>Table 1. CFA Goodness-of-Fit Indices.</p> <p> <ephtml> <table><colgroup><col align="left" /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /></colgroup><thead><tr><th align="left">Model</th><th align="center"><italic>df</italic></th><th align="center">χ<sup>2</sup></th><th align="center">CFI</th><th align="center">TLI</th><th align="center">RMSEA [90% CI]</th><th align="center">Δχ<sup>2</sup> (<italic>df</italic>)</th></tr></thead><tbody><tr><td>Single-factor</td><td>702</td><td>6992.14</td><td>.753</td><td>.739</td><td>0.135 [.132,.138]</td><td align="center">—</td></tr><tr><td>Five-factor</td><td>692</td><td>2657.06</td><td>.923</td><td>.917</td><td>0.076 [.073,.079]</td><td>929.99 (10)<xref ref-type="table-fn" rid="tfn2">*</xref></td></tr><tr><td>Bifactor version</td><td>663</td><td>2524.92</td><td>.927</td><td>.918</td><td>0.076 [.073,.079]</td><td align="center">—</td></tr></tbody></table> </ephtml> </p> <p>1 <emph>Note</emph>. CFA = confirmatory factor analysis; CFI = comparative fit index; TLI = Tucker–Lewis index; RMSEA = root mean square error of approximation; CI = confidence interval.</p> <p>2 <emph>p</emph> <.001.</p> <p>Graph</p> <p>Table 2. Correlations Between Latent Factors.</p> <p> <ephtml> <table><colgroup><col align="left" /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /></colgroup><thead><tr><th align="left">Latent Factors</th><th align="center">Inability to learn</th><th align="center">Relationship problems</th><th align="center">Inappropriate behaviors</th><th align="center">Unhappiness/depression</th></tr></thead><tbody><tr><td>Inability to learn</td><td align="center">—</td><td align="center">—</td><td align="center">—</td><td align="center">—</td></tr><tr><td>Relationship problems</td><td>.53</td><td align="center">—</td><td align="center">—</td><td align="center">—</td></tr><tr><td>Inappropriate behaviors</td><td>.53</td><td>.54</td><td align="center">—</td><td align="center">—</td></tr><tr><td>Unhappiness/depression</td><td>.54</td><td>.79</td><td>.41</td><td align="center">—</td></tr><tr><td>Physical symptoms/fears</td><td>.47</td><td>.72</td><td>.48</td><td>.85</td></tr></tbody></table> </ephtml> </p> <p>3 <emph>Note</emph>. All correlations were statistically significant at the.001 level.</p> <p>The bifactor version of the correlated factors model fit the data well (CFI ≥.90, TLI ≥.90, RMSEA <.08), but did not fit the data more closely than the correlated factor models as indicated by the minor difference in CFI of.004 (see Table 1). Note that the chi-square difference test could not be computed due to a singular matrix, so the test is not reported in Table 2. The bifactor model suggests that there is a relatively strong general ED factor, distinct Inability to Learn and Inappropriate Behavior factors, and weak Relationship Problems, Unhappiness or Depression, and Physical Symptoms or Fears factors. Using bifactor model estimates, 57% of the ECV was due to the general ED factor, 17% was attributable to the Inappropriate Behavior factor, 12% to the Inability to Learn factor, and less than 5% to each of the other three factors.</p> <p>Omega hierarchical, which represents the proportion of observed score variance attributable to the true score variance of each factor, was.84 for the general ED factor. For the group factors (e.g., Inability to Learn, Inappropriate Behavior, etc.), omega hierarchical represents the reliability of subscale scores after accounting for true score variance attributable to the general factor. Omega hierarchical was.61 for the Inappropriate Behavior factor,.55 for the Inability to Learn factor,.25 for the Physical Symptoms or Fears factor,.24 for the Relationship Problems factor, and.21 for the Unhappiness or Depression factor.</p> <hd id="AN0156443030-8">Discussion</hd> <p>During the initial SAED development process, item content was generated to align with the federal definition, and exploratory factor analysis was used to assist in creating scales that correspond to the IDEA definition's five characteristics of ED. The developers used data from a nationally representative sample of students with and without ED ([<reflink idref="bib14" id="ref61">14</reflink>]). To our knowledge, this is the first study to examine the internal structure of the SAED-3 RS in a confirmatory framework with a sample of students with ED. Evidence of the internal structure is the basis for score interpretation and score reliability estimation. The findings of this study provide moderate empirical support for the validity of the 5-factor internal structure of the SAED-3 RS. The 5-factor model fit the data acceptably well. Specifically, the 5-factor model fit significantly better than a single-factor model and met acceptable thresholds for the indicators (i.e., CFI, TLI, and RMSEA) that assess goodness of fit. However, the high correlations between the Relationship Problems, Unhappiness/Depression, and Physical Symptoms factors raises questions about the uniqueness of these factors and the utility of interpreting the these dimensions separately.</p> <p>Although the major goal of this study was to examine the structural validity of the 5-factor model aligned with the federal definition of ED, for purposes of comparison, a bifactor solution was also examined. While the bifactor model fit the data acceptably, this model did not fit the data appreciably better than the 5-factor model. The bifactor model does, however, provide additional insight into the meaningfulness and interpretation of the factors. In the bifactor model, ECV and omega hierarchical indicated that the Inability to Learn and Inappropriate Behavior were distinct, unique factors; however, limited reliable variance beyond that attributable to the general ED factor existed for the other three factors (Relationship Problems, Unhappiness or Depression, and Physical Symptoms or Fears). As such, the interpretation of these subscale scores as unique constructs may be limited.</p> <p>As noted, the overriding objective in the design of the RS was to create measurable scales corresponding to the five ED characteristics ([<reflink idref="bib14" id="ref62">14</reflink>]). The creation of those scales was strongly guided by exploratory factor analysis but were not based entirely on those results. In contrast, the present findings are based entirely on CFA of data collected from a different sample of ED students and their teachers. In consideration of these differences, it is not surprising that some RS subscales received limited support as unique factors.</p> <p>While several studies have demonstrated that scores from the RS exhibit acceptable psychometric characteristics including internal consistency, convergent validity, and interrater and test–retest reliability, for the most part, this evidence was demonstrated during the development and norming of the original SAED (see [<reflink idref="bib14" id="ref63">14</reflink>]). The findings from this study afford additional psychometric support for the SAED-3 RS scores by demonstrating essential evidence of the internal structure of the assessment that aligns with the federal definition of ED. This study also provides more rigorous evidence of score reliability for the subscales, which indicated that the variances for the Inability to Learn and Inappropriate Behavior subscale scores are reliable and largely unique while the variances of the other three subscale score are somewhat less reliable due to a common source of variance. In studies of other forms of reliability (e.g., [<reflink idref="bib16" id="ref64">16</reflink>]), all five characteristic scales have shown statistically significant, medium to large degrees of reliability.</p> <hd id="AN0156443030-9">Limitations</hd> <p>A number of limitations of this research should be noted. First, the national sample of students with ED was not randomly selected. School personnel were contacted and asked to volunteer to provide data. Thus the sample included teachers who volunteered to participate and completed rating forms on the students with whom they work. Obviously, this sample does not include data about students with ED whose teachers chose not to provide data. Responses of nonparticipating teachers might be different from those of teachers who participated, so this consideration may have introduced bias to the findings. Furthermore, limited data were collected on teacher characteristics, and those data were collected at the student level, which made describing teacher characteristics untenable for this study.</p> <p>Second, goodness-of-fit indexes for the correlated factors model and the bifactor model represented acceptable fit to the data, but did not indicate "close" fit to the data. Perhaps the heterogeneity of the population of students with ED underlies the relative misfit of the CFA models. In addition, only three CFA models were evaluated in this study; however, there are other potential alternative models that were not tested which may fit the data well. Furthermore, latent variable modeling approaches such as CFA are sample dependent, and therefore, the extent to which the findings generalize to the broader population of students with ED is not entirely clear.</p> <p>Third, Hispanic students school-identified with ED were underrepresented. In the sample, Hispanic students represented 7.7% of students with ED, but in IDEA data, Hispanic students account for approximately 18% of students with ED ([<reflink idref="bib48" id="ref65">48</reflink>]). The generalizability of the present findings may be limited because of the underrepresentation of Hispanic students.</p> <p>In addition, not all teachers rated the same number of students with ED: some rated one student, while some rated all students with ED on their class rolls. This situation calls for a multilevel analysis where students are nested within teachers, but because of International Review Board (IRB) data collection requirements, it was not feasible to identify which teachers rated each student. Therefore, single-level analysis models were used as if each student were rated by a different teacher. We recommend that in future replications, the researcher should take steps to allow for nested data analyses.</p> <hd id="AN0156443030-10">Future Research</hd> <p>The stated limitations suggest needed lines of research. First, it may be possible to address the participating versus nonparticipating teacher issue by making a substantial effort to persuade the teachers that the value of all teachers participating is so great that the result will be worth their investment of time and effort. The likelihood of such an effort's success would probably be greater with smaller sample sizes. Second, future studies should attempt to replicate the factor models evaluated by this study as well as evaluate other theoretically justified factor structures. Such replications and extensions would provide useful information about the generalizability of the findings to the larger population of students with ED. Third, future studies should investigate the characteristics of ED among Hispanic students, especially involving groups of student with ED in which the proportion of Hispanic students matches that in national data.</p> <p>A fourth direction is that the SAED-3 RS could be used in longitudinal studies to examine the stability and sensitivity to change of teacher ratings. The long-term stability and the sensitivity to change of SAED-3 RS ratings are important issues for school personnel who are considering using the assessment in planning and measuring outcomes of intervention services. It would make little sense to plan services or supports for students with ED around a personal variable that would change markedly over time in the absence of services or to evaluate the effect of an intervention using a variable that is not sensitive to change. Furthermore, other researchers should evaluate the predictive validity of the RS scores with respect to student social and emotional functioning, school behavioral outcomes (e.g., office referrals, suspensions, expulsions), and academic outcomes (e.g., grades, graduation rates, standardized test performance). In addition, researchers need to examine the utility of the SAED-3 RS as a specialized teacher RS measure within a comprehensive school approach to accurately identifying students with ED. Specifically, investigators should examine the feasibility and acceptability of the SAED-3 RS by teachers and school administrators in using the instrument as part of a school assessment model.</p> <p>Moreover, additional studies are needed to further investigate other aspects of the validity of the SAED-3 RS. For example, its predictive validity could be examined by measuring the RS subscale scores of many students who are under consideration for identification as ED, while making those RS data unavailable to the decision-making teams. The RS would show predictive validity to the extent that RS subscale scores are correlated with the decision to identify as ED. The utility of the SAED-3 RS should be studied by examining how much its results increase the accuracy and/or efficiency of a decision to identify a student as ED, and facilitate the process of communicating the identification decision to teachers, parents, and other consumers.</p> <p>The SAED-3 RS was not designed to measure the extent of improvement shown by a student with ED, but it may have value as such an indicator. Its value in that role could be studied by comparing data collected two or more times from both the RS and some other indicator of student emotional and behavioral functioning (e.g., recording of several target behaviors).</p> <hd id="AN0156443030-11">Implications</hd> <p>The findings of this study contribute to the existing literature base on the SAED-3 RS and provide essential data that the RS appears to yield scores that are psychometrically sound and assess the emotional and behavioral problems of students who are school-identified as ED. Previous research demonstrated that the SAED-RS scores reached acceptable levels of reliability (i.e., internal consistency, inter-rater reliability, and test–retest reliability) and validity (i.e., content description, criterion prediction, construct identification, test bias, and diagnostic accuracy) ([<reflink idref="bib16" id="ref66">16</reflink>]). In this study, the SAED-RS appeared to measure five key characteristics of students school-identified as ED. However, three of the five subscale scores (Relationship Problems, Unhappiness/ Depression, and Physical Symptoms) lack strong discriminant validity and may need to be interpreted with that in mind.</p> <p>For teachers and other school personnel, the primary use of the SAED-3 RS is in identifying students with ED, and who may be eligible to receive special education and related services under IDEA. We emphasize that no one instrument can be used to identify students as ED, but the compelling evidence of reliability and validity of the SAED RS scores indicates that the RS is well positioned to play a significant role in the identification of students with ED. For state and local school administrators, evidence of internal structure of the SAED-RS scores indicates that this assessment procedure can help operationally define the federal definition of ED and help meet the IDEA mandates. For researchers interested in studying school-identified students with ED, the SAED-RS provides a psychometrically sound measurement for studying important issues related to the education of students with ED, especially clarifying the characteristics of this student population, and potentially determining individual and group responses to selected school-based interventions, and measuring the long-term outcomes of educational interventions.</p> <ref id="AN0156443030-12"> <title> References </title> <blist> <bibl id="bib1" idref="ref25" type="bt">1</bibl> <bibtext> Achenbach T. M. (2009). The Achenbach System of Empirically Based Assessment (ASEBA): Development, findings, theory, and applications. University of Vermont Research Center for Children, Youth, & Families.</bibtext> </blist> <blist> <bibl id="bib2" idref="ref27" type="bt">2</bibl> <bibtext> Algozzine B. (2017). Toward an acceptable definition of emotional disturbance: Waiting for the change. Behavioral Disorders, 42, 136–144.</bibtext> </blist> <blist> <bibl id="bib3" idref="ref28" type="bt">3</bibl> <bibtext> Becker S., Peternite C., Evans S., Andrews C., Christensen O., Kraan E., Weist M. (2011). Eligibility, assessment and educational placement issues for students classified with emotional disturbance: Federal and state-level analyses. School Mental Health, 3, 24–34.</bibtext> </blist> <blist> <bibl id="bib4" idref="ref52" type="bt">4</bibl> <bibtext> Bentler P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238–246.</bibtext> </blist> <blist> <bibl id="bib5" idref="ref54" type="bt">5</bibl> <bibtext> Boomsma A. (2000). Reporting analyses of covariance structures. Structural Equation Modeling, 7, 461–483.</bibtext> </blist> <blist> <bibl id="bib6" idref="ref9" type="bt">6</bibl> <bibtext> Bradley R., Doolittle J., Bartolotta R. (2008). Building on the data and adding to the discussion: The experiences and outcomes of students with emotional disturbance. Journal of Behavioral Education, 17, 4–23. https://doi.org/10.1007/s10864-007-9058-6</bibtext> </blist> <blist> <bibl id="bib7" idref="ref48" type="bt">7</bibl> <bibtext> Brouwer D., Meijer R. R., Zevalkink J. (2013). On the factor structure of the Beck Depression Inventory-II: G is the key. Psychological Assessment, 25, 136–145. https://doi.org/10.1037/a0029228</bibtext> </blist> <blist> <bibl id="bib8" idref="ref60" type="bt">8</bibl> <bibtext> Brown T. A. (2006). Confirmatory factor analysis for applied research. Guilford Press.</bibtext> </blist> <blist> <bibl id="bib9" idref="ref56" type="bt">9</bibl> <bibtext> Browne M. W., Cudeck R. (1993). Alternative ways of assessing model fit. In Bollen K. A., Long J. S. (Eds.), Testing structural equation models (pp. 136–162). SAGE.</bibtext> </blist> <blist> <bibtext> Conroy M. A., Hendrickson J. M., Sester P. P. (2004). Early identification and prevention of emotional and behavioral disorders. In Rutherford R. B., Quinn M. M., Mathur S. R. (Eds.), Handbook of research in emotional and behavioral disorders (pp. 199–215). Guilford Press.</bibtext> </blist> <blist> <bibtext> Costello E. J., Mustillo S., Erkanli A., Keeler G., Angold A. (2003). Prevalence and development psychiatric disorders in childhood and adolescence. Archives of General Psychiatry, 60, 837–844. https://doi.org/10.1001/archpsyc.60.8.837</bibtext> </blist> <blist> <bibtext> Cullinan D., Harniss M. K., Epstein M. H., Ryser G. (2002). The Scale for Assessing Emotional Disturbance: Concurrent validity. Journal of Child and Family Studies, 10, 449–466.</bibtext> </blist> <blist> <bibtext> DeMars C. E. (2013). A tutorial on interpreting bifactor model scores. International Journal of Testing, 13, 354–378. https://doi.org/I0.1080/15305058.2013.799067</bibtext> </blist> <blist> <bibtext> Epstein M. H., Cullinan D. (1998). Scale for Assessing Emotional Disturbance (SAED). Pro-Ed.</bibtext> </blist> <blist> <bibtext> Epstein M. H., Cullinan D., Harniss M. K., Ryser G. (1999). The scale for assessing emotional disturbance: Test-retest and interrater reliability. Behavioral Disorders, 24, 222–230.</bibtext> </blist> <blist> <bibtext> Epstein M. H., Cullinan D., Pierce C., Huscroft-D'Angelo J., Wery J. (2020). Scales for assessing emotional disturbance (3rd ed.). Pro-Ed.</bibtext> </blist> <blist> <bibtext> Epstein M. H., Cullinan D., Ryser G., Pearson N. (2002). Development of a scale to assess emotional disturbance. Behavioral Disorders, 28, 5–22. https://doi.org/10.1177/019874290202800101</bibtext> </blist> <blist> <bibtext> Epstein M. H., Nordness P. D., Cullinan D., Hertzog M. (2002). Scale for assessing emotional disturbance: Long term test-retest reliability and convergent validity with kindergarten and first grade students. Remedial and Special Education, 23, 141–148. https://doi.org/10.1177/07419325020230030201</bibtext> </blist> <blist> <bibtext> Essex M., Kraemer H. C., Slattery M. J., Burk L. R., Boyce W. T., Woodward H. R., Kupfer D. J. (2009). Screening for childhood mental health problems: Outcomes and early identification. Journal of Child Psychology and Psychiatry, 50, 562–570. https://doi.org/10.1111/j.1469-7610.2008.02015.x</bibtext> </blist> <blist> <bibtext> Florell D. (2018). Historical foundations. In Grapin S. L., Kranzler J. H. (Eds.), School psychology: Professional issues and practices (pp. 21–41). Springer.</bibtext> </blist> <blist> <bibtext> Forness S. R., Knitzer J. (1992). A new proposed and definition and terminology to replace "serious emotional disturbance" in Individuals with Disabilities Education Act. School Psychology Review, 21, 12–20.</bibtext> </blist> <blist> <bibtext> Ghandour R. M., Sherman L. J., Vladutiu C. J., Ali M. M., Lynch S. E., Bitsko R. H., Blumberg S. J. (2019). Prevalence and treatment of depression, anxiety, and conduct problems in U.S. children. The Journal of Pediatrics, 206, 256–226.</bibtext> </blist> <blist> <bibtext> Glover T. A., Albers C. A. (2007). Considerations for evaluating universal screening assessments. Journal of School Psychology, 45, 117–135. https://doi.org/10.1016/j.jsp.2006.05.005</bibtext> </blist> <blist> <bibtext> Hanchon T. A., Allen R. A. (2013). Identifying students with emotional disturbance: School psychologists' practices and perceptions. Psychology in the Schools, 50, 193–208. https://doi.org/10.1002/pits.21668</bibtext> </blist> <blist> <bibtext> Hanchon T. A., Allen R. A. (2018). The identification of students with emotional disturbance: Moving the field toward responsible assessment practices. chool psychologists' practices and perceptions. Psychology in the Schools, 55, 176–189. https://doi.org/10.1002/pits.22099</bibtext> </blist> <blist> <bibtext> Hu L., Bentler P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55.</bibtext> </blist> <blist> <bibtext> Individuals with Disabilities Education Improvement Act of 2004, Pub. L. No. 108-446, 20, U.S.C. 1400 et seq. (2004)</bibtext> </blist> <blist> <bibtext> Jaffee S. R., Harrington H., Cohen P., Moffitt T. E. (2005). Cumulative prevalence of psychiatric disorder in youths. Journal of the American Academy of Child and Adolescent Psychiatry, 44, 406–407. https://doi.org/10.1097/01.chi.0000155317.38265.61</bibtext> </blist> <blist> <bibtext> Kauffman J. M., Landrum T. J. (2017). Characteristics of emotional and behavioral disorders of children and youth (11th ed.). Pearson.</bibtext> </blist> <blist> <bibtext> Lambert M. C., Cullinan D, Epstein M. H., Martin J. (2021). Differences between students with emotional disturbance, learning disabilities, and without disabilities on the five dimensions of emotional disturbance. Journal of Applied School Psychology. https://doi.org/10.1080/15377903.2021.1895399</bibtext> </blist> <blist> <bibtext> Lambert M. C., Martin J., Epstein M. H., Cullinan D. (2021). Differential item functioning of the Scales for Assessing Emotional Disturbance – 3 Rating Scale for White and Hispanic students. Journal of Emotional and Behavioral Disorders. https://doi.org/10.1177/1063426620988658</bibtext> </blist> <blist> <bibtext> Lambert M. C., Martin J., Epstein M. H., Cullinan D., Katsiyannis A. (2021). Differential item functioning of the Scales for Assessing Emotional Disturbance – 3 Rating Scale for White and African-American students. Psychology in the Schools, 58, 553–568.</bibtext> </blist> <blist> <bibtext> MacCallum R. C., Browne M. W., Sugawara H. M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1(2), 130–149.</bibtext> </blist> <blist> <bibtext> McDonald R. P. (1999). Test theory: A unified treatment. Erlbaum Lawrence.</bibtext> </blist> <blist> <bibtext> Merikangas K. R., He J.-P., Brody D., Fisher P. W., Bourdon K., Koretz D. S. (2010). Prevalence and treatment of mental disorders among U.S. children in the 2001-2004 NHANES. Pediatrics, 125, 75–81. https://doi.org/10.1542/peds.2008-2598</bibtext> </blist> <blist> <bibtext> Merrell K. W., Walker H. M. (2004). Deconstructing a definition: Social maladjustment versus emotional disturbance and moving the EBD field forward. Psychology in the Schools, 41, 899–910. https://doi.org/10.1002/pits.20046</bibtext> </blist> <blist> <bibtext> Mitchell B. S., Kern L., Conroy M. A. (2019). Supporting students with emotional or behavioral disorders: State of the field. Behavioral Disorders, 44, 70–84. https://doi.org/10.1177/0198742918816518</bibtext> </blist> <blist> <bibtext> Mrazek D., Mrazek P. J. (2005). Prevention of psychiatric disorders in children and adolescents. In Sadock B. J., Sadock V. A. (Eds.), Kaplan & Sadock's comprehensive textbook of psychiatry, volume II (pp. 3513–3518). Lippincott Williams & Wilkins.</bibtext> </blist> <blist> <bibtext> Muthén L. K., Muthén B. O. (1998-2014). Mplus user's guide (7th ed.).</bibtext> </blist> <blist> <bibtext> National Association of School Psychologists. (2016). School psychologists' involvement in assessment.</bibtext> </blist> <blist> <bibtext> National Research Council and Institute of Medicine, Committee on the Prevention of Mental Disorders and Substance Abuse Among Children, Youth, and Young Adults: Research Advances and Promising Interventions. (2009). Preventing mental, emotional, and behavioral disorders among young people: Progress and possibilities. In M. E. O'Connell, T. Boat, K. E. Warner (Eds.), Board on children, youth, and families, division of behavioral and social sciences and education. National Academies Press.</bibtext> </blist> <blist> <bibtext> Reise S. P. (2012). The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47, 667–696. https://doi.org/10.1080/00273171.2012.715555</bibtext> </blist> <blist> <bibtext> Reise S. P., Moore T. M., Haviland M. G. (2013). Applying unidimensional item response theory models to psychological data. InGeisinger K. F., Bracken B. A., Carlson J. F., Hansen J.-I. C., Kuncel N. R., Reise S. P., Rodriguez M. C. (Eds.), APA handbooks in psychology. APA handbook of testing and assessment in psychology, Vol. 1. Test theory and testing and assessment in industrial and organizational psychology (pp. 101–119). American Psychological Association. https://doi.org/10.1037/14047-006</bibtext> </blist> <blist> <bibtext> Reynolds C. R., Kamphaus R. W. (2015). Behavioral Assessment System for Children Third Edition (BASC-3). Pearson.</bibtext> </blist> <blist> <bibtext> Rodriquez A., Reise S. P., Haviland M. G. (2016). Evaluating bifactor models: Calculating and interpreting statistical indices. Psychological Methods, 21, 137–150. https://doi.org/10.1037/met0000045</bibtext> </blist> <blist> <bibtext> Skiba R., Grizzle K. (1992). The social maladjustment exclusion: Issues of definition and assessment. School Psychology Review, 20, 580–598.</bibtext> </blist> <blist> <bibtext> Steiger J. H., Lind J. C. (1980). Statistically-based tests for the number of common factors. Paper presented at the annual Spring Meeting of the Psychometric Society in Iowa City.</bibtext> </blist> <blist> <bibtext> U.S. Department of Education. (2018). 40th annual report to Congress on the implementation of the Individuals with Disabilities Education Act. <ulink href="http://www.ed.gov/about/reports/annual/osep">http://www.ed.gov/about/reports/annual/osep</ulink></bibtext> </blist> <blist> <bibtext> U.S. Department of Health and Human Services. (1999). Mental health: A report of the Surgeon General. U.S. Department of Health and Human Services, Substance Abuse and Mental Health Services Administration, Center for Mental Health Services, National Institutes of Health, National Institute of Mental Health.</bibtext> </blist> <blist> <bibtext> Wagner M. W., Kutash K., Duchnowski A. J., Epstein M. H., Sumi W. C. (2005). The children and youth we serve: A national picture of the characteristics of students with emotional disturbances receiving special education. Journal of Emotional and Behavioral Disorders, 13, 79–96. https://doi.org/10.1177/10634266050130020201</bibtext> </blist> </ref> <ref id="AN0156443030-13"> <title> Footnotes </title> <blist> <bibtext> It is important to note that the second and third authors are developers of the SAED-3, and receive royalties from sales of the assessment. The fourth author is currently employed by the SAED-3 publisher, and therefore has an indirect financial interest in the assessment. It is also important to note that the data were analyzed and interpreted by the lead author independently from the other authors. The lead author has neither a financial interest related to the SAED-3 nor any other conflict of interest related to this study.</bibtext> </blist> <blist> <bibtext> The author(s) received no financial support for the research, authorship, and/or publication of this article.</bibtext> </blist> </ref> <aug> <p>By Matthew C. Lambert; Douglas Cullinan; Michael H. Epstein and Jodie Martin</p> <p>Reported by Author; Author; Author; Author</p> </aug> <nolink nlid="nl1" bibid="bib28" firstref="ref1"></nolink> <nolink nlid="nl2" bibid="bib35" firstref="ref2"></nolink> <nolink nlid="nl3" bibid="bib41" firstref="ref3"></nolink> <nolink nlid="nl4" bibid="bib49" firstref="ref4"></nolink> <nolink nlid="nl5" bibid="bib22" firstref="ref5"></nolink> <nolink nlid="nl6" bibid="bib27" firstref="ref6"></nolink> <nolink nlid="nl7" bibid="bib29" firstref="ref7"></nolink> <nolink nlid="nl8" bibid="bib48" firstref="ref8"></nolink> <nolink nlid="nl9" bibid="bib50" firstref="ref11"></nolink> <nolink nlid="nl10" bibid="bib11" firstref="ref12"></nolink> <nolink nlid="nl11" bibid="bib19" firstref="ref13"></nolink> <nolink nlid="nl12" bibid="bib10" firstref="ref14"></nolink> <nolink nlid="nl13" bibid="bib38" firstref="ref15"></nolink> <nolink nlid="nl14" bibid="bib23" firstref="ref17"></nolink> <nolink nlid="nl15" bibid="bib40" firstref="ref18"></nolink> <nolink nlid="nl16" bibid="bib20" firstref="ref19"></nolink> <nolink nlid="nl17" bibid="bib21" firstref="ref20"></nolink> <nolink nlid="nl18" bibid="bib24" firstref="ref21"></nolink> <nolink nlid="nl19" bibid="bib25" firstref="ref22"></nolink> <nolink nlid="nl20" bibid="bib36" firstref="ref23"></nolink> <nolink nlid="nl21" bibid="bib46" firstref="ref24"></nolink> <nolink nlid="nl22" bibid="bib44" firstref="ref26"></nolink> <nolink nlid="nl23" bibid="bib37" firstref="ref29"></nolink> <nolink nlid="nl24" bibid="bib16" firstref="ref30"></nolink> <nolink nlid="nl25" bibid="bib14" firstref="ref31"></nolink> <nolink nlid="nl26" bibid="bib12" firstref="ref32"></nolink> <nolink nlid="nl27" bibid="bib17" firstref="ref33"></nolink> <nolink nlid="nl28" bibid="bib15" firstref="ref34"></nolink> <nolink nlid="nl29" bibid="bib18" firstref="ref36"></nolink> <nolink nlid="nl30" bibid="bib30" firstref="ref37"></nolink> <nolink nlid="nl31" bibid="bib31" firstref="ref39"></nolink> <nolink nlid="nl32" bibid="bib32" firstref="ref40"></nolink> <nolink nlid="nl33" bibid="bib39" firstref="ref42"></nolink> <nolink nlid="nl34" bibid="bib34" firstref="ref45"></nolink> <nolink nlid="nl35" bibid="bib42" firstref="ref46"></nolink> <nolink nlid="nl36" bibid="bib13" firstref="ref47"></nolink> <nolink nlid="nl37" bibid="bib43" firstref="ref49"></nolink> <nolink nlid="nl38" bibid="bib45" firstref="ref50"></nolink> <nolink nlid="nl39" bibid="bib47" firstref="ref53"></nolink> <nolink nlid="nl40" bibid="bib26" firstref="ref55"></nolink> <nolink nlid="nl41" bibid="bib33" firstref="ref58"></nolink>
Header DbId: eric
DbLabel: ERIC
An: EJ1337993
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Factor Structure of the Scales for Assessing Emotional Disturbance -- 3 Rating Scale for Students Identified with Emotional Disturbance
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Lambert%2C+Matthew+C%2E%22">Lambert, Matthew C.</searchLink><br /><searchLink fieldCode="AR" term="%22Cullinan%2C+Douglas%22">Cullinan, Douglas</searchLink><br /><searchLink fieldCode="AR" term="%22Epstein%2C+Michael+H%2E%22">Epstein, Michael H.</searchLink><br /><searchLink fieldCode="AR" term="%22Martin%2C+Jodie%22">Martin, Jodie</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Behavioral+Disorders%22"><i>Behavioral Disorders</i></searchLink>. May 2022 47(3):187-195.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: SAGE Publications and Hammill Institute on Disabilities. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 9
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2022
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Elementary+Secondary+Education%22">Elementary Secondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Emotional+Disturbances%22">Emotional Disturbances</searchLink><br /><searchLink fieldCode="DE" term="%22Rating+Scales%22">Rating Scales</searchLink><br /><searchLink fieldCode="DE" term="%22Students+with+Disabilities%22">Students with Disabilities</searchLink><br /><searchLink fieldCode="DE" term="%22Symptoms+%28Individual+Disorders%29%22">Symptoms (Individual Disorders)</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Validity%22">Test Validity</searchLink><br /><searchLink fieldCode="DE" term="%22Factor+Structure%22">Factor Structure</searchLink><br /><searchLink fieldCode="DE" term="%22Disability+Identification%22">Disability Identification</searchLink><br /><searchLink fieldCode="DE" term="%22Psychometrics%22">Psychometrics</searchLink><br /><searchLink fieldCode="DE" term="%22Elementary+Secondary+Education%22">Elementary Secondary Education</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Evaluation%22">Student Evaluation</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1177/01987429211012328
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 0198-7429
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: This study examined the internal structure of the Scales for Assessing Emotional Disturbance-3 Rating Scale (RS), a teacher-completed RS developed to measure emotional disturbance (ED). As defined in U.S. law and regulations, ED involves five characteristics or patterns of behavioral and emotional maladaptation. RS data obtained on a sample of students with ED were used to examine validity evidence based on the internal structure of the assessment. Of particular interest was the extent to which multivariate factors derived from the RS data conform to the five characteristics of ED stated in the definition. Results indicate that the RS data fit a 5-factor model reasonably well. A subsequent bifactor analysis identified a considerable proportion of common variance across factors, suggesting the presence of a strong general ED factor, two distinct group factors (Inability to Learn and Inappropriate Behavior), and three weak group factors. The findings provided evidence of the validity of the SAED-3 RS based on internal structure and pointed to support for use of the RS in contributing to the process of determining whether a student qualifies for the ED education disability. Implications for improved research on the nature of ED and how students with ED can be better served are discussed.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2022
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1337993
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1337993
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1177/01987429211012328
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 9
        StartPage: 187
    Subjects:
      – SubjectFull: Emotional Disturbances
        Type: general
      – SubjectFull: Rating Scales
        Type: general
      – SubjectFull: Students with Disabilities
        Type: general
      – SubjectFull: Symptoms (Individual Disorders)
        Type: general
      – SubjectFull: Test Validity
        Type: general
      – SubjectFull: Factor Structure
        Type: general
      – SubjectFull: Disability Identification
        Type: general
      – SubjectFull: Psychometrics
        Type: general
      – SubjectFull: Elementary Secondary Education
        Type: general
      – SubjectFull: Student Evaluation
        Type: general
    Titles:
      – TitleFull: Factor Structure of the Scales for Assessing Emotional Disturbance -- 3 Rating Scale for Students Identified with Emotional Disturbance
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Lambert, Matthew C.
      – PersonEntity:
          Name:
            NameFull: Cullinan, Douglas
      – PersonEntity:
          Name:
            NameFull: Epstein, Michael H.
      – PersonEntity:
          Name:
            NameFull: Martin, Jodie
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 05
              Type: published
              Y: 2022
          Identifiers:
            – Type: issn-print
              Value: 0198-7429
          Numbering:
            – Type: volume
              Value: 47
            – Type: issue
              Value: 3
          Titles:
            – TitleFull: Behavioral Disorders
              Type: main
ResultId 1