View in EDS HTML Full Text PDF Full Text

Redefining Individual Growth and Development Indicators: Phonological Awareness

Saved in:
Bibliographic Details
Title: Redefining Individual Growth and Development Indicators: Phonological Awareness
Language: English
Authors: Wackerle-Hollman, Alisha K., Schmitt, Braden A., Bradfield, Tracy A., Rodriguez, Michael C., McConnell, Scott R.
Source: Grantee Submission. 2015 48(5):495-510.
Peer Reviewed: Y
Page Count: 16
Publication Date: 2015
Sponsoring Agency: Institute of Education Sciences (ED)
Contract Number: R324C080011
Document Type: Journal Articles
Reports - Research
Descriptors: Phonological Awareness, Individual Development, Response to Intervention, Early Experience, Early Reading, Outcome Measures, Psychometrics, Measures (Individuals), Standardized Tests, Item Analysis, Evaluation Criteria, Correlation, Achievement Gains, Achievement Rating, Achievement Tests, Item Response Theory, Young Children
DOI: 10.1177/0022219413510181
Abstract: Learning to read is one of the most important indicators of academic achievement. The development of early literacy skills during the preschool years is associated with improved reading outcomes in later grades. One of these skill areas,phonological awareness, shows particular importance because of its strong link to later reading success. Presented here are two studies that describe the development and revision of four measures of phonological awareness skills: Individual Growth and Development Indicators Sound Blending, Syllable Sameness, Rhyming, and Alliteration 2.0. The authors discuss the measure development process, revision, and utility within an early childhood Response to Intervention framework. [This article was published in "Journal of Learning Disabilities," (EJ1070909).]
Abstractor: As Provided
IES Funded: Yes
Entry Date: 2020
Accession Number: ED605881
Database: ERIC
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
    Url: https://content.ebscohost.com/cds/retrieve?content=AQICAHj0k_4E0hTGH8RJwT4gCJyBsGNe_WN95AvKlDbXJGqwxwHArS1MHnzqPFdn1AVQeJUJAAAA4jCB3wYJKoZIhvcNAQcGoIHRMIHOAgEAMIHIBgkqhkiG9w0BBwEwHgYJYIZIAWUDBAEuMBEEDIQPdaqDO1eOJE_5NwIBEICBmnYAdQXbqSXUaH5DT5kQEUiXeujLh_JxVxx_7T19_Js0MjZ_hy9kZW99wjWezgd-JW3h1Aa3xs1_0R8gsuhcTruycOpWvlK_0y_uzpP3TN269D-XJIhj1Ejl6GWMX3qq34MSUOArIBzkHYbUnyBBeeliRsXWRSVnnynSqVlgPhvs1UrQLSfj5pnD_QBxuf_j9C97TRwnLTfnU5c=
Text:
  Availability: 1
  Value: <anid>AN0109198109;led01sep.15;2015Sep01.13:46;v2.2.500</anid> <title id="AN0109198109-1">Redefining Individual Growth and Development Indicators </title> <p>Learning to read is one of the most important indicators of academic achievement. The development of early literacy skills during the preschool years is associated with improved reading outcomes in later grades. One of these skill areas, phonological awareness, shows particular importance because of its strong link to later reading success. Presented here are two studies that describe the development and revision of four measures of phonological awareness skills: Individual Growth and Development Indicators Sound Blending, Syllable Sameness, Rhyming, and Alliteration 2.0. The authors discuss the measure development process, revision, and utility within an early childhood Response to Intervention framework.</p> <p>preschool age; assessment; early literacy reading; early literacy; phonological awareness; Response to Intervention; Individual Growth and Development Indicators</p> <p>Learning to read is one of the most important indicators of academic success ([<reflink idref="bib38" id="ref1">38</reflink>] ). A growing body of research highlights the association between the development of early literacy skills during the preschool and very early elementary grades and improved reading outcomes in later grades ([<reflink idref="bib38" id="ref2">38</reflink>] ). During the preschool years (ages 3 to 5), research indicates a defined set of skills as precursors, and in some cases prerequisites, to establish the groundwork for learning to read (e.g., [<reflink idref="bib32" id="ref3">32</reflink>] ). These skills, termed early or emergent literacy, capture the foundational elements essential for reading in the elementary grades ([<reflink idref="bib42" id="ref4">42</reflink>] ).</p> <p>Both empirical and theoretical research suggests early literacy comprises at least four key domains ([<reflink idref="bib29" id="ref5">29</reflink>] ; [<reflink idref="bib37" id="ref6">37</reflink>] ; [<reflink idref="bib42" id="ref7">42</reflink>] ) These domains include (a) alphabet knowledge and concepts about print, or the ability to recognize and produce letter names and sounds and understand conventions of written text ([<reflink idref="bib25" id="ref8">25</reflink>] ); (b) comprehension, or the ability to gain information and draw inference from written and/or spoken language ([<reflink idref="bib38" id="ref9">38</reflink>] ); (c) oral language, or a child’s expressive and receptive vocabulary ([<reflink idref="bib12" id="ref10">12</reflink>] ); and (d) phonological awareness, or the ability to detect and manipulate words at the level of phonemes, the smallest units of spoken language ([<reflink idref="bib4" id="ref11">4</reflink>] ).</p> <hd id="AN0109198109-2">Phonological Awareness</hd> <p>Of the four domains of early literacy identified here, phonological awareness holds particular importance to educators because of its strong link and contribution to later reading success ([<reflink idref="bib2" id="ref12">2</reflink>] ; [<reflink idref="bib31" id="ref13">31</reflink>] ). Study findings have illustrated that students with strong phonological awareness skills at the preschool and kindergarten level are likely to be more proficient readers at third grade ([<reflink idref="bib31" id="ref14">31</reflink>] ; [<reflink idref="bib41" id="ref15">41</reflink>] ). Furthermore, research recognizes specific skills characteristic of phonological awareness, including rhyming, alliteration, blending, and elision, contribute to robust reading performance. For example, student ability to isolate and identify phonemes at 4 and 5 years of age has been shown to predict student performance on word reading and comprehension tasks in second grade ([<reflink idref="bib31" id="ref16">31</reflink>] ). Similarly, [<reflink idref="bib24" id="ref17">24</reflink>] have found that preschool-age children’s performance on blending tasks is highly correlated with beginning reading assessments at the end of first grade.</p> <p>Based on the critical link between phonological awareness and later reading success, a considerable effort has been placed on identifying the component skills and the conceptual and pragmatic trajectory of the development of those skills within phonological awareness. At least three models exist in the research literature that align phonological awareness with a continuum of early literacy skill development. [<reflink idref="bib19" id="ref18">19</reflink>] proposed that phonological awareness skills develop in three consecutive phases moving from largest to smallest units of text, where development during the preschool years (Phase 1) is represented by rhyme and alliteration awareness, followed by the development of phoneme-level knowledge and phonemic awareness (Phase 2). Goswami and Bryant close the continuum with the development of beginning reading skills, and as a result, spelling skills, finally culminating in a fluent reading experience (Phase 3; [<reflink idref="bib7" id="ref19">7</reflink>] ; [<reflink idref="bib20" id="ref20">20</reflink>] ).</p> <p>Similarly, [<reflink idref="bib17" id="ref21">17</reflink>] suggested phonological awareness can be separated into two types: epilinguistic awareness and metalinguistic awareness. Epilinguistic awareness is the global awareness of similarities between speech sounds gathered from previous knowledge or environmental stimuli. Metalinguistic awareness is the conscious awareness of phonological segments within words (e.g., phonemes). Tasks that require compartmentalizing words by deleting, combining, or replacing sounds in words are metalinguistic ([<reflink idref="bib7" id="ref22">7</reflink>] ).</p> <p>Another pragmatic model, put forth by [<reflink idref="bib3" id="ref23">3</reflink>] , more directly specifies a continuum of skill development from preschool to fluent reading that includes word awareness, syllable awareness, onset-rime awareness, and phoneme awareness. Each skill set includes specific tasks related to phonological and phonemic awareness. For example, onset-rime awareness includes tasks such as alliteration ([<reflink idref="bib33" id="ref24">33</reflink>] ). The continuum of skills moves from largest to smallest units as well as from least to most complex. Together these theories and related skills demonstrate that phonological awareness is a dynamic domain, with relevant assessments capturing a variety of contributing skills.</p> <hd id="AN0109198109-3">Response to Intervention</hd> <p>To appropriately target the needs of all children’s phonological awareness skills, assessment and intervention practices must be tailored to provide a match between a student’s skill level and instructional content ([<reflink idref="bib16" id="ref25">16</reflink>] ). The Response to Intervention (RTI) model is uniquely suited to address these varied needs by implementing a three-tiered system of assessment and intervention.</p> <p>RTI is a framework to identify, monitor, and intervene with students based on individualized student academic need ([<reflink idref="bib15" id="ref26">15</reflink>] ; [<reflink idref="bib23" id="ref27">23</reflink>] ). Students are assessed to determine level of current performance, and intervention services are provided to match this performance level in one of three tiers. Tier 1 features high-quality evidence-based instruction, with complementary periodic screening. Tier 2 provides increased support for those students not making adequate progress in the general universal Tier 1 curriculum and is often presented as small group instruction along with more frequent progress monitoring to evaluate student performance. Tier 3 provides intensive, targeted, and individualized intervention and complementary progress monitoring for those students who continue to make limited progress with additional intervention.</p> <p>In an RTI model, measures used to assess early literacy skills must function in two ways ([<reflink idref="bib15" id="ref28">15</reflink>] ; [<reflink idref="bib22" id="ref29">22</reflink>] ). First, measures must be able to identify individual students who might require a more intensive level of intervention. Second, for those students who are candidates for more intensive instruction and intervention, measures must accurately monitor progress over brief periods of time to continually evaluate if students are improving relevant skills during intervention. Both identification and progress monitoring measures must be psychometrically robust and logistically feasible, allowing educational professionals to gather meaningful data to inform instructional and intervention decisions.</p> <p>At the same time, assessments that demonstrate utility in an RTI model must also achieve additional empirical and pragmatic criteria. To demonstrate psychometric utility in assessing performance over brief periods of time, measures should achieve standard deviations below 50% of the mean to ensure the scale produces scores in the highest and lowest regions of the scale, representing lower and higher levels of performance. Additionally, measures should obtain less than 20% of children with a score of zero and produce skew and kurtosis values less than an absolute value of 1. From a qualitative perspective, measures must also adhere to General Outcome Measurement (GOM) tenets ([<reflink idref="bib28" id="ref30">28</reflink>] ). GOM provides a unique approach for developing measures in that it captures both empirical and functional standards by providing hallmarks of measurement creation, including being brief (between 1 and 2 minutes per task), being easy to administer and easy to interpret, being related to long term goals, having longevity (can be used for at least one academic year), having reliability, having validity, being inexpensive (or easily attainable), and being sensitive to growth over time, as well as demonstrating utility as a progress monitoring measure ([<reflink idref="bib14" id="ref31">14</reflink>] ; [<reflink idref="bib28" id="ref32">28</reflink>] ).</p> <p>Finally, measurement pragmatic standards specific to RTI must also be considered. First, teachers and administrators may find the most utility in measures that are brief and provide meaningful data to inform relevant and efficient instructional changes. Second, although RTI models can be successful with a normative or a criterion reference standard approach, we suggest a criterion reference standard of performance may be more robust (i.e., benchmarks, or attainment or lack of attainment of specific skills, and/or odds ratios that indicate likely mastery of future standards) rather than comparison to a normative peer group, which may limit the assessor’s ability to evaluate a student’s absolute skill level. Third, measures must include a psychometrically robust scale of items to represent the construct of interest, rather than a small number of items that may not provide enough information about areas of skill deficit to inform instruction and intervention.</p> <p>Currently, a number of standardized assessments of phonological awareness for preschool-age children exist, including the Pre-Reading Inventory of Phonological Awareness ([<reflink idref="bib10" id="ref33">10</reflink>] ) and the Test of Preschool Early Literacy (TOPEL; [<reflink idref="bib24" id="ref34">24</reflink>] ). Although these types of measures might adequately support screening decisions in an RTI model, as a stand-alone measure they do not demonstrate utility in meeting the specified needs of RTI.</p> <p>One set of measures that demonstrate potential within an RTI framework are the early literacy Individual Growth and Development Indicators (IGDIs). IGDIs are a set of brief tasks that evaluate early literacy performance in preschool-age children. With a widespread distribution of users across the nation, supported by a long history of research support, the original set of these measures, IGDIs 1.0, have utility in assessment, screening/identification, evaluation, and intervention studies ([<reflink idref="bib23" id="ref35">23</reflink>] ; [<reflink idref="bib27" id="ref36">27</reflink>] ). IGDIs 1.0 were created using the tenets of GOM as a guiding framework. The IGDIs 1.0 feature two phonological awareness measures, Rhyming and Alliteration. Existing data for Rhyming and Alliteration indicate they measure phonological awareness, with moderate levels of convergent and discriminant validity including the Picture Vocabulary Test–3 ([<reflink idref="bib11" id="ref37">11</reflink>] ; [<reflink idref="bib28" id="ref38">28</reflink>] = .40 to .62), Concepts About Print ([<reflink idref="bib8" id="ref39">8</reflink>] ; [<reflink idref="bib25" id="ref40">25</reflink>] = .34 to .64), and the Test of Phonological Awareness ([<reflink idref="bib39" id="ref41">39</reflink>] ; r = .44 to .79), demonstrated in empirical contributions from [<reflink idref="bib26" id="ref42">26</reflink>] , [<reflink idref="bib30" id="ref43">30</reflink>] , and [<reflink idref="bib34" id="ref44">34</reflink>] ([<reflink idref="bib13" id="ref45">13</reflink>] ). Similarly, moderate to high test-retest coefficients were obtained for both tasks (.83 to .89 for Rhyming and .46 to .80 for Alliteration; [<reflink idref="bib13" id="ref46">13</reflink>] ). These research findings suggest the measures demonstrate some degree of utility and psychometric adequacy; however, they have significant shortcomings ([<reflink idref="bib27" id="ref47">27</reflink>] ).</p> <p>The development of the IGDIs 1.0 was not based on classical test theory. Given this, the data accompanying performance are based on sample-dependent observed scores and typically are used to track normative development, limiting assessors from evaluating student performance based on absolute skill level.</p> <p>Additionally, because Rhyming and Alliteration are measures that require students to respond to onset rime and/or syllable-level units (fitting within [<reflink idref="bib19" id="ref48">19</reflink>] first phase of phonological awareness with a moderate level of word complexity), the tasks may be too difficult for many preschool-age students. Studies demonstrate that students who are 3 to 4 years of age often receive scores of zero, suggesting the Rhyming and Alliteration IGDIs 1.0 have limited utility with young preschool children ([<reflink idref="bib36" id="ref49">36</reflink>] ; [<reflink idref="bib40" id="ref50">40</reflink>] ). Finally, the standardized administration instructions for IGDIs 1.0 specify that the entire set of items is randomly shuffled prior to administration, and information is not consistently gathered about item-level performance. Information is also not gathered about item difficulty or discrimination, preventing assessors, test developers, and users to make more fine-grained evaluations of child performance.</p> <p>To address these challenges, the measures developed here followed an iterative research and development process using item response theory ([<reflink idref="bib18" id="ref51">18</reflink>] ; [<reflink idref="bib1" id="ref52">1</reflink>] ) generally and [<reflink idref="bib43" id="ref53">43</reflink>] measurement construction framework specifically to respond to the first function of assessment within an RTI model: identifying students in need of additional intervention</p> <p>Wilson’s framework was used to conceptually support and design items, define item characteristics such as responses of interest and parameters for scoring, and statistically model performance (for a detailed description of Wilson’s model, see [<reflink idref="bib43" id="ref54">43</reflink>] ). Wilson’s model employs four processes: construct mapping, defining the item response, defining the outcome space, and selecting a measurement model. Prior to Study 1 we developed a construct map to provide a strong guide for interpretation. The construct map included an operational definition of phonological awareness, as previous described, through comprehensive literature review and expert contributions. We then used the construct map as a foundation for item design. Items were constructed as manifestations of the construct to capture student performance in each domain and revised through an iterative process across the three studies presented here. These three studies then gathered student performance data that have provided important information about how items at different levels of child performance function. The outcome space is where we applied rules for scoring responses and evaluated features of responses to items we constructed. The outcome space facilitated the identification of student responses corresponding to a particular level on the construct and to make meaning of student performance. Finally, following Wilson’s suggestions, work on IGDIs 2.0 employed Rasch modeling and Item Response Theory ([<reflink idref="bib1" id="ref55">1</reflink>] ).</p> <p>Rasch modeling provides an approach that considers both student ability (person parameter) and item-level statistics (item parameter). By locating items and student abilities on the same scale, we can better examine if items are available for students at their given ability levels. Therefore, creating items that surround and include the distribution of student ability offers the most parsimonious assessment of ability.</p> <p>We based this work on Rasch modeling for two reasons. First, pragmatic constraints prevented the use of other IRT models because of the nature and limitation of the sample. In addition, Rasch models provide one-to-one correspondence between Rasch scaled scores and raw scores, to facilitate the ease of number-correct scoring, a hallmark of ease of use in early childhood assessment. In addition, research demonstrates that one-parameter and two-parameter item difficulties are generally correlated at very high levels, typically .98 ([<reflink idref="bib9" id="ref56">9</reflink>] , p. 152). Second, the Rasch model provides a strong framework for instrument design, in that the model facilitates evaluation of item functioning by allowing for the creation and identification of items that fit the model rather than identifying a model to fit the data. By employing the Rasch model to help construct the IGDI 2.0 measures, a conceptually robust foundation for producing appropriate and meaningful scores was utilized, rather than identifying a measurement model to explain variation and perhaps inadequacies in data due to less objectively constructed measures.</p> <p>This article presents the development and related processes used throughout three phases of iterative development to define, pilot, and validate newly revised IGDI 2.0 measures of phonological awareness. This iterative process was designed to maximize efficiency in the development of useful measures for the identification function of RTI assessment; as a result, early phases included smaller samples and broad selection of measures and procedures, with each successive phase deepening methodological rigor and narrowing analytic procedures. These measures, utilizing the strengths of GOM and psychometric advances related to [<reflink idref="bib43" id="ref57">43</reflink>] model and Rasch modeling, may provide a foundation for a robust and seamless measurement model for use in an early childhood RTI model, but represent the first three steps in a continuous process of revision and validation.</p> <p>Three studies were conducted under the auspices of the Center for Response to Intervention in Early Childhood (CRTIEC) as part of a larger effort to expand IGDIs to capture all domains of early literacy and to revise existing measures as appropriate. Study 1 describes the primary development and initial measure design, selection, and piloting, including examining psychometric and practical properties of several potential measures of phonological awareness; this first study represents an empirical “test of concept” for possible identification measures. Study 2 describes the revision and validation of the most promising measures and testing with a larger, more diverse sample, providing a more robust test of psychometric characteristics of full prototypes of RTI identification item pools. Finally, Study 3 describes the final iteration of revised items designed to uniquely examine performance to discern Tier 1 and Tier 2 or Tier 3 intervention candidates.</p> <hd id="AN0109198109-4">Study 1: Developing and Piloting New Measures</hd> <p>The purpose of Study 1 was to review procedures for initial measure design and selection, to examine the psychometric and practical properties of newly developed IGDIs 2.0, and to select individual measurement formats for further research and development. Specifically, this study sought to answer the following questions: (a) To what extent do the selected measures relate to one another? (b) To what extent do individual measures relate to standardized measures of phonological awareness? And (c) how do the IGDI 2.0 measures perform at the item level?</p> <hd id="AN0109198109-5">Literature Review</hd> <p>A comprehensive literature review was completed in order to determine a consistent definition of “phonological awareness” (see [<reflink idref="bib29" id="ref58">29</reflink>] , for more information on this review). A keyword search using phonological awareness and phonemic awareness within Education Full Text and Psych Info yielded nine peer-reviewed articles published after 2006 that featured the conceptual development of either phonological awareness or phonemic awareness and targeted preschool-age children. The variety of definitions within the articles yielded common elements, including an understanding that words are made up of individual sounds and the ability to recognize and manipulate sounds. Synthesis of the articles revealed phonological awareness may be best defined as “the ability to detect and manipulate the sound’s structure of words independent from their meanings” ([<reflink idref="bib33" id="ref59">33</reflink>] , p. 3).</p> <hd id="AN0109198109-6">Method</hd> <hd id="AN0109198109-7">Measure Design: Phonological Awareness</hd> <p>To capture phonological awareness skills, four tasks were created or revised (see [<reflink idref="bib1" id="ref60">1</reflink>] for a description of each measure and a summary of quantitative and qualitative prepilot responses to the tasks). In addition to two previous versions of Rhyming 1.0 and Alliteration 1.0, four new tasks were tested: Rhyming 2.0, Alliteration 2.0, Syllable Sameness, and Sound Blending.</p> <hd id="AN0109198109-8"> Phonological Measure Development and Qualitative Results.</hd> <ct id="AN0109198109-9"> ..CHT.-</ct> <p> <ephtml> <table><colgroup><col align="left" /><col align="char" char="." /><col align="char" char="." /><col align="left" /><col align="char" char="." /></colgroup><tr><th align="left">Measure Description</th><th align="center">Type</th><th align="center">M (Range)</th><th align="center">Qualitative Results Summary (n = 10)</th><th align="center">Selected for Study 1</th></tr><tr><td>Syllable Segmenting required the child to correctly clap the syllable pattern of two-, three-, or four-syllable words, presented verbally (e.g., “elephant” should elicit three consecutive claps).</td><td>1, 3</td><td>8.25 (0 to 18)</td><td>Syllable Segmentation received a dichotomous response pattern where responses were either consistently two claps regardless of the prompt, or nearing 100% accuracy. Syllable Segmentation took 5 to 6 minutes to administer and score.</td><td>No</td></tr><tr><td>Rhyming required the child to identify a word that rhymes with a target word, given three choices illustrated pictorially.</td><td>2, 4</td><td>N/A</td><td>No results were obtained in the prepilot because the format of Rhyming did not substantially change from IGDIs 1.0.</td><td>Yes</td></tr><tr><td>Alliteration required the child to identify a word that starts with the same sound as the target word, given three choices illustrated pictorially. Each item included an example alliterative, emphasizing a name or adjective that starts with the same initial sound as the target (e.g., Dan the Dog). Whenever possible, the target pictures name or adjective were monosyllabic.</td><td>2, 4</td><td>5.82 (4 to 9)</td><td>Alliteration response patterns suggested students enjoyed and could complete the task. Assessors reported Alliteration was highly engaging and easy to administer and score. Alliteration took 6 to 7 minutes to administer and score.</td><td>Yes</td></tr><tr><td>Sound Blending required the child to produce a word given a prompt including a word, syllable, or phoneme blend (e.g., the syllables /wa/ /ter/ should elicit the word water).</td><td>2, 3</td><td>4.75 (0 to 14)</td><td>Sound Blending received a dichotomous response pattern; students seemed to understand the task (i.e., nearing 100% accuracy) or clearly did not grasp the concept at all and could not blend (i.e., repeating the prompt verbatim). Assessors reported students struggled more with phoneme-level items compared to syllable- and word-level items. Sound Blending took 5 to 6 minutes to administer and score.</td><td>Yes</td></tr></table> </ephtml> </p> <p>-1 Note. IGDI = Individual Growth and Development Indicator. Each task was timed for 2 minutes and a score was given as the number correct. 1= Manipulation; 2 = detection; 3 = production; 4 = multiple-choice.</p> <hd id="AN0109198109-10">Participants and setting</hd> <p>A total of 47 children enrolled in three childcare centers in the Upper Midwest participated in this investigation. An economically diverse sample was recruited from two centers located in suburban areas serving a predominately Caucasian population and one located in an urban area serving a predominately Asian American population. Children ranged in age from 36 to 71 months. Fourteen of the children were 3 years old (36 to 47 months), 19 children were 4 years old (48 to 59 months), and 14 children were 5 years old (60 to 71 months). Twenty-one (44.6%) were female and 26 (55.4%) were male.</p> <hd id="AN0109198109-11">Measures</hd> <hd id="AN0109198109-12">Alliteration 1.0</hd> <p>Alliteration 1.0 was drawn from existing IGDIs ([<reflink idref="bib13" id="ref61">13</reflink>] ) and is an individually administered assessment in which the child identifies from three alternatives a word that starts with the same sound as a provided target. Participants were presented with an 8.5 × 5.5 inch card with four pictures arranged in one row and three alternatives below the centered target. Following an introduction, instruction on how to complete the task, and four practice trials, the administrator read standardized directions to the child: “Point to the picture that starts with the same sound as ____.” The number of cards answered correctly in 2 minutes was recorded as the child’s score.</p> <hd id="AN0109198109-13">Rhyming 1.0</hd> <p>Rhyming 1.0 is an existing individually administered IGDI measure ([<reflink idref="bib13" id="ref62">13</reflink>] ) in which the child identifies from three alternatives a word that rhymes with a provided target word. Participants were presented with an 8.5 × 5.5 inch card with four pictures arranged in one row and three alternatives below the centered target. Following an introduction, instruction on how to complete the task, and four practice trials, the administrator read standardized directions to the child: “Point to the picture that rhymes with or sounds the same as_____.” The number of cards answered correctly in 2 minutes was recorded as the child’s score.</p> <hd id="AN0109198109-14">Alliteration 2.0</hd> <p>Alliteration 2.0 is a revised version of the original IGDI and is an individually administered assessment in which the child identifies from three alternatives a word that starts with a provided target sound. Participants were presented with an 8.5 × 5.5 inch card with four pictures arranged in one row and three alternatives below the centered target. The target picture also included an adjective or name that started with the same sound (e.g., Dan the Dog) that provided the child with two opportunities to hear the target sound. Following an introduction, instruction on how to complete the task, and four practice trials, the administrator read standardized directions to the child: “Point to the picture that starts like _____.” The number of cards answered correctly in 2 minutes was recorded as the child’s score.</p> <hd id="AN0109198109-15">Rhyming 2.0</hd> <p>Rhyming 2.0 is also a revised version of the original IGDI and is an individually administered assessment in which the child identifies from three alternatives a word that rhymes with a provided target word. Participants were presented with an 8.5 × 5.5 inch card with four pictures arranged in one row and three alternatives below the centered target. Following an introduction, instruction on how to complete the task, and four practice trials, the administrator read the standardized directions to the child: “Point to the picture that rhymes with _____.” The child was shown two example tasks, modeled by the administrator. The number of cards answered correctly in 2 minutes was recorded as the child’s score.</p> <hd id="AN0109198109-16">Sound Blending</hd> <p>Sound Blending is an individually administered assessment in which the student is prompted to blend word segments at the word, syllable, and phoneme level. Sound Blending was presented verbally using two blocks as manipulatives to assist with demonstrating the tasks. Following an introduction, instruction on how to complete the task, and four practice trials, the administrator read the standardized directions to the child: “I’m going to say some words in a funny way. See if you can say them the real way.” Children were then presented with words that had been segmented into two parts (e.g., cow-boy), with the administrator tapping one block with her finger for each sound presented. The number of words blended correctly in 2 minutes was recorded as the student’s score.</p> <hd id="AN0109198109-17">Syllable Segmentation</hd> <p>Syllable Segmentation is a verbal, individually administered assessment in which the child is prompted to clap once for each syllable of simple words. Following an introduction, instruction on how to complete the task, and four practice trials, the administrator read the standardized directions to the child: “When we say words, we can say their parts using claps. We can say elephant like this: /el/-/e/-/phant/.” Administrators clapped one time for each syllable in the word. Children were verbally presented with two-, three-, and four-syllable words. The number of words segmented correctly in 2 minutes was recorded as the child’s score.</p> <hd id="AN0109198109-18">TOPEL</hd> <p>Participants were given the Phonological Awareness subtest of the TOPEL ([<reflink idref="bib24" id="ref63">24</reflink>] ) as a criterion measure of phonological awareness. The subtest includes elision tasks, which required the participant to remove part of a word (e.g., “say sandbox without sand”), and sound blending tasks, in which the participant must blend two parts of a word together (e.g., “What do these sounds make: /Ba/-/t/?”). Raw scores from the Phonological Awareness subtest were used for the purposes of these analyses, to allow for variance due to age. The Phonological Awareness subtest of the TOPEL has a test-retest reliability coefficient of .83. The correlation coefficients for the TOPEL and the elision and blending subtests of the Comprehensive Test of Phonological Processing, were .59 and .65, respectively ([<reflink idref="bib24" id="ref64">24</reflink>] ). Child performance was represented by scale score.</p> <hd id="AN0109198109-19">Procedures</hd> <p>All measures were administered one-on-one with each child by trained undergraduate and/or graduate students. Prior to administration of the measures, the undergraduate and graduate students were trained in standardized procedures for each measure in order to ensure consistent administration across the study. All assessors were monitored using fidelity checklists during training, received feedback regarding administration errors, and were required to remedy errors before using the assessments with participating children.</p> <p>All assessment sessions were conducted on-site at each participating childcare center, either in an empty classroom, conference room, or quiet hallway area. All children were administered four IGDI measures and one criterion measure. To compare the functionality of Alliteration 2.0 and Rhyming 2.0 with existing measures, about half of the children (n = 21) also received two additional measures: Rhyming 1.0 and Alliteration 1.0. In order to decrease the burden on children’s attention, assessments were conducted in two separate sessions, each lasting from 15 to 20 minutes. After each session, the children selected a small toy from a prize box.</p> <hd id="AN0109198109-20">Results</hd> <hd id="AN0109198109-21">Evaluation of Measure Criteria</hd> <p>Descriptive statistics for each Phonological Awareness IGDI and the TOPEL are presented in [<reflink idref="bib2" id="ref65">2</reflink>] . The descriptive statistics listed in [<reflink idref="bib2" id="ref66">2</reflink>] were consistent with the majority of the suggested qualitative criteria for GOMs (e.g., easy to use, brevity, longevity). We also evaluated these measures against empirical criteria for measurement within an RTI model (i.e., SD < 50% of the mean, less than 20% of children with a score of zero, and skew and kurtosis values less than an absolute value of 1). All IGDI measures had SDs that were relatively large compared to the means, all but one of the measures exceeded skew and kurtosis criteria, and all measures obtained zero scores in excess of the 20% standard, with Sound Blending resulting in the highest percentage of children receiving this score (57%). Alliteration 1.0 had the largest skew and kurtosis. Finally, when considering the measurement criteria for use within an RTI model, the IGDI measures were brief enough to provide data-based decision making, evaluate performance based on a criterion-referenced performance standard, and include test construction featuring solely phonological awareness tasks.</p> <hd id="AN0109198109-22"> Study 1 Early Childhood RTI Criteria: Descriptive Statistics.</hd> <ct id="AN0109198109-23"> ..CHT.-</ct> <p> <ephtml> <table><colgroup><col align="left" /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /></colgroup><tr><th align="left">Measure</th><th align="center">N</th><th align="center">M</th><th align="center">SD</th><th align="center">Skew</th><th align="center">Kurtosis</th><th align="center">% of Zero Scores</th></tr><tr><td>Alliteration 1.0</td><td>21</td><td>3.38</td><td>4.48</td><td>1.71</td><td>3.16</td><td>42</td></tr><tr><td>Rhyming 1.0</td><td>21</td><td>6.86</td><td>5.94</td><td>0.08</td><td>−1.58</td><td>33</td></tr><tr><td>Alliteration 2.0</td><td>47</td><td>3.38</td><td>4.34</td><td>1.22</td><td>0.47</td><td>47</td></tr><tr><td>Rhyming 2.0</td><td>47</td><td>4.68</td><td>5.09</td><td>0.55</td><td>−1.15</td><td>45</td></tr><tr><td>Sound Blending</td><td>47</td><td>7.13</td><td>9.17</td><td>0.78</td><td>−0.94</td><td>57</td></tr><tr><td>Syllable Segmenting</td><td>47</td><td>10.91</td><td>10.92</td><td>0.43</td><td>−1.23</td><td>38</td></tr><tr><td>TOPEL PA</td><td>47</td><td>14.38</td><td>6.21</td><td>−0.08</td><td>−0.50</td><td>2</td></tr></table> </ephtml> </p> <p>-2 Note. RTI = Response to Intervention; TOPEL PA = Test of Preschool Early Literacy, Phonological Awareness.</p> <hd id="AN0109198109-24">Relations Among Measures</hd> <p>Correlations between measures were calculated and are included in [<reflink idref="bib3" id="ref67">3</reflink>] . Intercorrelations of all new measures with the older IGDIs 1.0 were small. Intercorrelations with the revised IGDIs 2.0 (Alliteration 2.0 and Rhyming 2.0) and new IGDIs (Sound Blending and Syllable Segmenting) were all moderate or moderate to high. One exception was the correlation between Rhyming 1.0 and Rhyming 2.0 (.71), which was the highest correlation of the group. The lowest correlation was between Rhyming 1.0 and Alliteration 1.0 (.16). Criterion-related validity correlation coefficients for the TOPEL Phonological Awareness were at or above .27, with Sound Blending at .70.</p> <hd id="AN0109198109-25"> Study 1 Correlation Between Measures.</hd> <ct id="AN0109198109-26"> ..CHT.-</ct> <p> <ephtml> <table><colgroup><col align="left" /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /></colgroup><tr><th align="left">Measure</th><th align="center">Alliteration 1.0</th><th align="center">Rhyming 1.0</th><th align="center">Alliteration 2.0</th><th align="center">Rhyming 2.0</th><th align="center">Sound Blending</th><th align="center">Syllable Segment</th></tr><tr><td>Rhyming 1.0</td><td>.16*</td><td align="center">—</td><td /><td /><td /><td /></tr><tr><td>Alliteration 2.0</td><td>.43</td><td>.61**</td><td align="center">—</td><td /><td /><td /></tr><tr><td>Rhyming 2.0</td><td>.37</td><td>.72**</td><td>.51**</td><td align="center">—</td><td /><td /></tr><tr><td>Sound Blending</td><td>.39</td><td>.22</td><td>.42**</td><td>.55*</td><td align="center">—</td><td /></tr><tr><td>Syllable Segment</td><td>.45*</td><td>.29</td><td>.52**</td><td>.55**</td><td>.59**</td><td align="center">—</td></tr><tr><td>TOPEL PA</td><td>.56**</td><td>.27</td><td>.63**</td><td>.42*</td><td>.70**</td><td>.53**</td></tr></table> </ephtml> </p> <p>-3 Note. TOPEL PA = Test of Preschool Early Literacy, Phonological Awareness.</p> <p>-4 p < .05. **p < .01.</p> <hd id="AN0109198109-27">Item-Level Performance</hd> <p>In addition to descriptive information and correlations, item-level means and item-total correlations for each measure were also examined ([<reflink idref="bib4" id="ref68">4</reflink>] ). Item-level means provide information about individual item difficulty. Item-total correlations indicate the degree to which an item contributes to the overall measure and discriminates between those that do or do not have a trait (e.g., phonological awareness ability). For Alliteration 2.0 and Syllable Segmenting, 80% or more of the item means fell between .20 and .80. This was not the case for Rhyming 2.0 and Sound Blending, where less than 60% of the item means fell between .20 and .80. This indicates that overall the items in Rhyming 2.0 and Sound Blending were too difficult for this sample of children as compared to the items in the Alliteration 2.0 and Syllable Segmenting. Rhyming 2.0 and Sound Blending had fewer items that positively discriminate between children who did and did not have the skills assessed by these measures, as compared to Alliteration 2.0 and Syllable Segmenting.</p> <hd id="AN0109198109-28"> Study 1 Mean Number of Reponses per Item, Range of Item Means, Means, and Item-Total Correlation Ranges by Measure.</hd> <ct id="AN0109198109-29"> ..CHT.-</ct> <p> <ephtml> <table><colgroup><col align="left" /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /></colgroup><tr><th /><th /><th align="center" colspan="2">Item Means</th><th align="center" colspan="2">Item-Total Correlations</th></tr><tr><th align="left">Measure</th><th align="center">Mean Number of Responses per Item</th><th align="center">Range</th><th align="center">% Between .20 and .80</th><th align="center">Range</th><th align="center">% .20 or Above</th></tr><tr><td>Alliteration 2.0</td><td>5.79</td><td>.25 to 1.00</td><td>80</td><td>−.39 to .94</td><td>79</td></tr><tr><td>Rhyming 2.0</td><td>6.03</td><td>.33 to 1.00</td><td>56</td><td>−.53 to .97</td><td>61</td></tr><tr><td>Sound Blending</td><td>8.43</td><td>.40 to 1.00</td><td>37</td><td>−.28 to .70</td><td>43</td></tr><tr><td>Syllable Segmenting</td><td>20.75</td><td>.28 to .83</td><td>100</td><td>.17 to .84</td><td>98</td></tr></table> </ephtml> </p> <hd id="AN0109198109-30">Discussion</hd> <p>This study involved a small-scale examination of the IGDI 2.0 phonological awareness measures, conducted to capture preliminary information such as student response rate, zero responses, and basic descriptive statistics, and to determine which IGDI 2.0 measures were the best candidates for further development and large-scale field testing in Study 2. During item development for pilot testing, GOM features were maintained as much as possible, and as a result the item sets remained timed tasks (1 or 2 minutes). Evaluation of each measure included a comparison of descriptive statistics to predefined GOM and measure criteria, examination of correlations both between measures within the domain and with standardized criterion measures (e.g., TOPEL) to evaluate validity.</p> <p>Finally, initial item-level performance data were examined within each task to provide additional support for selecting measures for further development and testing in Study 2.</p> <hd id="AN0109198109-31">Essential GOM Criteria</hd> <p>GOM criteria remain an important tenet of IGDI 1.0 and 2.0 measures because they align the measurement tools with real-world academic goals and provide the end user with tools that are both socially and psychometrically valid, but also are engaging and brief to administer. Of the GOM characteristics described previously, all six evaluated phonological awareness assessments are quick (2 minutes each) and easy to administer and interpret. Assessors reported Rhyming 2.0 and Alliteration 2.0 were generally easy to administer and interpret. Assessors reported challenges with Syllable Segmenting because the nature of the assessment elicited a dichotomous response set from children. Either children were nearly always accurate and clearly understood the task or children demonstrated a lack of understanding entirely, as illustrated by continually clapping, instead of clapping along with the syllables of the word and very low or zero scores. Sound Blending demonstrated additional challenges because of the nature of the task (manipulation of cubes), pronunciation of separated words, and related pacing of stimuli.</p> <p>In addition, results suggested nearly all of the measures met few of the empirical Early Childhood (EC) RTI criteria. Alliteration 1.0 met none of the criteria; Rhyming 1.0, Rhyming 2.0, and Syllable Segmenting only met the skew criterion; Alliteration 2.0 met only the criterion for kurtosis; and Sound Blending met the criteria for both skewness and kurtosis. It should be noted that none of the measures met the criterion for a standard deviation less than 50% of the sample mean. Because mean performance on the IGDI phonological awareness measures was low relative to the standard deviations, performance at the lower end of the distributions could not be appropriately captured, as illustrated by a significant proportion of zero scores and visual analysis of sample distributions suggesting items were too difficult for this sample. Together, these three criteria (skew, kurtosis, and SD/M ratio) describe the shape of the distribution. Taken together, these findings suggest that the IGDI 2.0 measures are superior to the IGDI 1.0 measures; however, in general, the phonological awareness measures performed poorly among statistical EC RTI criteria, indicating the need for improvement in the measures to accurately capture child performance. In particular, post hoc analyses suggested that items located higher on the ability scale than did children and that future instrument development would require more items at the lower or earlier level of ability.</p> <hd id="AN0109198109-32">Validity Evidence</hd> <p>Validity was examined by evaluating the relation between the IGDI measures within the phonological awareness domain. Intermeasure correlations ranged from weak (Rhyming 1.0 and Alliteration 1.0) to strong (Rhyming 1.0 and Rhyming 2.0). The dramatic variability in internal criterion-related validity correlations suggest some measures may be poor representations of the phonological awareness domain (Alliteration 1.0), while others may be adequate to strong representations (Rhyming 2.0). These findings further support the notion that the IGDI 2.0 measures outperformed the IGDI 1.0 measures; however, all of the current measures of phonological awareness skills had significant room for improvement.</p> <p>The relation between IGDI performance and performance on the TOPEL was also examined to evaluate external criterion-related validity evidence. With the exception of Alliteration 1.0, all measures demonstrated significant correlations with the TOPEL, suggesting the IGDI measures may appropriately access the phonological awareness domain.</p> <hd id="AN0109198109-33">Item-Level Functioning</hd> <p>The p values, the proportion of children passing an item, ranged between .25 and 1.00. A p value within the range of .20 to .80 was considered acceptable. The p values outside this range indicate the item did not contribute to the test in a meaningful way, as a result of either being too difficult or too easy. Similarly, item-total correlations can also be used to aid in determining if items contribute to a test in meaningful ways. Item-total correlations with values that were greater than .20 were determined to be discriminating well and items at or above .20 were retained in the potential item pool. With the exception of Sound Blending, the measures had over 60% of items with values at or above .20.</p> <p>The phonological awareness measures demonstrate both strengths and weaknesses across the three contributing pieces of empirical and practical evidence. Three candidate measures—Rhyming 2.0, Alliteration 2.0, and Sound Blending—were selected for further refinement and iterative revisions for field testing in Study 2. The final three measures were chosen based on their superior fit with the GOM criteria, supporting criterion validity evidence, and item-level functioning. Alliteration 1.0 and Rhyming 1.0 were eliminated because their counterpart revisions were statistically improved, and Syllable Segmenting was removed because of poor performance within item level and descriptive evaluations and anecdotal reports noting a dichotomous response pattern.</p> <hd id="AN0109198109-34">Study 2</hd> <p>Building on the results of Study 1, Study 2 intended to examine the psychometric properties of newly developed IGDIs 2.0 with an expanded set of items and revised procedures to conceptually support a reduced floor effect. Study 2 also drew a larger, more diverse sample of children. Specifically, this study sought to answer the following questions: (a) To what extent do the measures relate to one another? (b) What is the validity of the measures?</p> <p>For Study 2, the [<reflink idref="bib43" id="ref69">43</reflink>] “constructing measures” framework was implemented fully, employing the Rasch measurement model for analyses of child and item performance. The Rasch model places items on a scale based on item difficulty, locating the average item at zero (typically resulting in an ability scale from −4 to 4). Based on their performance on the IGDI items, children are assigned Rasch scores that reflect their ability in the given domain, relative to the location of the items. Thus, items and children are placed on a common scale, defined by the items as representation of the construct.</p> <hd id="AN0109198109-35">Method</hd> <hd id="AN0109198109-36">Participants and Setting</hd> <p>A total of 756 children participated in assessments in the fall, winter, and spring of the 2009–2010 academic year. Of the 756 participants, 633 children received scores above zero on the Rhyming 2.0 and Alliteration 2.0 measures and were included in the analyses presented here. Children in the larger study were enrolled in 65 classrooms in childcare centers from four states in the East, Midwest, and Pacific Northwest. Early care and educational setting classrooms were targeted for recruitment. Children between 4 and 5 years of age (48 and 71 months) were eligible for recruitment. Parental consent forms were sent home with all eligible children. The mean age of children was 54 months. Exactly half of the children were male (n = 378) and half were female (n = 378). The distribution of race/ethnicity was as follows: 36% White, 30% African American, 20% Hispanic, 10 multirace, 2% Asian, 1.5% Other, and 0.4% Native American. Eighty-four percent of parents reported speaking to their child at home in English and 21% in Spanish.</p> <hd id="AN0109198109-37">Measures</hd> <p>Using information collected from Study 1, measures were selected for use in Study 2 based on their overall fit with the GOM characteristics, criterion validity correlation coefficients, item-level information, and the professional judgment of the research team regarding the feasibility of each measure. For those measures that were considered for Study 2, poorly functioning items were discarded or edited to remove for construct-irrelevant features ([<reflink idref="bib1" id="ref70">1</reflink>] ). Construct-irrelevant features are elements of an item that influence child response but do not relate to the domain. Construct-irrelevant features include aspects within items such as unnecessary backgrounds, unnecessary borders around items, or differences in image type (e.g., illustration vs. photograph). Additional items were developed for each measure, yielding a total item pool of 44 items per measure.</p> <p>The measures considered for application in Study 2 included Alliteration 2.0, Rhyming 2.0, and Sound Blending. Administration procedures for each task were not revised. As a result, assessors were provided with the same manual as in Study 1. The Phonological Awareness subtest of the TOPEL was administered as the phonological awareness criterion measure ([<reflink idref="bib24" id="ref71">24</reflink>] ).</p> <hd id="AN0109198109-38">Procedures</hd> <p>During Study 2, participants were administered measures during three waves of data collection (fall, winter, and spring) throughout the academic year as part of a larger study ([<reflink idref="bib21" id="ref72">21</reflink>] ). During each wave, participants were administered nine IGDI measures from the Oral Language, Alphabet Knowledge, and Phonological Awareness domains of early literacy. In Waves 1 and 3, each participant received one of three criterion measures being used in three different IGDI validation efforts. Administration of the criterion measures was spiraled across participants so that one third of the participants received a criterion from each early literacy domain. Measures were administered across two or three sessions, each lasting 15 to 20 minutes. All measures were administered by trained graduate or undergraduate students. Assessment sessions were conducted onsite at each center, either in an empty classroom, conference room, or quiet hallway.</p> <p>In order to collect sufficient item-level data to meet Rasch model requirements, data collection was structured such that each item would be administered to at least 100 children. Due to the large number of items per measure, a bundling procedure was created to ensure 100 responses per item. Each bundle had four sample cards and five common cards (i.e., cards that remained constant across bundles) and 15 timed administration items, for a total of 24 items in each bundle. The five common cards were selected to represent the full range of ability and were used to anchor items across multiple bundles on the same scale. Because assessments were timed, bundles were designed such that some items overlapped across bundles to account for variation in child performance within the given time frame (e.g., 1 to 2 minutes). In this way, items that did not receive responses (because the student was unable to receive the item due to time) were not counted as incorrect; instead, they were simply excluded from analysis. Because of the overlap in bundles and the assessment scheme, all items achieved at least 100 responses.</p> <p>For the purposes of the analyses, the IGDIs were scored using the Rasch model ([<reflink idref="bib35" id="ref73">35</reflink>] ; [<reflink idref="bib1" id="ref74">1</reflink>] ). Once cases with raw scores of zero were removed—since they provide no information about child ability or item function—and Rasch scores calculated, we computed descriptive data for Waves 1 and 3.</p> <hd id="AN0109198109-39">Results</hd> <hd id="AN0109198109-40">Characteristics of Measures</hd> <p>More than half of all children received a raw score of zero on Sound Blending; therefore, this measure was dropped from further analyses. Descriptive statistics for Alliteration 2.0 and Rhyming 2.0 IGDIs and TOPEL are presented in [<reflink idref="bib5" id="ref75">5</reflink>] . Descriptive results for the TOPEL Phonological Awareness subtest were also computed. Overall, participants’ scores on Rhyming 2.0 tended to vary more than scores on Alliteration 2.0.</p> <hd id="AN0109198109-41"> Study 2 Mean Rasch Scores, Standard Deviations, Skew, and Kurtosis by Measure and Wave.</hd> <ct id="AN0109198109-42"> ..CHT.-</ct> <p> <ephtml> <table><colgroup><col align="left" /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /></colgroup><tr><th align="left">Measure</th><th align="center">n</th><th align="center">M</th><th align="center">SD</th><th align="center">Skew</th><th align="center">Kurtosis</th></tr><tr><td>Wave 1</td><td /><td /><td /><td /><td /></tr><tr><td> Alliteration 2.0</td><td>740</td><td>−0.79</td><td>1.51</td><td>0.33</td><td>−0.01</td></tr><tr><td> Rhyming 2.0</td><td>802</td><td>−0.47</td><td>1.75</td><td>0.52</td><td>−0.32</td></tr><tr><td> TOPEL</td><td>199</td><td>12.9</td><td>5.63</td><td /><td /></tr><tr><td>Wave 3</td><td /><td /><td /><td /><td /></tr><tr><td> Alliteration 2.0</td><td>633</td><td>0.17</td><td>1.22</td><td>1.35</td><td>2.06</td></tr><tr><td> Rhyming 2.0</td><td>653</td><td>0.82</td><td>1.59</td><td>0.50</td><td>−0.57</td></tr><tr><td> TOPEL</td><td>198</td><td>16.0</td><td>5.80</td><td /><td /></tr></table> </ephtml> </p> <p>-5 Note. Test of Preschool Early Literacy (TOPEL) scores are represented as raw scores.</p> <hd id="AN0109198109-43">Relations among measures</hd> <p>Correlations between measures are included in [<reflink idref="bib6" id="ref76">6</reflink>] . Correlations between the IGDI measures and the TOPEL Phonological Awareness subtest were moderate.</p> <hd id="AN0109198109-44"> Study 2 Correlations Between Measures.</hd> <ct id="AN0109198109-45"> ..CHT.-</ct> <p> <ephtml> <table><colgroup><col align="left" /><col align="char" char="." /><col align="char" char="." /></colgroup><tr><th /><th align="center">Alliteration 2.0</th><th align="center">Rhyming 2.0</th></tr><tr><td>Rhyming 2.0</td><td>.51**</td><td align="center">—</td></tr><tr><td>TOPEL PA</td><td>.52**</td><td>.45**</td></tr></table> </ephtml> </p> <p>-6 Note. TOPEL PA = Test of Preschool Early Literacy, Phonological Awareness.</p> <p>-7 p < .01.</p> <hd id="AN0109198109-46">Discussion</hd> <p>This study presented a large-scale field test of IGDI 2.0 phonological awareness measures, conducted to capture validity evidence to support further development and application of the IGDI 2.0 measures, with implications for use within an RTI model. Descriptive statistics and criterion-related validity coefficients between measures and with the TOPEL were evaluated to determine the feasibility, utility, and validity of the measures. This study represented a diverse sample of students, representing four geographic regions across the continental United States. Students included typically developing and special education students, as well as English Language Learners (ELLs) and students enrolled in programs primarily serving low-income families (e.g., Head Start). By evaluating student performance within the larger sample, greater confidence can be vested in the descriptive properties of the IGDI 2.0 measures, offering data to support application with differing populations. Similarly, by evaluating the relation between and among measures and the TOPEL information about the utility of the phonological awareness, IGDI measures as appropriate measures of the construct of phonological awareness can be evaluated, thus answering the research questions.</p> <hd id="AN0109198109-47">Descriptive Analysis and Item-Level Performance</hd> <p>For Rhyming 2.0 and Alliteration 2.0 mean scores suggest students’ performance was below the ability required for the average item (located at 0) at Wave 1 and above the ability required for the average item at Wave 3. While mean performance of IGDI 2.0 measures is not comparable between studies, Study 2 indicates items for each measure demonstrate utility and have implications for use within an RTI model in that the items represent student abilities that are appropriate for preschool-age children, however measures still contain too few items that may have greater utility for low-performing preschool students as indicated by the percentage of zero scores received (10% for Rhyming 2.0 and 9% for Alliteration 2.0, Wave 3). Although only Wave 3 scores are reported here, it should be noted that the percentage of zero scores decreased over time, with the largest percentage obtained at Wave 1 followed by Wave 2.</p> <hd id="AN0109198109-48">Validity Evidence</hd> <p>Validity was examined by evaluating the relation between IGDIs within the phonological awareness domain. Intermeasure correlations between Rhyming 2.0 and Alliteration 2.0 suggest a moderate relation between measures. This correlation potentially illustrates common contributions to the phonological awareness domain, but also unique contributions of each measure. Compared to Study 1 correlations, Rhyming 2.0 and Alliteration 2.0 remained the same (.51), however sample sizes differed dramatically, from 47 in Study 1 to 653 in Study 2.</p> <p>Relations between performance on IGDIs and TOPEL were also examined to evaluate external criterion-related validity evidence. Correlations between the TOPEL and Alliteration 2.0 and Rhyming 2.0 suggest moderate and generally equivalent relations between the established criterion test and the current IGDI measures.</p> <p>Taken together, Study 2 findings suggest Rhyming 2.0 and Alliteration 2.0 perform adequately with preschool-age students who demonstrate higher levels of phonological awareness ability; however, for students with lower levels of phonological awareness ability, who as a result may be at risk for later reading difficulties, the phonological awareness IGDIs had less utility. Therefore, item sets included in Rhyming 2.0 and Alliteration 2.0 have improved but are in need of further item-level revisions and development of additional items for optimal use within an RTI paradigm. As such, a second level of revisions, including improving the Rhyming 2.0 and Alliteration 2.0 tasks to a two-choice selection (rather than three), further examining potential construct irrelevant features, and providing simplified instructions for students, was considered and was examined in a revision study during the 2010–2011 academic year (Study 3).</p> <hd id="AN0109198109-49">Study 3</hd> <p>Based on the results of Studies 1 and 2, two IGDI 2.0 measures, Rhyming 2.0 and Alliteration 2.0, demonstrated improved effects for high-achieving students, but warranted revisions to demonstrate utility with low-achieving students, for appropriate use in an RTI model. The authors determined a third study would be appropriate to evaluate if the issues identified in Study 2 could be remedied. In this study, the same measurement model was utilized (i.e., Rasch); however, to more authentically employ the Rasch model, the timing of measures was removed and the procedures and item-level features were modified with the intention of appropriately capturing performance of low-ability students. Study 3 featured two research questions: (a) To what extent do the newly revised Rhyming 2.0 and Alliteration 2.0 measures show improved concurrent criterion validity than those established in Study 2? And (b) to what degree are the item locations representative of student ability level for Rhyming 2.0 and Alliteration 2.0 on the Rasch scale? That is, are the items more likely to represent low ability levels and reduce ceiling effects?</p> <hd id="AN0109198109-50">Method</hd> <hd id="AN0109198109-51">Participants and Setting</hd> <p>A total of 278 children participated in two seasonal assessments: winter and spring of the 2010–2011 academic year. Four- and 5-year-old children (48 and 71 months) were recruited from early care and educational setting classrooms. Parental consent forms were sent home with all eligible participants, yielding a consented sample of 151 males (55%) and 127 females (45%). The distribution of race/ethnicity was as follows: 36% White, 30% African American, 5% Hispanic 2%, Asian, and 1% Other. Of the 241 students who reported disability status and ELL status, 38 (16%) had an Individualized Education Program (IEP) and 17 (7%) were considered ELLs.</p> <hd id="AN0109198109-52">Measures</hd> <p>As suggested in Study 2, IGDI Rhyming 2.0 and Alliteration 2.0 measures were selected for use in Study 3. During Study 3 a series of revisions were made to each of the measures to improve item-level functioning. The procedures described in Study 2 to remove construct-irrelevant features were again employed. In addition, for each task we reduced the number of choice responses available within each item from three to two to further reduce the cognitive load, such that children would be required to remember less information before making a choice response. Additional items were written explicitly to sample lower ability content for each measure. After revisions and new item construction, a total item pool of 60 items per measure was developed.</p> <p>Administration procedures were also revised to reduce the cognitive load of each task by providing scaffolding during administration such that the administrator paired each target and response choice together for the child (e.g., “Toy, boy, mask. Which two rhyme? Is it toy, boy (insert pause) or toy, mask?” for Rhyming and “Tree, duck. Which one starts with /d/?” for Alliteration). In addition, the timing of the IGDI measures was removed, and the test was redesigned to be a fixed length interaction to more authentically employ the assumptions of the Rasch model.</p> <p>Assessors were trained on the revised procedures and obtained 90% fidelity of implementation prior to data collection efforts. Similar to Study 2, the Phonological Awareness subtest of the TOPEL was administered as the criterion measure ([<reflink idref="bib24" id="ref77">24</reflink>] ).</p> <hd id="AN0109198109-53">Procedures</hd> <p>During Study 3, participants were administered measures during two waves of data collection (winter and spring) in 2011. During each wave, participants were administered six IGDI 2.0 measures from the Oral Language, Alphabet Knowledge, Phonological Awareness, and Comprehension domains of early literacy. Sixty participants were randomly selected for standardized criterion assessments during the second wave, with 57 standardized assessments (i.e., TOPEL) completed (three students were absent on the day of assessment). Measures were administered across three sessions, each lasting 10 to 15 minutes, such that each student saw a total of 60 items per Rhyming 2.0 and Alliteration 2.0 measure. All measures were administered by trained graduate or undergraduate students. Assessment sessions were conducted onsite at each center, either in an empty classroom, conference room, or quiet hallway.</p> <p>As noted in Study 2, Rasch modeling was used to evaluate each measure. First, to better understand the structure of the measures of phonological awareness and to provide evidence of unidimensionality to support the use of the Rasch model, we conducted two forms of confirmatory factor analysis (CFA). The first tests the fit of the data to a unidimensional model for Alliteration 2.0 and Rhyming 2.0 independently, and the second tests a two-factor model allowing the factors of Alliteration 2.0 and Rhyming 2.0 to correlate. For each model, two fit indices are reported, including the comparative fit index (CFI), where good fit is found with values greater than .95, and the root mean squared error of approximation (RMSEA), where good fit is found with values less than .08 ([<reflink idref="bib6" id="ref78">6</reflink>] ). The first independent unidimensional models fit very well. For Alliteration 2.0, the CFI was .986 and RMSEA was .026. For Rhyming 2.0, the CFA was .922 and RMSEA was .072. The combined model allowing the two measures of Phonological Awareness to correlate yielded a CFI of .961 and RMSEA of .038, with a correlation between the factor scores of Alliteration 2.0 and Rhyming 2.0 (removing measurement error) of .75 (56% common variance between the constructs of Alliteration 2.0 and Rhyming 2.0). The CFA results indicate adequate to excellent fit.</p> <p>Second, Rasch assumptions, including local independence—or that the response on one item does not depend on a response to other items—item fit, and item discrimination, were tested within the model. Results indicate that assumptions were confirmed with empirically robust item-level statistics (infit and outfit less than a value of 2; discrimination was uniformly moderate to high).</p> <p>Finally, Rasch modeling required 100 responses per item. As such, this study sampled items across students to achieve 100 responses for each of the 60 items in each measure. Items were then scored using descriptive methods and the Rasch model ([<reflink idref="bib1" id="ref79">1</reflink>] ; [<reflink idref="bib35" id="ref80">35</reflink>] ).</p> <hd id="AN0109198109-54">Results</hd> <hd id="AN0109198109-55">Characteristics of Measures</hd> <p>During Study 3, no child assessed received a score of zero on both Rhyming2.0 and Alliteration 2.0. Descriptive statistics for Alliteration 2.0 and Rhyming 2.0 IGDIs and TOPEL are presented in [<reflink idref="bib7" id="ref81">7</reflink>] . Descriptive results for the TOPEL Phonological Awareness subtest were also computed.</p> <hd id="AN0109198109-56"> Study 3 Mean Raw Scores, Mean Rasch Score (Ability), Standard Deviations, Minimum, Maximum, Skew, and Kurtosis by Measure by Wave.</hd> <ct id="AN0109198109-57"> ..CHT.-</ct> <p> <ephtml> <table><colgroup><col align="left" /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /></colgroup><tr><th align="left">Measure</th><th align="center">Wave</th><th align="center">n</th><th align="center">M (Rasch)</th><th align="center">M (Raw)</th><th align="center">SD</th><th align="center">Min.</th><th align="center">Max.</th><th align="center">Skew</th><th align="center">Kurtosis</th></tr><tr><td>Alliteration 2.0</td><td>Winter</td><td>276</td><td>2.31</td><td>48.00</td><td>11.45</td><td>24</td><td>60</td><td>−0.46</td><td>−1.29</td></tr><tr><td /><td>Spring</td><td>82</td><td>3.08</td><td>49.95</td><td>12.08</td><td>25</td><td>60</td><td>−0.73</td><td>−1.19</td></tr><tr><td>Rhyming 2.0</td><td>Winter</td><td>271</td><td>0.9</td><td>45.15</td><td>12.17</td><td>21</td><td>60</td><td>−0.22</td><td>−1.55</td></tr><tr><td /><td>Spring</td><td>115</td><td>1.91</td><td>47.64</td><td>11.66</td><td>24</td><td>60</td><td>−0.51</td><td>−1.34</td></tr><tr><td>TOPEL PA</td><td>Spring</td><td>59</td><td>N/A</td><td>14.54</td><td>6.22</td><td>4</td><td>27</td><td>0.26</td><td>−0.97</td></tr></table> </ephtml> </p> <p>-8 Note. All statistics are provided for raw scores with the exception of the M (Rasch). TOPEL PA = Test of Preschool Early Literacy, Phonological Awareness.</p> <hd id="AN0109198109-58">Relations among measures</hd> <p>Correlations between measures are included in [<reflink idref="bib8" id="ref82">8</reflink>] . Correlations between the IGDI measures and the TOPEL PA subtest were moderate, with IGDI correlations with TOPEL .50 to .61 (compared to r = .45 to .52 in Study 2).</p> <hd id="AN0109198109-59"> Study 3 Correlations Between Measures.</hd> <ct id="AN0109198109-60"> ..CHT.-</ct> <p> <ephtml> <table><colgroup><col align="left" /><col align="char" char="." /><col align="char" char="." /></colgroup><tr><th /><th align="center">Alliteration 2.0</th><th align="center">Rhyming 2.0</th></tr><tr><td>Rhyming 2.0</td><td>.67**</td><td align="center">—</td></tr><tr><td>TOPEL PA</td><td>.61**</td><td>.50**</td></tr></table> </ephtml> </p> <p>-9 Note. n = 57. TOPEL PA = Test of Preschool Early Literacy, Phonological Awareness.**p < .01.</p> <hd id="AN0109198109-61">Discussion</hd> <p>This study represented the third step in an iterative development process to field test two IGDI 2.0 Phonological Awareness measures: Rhyming 2.0 and Alliteration 2.0. This study was conducted to capture validity evidence to support the use of IGDI measures within an RTI model to identify students who may be in need of additional instructional support or intervention at the Tier 2 or Tier 3 level. Descriptive statistics and criterion-related validity coefficients between measures and with the TOPEL Phonological Awareness were examined to evaluate the utility and validity of the measures.</p> <hd id="AN0109198109-62">Descriptive Analysis and Item-Level Performance</hd> <p>For Rhyming 2.0 and Alliteration 2.0, mean Rasch scores suggest average student ability was above the ability required for the average item (located at 0). Although mean performance of IGDI 2.0 measures is not comparable between studies because the content of the items was revised, Study 3 indicates no floor effects were present in this sample, with a minimum raw score of 24 and 21 on the IGDI 2.0 measures. As a result, compared to Study 2, the revised Rhyming 2.0 and Alliteration 2.0 measures demonstrate utility and have implications for use within an RTI model in that the items represent student abilities that are appropriate for preschool-age children. More specifically, the items capture ability levels of students who may be appropriate candidates for Tier 2 or Tier 3 intervention, as illustrated by the lack of zero scores. These item analyses suggest the IGDI 2.0 Phonological Awareness measures may be appropriately used for identifying students who are candidates for Tier 2 and Tier 3 intervention, such that their level of performance can be accurately identified in the Rasch model.</p> <hd id="AN0109198109-63">Validity Evidence</hd> <p>In comparison to Study 2, the revised Rhyming 2.0 and Alliteration 2.0 measures demonstrate improved concurrent and criterion correlations, improving from 0.51 (n = 633) between Rhyming and Alliteration in Study 2 to 0.67 in Study 3 (n = 57) . Similarly, relations between the standardized measure (TOPEL Phonological Awareness) and the revised IGDI measures were also improved, from 0.52 for Alliteration and 0.45 for Rhyming to 0.61 and 0.50, respectively, in Study 3.</p> <p>Results from Study 3 indicate Rhyming 2.0 and Alliteration 2.0 perform adequately with preschool-age students across ability levels of phonological awareness. Improvements to the measures, reduced cognitive load, and examination of item characteristics to write new items at lower ability levels contributed to an empirically validated scale of items used for seasonal identification of students in need of intervention at a Tier 2 or Tier 3 level.</p> <hd id="AN0109198109-64">General Discussion</hd> <p>Early literacy assessment models for RTI represent new directions in early childhood education, moving away from a “wait to fail” approach and toward a responsive and preventative approach to child intervention and assessment ([<reflink idref="bib21" id="ref83">21</reflink>] ). The measures developed here (IGDIs 2.0) have been designed to be uniquely suited for use within an RTI model, positioning item sets to meet the ability levels of preschool-age children for use as the identification of students who may need additional intervention. As a result, IGDIs 2.0 demonstrate promise in an RTI framework and will be further developed through the iterative development process as identification measures—beginning with the process described within this article.</p> <p>More specifically, IGDIs 2.0 feature phonological awareness tasks that capture a portion of the continuum of skills represented in current theories including syllable awareness (Rhyming 2.0) and onset-rime awareness (Alliteration 2.0; [<reflink idref="bib3" id="ref84">3</reflink>] ). Furthermore, consistent with [<reflink idref="bib19" id="ref85">19</reflink>] , the IGDI measures were developed focusing on initial early literacy skills capitalizing on rhyme and alliteration development. By developing tasks that represent the continuum of the phonological awareness construct, the research team intended to appropriately span the ability levels represented in preschool classrooms, further illustrating performance at the RTI tier-level divisions (i.e. Tier 1, Tier 2, Tier 3). It is relevant to note that these phonological awareness measures were not developed in exclusion of alphabet knowledge tasks that closely inform and link to phonological awareness skill development, such as letter sounds and letter names. Instead, complementary IGDI 2.0 measures, including a sound identification measure, were developed by domain with parallel research to support measure development within the domain of alphabet knowledge (see [<reflink idref="bib5" id="ref86">5</reflink>] ).</p> <p>The data presented here indicate the measures have progressed through three iterative phases of development and have now reached standards for potential use within an RTI model. The measures are able to accurately capture the ability levels of all preschool-age students as demonstrated in Study 3. However, to identify those students in need of Tier 2 or Tier 3 intervention, measures that are sensitive to low ability levels are not enough; relevant cut-score criteria and predictive validity estimates are also needed.</p> <p>Current work on the IGDI 2.0 measures is focused on creating empirically robust cut-scores for Tier 2 and Tier 3 candidacy or, stated another way, for screening or identification purposes. This identification set of IGDI 2.0 phonological awareness measures can be used to reliably and accurately detect those students with ability levels that may need support at the Tier 2 or Tier 3 level during season screening assessments. With robust measures for identification of students as candidates for intervention in hand, practitioner needs will move toward the next step of assessment in an RTI model: progress monitoring. However, the data presented in these studies are not useful for progress monitoring analysis. The studies presented here do not offer any parameters to evaluate expected growth rates and sensitivity to growth.</p> <p>It is also important to recognize the IGDI 2.0 identification measures are not without limitations. Given the nature of development during the preschool years, the opportunities to examine “typical” emergence and mastery of early literacy skills are at best brief. It may be the case that the measures presented here have utility for only a brief period. In practice, complementing IGDIs 2.0 with other measures or methods of evaluating performance (e.g., master monitory tasks) may prove useful. Furthermore, because IGDIs 2.0 are in their infancy, no data are yet available that examine the predictive validity of the measures. Without this information, end users cannot be confident in their ability to reliably predict academic success in the area of phonological awareness at later grades (kindergarten through third grade).</p> <p>Nevertheless, even considering these limitations, there are currently no early literacy measures available that cater specifically to the unique needs of an early childhood RTI model and meet the psychometric criteria suggested in Studies 1 through 3. Furthermore, by implementing an iterative refinement and revision process, the IGDI 2.0 measures will ensure appropriate interpretability through reduced measurement error, strong construct representations, and specific item-level information to support task creation. This ongoing process represents an effort to maintain a research-to-practice transition, by ensuring both robust psychometric standards and practical utility, resulting in a superior set of early literacy assessment tools.</p> <p>As the process of refinement and revision continues, including development of criterion-based cut scores and the demonstration of predictive validity, a simultaneous program of early childhood RTI model development is also occurring with interventions at the Tier 2 and Tier 3 level, fidelity of implementation procedures, and considerations for parents, assessors, and facilitators. As both the assessment and complementary RTI intervention and support come to fruition, there are tremendous opportunities for improved assessment and intervention and, as a result, dramatically improved student outcomes.</p> <hd id="AN0109198109-65">Acknowledgements</hd> <p>The authors would like to thank colleagues who assisted with this project including participating childcare centers and programs in the Minneapolis/St. Paul area. Additionally, the authors express sincere appreciation for the work contributed by partner CRTIEC sites including Howard Goldstein and supporting staff at The Ohio State University, Ruth Kaminski and supporting staff at Dynamic Measurement Group, and Judith Carta and Charles Greenwood and supporting staff at the University of Kansas. Finally, the authors are indebted to the research team at the University of Minnesota, who participated in measure design and data collection: Tony Albano, Amanda Besner, Kate Clayton, Laura Potter, and Megan Rodriguez. However, the opinions and recommendations presented in this article are those of the authors alone, and no official endorsement from the Institute of Education Sciences should be inferred.</p> <hd id="AN0109198109-66">Footnotes</hd> <ref id="AN0109198109-67"> <title>References</title> <blist> <bibl id="bib1" idref="ref52" type="bt">1</bibl> <bibtext>Albano A. D., Rodriguez M. C., McConnell S., Bradfield T., Wackerle-Hollman A. (2011, April). Scaling with measures of early literacy. Paper presented at the meeting of the National Council for Measurement in Education, New Orleans, LA. </bibtext> </blist> <blist> <bibl id="bib2" idref="ref12" type="bt">2</bibl> <bibtext>Anthony J. L., Lonigan C. J. (2004). The nature of phonological awareness: Converging evidence from four studies of preschool and early grade school children. Journal of Educational Psychology, 96(1), 53–55. </bibtext> </blist> <blist> <bibl id="bib3" idref="ref23" type="bt">3</bibl> <bibtext>Anthony J. L., Lonigan C. J., Driscoll K., Phillips B. M., Burgess S. R. (2003). Phonological sensitivity: A quasi-parallel progression of word structure units and cognitive operations. Reading Research Quarterly, 38(4), 470–487. </bibtext> </blist> <blist> <bibl id="bib4" idref="ref11" type="bt">4</bibl> <bibtext>Anthony J. L., Williams J. M., McDonald R., Francis D. J. (2007). Phonological processing and emergent literacy in younger and older preschool children. Annals of Dyslexia, 57(2), 113–137. </bibtext> </blist> <blist> <bibl id="bib5" idref="ref75" type="bt">5</bibl> <bibtext>Bradfield T., Wackerle-Hollman A., McConnell S. (2011, January). Using IGDIs to identify children for tiered intervention. Presentation at the Center for Response to Intervention in Early Childhood Summit on Early Childhood RTI, Albuquerque, NM. </bibtext> </blist> <blist> <bibl id="bib6" idref="ref76" type="bt">6</bibl> <bibtext>Brown T. A. (2006). Confirmatory factor analysis for applied research. New York: Guilford. </bibtext> </blist> <blist> <bibl id="bib7" idref="ref19" type="bt">7</bibl> <bibtext>Carroll J. M., Snowling M. J., Hulme C., Stevenson J. (2003). The development of phonological awareness in preschool children. Developmental Psychology, 39(5), 913–923. </bibtext> </blist> <blist> <bibl id="bib8" idref="ref39" type="bt">8</bibl> <bibtext>Clay M. M. (1985). The early detection of reading difficulties. Portsmouth, NH: Heinemann. </bibtext> </blist> <blist> <bibl id="bib9" idref="ref56" type="bt">9</bibl> <bibtext>de Ayala R. J. (2009). The theory and practice of item response theory. New York: Guildford. </bibtext> </blist> <blist> <bibl id="bib10" idref="ref33" type="bt">10</bibl> <bibtext>Dodd B., Crosbie S., McIntosh B., Teitzel T., Ozanne A. (2003). Pre-Reading Inventory of Phonological Awareness. San Antonio, TX: Psychological Corportation. </bibtext> </blist> <blist> <bibl id="bib11" idref="ref37" type="bt">11</bibl> <bibtext>Dunn L. M., Dunn D. M. (2007). Peabody Picture Vocabulary Test (4th ed.). Circle Pines, MN: American Guidance Service. </bibtext> </blist> <blist> <bibl id="bib12" idref="ref10" type="bt">12</bibl> <bibtext>Dunst C., Trivette C. M., Masiello T., Roper N., Robyak A. (2006). Framework for developing evidence-based early literacy learning practices. CELLpapers, 1(1). Retrieved from <ulink href="http://www.earlyliteracylearning.org/cellpapers/cellpapers%5fv1%5fn1.pdf">http://www.earlyliteracylearning.org/cellpapers/cellpapers%5fv1%5fn1.pdf</ulink></bibtext> </blist> <blist> <bibl id="bib13" idref="ref45" type="bt">13</bibl> <bibtext>Early Childhood Research Institute on Measuring Growth and Development (ECRI-MGD). (1998). Theoretical foundations of the early childhood research institute on measuring growth and development: An early childhood problem-solving model (Tech. Rep. No. 6). Minneapolis: University of Minnesota, Center for Early Education and Development. </bibtext> </blist> <blist> <bibl id="bib14" idref="ref31" type="bt">14</bibl> <bibtext>Fuchs L. S., Deno S. L. (1991). Paradigmatic distinctions between instructionally relevant measurement models. Exceptional Children, 57(6), 488–499. </bibtext> </blist> <blist> <bibl id="bib15" idref="ref26" type="bt">15</bibl> <bibtext>Fuchs D., Fuchs L. S. (2006). Introduction to Response to Intervention: What, why, and how valid is it?Reading Research Quarterly, 41(1), 93–99. </bibtext> </blist> <blist> <bibl id="bib16" idref="ref25" type="bt">16</bibl> <bibtext>Fuchs L. S., Fuchs D., Compton D. (2012). Smart RTI: A next generation approach to multilevel prevention. Exceptional Children, 78(3), 263–279. </bibtext> </blist> <blist> <bibl id="bib17" idref="ref21" type="bt">17</bibl> <bibtext>Gombert J. E. (1992). Metalinguistic development. New York: Harvester Wheatsheaf. </bibtext> </blist> <blist> <bibl id="bib18" idref="ref51" type="bt">18</bibl> <bibtext>Gorin S., Embretson J. (2008). Item response theory and Rasch Modeling. In McKay D. (Ed.), The handbook of research methods in abnormal and clinical psychology (pp. 271-292). Thousand Oaks, CA: Sage Publications. </bibtext> </blist> <blist> <bibl id="bib19" idref="ref18" type="bt">19</bibl> <bibtext>Goswami U. (1990). Phonological skills and learning to read. London: Lawrence Erlbaum. </bibtext> </blist> <blist> <bibl id="bib20" idref="ref20" type="bt">20</bibl> <bibtext>Goswami U., East M. (2000). Rhyme and analogy in beginning reading: Conceptual and methodological issues. Applied Psycholinguistics, 21(1), 63–93. </bibtext> </blist> <blist> <bibl id="bib21" idref="ref72" type="bt">21</bibl> <bibtext>Greenwood C. R., Bradfield T., Kaminski R., Linas M., Carta J. J., Nylander D. (2011). The Response to Intervention (RTI) approach in early childhood. Focus on Exceptional Children, 43(9), 1–22. </bibtext> </blist> <blist> <bibl id="bib22" idref="ref29" type="bt">22</bibl> <bibtext>Greenwood C. R., Carta J. J., McConnell S. R., Goldstein H., Kaminski R. A. (2009). Center for Response to Intervention in Early Childhood. Retrieved March1, 2011, from <ulink href="http://www.crtiec.org">http://www.crtiec.org</ulink></bibtext> </blist> <blist> <bibl id="bib23" idref="ref27" type="bt">23</bibl> <bibtext>Greenwood C. R., Kratochwill T. R., Clements M. (2008). Schoolwide prevention models: Lessons learned in elementary schools. New York: Guilford Press. </bibtext> </blist> <blist> <bibl id="bib24" idref="ref17" type="bt">24</bibl> <bibtext>Lonigan C. J., Wagner R. K., Torgesen J. K., Rashotte C. A. (2007). Test of Preschool Early Literacy. Austin, TX: PRO-ED. </bibtext> </blist> <blist> <bibl id="bib25" idref="ref8" type="bt">25</bibl> <bibtext>McBride-Chang C. (1999). The ABCs of the ABCs: The development of letter-name and letter-sound knowledge. Merrill-Palmer Quarterly: Journal of Developmental Psychology, 45(2), 285–308. </bibtext> </blist> <blist> <bibl id="bib26" idref="ref42" type="bt">26</bibl> <bibtext>McConnell S., McEvoy M., Priest J. (2002). “Growing” measures for monitoring progress in early childhood education: A research and development process for individual growth and development indicators. Assessment for Effective Intervention, 27(4), 3–14. </bibtext> </blist> <blist> <bibl id="bib27" idref="ref36" type="bt">27</bibl> <bibtext>McConnell S. R., Missall K. N. (2008). Best practices in monitoring progress in preschool children. In Thomas A., Grimes J. (Eds.), Best practices in school psychology (5th ed., Vol.2, pp. 561-573). Bethesda, MD: National Association of School Psychologists. </bibtext> </blist> <blist> <bibl id="bib28" idref="ref30" type="bt">28</bibl> <bibtext>McConnell S. R., Wackerle-Hollman A. (2013). Can we measure the transition to reading? Relations among general outcome measures of language and early literacy development from preschool to early elementary grades. Unpublished manuscript, University of Minnesota, Minneapolis. </bibtext> </blist> <blist> <bibl id="bib29" idref="ref5" type="bt">29</bibl> <bibtext>McConnell S. R., Wackerle-Hollman A., Bradfield T. A. (in press). Early childhood literacy screening. In Kettler R., Glover T., Albers C., Feeney-Kettler K. A. (Eds.), Universal screening in educational settings: Identification, implications, and interpretation. Washington, DC: American Psychological Association. </bibtext> </blist> <blist> <bibl id="bib30" idref="ref43" type="bt">30</bibl> <bibtext>Missall K. (2004). Relations between general outcome measures of literacy. Retrieved January10, 2006, from <ulink href="http://www.dynamicmeasurement.org/presentations/ds04Missalll.pdf">www.dynamicmeasurement.org/presentations/ds04Missalll.pdf</ulink></bibtext> </blist> <blist> <bibl id="bib31" idref="ref13" type="bt">31</bibl> <bibtext>Muter V., Hulme C., Snowling M. J., Stevenson J. (2004). Phonemes, rimes, vocabulary, and grammatical skills as foundations of early reading development: Evidence from a longitudinal study. Developmental Psychology, 40(5), 665–681. </bibtext> </blist> <blist> <bibl id="bib32" idref="ref3" type="bt">32</bibl> <bibtext>National Early Literacy Panel. (2008). Developing early literacy report of the National Early Literacy Panel. Washington, DC: Author. </bibtext> </blist> <blist> <bibl id="bib33" idref="ref24" type="bt">33</bibl> <bibtext>Phillips B. M., ClancyMenchetti J., Lonigan C. J. (2008). Successful phonological awareness instruction with preschool children: Lessons from the classroom. Topics in Early Childhood Special Education, 28(1), 3–17. </bibtext> </blist> <blist> <bibl id="bib34" idref="ref44" type="bt">34</bibl> <bibtext>Priest J. S., Silberglitt B., Hall S., Estrem T. L. (2000). Progress on preschool IGDIs for early literacy. Paper presented at the Presentation at Heartland Area Education Association, Des Moines, IA. </bibtext> </blist> <blist> <bibl id="bib35" idref="ref73" type="bt">35</bibl> <bibtext>Rasch G. (1960). Probabilistic models for some intelligence and attainment tests. Chicago: University of Chicago Press. </bibtext> </blist> <blist> <bibl id="bib36" idref="ref49" type="bt">36</bibl> <bibtext>Roseth C. J., Missall K. N., McConnell S. R. (in press). Early Literacy Individual Growth and Development Indicators (EL-IGDIs): Growth trajectories using a large, internet-based sample. Journal of School Psychology. </bibtext> </blist> <blist> <bibl id="bib37" idref="ref6" type="bt">37</bibl> <bibtext>Senechal M., LeFevre J., SmithChant B. L., Colton K. V. (2001). On refining theoretical models of emergent literacy: The role of empirical evidence. Journal of School Psychology, 39(5), 439–460. </bibtext> </blist> <blist> <bibl id="bib38" idref="ref1" type="bt">38</bibl> <bibtext>Snow C. E., Burns M., Griffin P. (1998). Preventing reading difficulties in young children. Washington, DC: National Academy Press. </bibtext> </blist> <blist> <bibl id="bib39" idref="ref41" type="bt">39</bibl> <bibtext>Torgesen J. K., Bryant B. R. (2004). Test of phonological awareness-second edition: PLUS. Austin, TX: PRO-ED. </bibtext> </blist> <blist> <bibl id="bib40" idref="ref50" type="bt">40</bibl> <bibtext>Wackerle-Hollman A. (2009). The effects of progress monitoring and consultation on emergent literacy performance as measured by the Individual Growth and Development Indicators. Digital Dissertations. Retrieved from <ulink href="http://conservancy.umn.edu/bitstream/54208/1/Hollman%5fumn%5f0130E%5f10460.pdf">http://conservancy.umn.edu/bitstream/54208/1/Hollman%5fumn%5f0130E%5f10460.pdf</ulink></bibtext> </blist> <blist> <bibl id="bib41" idref="ref15" type="bt">41</bibl> <bibtext>Wagner R. K., Torgesen J. K., Rashotte C. A., Hecht S. A., Barker T. A., Burgess S. R., Garon T. (1997). Changing relations between phonological processing abilities and word-level reading as children develop from beginning to skilled readers: A 5-year longitudinal study. Developmental Psychology, 33(3), 468–479. </bibtext> </blist> <blist> <bibl id="bib42" idref="ref4" type="bt">42</bibl> <bibtext>Whitehurst G. J., Lonigan C. J. (1998). Child development and emergent literacy. Child Development, 69(3), 848–872. </bibtext> </blist> <blist> <bibl id="bib43" idref="ref53" type="bt">43</bibl> <bibtext>Wilson M. (2005). Constructing measures: An item response modeling approach. Mahwah, NJ: Lawrence Erlbaum. </bibtext> </blist> </ref> <aug> <p>By Alisha K. Wackerle-Hollman; Braden A. Schmitt; Tracy A. Bradfield; Michael C. Rodriguez and Scott R. McConnell</p> </aug>
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED605881
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED605881
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Redefining Individual Growth and Development Indicators: Phonological Awareness
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Wackerle-Hollman%2C+Alisha+K%2E%22">Wackerle-Hollman, Alisha K.</searchLink><br /><searchLink fieldCode="AR" term="%22Schmitt%2C+Braden+A%2E%22">Schmitt, Braden A.</searchLink><br /><searchLink fieldCode="AR" term="%22Bradfield%2C+Tracy+A%2E%22">Bradfield, Tracy A.</searchLink><br /><searchLink fieldCode="AR" term="%22Rodriguez%2C+Michael+C%2E%22">Rodriguez, Michael C.</searchLink><br /><searchLink fieldCode="AR" term="%22McConnell%2C+Scott+R%2E%22">McConnell, Scott R.</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Grantee+Submission%22"><i>Grantee Submission</i></searchLink>. 2015 48(5):495-510.
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 16
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2015
– Name: SourceSuprt
  Label: Sponsoring Agency
  Group: SrcSuprt
  Data: Institute of Education Sciences (ED)
– Name: NumberContract
  Label: Contract Number
  Group: NumCntrct
  Data: R324C080011
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Phonological+Awareness%22">Phonological Awareness</searchLink><br /><searchLink fieldCode="DE" term="%22Individual+Development%22">Individual Development</searchLink><br /><searchLink fieldCode="DE" term="%22Response+to+Intervention%22">Response to Intervention</searchLink><br /><searchLink fieldCode="DE" term="%22Early+Experience%22">Early Experience</searchLink><br /><searchLink fieldCode="DE" term="%22Early+Reading%22">Early Reading</searchLink><br /><searchLink fieldCode="DE" term="%22Outcome+Measures%22">Outcome Measures</searchLink><br /><searchLink fieldCode="DE" term="%22Psychometrics%22">Psychometrics</searchLink><br /><searchLink fieldCode="DE" term="%22Measures+%28Individuals%29%22">Measures (Individuals)</searchLink><br /><searchLink fieldCode="DE" term="%22Standardized+Tests%22">Standardized Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Item+Analysis%22">Item Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluation+Criteria%22">Evaluation Criteria</searchLink><br /><searchLink fieldCode="DE" term="%22Correlation%22">Correlation</searchLink><br /><searchLink fieldCode="DE" term="%22Achievement+Gains%22">Achievement Gains</searchLink><br /><searchLink fieldCode="DE" term="%22Achievement+Rating%22">Achievement Rating</searchLink><br /><searchLink fieldCode="DE" term="%22Achievement+Tests%22">Achievement Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Item+Response+Theory%22">Item Response Theory</searchLink><br /><searchLink fieldCode="DE" term="%22Young+Children%22">Young Children</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1177/0022219413510181
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Learning to read is one of the most important indicators of academic achievement. The development of early literacy skills during the preschool years is associated with improved reading outcomes in later grades. One of these skill areas,phonological awareness, shows particular importance because of its strong link to later reading success. Presented here are two studies that describe the development and revision of four measures of phonological awareness skills: Individual Growth and Development Indicators Sound Blending, Syllable Sameness, Rhyming, and Alliteration 2.0. The authors discuss the measure development process, revision, and utility within an early childhood Response to Intervention framework. [This article was published in "Journal of Learning Disabilities," (EJ1070909).]
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: CodeSource
  Label: IES Funded
  Group: SrcInfo
  Data: Yes
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2020
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED605881
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED605881
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1177/0022219413510181
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 16
        StartPage: 495
    Subjects:
      – SubjectFull: Phonological Awareness
        Type: general
      – SubjectFull: Individual Development
        Type: general
      – SubjectFull: Response to Intervention
        Type: general
      – SubjectFull: Early Experience
        Type: general
      – SubjectFull: Early Reading
        Type: general
      – SubjectFull: Outcome Measures
        Type: general
      – SubjectFull: Psychometrics
        Type: general
      – SubjectFull: Measures (Individuals)
        Type: general
      – SubjectFull: Standardized Tests
        Type: general
      – SubjectFull: Item Analysis
        Type: general
      – SubjectFull: Evaluation Criteria
        Type: general
      – SubjectFull: Correlation
        Type: general
      – SubjectFull: Achievement Gains
        Type: general
      – SubjectFull: Achievement Rating
        Type: general
      – SubjectFull: Achievement Tests
        Type: general
      – SubjectFull: Item Response Theory
        Type: general
      – SubjectFull: Young Children
        Type: general
    Titles:
      – TitleFull: Redefining Individual Growth and Development Indicators: Phonological Awareness
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Wackerle-Hollman, Alisha K.
      – PersonEntity:
          Name:
            NameFull: Schmitt, Braden A.
      – PersonEntity:
          Name:
            NameFull: Bradfield, Tracy A.
      – PersonEntity:
          Name:
            NameFull: Rodriguez, Michael C.
      – PersonEntity:
          Name:
            NameFull: McConnell, Scott R.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2015
          Numbering:
            – Type: volume
              Value: 48
            – Type: issue
              Value: 5
          Titles:
            – TitleFull: Grantee Submission
              Type: main
ResultId 1