Developing a Measure of Spanish Phonological Awareness for Preschool Age Children: Spanish Individual Growth and Development Indicators
Saved in:
| Title: | Developing a Measure of Spanish Phonological Awareness for Preschool Age Children: Spanish Individual Growth and Development Indicators |
|---|---|
| Language: | English |
| Authors: | Wackerle-Hollman, Alisha, Durán, Lillian, Brunner, Stephanie, Palma, Jose, Kohlmeier, Theresa, Rodriguez, Michael C. |
| Source: | Grantee Submission. 2019 24(1):33-56. |
| Peer Reviewed: | Y |
| Page Count: | 25 |
| Publication Date: | 2019 |
| Sponsoring Agency: | Institute of Education Sciences (ED) |
| Contract Number: | R305A120449 |
| Document Type: | Journal Articles Reports - Research |
| Education Level: | Early Childhood Education Preschool Education |
| Descriptors: | Spanish, Spanish Speaking, English, Bilingual Students, Preschool Education, Preschool Children, Test Construction, Test Items, Test Validity, Hispanic American Students, Phonological Awareness |
| Geographic Terms: | Minnesota, Florida, California, Utah, Kansas, Illinois |
| DOI: | 10.1080/10627197.2018.1545570 |
| ISSN: | 1062-7197 |
| Abstract: | Spanish speakers in the United States are a steadily increasing population, up by 233% since 1980. Given the growing population of dual language learners (DLLs) and the large numbers of Spanish-speaking children enrolled in pre-kindergarten programs, addressing the educational needs of preschool-aged DLLs has become a national imperative. Specifically, the intersection of this growing population and the dearth of appropriate assessment tools to evaluate DLLs early language and literacy skills creates a need for assessments that accurately measure preschool performance. This manuscript reports on the iterative design process of a measure of Spanish phonological awareness for preschool-aged DLLs: Spanish Individual Growth and Development Indicators (S-IGDI) Primeros Sonidos. We employed measure design framework to develop the measure and tested item function within a study of 970, 4-5 year old DLLs. Results, including item level analyses and evidence regarding construct and criterion validity are reported. [This article was published in "Educational Assessment" (EJ1205857).] |
| Abstractor: | As Provided |
| IES Funded: | Yes |
| Entry Date: | 2019 |
| Accession Number: | ED595878 |
| Database: | ERIC |
|
Full text is not displayed to guests.
Login for full access.
|
|
| FullText | Links: – Type: pdflink Url: https://content.ebscohost.com/cds/retrieve?content=AQICAHj0k_4E0hTGH8RJwT4gCJyBsGNe_WN95AvKlDbXJGqwxwEtawQJMw1oQHBWepOzDLncAAAA4zCB4AYJKoZIhvcNAQcGoIHSMIHPAgEAMIHJBgkqhkiG9w0BBwEwHgYJYIZIAWUDBAEuMBEEDPWrvsqeHnWXzlul4QIBEICBmy97PQbk5KVArv6W4Fqki5G2o4U0EXN3etzQbgKKj1txsZ6x0iP7kxZDGjbNI29UYTu1gtdTtrZmVecVeoj3Xwp8bY4Kcj9bg4I4vwbU-KxoYiVnqS9ANhb_zA635iTdc6GFgHq5Q832mXsgq66ZABGu0MrfoDbd5DX_9-cVspp8XTQSnrGjz5NgBSNGqjXhYDZ9KJxOk1yV6t-7 Text: Availability: 1 Value: <anid>AN0134694290;7ls01jan.19;2019Feb15.11:27;v2.2.500</anid> <title id="AN0134694290-1">Developing a Measure of Spanish Phonological Awareness for Preschool Age Children: Spanish Individual Growth and Development Indicators </title> <p>Spanish speakers in the United States are a steadily increasing population, up by 233% since 1980. Given the growing population of dual language learners (DLLs) and the large numbers of Spanish-speaking children enrolled in pre-kindergarten programs, addressing the educational needs of preschool-aged DLLs has become a national imperative. Specifically, the intersection of this growing population and the dearth of appropriate assessment tools to evaluate DLLs early language and literacy skills creates a need for assessments that accurately measure preschool performance. This manuscript reports on the iterative design process of a measure of Spanish phonological awareness for preschool-aged DLLs: Spanish Individual Growth and Development Indicators (S-IGDI) Primeros Sonidos. We employed measure design framework to develop the measure and tested item function within a study of 970, 4-5 year old DLLs. Results, including item level analyses and evidence regarding construct and criterion validity are reported.</p> <p>Spanish speakers in the United States (US) are a steadily increasing population, up by 233% since 1980. Projections indicate between 39 to 43 million Spanish speakers will live in the US by 2020 (Lopez &amp; Gonzalez-Barrera, 2013). Currently, 1 in 4 preschool-age children are Latino, and in Head Start, young dual language learners (DLLs) represent 30% of national enrollment; of these, 89% speak Spanish at home (U.S. Department of Health &amp; Human Services [USDHHS], 2013; Wildsmith, Scott, Guzman, &amp; Cook, 2014). In Migrant Head Start, Spanish-speaking children represent 85% of enrollment (USDHHS, 2009). Given the growing population of Latinos in the US and the large numbers of Spanish-speaking children enrolled in pre-kindergarten (Pre-K) programs, addressing the educational needs of young Spanish speakers has become a national imperative (Garcia &amp; Jensen, 2009; U.S. Census Bureau, 2010).</p> <p>Current educational approaches with Spanish-English dual language learners (SE-DLL)[<reflink idref="bib1" id="ref1">1</reflink>] are not significantly improving English reading outcomes (National Center for Education Statistics [NCES], 2013). Since 1975, a persistent gap has been present in reading scores on the National Assessment of Educational Progress (NAEP) between White and Latino children at ages 9, 13, and 17 (NCES, 2013). The most recent long-term reading trend data indicate that although the scores for Latino students have improved, so too have the scores of White students, essentially maintaining the gap since 1975 at all age groups except at age 13 where the gap has narrowed. These data provide evidence that the field has failed to implement effective practices, including appropriate assessment, for SE-DLLs. Without ample resources to support academic success, SE-DLLs experience an elevated level of risk of academic failure (Goldenberg, 2008). High quality instruction, intervention and assessment for SE-DLLs are needed to better educate this population, but research is only beginning to discern what practices and tools are most effective. We focus on one aspect of supporting SE-DLLs: developing meaningful assessments to accurately evaluate SE-DLL early literacy performance.</p> <p>1 The term "Spanish-English dual language learners" (SE-DLLs) encompasses other terms frequently used, such as Limited English Proficient (LEP), bilingual, English language learners (ELL), English learners, and children who speak a Language Other Than English (LOTE).</p> <p>At the core of any evidence-based educational program is the development of assessments to measure instructional targets. Given the cultural and linguistic diversity in the US (Barrera &amp; Liu, 2010; USCB, 2010), technically adequate measures designed to accurately capture the ability levels of a broad range of children are needed. These tools should include screening and progress monitoring measures to be used within the context of data-based decision making to support instructional modification (Brown &amp; Doolittle, 2008; Haager, 2007; Hosp, Hosp, &amp; Dole, 2011). Without reliable and valid inferences about children's abilities, it is difficult to gain meaningful information about student performance. We respond to these needs by describing the development and calibration of the new Spanish Individual Growth and Development Indicators (<emph>S-IGDIs</emph>) phonological awareness measure. <emph>S-IGDIs</emph> represent an innovative approach to developing a measure in Spanish that will provide early childhood practitioners with an efficient, cost-effective, and accurate tool for examining performance of preschool-aged SE-DLLs.</p> <hd id="AN0134694290-2">Supporting early literacy development</hd> <p>One area to focus assessment efforts for SE-DLLs is early literacy skills in both English and Spanish. Early literacy skills are those skills that are known predictors of later reading success (National Early Literacy Panel, 2008). Without the ability to read in English, SE-DLLs may struggle to achieve adequate educational outcomes across all academic content areas, as SE-DLL children in most US classrooms must be able to read in their second language to complete tasks in other domains. As such, intervening early and successfully to support the prerequisite skills necessary for learning to read in English remains integral to improving the long-term academic outcomes of SE-DLLs in the US (Goldenberg, 2008).</p> <p>Exactly how to intervene to best support the long-term goal of reading in English is less understood. Researchers have demonstrated the presence of cross-linguistic transfer for SE-DLLs. Researchers show SE-DLLs use their native language skills and knowledge to support the development of English language and literacy skills, and in some circumstances also use their English language and literacy skills to support development of Spanish (c.f. Cárdenas-Hagan, Carlson, &amp; Pollard-Durodola, 2007; Geva &amp; Genesee, 2006; Melby-Lervåg &amp; Lervåg, 2011). Although research findings vary in describing the nature and direction of the association between first (L1) and second languages (L2), it is generally accepted that both languages contribute in some way to how a child learns to read in the second language (Genesee, Geva, Dressler, &amp; Kamil, 2006; Hammer, Lawrence, &amp; Miccio, 2007; Melby-Lervåg &amp; Lervåg, 2011). Researchers also have shown that intervention delivered in the native language has produced meaningful gains on English and Spanish early literacy and language outcomes for preschool-age SE-DLLs (Farver, Lonigan, &amp; Eppe, 2009). Taken together, these research findings support the need to assess and support early language and literacy in L1 and L2 during the preschool years.</p> <hd id="AN0134694290-3">Spanish and english phonological awareness</hd> <p>We define Phonological Awareness (PA) as the meta-linguistic ability to understand that spoken words are comprised of small sound units; to detect, discriminate between, and manipulate these structural components; and to perform these skills independent of word meaning (Torgeson &amp; Mathes, 2000). In English, PA skills such as detecting initial sounds, segmenting, blending, and elision have consistently been shown to predict reading ability when measured in preschool (Anthony &amp; Lonigan, 2004; Muter, Hulme, Snowling, &amp; Stevenson, 2004). Associations have been found between early Spanish PA and later Spanish reading development (Branum-Martin et al., 2006; Farver, Nakamoto, &amp; Lonigan, 2007; Gorman &amp; Gillam, 2003). Spanish PA skills are also predictive of reading achievement in English (Leafstedt &amp; Gerber, 2005; Melby-Lervåg &amp; Lervåg, 2011; Proctor, August, Carlo, &amp; Snow, 2006; Swanson, Rosston, Gerber, &amp; Solari, 2008). In Pre-K, PA Spanish skills such as elision and rhyming correlate with the same English skills (Dickinson, McCabe, Clark-Chiarelli, &amp; Wolf, 2004; López &amp; Greenfield, 2004).</p> <p>Although there is sufficient evidence to suggest cross-linguistic transfer is present for PA, associations may be more complex than can be modeled by correlational studies alone (Melby-Lervåg &amp; Lervåg, 2011). Branum-Martin et al. (2006) found through multi-level modeling that Spanish and English PA loaded best as separate factors (and potentially represent separate constructs), despite high correlations. These results support the notion that some PA skills may be language-specific and associations may vary across the PA skills that are measured. For example, Goodrich, Lonigan, and Farver (2013) found that children with higher elision scores in Spanish demonstrated higher English elision skills at the end of intervention than those children with lower initial scores in Spanish; however, the same findings were not present for blending tasks, suggesting variability in findings based on different PA skills. Further, SE-DLLs English performance may be more strongly predicted by English literacy skills than Spanish early literacy skills (Hammer, Jia, &amp; Uchikoshi, 2011). Researchers have also identified mediators such as language of instruction and language proficiency that may influence these cross-linguistic associations (Cárdenas-Hagan et al., 2007; Goodrich, Lonigan, &amp; Farver, 2014).</p> <p>Given the lack of clarity in understanding how to best intervene with SE-DLLs relative to their native language and literacy ability, and the current evidence available regarding the cross-linguistic association between Spanish and English, it seems logical to target assessment development of early literacy skills in Spanish. In this way, we can improve our understanding of the nature of cross-linguistic transfer as well as examine student responses in ways that inform the potential for instruction and intervention in Spanish, English or both languages to support English reading development.</p> <hd id="AN0134694290-4">Understanding the need for spanish assessment tools</hd> <p>To provide instructional practices that maximize SE-DLL student performance in English and Spanish, it is important to help practitioners make data-based decisions with empirically sound measurement tools. Specifically, for SE-DLLs we must be able to ascertain to what degree each language has developed so that educators can respond with differentiated approaches. High-quality Spanish measures that can accurately identify candidates for language and literacy intervention are an important contribution to understanding how to best intervene with SE-DLL students.</p> <p>At present, there are few high-quality, commercially available, Spanish PA early childhood assessment tools accessible to practitioners that can be used to inform instruction during the Pre-K years. We focus here on screening assessments because of their instrumental link to data-based decision making at the classroom level (McConnell, Wackerle-Hollman, &amp; Bradfield, 2014); in differentiated instructional models where practitioners aim to meet the unique needs of each student with leveled instructional strategies, screening is essential. Of the Spanish screening assessments available, including the Get Ready to Read-Spanish (<emph>¡Prepárate a leer!</emph> - Revisada, <emph>GRTR-S-R</emph>, Lonigan, 2003), Istation ISIP (Mathes &amp; Torgesen, 2005), and the Circle Phonological Awareness Language and Literacy System (C-PALLS, Landry, Assel, Gunewig, &amp; Swank, 2004), none provide published information on the process of the development of the Spanish versions, making it difficult to ascertain to what degree translation of existing English items or measures was used to develop the Spanish measures (Barrueco, López, Ong, &amp; Lozano, 2012). This is problematic for two reasons. First, limited information on current assessments prevents a review of how the assessment accesses an identified construct. Although the trajectory of Spanish PA is similar to English, it is not identical (Anthony et al., 2011), and if assessments are translations of English PA measures, then important facets of Spanish PA may not be represented because the measures may represent an English construct translated to Spanish, rather than a Spanish early literacy construct. Second, without information regarding assessment design and validation, it is difficult to determine whether factors such as length and difficulty of Spanish words chosen, complexity of distractors (incorrect options), and construct irrelevant features were addressed. Fortunately, additional tools are available in the K-12 arena that may offer a bridge to validate predictive efforts such as the Indicadores Dinámicos del Éxito en la Lectura (IDEL, Good, Baker, Knutson, &amp; Watson, 2007) and FASTBridge Spanish Reading measures (Christ, 2013), both designed with Spanish development in mind, in contrast to existing translated tools.</p> <hd id="AN0134694290-5">Research questions</hd> <p>Given the need for new measures of Spanish early literacy to improve our understanding of how to intervene with young SE-DLLs, we describe the development process and examine the psychometric properties of the <emph>Primeros Sonidos</emph>/<emph>First Sounds (PS/FS) S-IGDIs</emph> measure. We present the process of item design followed by large-scale validation trials to answer the following questions: (a) What are the item-level statistics of <emph>PS/FS</emph>? (b) To what degree do <emph>PS/FS</emph> items appropriately measure child Spanish PA abilities? and (c) To what extent is <emph>PS/FS</emph> associated with other standardized measures of Spanish language and early literacy?</p> <hd id="AN0134694290-6">Method</hd> <p></p> <hd id="AN0134694290-7">Instrument</hd> <p></p> <hd id="AN0134694290-8">Development of the spanish individual growth and development indicators</hd> <p>The <emph>S-IGDIs</emph> are a set of early literacy screening measures designed for use with SE-DLL preschoolers. Grounded in Wilson's (2005) measure design framework, the <emph>S-IGDIs</emph> seek to measure early literacy skills in Spanish that predict later literacy outcomes in English. <emph>S-IGDIs</emph> are designed to assess SE-DLL preschool performance in Spanish in complement to their English counterparts: English <emph>IGDIs 2.0</emph>. These assessments were developed to measure early literacy in English and Spanish as separate constructs and to provide information on student ability in each language to promote data-based decision making and improved instructional practices. <emph>S-IGDIs</emph> are not translations of English measures. The unique features of Spanish phonology, word structure, and semantics informed <emph>S-IGDI</emph> test development. This was accomplished through four components from Wilson's framework for developing measures: construct map, item design, outcome space, and measurement model (Wilson, 2005).</p> <hd id="AN0134694290-9">Defining the construct map</hd> <p>To begin the iterative process of measure development, the research team conducted an extensive literature review to arrive at constructs of interest, construct definitions, and research-based suggestions for item and measure design. A search using the key words "Spanish+ Assessment+ Phonological Awareness" and "Early Literacy+ Spanish+ Assessment" targeting references post-2010 was employed in Google Scholar, EBSCO, Academic Search Primer, Psych INFO and ERIC, yielding a total of 39 articles, book citations, and assessment citations for review. Articles that referenced Spanish but did not include Spanish measures were removed as well as articles that included measures for only Kindergarten and older grades, reducing the pool of articles to 28. Each source was reviewed for suggested PA Spanish tasks, and presentations of each task were cataloged for a detailed review see Wackerle-Hollman et al., 2012). From the literature review, the syllable is a salient phonological unit in Spanish; blending, initial sound identification, and syllable segmenting tasks may be particularly appropriate. In addition, Spanish phonological awareness may be best represented by a unitary construct sampled by various tasks that are indicative of differing levels of performance on that construct (e.g., Anthony et al., 2011). Results of the comprehensive literature review were synthesized to inform a PA continuum of skill that functions as the foundation of the <emph>PS/FS</emph> measure design process. Within the continuum, we identified early childhood skills indicative of lower PA ability, such as syllable identification and blending, to skills indicative of higher levels of PA ability, such as elision (Anthony et al., 2011; Gorman &amp; Gillam, 2003). These findings supported the notion that Spanish PA may be best represented as a unitary construct that may be sampled by tasks to assess skills that may have differing trajectories or developmental timelines.</p> <hd id="AN0134694290-10">Designing items</hd> <p>For each measure designed, the concept presented aligned with the construct definition and represented the targeted skill. Four initial Spanish PA measures included representations from various locations on the construct map: a rhyming task, a first sounds task, a blending task, and an elision task. All new measures of Spanish PA were designed by manipulating presentation style (e.g., receptive choice or expressive production) and/or delivery features (e.g., using images when possible to reduce cognitive burdens, etc.) present in the research literature. However, after initial pilot studies in Years 1 and 2, we focused our design efforts on one of the four measures: <emph>Primeros Sonidos/First Sounds (PS/FS)</emph> because the remaining measures failed to meet empirical and qualitative criteria. Information on the design, testing, and eventual elimination process for the other Spanish PA measures can be found in the <emph>S-IGDI</emph> technical reports (2016) available at <ulink href="http://innovation.umn.edu/igdi/projects/spanish-igdis/">http://innovation.umn.edu/igdi/projects/spanish-igdis/</ulink></p> <p>During our design process, our construct definition of PA to define measure components. We noted that children should be able to "detect and discriminate between small units of sound," and as such we included measures that required such detection (e.g., in first sounds we asked children to identify the first sound or syllable they hear in a word).</p> <p> <emph>S-IGDI PS/FS</emph> items were designed to incorporate culturally relevant factors and to include measurement review processes that carefully evaluated item-level features (Wackerle-Hollman et al., under review). As researchers suggest translated measures do not account for the ways that Spanish early literacy skills may develop differently from these skills in English (Barrueco et al., 2012; Peña, 2007; Wackerle-Hollman et al., 2012), the <emph>S-IGDI</emph> item design process consisted of using words from existing Spanish word corpuses including Spanish early childhood curricula, high-frequency words collected from an inventory of 100 Spanish children's picture books, and the Spanish version of the MacArthur Bates Communicative Development Inventory (MacArthur <emph>Inventarios del Desarrollo de Habilidades Comunicativas</emph>; Jackson-Maldonado et al., 2003). We also carefully selected and designed images to reflect culturally relevant and developmentally appropriate targets. Four national experts external to the project team were then recruited for their knowledge in bilingual assessment, Spanish language development, and early childhood research with SE-DLLs to review all items. Feedback was provided in one-on-one interviews and was incorporated into <emph>S-IGDI PS/FS</emph> design. Feedback included careful consideration of the selection of words and their usability with a variety of Spanish dialects and cultures within the US Latino population (for example, in Puerto Rican Spanish, <emph>llanta</emph> [tire] is <emph>rueda</emph>, and <emph>naranja</emph> [orange] is <emph>china</emph>).</p> <p>Once item-level targets were identified, we isolated and removed construct-irrelevant features, including background context in photographs and distractors with common features that were not part of the target skill (e.g., in the <emph>PS/FS</emph> task we excluded distractors that rhymed). We also strategically manipulated the number of distractors present on each item to include either one (distractor and target) or two (two distractors and a target). Although we recognized that including just one distractor would increase the likelihood of selecting a correct response by guessing given an odds ratio of 1/2 (.50), we reasoned that item fit for these items would be poor if guessing was present (Smith, 1994). Regarding linguistic limitations, the research team carefully considered appropriate target sounds given particular nuances of Spanish sounds. For example, when considering phonemes, no <emph>PS/FS</emph> items included/w/or/h/as a target because all Spanish words that begin with the grapheme/w/are English-influenced words (e.g., wafle, waterpolista) and because no Spanish words begin with a sounded/h/, as this sound is silent in Spanish. Also, we were careful to prevent words or images with similar initial sounds from appearing on the same item. For example, the graphemes/c/,/s/, and/z/all sound the same in Spanish (e.g., all make a/s/phoneme), so a zebra (<emph>cebra</emph>), snake (<emph>serpiente</emph>), and shoe (<emph>zapato</emph>) could never appear in the same item. We also considered the syllabic nature of Spanish words, recognizing that it is often difficult to isolate the initial phoneme (Gorman &amp; Gillam, 2003), so we included <emph>PS/FS</emph> items that isolated the initial syllable (e.g.,/cha/for <emph>chaqueta</emph>, and/za/for <emph>zapato</emph>). Final items in the <emph>PS/FS</emph> measure targeted both initial syllable and initial phoneme.</p> <p>Regarding pragmatic item design features, for <emph>S-IGDIs</emph> to be useful for early childhood practitioners who serve SE-DLLs, they must be easy to use and understand. These features coincide with the characteristics of general outcome measures (GOM), which are a class of measures designed to be predictors of meaningful long-term academic success while maintaining efficiency, ease of use, and feasibility (Fuchs &amp; Deno, 1991). <emph>PS/FS</emph> items were designed to be easily delivered by lay-level practitioners; all prompts and response choices are printed on the back of each item and all measures require less than five minutes to deliver and score. Evidence to support the usability and feasibility of <emph>S-IGDIs</emph> has been collected through three primary means. First, scoring rubrics were developed and applied based on four criteria: (a) child interaction with <emph>S-IGDIs</emph> will produce meaningful responses through child active engagement (e.g., making eye contact, demonstrating interest, and attending to the assessors requests); (b) child interaction with <emph>S-IGDIs</emph> will produce a valid response pattern (e.g. the child's response should be a logical extension of knowledge based on the prompt and not off topic); (c) the <emph>S-IGDIs</emph> should be easy to use; (d) the <emph>S-IGDIs</emph> should be timely to deliver and score. Second, we obtained expert reviews from the four SE-DLL early literacy researchers previously described. Third, teacher surveys were administered addressing feasibility and usability.</p> <p>Qualitative summaries of <emph>PS/FS</emph> were collected from four bilingual data collectors who assessed and rated 35 students. Scores ranged from 0-3, where 0 indicated the variable was unsatisfactorily achieved (not observed) and unresolvable (no clear resolution was available to repair the prompt to produce the desired behavior); a 1 indicated the variable was unsatisfactorily achieved but resolvable (a clear resolution was available to repair the prompt to produce the desired behavior); a 2 indicated the variable was satisfactorily achieved (the behavior of interest was observed, but not as anticipated in measure design), but had some reservations that were resolvable (a clear resolution was available to improve the instance of the desired behavior); and 3 indicated the variable was satisfactorily achieved without reservations. Results indicated initial trials for <emph>PS/FS</emph> yielded an average score of 2.8. All assessors reported <emph>PS/FS</emph> required 1-3 minutes to deliver and score and students appeared engaged with all items.</p> <p>Four expert reviewers were given item sets to review with instructional prompts. All reviewers agreed that <emph>PS/FS</emph> was efficient and easy to deliver. One reviewer requested changes in the prompts to make it more accessible by lay-level assessors and another noted that the measure-administration training must be provided in Spanish and English to support bilingual classrooms. All suggested modifications were incorporated into <emph>PS/FS</emph> measure design.</p> <p>Finally, a subset of bilingual teachers from the study (<emph>n</emph> = 20) reported on feasibility and usability via survey and interview formats. The sample included teachers with an average of seven years working in early childhood programs. Teachers reviewed the materials, instructions for administration, and scoring forms and then observed a trained data collector giving the assessment to one of their students. Following the observation, teachers completed the Feasibility and Utility survey that included two sections: ease of administration and feasibility, utility and practicality. The ease of administration section included 16 questions, where 13 questions used a four-point rating scale ranging from <emph>strongly agree</emph> to <emph>strongly disagree</emph>, and three were open ended. Example items included questions about instruction ease, administration time, scoring ease, and overall measure relevance. Results indicated teachers strongly agreed with items an average of 73% of the time (range of 45% to 90%), where only 45% strongly agreed with the item "The scoring sheets were easy for me to use." One teacher (5%) reported disagreement with this item. No teachers reported <emph>strongly disagree</emph> for any of the items. Overall, teachers found it easy to evaluate responses, the measure was brief to administer and score, and the measure included easy-to-understand standardized instructions. The three open-ended questions asked participants how they would make sample questions, items, and prompts easier to administer. Only seven teachers provided feedback, including suggestions such as changing some of the images, providing instructions in Spanish <emph>and</emph> English on the item sets, and including frequently asked questions specific to <emph>PS/FS</emph> right on the item cards.</p> <p>The feasibility, utility, and practicality section of the survey included nine rating-scale items to evaluate the extent to which teachers could easily incorporate the assessment protocol into classroom practices and the degree to which they found resulting <emph>S-IGDI</emph> data useful in supporting language and early literacy instruction. All teachers reported <emph>strongly agree</emph> to the question "Is <emph>PS/FS</emph> developmentally appropriate for SE-DLLs in your classroom?" Teachers agreed that <emph>PS/FS</emph> scores were very useful for supporting instructional modifications, and that testing materials were interpretable for children, indicating their students would be familiar with the images provided. All teachers strongly agreed that <emph>PS/FS</emph> appropriately measured PA and agreed that <emph>PS/FS</emph> measured skills they taught in their class.</p> <p>Across sources, results were summarized and incorporated into item design when relevant. The evidence from these three sources - qualitative rubrics, expert and teacher surveys- indicate <emph>PS/FS</emph> demonstrates utility and feasibility in early childhood classrooms.</p> <hd id="AN0134694290-11">Creating an outcome space</hd> <p>The outcome space represents the frame for item presentation and scoring. During <emph>PS/FS</emph> item design, we reasoned a receptive response in a multiple-choice presentation style would provide ample opportunities to administer a significant number of items while also allowing for standardization of dichotomous scoring. As such, all <emph>PS/FS</emph> items included two or three images; selection of the target image yielded a correct score.</p> <p>When considering the outcome space, we also reviewed our intentions for soliciting responses. Responses come from preschool-age students, and given our effort to limit construct-irrelevant features, using images to represent the <emph>PS/FS</emph> phonemes and syllables reduces the cognitive load and contributes to a response that was less likely to be influenced by memory capacity. Further, we developed prompts that reduce cognitive dissonance by labeling all images to prevent children from drawing on an existing label of an image they may have if it is not the same label used in the item. For example, a <emph>PS/FS</emph> item with three images of <emph>brazaletes</emph> (bracelets), <emph>cabra</emph> (goat), <emph>alfombra</emph> (rug) is presented by labeling each image and then providing the prompt, "<emph>Cual de estos dibujos empieza con</emph>/bra/?" [which picture starts with the sound/bra/?]. We allowed responses to be provided verbally or by pointing to the correct image since pointing to the image without saying it represents knowledge of the construct. In most of our trials, students said and pointed to the image on the card or pointed to the item and then verbally labeled it when prompted. These features aligned with the <emph>PS/FS</emph> measure focusing on receptive understanding of the item content. We are unaware of any studies that demonstrate empirical differences in predictive power of receptive versus expressive assessment approaches; however, Anthony et al. (2011) noted that receptive measurement approaches resulted in easier items than expressive measurement approaches.</p> <p>Further, our selection of the Rasch model for the selected-response (SR) items for receptive measurement in the outcome space acknowledges the differences in the location of the items (so called item difficulty, the ability required to have a 50% chance of correctly responding) and the locations (ability) of persons. The research literature on SR measures notes that the accumulation of the possibility of guessing is negligible in most cases (see Rodriguez, 2005, for a review). In addition to considering these factors, we also Used results from the outcomes space in the measurement model to evaluate the fit of items and eliminate those with poorer fit, via item-measure correlations, INFIT person fit indices, and overall item <emph>p</emph>-value statistics. We also examined the extent to which items functioned similarly across seasons, years, and in the presence of anchor items, including examination of item parameter drift over time and displacement when anchored with common items across forms. Finally, we evaluated differential item functioning (DIF) statistics for every item. Each item was carefully evaluated for consistency and stability (described in detail below).</p> <hd id="AN0134694290-12">Applying a measurement model</hd> <p> <emph>S-IGDIs</emph> employ a Rasch modeling approach to measurement (Rasch, 1980). Rasch modeling is an ideal fit for <emph>S-IGDI</emph> design because Rasch models are uniquely suited for measurement design and are consistent with Wilson's model. When the data fit the Rasch model, the property of invariance between items and persons is achieved, such that person location is not dependent on the specific items administered, and item location is not dependent on the persons responding to the item (Andrich, 2004; Engelhard, 2013; Sick, 2010). This property is an advancement beyond classical test theory, where person scores and item difficulty are sample specific. Specifically, the Rasch model conceptualizes responses as a function of the item locations (e.g., difficulties) and person locations (e.g., abilities). Therefore, children's scores on <emph>PS/FS</emph> are based on their modeled ability rather than on normative performance of the items with which they interacted.</p> <p>When the data fit the model, Rasch provides units of measurement on an interval level so that there is a uniform interpretation across the scale. In addition, the Rasch model meets the requirements for invariant measurement: (a) person measurements must be independent from items the person is administered; (b) a more able person must always have a greater chance of success on a given item than a less able person; (c) difficulty of items must be independent of the sample who received the items; (d) any person must have a greater probability of success on an easy item than on a more difficult item; and (e) items and persons are located on the same scale (Andrich, 2004; Bond &amp; Fox, 2015; Engelhard, 2013; Sick, 2010). The Rasch model requires at least 100 responses per item to adequately scale and calibrate items.</p> <p>However, even with the benefits of the Rasch model, there are various contrasting perspectives in the research literature; not all measurement experts agree with the claims made by Rasch advocates. We encourage the reader to review Sick (2010) and Andrich (2004) to gain further perspective on these contrasts. Specifically, some argue that additional parameter models should be tested rather than selecting a measurement model <emph>a priori</emph>. Although we did not employ this approach, we acknowledge that some see value in accounting for additional variance through use of the 2PL and 3PL models. Indeed, it is true that using 2PL or 3PL models will typically account for more variance; however, the focus of test design is <emph>not</emph> to explain maximum variance; instead, it is to maximize accurate measurement. Further, Rasch is a more parsimonious model and Rasch person parameter estimates correlate with 2PL models at rates above.90 (de Ayala, 2013). To satisfy such interests, we conducted a model comparison with the 2- and 3-parameter logistic models, with results reported below.</p> <hd id="AN0134694290-13">Participants</hd> <p></p> <hd id="AN0134694290-14">Participants &amp; setting</hd> <p>SE-DLL children in public and private early childhood education programs in MN, FL, CA, UT, KS, and IL were recruited for this study. In order to participate in the study, children had to speak Spanish according to parent or teacher report, be 4-5 years old, and be eligible for Kindergarten the following year. No children who were native English speakers were included in this study. Participating sites were recruited based on prior study enrollment, relationships with research staff, and email recruitment strategies. The study spanned 46 schools and 135 classrooms over two academic years (2013-2014 and 2014-2015). A total of 124 teachers participated in classroom surveys, with some teachers leading more than one classroom. Only 5% of classrooms included SE-DLL students but did not include bilingual teachers or educational support staff. Graduate research assistants and data collectors obtained signed parental consent after teachers sent consent forms home in student backpacks. Across all sites in the 2013-2014 year, 491 children returned consents to participate. A sample of 479 consented children was added in the 2014-2015 school year, for a total sample of 970 children.</p> <p>We aimed to recruit a dialectically diverse sample of Spanish-speaking children from FL to obtain Caribbean, Central American, and South American Spanish dialects; and from UT, CA, MN, KS, and IL to obtain Mexican and Central American dialects. Students were recruited by teachers initially indicating which students in their classroom spoke Spanish at home. Demographic forms were completed by 75% of the sample (732 families) which included 47.6% males. Child ages ranged from 4:0 to 5:11 at the beginning of the academic year, 5.9% of the sample received special education services (according to parent report), and 57% of the sample attended Head Start and/or had weekly family incomes less than $500. A recent report from the National Research Center on Hispanic Children and Families noted that nearly 66% of the total Hispanic population in the US live in low-income households (defined as two times the federal poverty level; Wildsmith, Alvira-Hammond, &amp; Guzman, 2016); our sample is relatively representative of US SE-DLLs in this respect. Specific to language exposure, parents reported that 69% of the sample heard Spanish from birth, 24% heard both English and Spanish, and 7% did not respond to this question. Children who were most comfortable speaking in Spanish or in a mix of Spanish and English comprised 72% of the sample. Although all native Spanish speakers, 10% of children were rated by their parent to be most comfortable speaking in English, perhaps due to the saliency of their current exposure to English in their preschool classrooms. In addition, approximately 9% of the sample reported speaking other languages at home including heritage languages such as Mam and Quechua, which are native to Central and South America. See Table 1 for additional demographic information.</p> <p>S-IGDI sample descriptives.</p> <p> <ephtml> &lt;table border="1" cellpadding="4"&gt;&lt;tbody&gt;&lt;tr&gt;&lt;td align="center"&gt;Characteristic&lt;/td&gt;&lt;td align="center"&gt;2013-2014 (n&amp;#160;=&amp;#160;396) %&lt;/td&gt;&lt;td align="center"&gt;2014-2015 (n&amp;#160;=&amp;#160;336) %&lt;/td&gt;&lt;td align="center"&gt;Total (n&amp;#160;=&amp;#160;732) %&lt;/td&gt;&lt;/tr&gt;&lt;/tbody&gt;&lt;tbody&gt;&lt;tr&gt;&lt;td&gt;Male&lt;/td&gt;&lt;td&gt;52.5&lt;/td&gt;&lt;td&gt;47.0&lt;/td&gt;&lt;td&gt;47.6&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Receiving special education services&lt;/td&gt;&lt;td&gt;4.0&lt;/td&gt;&lt;td&gt;7.7&lt;/td&gt;&lt;td&gt;5.9&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Latino (general)&lt;/td&gt;&lt;td&gt;52.1&lt;/td&gt;&lt;td&gt;56.0&lt;/td&gt;&lt;td&gt;54.1&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Mexican&lt;/td&gt;&lt;td&gt;15.4&lt;/td&gt;&lt;td&gt;17.6&lt;/td&gt;&lt;td&gt;17.2&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Puerto Rican&lt;/td&gt;&lt;td&gt;14.3&lt;/td&gt;&lt;td&gt;9.2&lt;/td&gt;&lt;td&gt;12.2&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Caribbean&lt;/td&gt;&lt;td&gt;2.5&lt;/td&gt;&lt;td&gt;&amp;#60;&amp;#160;1.0&lt;/td&gt;&lt;td&gt;1.2&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Central American&lt;/td&gt;&lt;td&gt;2.8&lt;/td&gt;&lt;td&gt;4.5&lt;/td&gt;&lt;td&gt;3.6&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;South American&lt;/td&gt;&lt;td&gt;1.5&lt;/td&gt;&lt;td&gt;&amp;#60;&amp;#160;1.0&lt;/td&gt;&lt;td&gt;&amp;#60;&amp;#160;1.0&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Multiple races/ethnicities&lt;/td&gt;&lt;td&gt;11.5&lt;/td&gt;&lt;td&gt;11.8&lt;/td&gt;&lt;td&gt;10.7&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Languages spoken to child from ages 0 to 1&lt;/td&gt;&lt;td /&gt;&lt;td /&gt;&lt;td /&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;Spanish&lt;/td&gt;&lt;td&gt;71.0&lt;/td&gt;&lt;td&gt;70.8&lt;/td&gt;&lt;td&gt;69.1&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;Both&lt;/td&gt;&lt;td&gt;24.3&lt;/td&gt;&lt;td&gt;25.6&lt;/td&gt;&lt;td&gt;24.0&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Language child uses when talking at home&lt;/td&gt;&lt;td /&gt;&lt;td /&gt;&lt;td /&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;Spanish&lt;/td&gt;&lt;td&gt;48.5&lt;/td&gt;&lt;td&gt;49.1&lt;/td&gt;&lt;td&gt;49.5&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;Both&lt;/td&gt;&lt;td&gt;24.0&lt;/td&gt;&lt;td&gt;41.7&lt;/td&gt;&lt;td&gt;32.2&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;English&lt;/td&gt;&lt;td&gt;12.0&lt;/td&gt;&lt;td&gt;8.3&lt;/td&gt;&lt;td&gt;10.4&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;Other&lt;/td&gt;&lt;td&gt;15.5&lt;/td&gt;&lt;td&gt;0.0&lt;/td&gt;&lt;td&gt;8.6&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Household weekly income&lt;/td&gt;&lt;td /&gt;&lt;td /&gt;&lt;td /&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;Less than $500&lt;/td&gt;&lt;td&gt;63.1&lt;/td&gt;&lt;td&gt;66.8&lt;/td&gt;&lt;td&gt;65.0&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;$501-700&lt;/td&gt;&lt;td&gt;22.7&lt;/td&gt;&lt;td&gt;27.5&lt;/td&gt;&lt;td&gt;24.6&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;$701-900&lt;/td&gt;&lt;td&gt;7.7&lt;/td&gt;&lt;td&gt;0.0&lt;/td&gt;&lt;td&gt;4.4&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;More than $901&lt;/td&gt;&lt;td&gt;6.6&lt;/td&gt;&lt;td&gt;5.7&lt;/td&gt;&lt;td&gt;6.1&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Mother's highest level of education&lt;/td&gt;&lt;td /&gt;&lt;td /&gt;&lt;td /&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;6&lt;sup&gt;th&lt;/sup&gt; grade or less&lt;/td&gt;&lt;td&gt;13.9&lt;/td&gt;&lt;td&gt;19.2&lt;/td&gt;&lt;td&gt;16.7&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;Less than 12&lt;sup&gt;th&lt;/sup&gt; grade&lt;/td&gt;&lt;td&gt;18.0&lt;/td&gt;&lt;td&gt;23.3&lt;/td&gt;&lt;td&gt;20.3&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;GED&lt;/td&gt;&lt;td&gt;12.1&lt;/td&gt;&lt;td&gt;7.2&lt;/td&gt;&lt;td&gt;10.0&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;High school diploma&lt;/td&gt;&lt;td&gt;11.3&lt;/td&gt;&lt;td&gt;21.6&lt;/td&gt;&lt;td&gt;15.5&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;Some education after high school&lt;/td&gt;&lt;td&gt;16.6&lt;/td&gt;&lt;td&gt;18.5&lt;/td&gt;&lt;td&gt;17.5&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;Associate's degree&lt;/td&gt;&lt;td&gt;9.7&lt;/td&gt;&lt;td&gt;0.0&lt;/td&gt;&lt;td&gt;5.6&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;College degree (BA/BS)&lt;/td&gt;&lt;td&gt;13.1&lt;/td&gt;&lt;td&gt;5.1&lt;/td&gt;&lt;td&gt;9.5&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;Graduate/professional degree&lt;/td&gt;&lt;td&gt;5.4&lt;/td&gt;&lt;td&gt;5.1&lt;/td&gt;&lt;td&gt;4.8&lt;/td&gt;&lt;/tr&gt;&lt;/tbody&gt;&lt;/table&gt; </ephtml> <emph>Note</emph>: Sample sizes in this table are based on number of families who returned the family survey, not on the total consented samples. The multiple ethnicities group includes those who selected two or more ethnicities on the family survey.</p> <p>At the classroom level, teachers reported language of instruction and level of language proficiency. Forty-five percent of the classrooms provided instruction in English, 53% used both languages for instruction, and 1% used Spanish only. Fourteen percent of lead teachers were bilingual, 45% of classrooms included a Spanish-speaking assistant, and 5% had no Spanish-speaking adults in the classroom. Of the 95% of classrooms containing Spanish-speaking or bilingual adults, 28% said other support staff used Spanish, 14% said Spanish interactions occurred via specialists, and 30% reported Spanish-speaking parent volunteers in the classroom. Fifty-six percent of classrooms reported that children spoke Spanish in the classroom.</p> <hd id="AN0134694290-15">Measures</hd> <p></p> <hd id="AN0134694290-16">S-IGDI primeros sonidos/first sounds</hd> <p>Six <emph>S-IGDI</emph> measures, including <emph>PS/FS</emph>, reached the final stages of development and were administered as part of a larger study. <emph>S-IGDIs</emph> were designed for children whose native language is Spanish and therefore are not appropriate for children whose second language is Spanish. The remaining five tasks were measures of oral language and alphabet knowledge. The <emph>PS/FS</emph> measure included four sample items and 21-28 test items, depending on form administered. The administrator modeled the first two sample items. The second two sample items were practice items and feedback was delivered for correct and incorrect responses. If the child responded correctly, then the administrator responded by saying, "<emph>muy bien</emph> (very good)." If the child responded incorrectly, then the administrator provided the correct response and re-administered the item. The measure was discontinued if the child responded incorrectly twice on a single sample item, which included 1% of the sample. If the child could not respond to the sample items even with direct feedback prompting them to repeat a correct response, then it was assumed the child did not understand the task or was unable to engage with the items. If children successfully engaged the sample items, all items were administered and no discontinue criteria were employed.</p> <p> <emph>PS/FS</emph> was designed to measure a child's ability to identify the initial sounds of words independent of meaning. Items were not ordered by difficulty in item sets; instead, they were randomly selected from the item pool and then delivered in a standardized order. Administrators presented each item by pointing to and labeling each of the two or three images followed by the prompt, "<emph>¿Cuál de estos dibujos empieza con</emph> ___<emph>?</emph>" ("Which of these pictures begin with ___?") inserting the target sound in the blank. Item targets varied, including single phonemes (e.g.,/c/), and initial syllables (e.g.,/cha/). Administrators used a manualized list of example phonemes to facilitate standardization of sound production without the schwa sound (e.g./t/instead of/te/). Children responded by pointing to or verbally labeling the image during the untimed administration. Scores were recorded as correct (identifying the image matching the target sound) or incorrect (identifying any other image).</p> <hd id="AN0134694290-17">Sampling scheme</hd> <p> <emph>PS/FS</emph> included 104 items; as such, to minimize the testing burden on participants, we employed a sampling scheme to strategically test all items at each site, allowing students to interact with a reduced number of items. Over the course of two academic years, eleven blocks were distributed across five forms using matrix sampling, and then assigned to students in an annual randomization. In Year 1, nine blocks were used, and in Year 2, students interacted with two blocks of items selected from Year 1. Each block consisted of 7-9 items, and combinations of three blocks (21-27 items) comprised a form in Year 1, whereas a combination of two blocks comprised a form in Year 2 (15 items). Blocks were sequentially assigned to forms (e.g. Form 101 included blocks A,B,C; Form 102 included blocks D, E, C etc.) and there were a total 5 forms. One block of items was common across adjacent forms so that calibration of all items could be linked and evaluated as a total item bank. Each child saw three forms (one form per season) including 4 sample items and 21-27 of 104 <emph>PS/FS</emph> items. Within each form for Year 1, all blocks were constructed by randomly selecting items from the item pool and then standardizing order of presentation. In Year 2, items were selected from Year 1 blocks to be administered to all student participants. Because of this design, typically employed by test developers during item development phases and during field-testing of new items, different numbers of students responded to different blocks of items, with the largest samples of responses obtained with the common (anchor) blocks used for linking forms. At the end of Year 2 all items were concurrently calibrated and treated as a single item pool.</p> <hd id="AN0134694290-18">Norm-referenced criterion measures</hd> <p>A strategically sampled subset of children also completed a criterion measure of early literacy in Spanish to understand the association between <emph>S-IGDI</emph> performance and existing, commercially available, norm-referenced measures of Spanish PA during the 2013-2014 academic year. Students were selected based on dialectical membership, gender, age distribution, program type, and geographic region to ensure that the sample included a dialectically diverse set of students with variability in performance (see Table 2). Because there are few available measures that examine the construct of Spanish early language and literacy rather than translating measures of English phonological awareness into Spanish, we expected limited correlations with <emph>PS/FS</emph>. The Test of Phonological Awareness in Spanish (<emph>TPAS</emph>, Riccio, Imhoff, Hasbrouck, &amp; Davis, 2004) and Get Ready to Read! - Revised Spanish version (<emph>¡Prepárate a leer!</emph> - Revisada, <emph>GRTR-S-R</emph>, Lonigan, 2003) were administered to the selected sample (<emph>n</emph> = 64 for <emph>TPAS, n</emph> = 60 for <emph>GRTR-S-R</emph>). Students were strategically sampled to represent variability in age (48-60 months) and geographic region (distributed across states).</p> <p>Demographic information for the criterion assessment subsample.</p> <p> <ephtml> &lt;table border="1" cellpadding="3"&gt;&lt;tbody&gt;&lt;tr&gt;&lt;td align="center"&gt;Characteristic&lt;/td&gt;&lt;td align="center"&gt;(n&amp;#160;=&amp;#160;60) GRTR %&lt;/td&gt;&lt;td align="center"&gt;(n&amp;#160;=&amp;#160;64) TPAS %&lt;/td&gt;&lt;/tr&gt;&lt;/tbody&gt;&lt;tbody&gt;&lt;tr&gt;&lt;td&gt;Male&lt;/td&gt;&lt;td&gt;67.3&lt;/td&gt;&lt;td&gt;48.4&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Receiving special education services&lt;/td&gt;&lt;td&gt;-&lt;/td&gt;&lt;td&gt;8.0*&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Latino (general)&lt;/td&gt;&lt;td&gt;83.3&lt;/td&gt;&lt;td&gt;68.8&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Mexican&lt;/td&gt;&lt;td&gt;19.6*&lt;/td&gt;&lt;td&gt;18.0*&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Puerto Rican&lt;/td&gt;&lt;td&gt;11.8*&lt;/td&gt;&lt;td&gt;16.0*&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Other Latin American&lt;/td&gt;&lt;td&gt;5.9*&lt;/td&gt;&lt;td&gt;8.0*&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Languages spoken to child from ages 0 to 1&lt;/td&gt;&lt;td /&gt;&lt;td /&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;Spanish&lt;/td&gt;&lt;td&gt;84.0*&lt;/td&gt;&lt;td&gt;84.0*&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;Both&lt;/td&gt;&lt;td&gt;13.6*&lt;/td&gt;&lt;td&gt;13.6*&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Language child uses when talking at home&lt;/td&gt;&lt;td /&gt;&lt;td /&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;Spanish&lt;/td&gt;&lt;td&gt;80.0*&lt;/td&gt;&lt;td&gt;67.3*&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;Both&lt;/td&gt;&lt;td&gt;20.0*&lt;/td&gt;&lt;td&gt;14.3*&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;English&lt;/td&gt;&lt;td&gt;-&lt;/td&gt;&lt;td&gt;12.2*&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;Other&lt;/td&gt;&lt;td&gt;-&lt;/td&gt;&lt;td&gt;6.1*&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Household weekly income&lt;/td&gt;&lt;td /&gt;&lt;td /&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;Less than $500&lt;/td&gt;&lt;td&gt;63.3&lt;/td&gt;&lt;td&gt;67.2&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;$501-700&lt;/td&gt;&lt;td&gt;23.6&lt;/td&gt;&lt;td&gt;20.3&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;$701-900&lt;/td&gt;&lt;td&gt;5.5&lt;/td&gt;&lt;td&gt;3.1&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;More than $901&lt;/td&gt;&lt;td&gt;7.3&lt;/td&gt;&lt;td&gt;-&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Mother's highest level of education&lt;/td&gt;&lt;td /&gt;&lt;td /&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;6&lt;sup&gt;th&lt;/sup&gt; grade or less&lt;/td&gt;&lt;td&gt;14.3*&lt;/td&gt;&lt;td&gt;23.9*&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;Less than 12&lt;sup&gt;th&lt;/sup&gt; grade&lt;/td&gt;&lt;td&gt;22.4*&lt;/td&gt;&lt;td&gt;19.6*&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;GED&lt;/td&gt;&lt;td&gt;16.3*&lt;/td&gt;&lt;td&gt;15.2*&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;High school diploma&lt;/td&gt;&lt;td&gt;6.1*&lt;/td&gt;&lt;td&gt;15.2*&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;Some education after high school&lt;/td&gt;&lt;td&gt;10.2*&lt;/td&gt;&lt;td&gt;8.7*&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;Associate's degree&lt;/td&gt;&lt;td&gt;12.4*&lt;/td&gt;&lt;td&gt;4.3*&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;College degree (BA/BS)&lt;/td&gt;&lt;td&gt;14.3*&lt;/td&gt;&lt;td&gt;8.7*&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;&amp;#8195;Graduate/professional degree&lt;/td&gt;&lt;td&gt;4.1*&lt;/td&gt;&lt;td&gt;4.3*&lt;/td&gt;&lt;/tr&gt;&lt;/tbody&gt;&lt;/table&gt; </ephtml> <emph>Note</emph>: *indicates a smaller sample of 51 for TPAS and 50 for GRTR. This information comes from the family questionnaire and not all parents responded to the family questions. As such, fewer students are reported on than in the subsample.</p> <p>The <emph>TPAS</emph> consists of four subtests: Initial Sounds, Final Sounds, Rhyming Words, and Deletion. However, the Deletion subtest was normed for children ages 6+, so administrators only gave the first three subtests. During administration, three (Final Sounds) or four (Initial Sounds and Rhyming Words) sample items were delivered with feedback for correct responses and corrective feedback for incorrect responses. Administration rules required that the test be discontinued if a child was unable to respond to any of the sample items. During this study, we administered all test items; when a child did not respond, we asked the question again and if they continued not to respond we marked the item as incorrect. A series of 20 (Final Sounds and Rhyming Words) to 30 (Initial Sounds) items were provided to children who passed the sample items. Children responded either "<emph>sí</emph>" or "no" to each item, and administrators scored a 1 for a correct response and a 0 for an incorrect response. Total scores were recorded as the sum of 1-point responses for each subtest.</p> <p>The <emph>GRTR-S-R</emph> is a 25-item flip book with one sample item, and takes 10-15 minutes to administer (Lonigan, 2003). The <emph>GRTR-S-R</emph> measures early literacy skills with 12 items that measure phonological awareness, including two items specific to initial phoneme awareness, however these 12 items are not available as a subtest. Administration occurred in Spanish and children saw each item in succession with the assessor scoring 1 for a correct and 0 for an incorrect response, with total score as the sum of 1-point responses. The <emph>GRTR-S-R</emph> does not have a discontinue criterion; all children saw all 25 items.</p> <hd id="AN0134694290-19">Procedures</hd> <p></p> <hd id="AN0134694290-20">Data collector training and fidelity</hd> <p>Two trained bilingual graduate research assistants conducted an in-person or digitally broadcasted comprehensive training with all Spanish-speaking data collectors to maintain standardized administration procedures and fidelity across participating sites. Trainings occurred twice annually due to data collector attrition and scheduling limitations and included eight sections: logistics, ethical principles for assessment, privacy and confidentiality, sampling scheme, data collection activities, scoring and entry procedures, and fidelity of implementation requirements. Data collectors watched training videos of measure administration and attended 3-hour training sessions, with specific attention to scoring. All data collectors were required to achieve 100% fidelity within three consecutive attempts, the first two allowing for feedback to support changes in performance. Fidelity trials occurred in Spanish with a team member who was a native Spanish speaker to check presentation fluency. All training materials were available in English and Spanish and designed for assessors with limited experience in early childhood assessment. Data collector country of origin varied, with approximately 14% of the data collectors from Mexico, 27% from Central or South America, and 59% identified as non-Latinos who spoke Spanish with native-like fluency. Data collector backgrounds varied to include university staff, undergraduate and graduate students, and community members who volunteered at participating preschool sites.</p> <hd id="AN0134694290-21">Testing procedures</hd> <p>Data collection for <emph>S-IGDIs</emph> occurred in fall, winter, and spring of the 2013-2014 and 2014-2015 academic years. Each student was tested up to three times in their given school year. Standardized criterion tests were administered in the spring of 2014. Assessment occurred one-on-one while the data collector sat at a table across from the child. Schools' setups varied; testing occurred in the classroom, in a room outside of the classroom, or in a quiet adjacent hallway. Total testing interactions lasted about 20 minutes per child, and children received a small trinket of their choice for participating. All data collectors were instructed to only speak Spanish with participants because young SE-DLLs demonstrate interlocutor sensitivity, such that they may be aware of which language to use with different people, and thus may not engage with an adult in Spanish if they perceive that this is not the adult's primary language (Maneva &amp; Genesee, 2002). Participants were randomly assigned to one of the <emph>PS/FS</emph> forms. Those students who were selected for criterion test administration were randomly assigned to each test (<emph>TPAS</emph> or <emph>GRTR-S-R</emph>).</p> <hd id="AN0134694290-22">Results</hd> <p>To evaluate <emph>PS/FS</emph>, we aligned results with each research question. During item calibrations, we managed all data by including children who responded (with correct or incorrect response) to 60% or more of the items for a given measure. We used this conservative approach to data inclusion for item calibrations because item calibrations require a meaningful response set to reduce error or noise in the analysis. Thus, children with at least 40% of the total items scored as missing on a measure could have contributed to error in the calibration because their response pattern may have been impacted by systematic lack of understanding the task and other unknown sources of error (e.g., lack of engagement, etc.). All response patterns were included when computing student ability scores after finalized calibrations.</p> <p>In addition, as noted, each child in both years of the study was assessed up to three times annually and each seasonal response set was treated independently in the calibration. Children's responses were treated as unique each season because they change in their ability levels and respond to a new set of items. If we assumed student abilities to be constant across seasons, then we would violate a basic principle of IRT, in that ability is not constant across item responses because student ability changes at each seasonal administration. As we viewed calibration within season and monitored item parameter drift (or displacement) across season and across year, it became clear that item calibration was stable regardless of how the data (students) were combined. Final concurrent-calibration was completed after all seasonal data were collected, and item responses were pooled for the 104 items. Given the sample of 970 children, the item-level results included a sample size of 2218 (which is no more than three times the total sample of children).</p> <hd id="AN0134694290-23">Item-level results and descriptive summaries of child abilities</hd> <p></p> <hd id="AN0134694290-24">Item-level results</hd> <p>To respond to the first research question, "What are the item-level statistics of <emph>PS/FS</emph>?", we produced Rasch item level calibrations. Item-level statistics were computed for <emph>PS/FS</emph> measures with Winsteps 3.67 (Linacre, 2008). Item-level output is provided in Table 3 and in Figure 1, the Wright item map. Results include standard Winsteps output variables including item difficulty (b-parameter estimates), standard error of the b-parameter estimate, correlations between the item and total test score (point-by measure correlations, PTMA), and infit and outfit measures of item fit. We expect PTMA values for items that meaningfully contribute to a test to be above.2; lower values are considered not contributing (Bond &amp; Fox, 2015). In addition, output includes <emph>p</emph>-values, which represent the proportion of children who answered the item correctly. Generally, a proportion correct ranging from.2 to.8 is desired. Appropriateness of model fit was investigated based on mean square infit and outfit statistics for item. The infit statistic is more sensitive to irregular responses near the location of item, whereas the outfit statistic is sensitive uniformly across the full range of person abilities (Engelhard, 2013). Infit and outfit statistics between 0.5 and 1.5 are ideal. Items with infit and outfit greater than 2 were eliminated or revised, as is common practice in test design procedures (Haladyna &amp; Rodriguez, 2013).</p> <p>Item level results for S-IGDI first sounds/primeros sonidos.</p> <p> <ephtml> &lt;table border="1" cellpadding="13"&gt;&lt;tbody&gt;&lt;tr&gt;&lt;td align="center"&gt;Item&lt;/td&gt;&lt;td align="center" colspan="2"&gt;Distractors&lt;/td&gt;&lt;td align="center"&gt;Target&lt;/td&gt;&lt;td align="center"&gt;DIF-SEX&lt;/td&gt;&lt;td align="center"&gt;DIF-DIAL&lt;/td&gt;&lt;td align="center"&gt;Count&lt;/td&gt;&lt;td align="center"&gt;P-value&lt;/td&gt;&lt;td align="center"&gt;b&lt;/td&gt;&lt;td align="center"&gt;SE(b)&lt;/td&gt;&lt;td align="center"&gt;INM&lt;/td&gt;&lt;td align="center"&gt;OUTM&lt;/td&gt;&lt;td align="center"&gt;PTMA&lt;/td&gt;&lt;/tr&gt;&lt;/tbody&gt;&lt;tbody&gt;&lt;tr&gt;&lt;td&gt;1&lt;/td&gt;&lt;td&gt;-&lt;/td&gt;&lt;td&gt;maracas&lt;/td&gt;&lt;td&gt;/cha/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;Y (.00)&lt;sup&gt;c&lt;/sup&gt;&lt;/td&gt;&lt;td&gt;315&lt;/td&gt;&lt;td&gt;.74&lt;/td&gt;&lt;td&gt;&amp;#8722;0.58&lt;/td&gt;&lt;td&gt;.14&lt;/td&gt;&lt;td&gt;1.02&lt;/td&gt;&lt;td&gt;1.10&lt;/td&gt;&lt;td&gt;.30&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;2&lt;/td&gt;&lt;td&gt;-&lt;/td&gt;&lt;td&gt;cobija&lt;/td&gt;&lt;td&gt;/bi/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;315&lt;/td&gt;&lt;td&gt;.69&lt;/td&gt;&lt;td&gt;&amp;#8722;0.31&lt;/td&gt;&lt;td&gt;.14&lt;/td&gt;&lt;td&gt;1.07&lt;/td&gt;&lt;td&gt;1.13&lt;/td&gt;&lt;td&gt;.31&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;3&lt;/td&gt;&lt;td&gt;-&lt;/td&gt;&lt;td&gt;pato&lt;/td&gt;&lt;td&gt;/ro/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;317&lt;/td&gt;&lt;td&gt;.70&lt;/td&gt;&lt;td&gt;&amp;#8722;0.36&lt;/td&gt;&lt;td&gt;.14&lt;/td&gt;&lt;td&gt;0.90&lt;/td&gt;&lt;td&gt;0.82&lt;/td&gt;&lt;td&gt;.42&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;4&lt;/td&gt;&lt;td&gt;-&lt;/td&gt;&lt;td&gt;queso&lt;/td&gt;&lt;td&gt;/u/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;320&lt;/td&gt;&lt;td&gt;.78&lt;/td&gt;&lt;td&gt;&amp;#8722;0.85&lt;/td&gt;&lt;td&gt;.15&lt;/td&gt;&lt;td&gt;0.91&lt;/td&gt;&lt;td&gt;0.75&lt;/td&gt;&lt;td&gt;.38&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;5&lt;/td&gt;&lt;td&gt;cobija&lt;/td&gt;&lt;td&gt;l&amp;#225;piz&lt;/td&gt;&lt;td&gt;/v/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;312&lt;/td&gt;&lt;td&gt;.57&lt;/td&gt;&lt;td&gt;0.36&lt;/td&gt;&lt;td&gt;.13&lt;/td&gt;&lt;td&gt;0.99&lt;/td&gt;&lt;td&gt;1.03&lt;/td&gt;&lt;td&gt;.41&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;6&lt;/td&gt;&lt;td&gt;manzana&lt;/td&gt;&lt;td&gt;guitarra&lt;/td&gt;&lt;td&gt;/z/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;316&lt;/td&gt;&lt;td&gt;.47&lt;/td&gt;&lt;td&gt;0.91&lt;/td&gt;&lt;td&gt;.13&lt;/td&gt;&lt;td&gt;0.97&lt;/td&gt;&lt;td&gt;0.97&lt;/td&gt;&lt;td&gt;.48&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;7&lt;/td&gt;&lt;td&gt;mu&amp;#241;eca&lt;/td&gt;&lt;td&gt;tomate&lt;/td&gt;&lt;td&gt;/a/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;308&lt;/td&gt;&lt;td&gt;.42&lt;/td&gt;&lt;td&gt;1.15&lt;/td&gt;&lt;td&gt;.14&lt;/td&gt;&lt;td&gt;1.00&lt;/td&gt;&lt;td&gt;0.99&lt;/td&gt;&lt;td&gt;.48&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;8&lt;/td&gt;&lt;td&gt;ojo&lt;/td&gt;&lt;td&gt;escuela&lt;/td&gt;&lt;td&gt;/ma/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;317&lt;/td&gt;&lt;td&gt;.55&lt;/td&gt;&lt;td&gt;0.49&lt;/td&gt;&lt;td&gt;.13&lt;/td&gt;&lt;td&gt;0.99&lt;/td&gt;&lt;td&gt;1.01&lt;/td&gt;&lt;td&gt;.42&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;9&lt;/td&gt;&lt;td&gt;pi&amp;#241;a&lt;/td&gt;&lt;td&gt;camisa&lt;/td&gt;&lt;td&gt;/o/&lt;/td&gt;&lt;td&gt;Y (.03)&lt;sup&gt;a&lt;/sup&gt;&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;1352&lt;/td&gt;&lt;td&gt;.51&lt;/td&gt;&lt;td&gt;0.45&lt;/td&gt;&lt;td&gt;.06&lt;/td&gt;&lt;td&gt;0.93&lt;/td&gt;&lt;td&gt;0.89&lt;/td&gt;&lt;td&gt;.49&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;10&lt;/td&gt;&lt;td&gt;-&lt;/td&gt;&lt;td&gt;conejo&lt;/td&gt;&lt;td&gt;/tro/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;318&lt;/td&gt;&lt;td&gt;.83&lt;/td&gt;&lt;td&gt;&amp;#8722;1.25&lt;/td&gt;&lt;td&gt;.16&lt;/td&gt;&lt;td&gt;1.00&lt;/td&gt;&lt;td&gt;0.90&lt;/td&gt;&lt;td&gt;.27&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;11&lt;/td&gt;&lt;td&gt;-&lt;/td&gt;&lt;td&gt;plancha&lt;/td&gt;&lt;td&gt;/o/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;758&lt;/td&gt;&lt;td&gt;.67&lt;/td&gt;&lt;td&gt;&amp;#8722;0.46&lt;/td&gt;&lt;td&gt;.09&lt;/td&gt;&lt;td&gt;1.00&lt;/td&gt;&lt;td&gt;0.97&lt;/td&gt;&lt;td&gt;.35&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;12&lt;/td&gt;&lt;td&gt;-&lt;/td&gt;&lt;td&gt;escuela&lt;/td&gt;&lt;td&gt;/o/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;318&lt;/td&gt;&lt;td&gt;.89&lt;/td&gt;&lt;td&gt;&amp;#8722;1.80&lt;/td&gt;&lt;td&gt;.19&lt;/td&gt;&lt;td&gt;0.99&lt;/td&gt;&lt;td&gt;0.93&lt;/td&gt;&lt;td&gt;.22&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;13&lt;/td&gt;&lt;td&gt;-&lt;/td&gt;&lt;td&gt;pelota&lt;/td&gt;&lt;td&gt;/l/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;318&lt;/td&gt;&lt;td&gt;.72&lt;/td&gt;&lt;td&gt;&amp;#8722;0.50&lt;/td&gt;&lt;td&gt;.14&lt;/td&gt;&lt;td&gt;0.96&lt;/td&gt;&lt;td&gt;0.90&lt;/td&gt;&lt;td&gt;.36&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;14&lt;/td&gt;&lt;td&gt;-&lt;/td&gt;&lt;td&gt;arena&lt;/td&gt;&lt;td&gt;/ll/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;755&lt;/td&gt;&lt;td&gt;.69&lt;/td&gt;&lt;td&gt;&amp;#8722;0.59&lt;/td&gt;&lt;td&gt;.09&lt;/td&gt;&lt;td&gt;0.99&lt;/td&gt;&lt;td&gt;0.96&lt;/td&gt;&lt;td&gt;.35&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;15&lt;/td&gt;&lt;td&gt;queso&lt;/td&gt;&lt;td&gt;pato&lt;/td&gt;&lt;td&gt;/f/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;1360&lt;/td&gt;&lt;td&gt;.51&lt;/td&gt;&lt;td&gt;0.41&lt;/td&gt;&lt;td&gt;.06&lt;/td&gt;&lt;td&gt;0.97&lt;/td&gt;&lt;td&gt;0.94&lt;/td&gt;&lt;td&gt;.46&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;16&lt;/td&gt;&lt;td&gt;&amp;#225;rbol&lt;/td&gt;&lt;td&gt;silla&lt;/td&gt;&lt;td&gt;/ja/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;599&lt;/td&gt;&lt;td&gt;.64&lt;/td&gt;&lt;td&gt;&amp;#8722;0.10&lt;/td&gt;&lt;td&gt;.10&lt;/td&gt;&lt;td&gt;1.04&lt;/td&gt;&lt;td&gt;1.00&lt;/td&gt;&lt;td&gt;.34&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;17&lt;/td&gt;&lt;td&gt;bota&lt;/td&gt;&lt;td&gt;rana&lt;/td&gt;&lt;td&gt;/ll/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;597&lt;/td&gt;&lt;td&gt;.63&lt;/td&gt;&lt;td&gt;&amp;#8722;0.07&lt;/td&gt;&lt;td&gt;.10&lt;/td&gt;&lt;td&gt;0.96&lt;/td&gt;&lt;td&gt;0.94&lt;/td&gt;&lt;td&gt;.40&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;18&lt;/td&gt;&lt;td&gt;lobo&lt;/td&gt;&lt;td&gt;nariz&lt;/td&gt;&lt;td&gt;/m/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;591&lt;/td&gt;&lt;td&gt;.44&lt;/td&gt;&lt;td&gt;0.93&lt;/td&gt;&lt;td&gt;.10&lt;/td&gt;&lt;td&gt;1.13&lt;/td&gt;&lt;td&gt;1.17&lt;/td&gt;&lt;td&gt;.36&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;19&lt;/td&gt;&lt;td&gt;fresa&lt;/td&gt;&lt;td&gt;pera&lt;/td&gt;&lt;td&gt;/li/&lt;/td&gt;&lt;td&gt;Y (.02)&lt;sup&gt;a&lt;/sup&gt;&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;590&lt;/td&gt;&lt;td&gt;.56&lt;/td&gt;&lt;td&gt;0.28&lt;/td&gt;&lt;td&gt;.10&lt;/td&gt;&lt;td&gt;1.00&lt;/td&gt;&lt;td&gt;1.03&lt;/td&gt;&lt;td&gt;.40&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;20&lt;/td&gt;&lt;td&gt;-&lt;/td&gt;&lt;td&gt;leche&lt;/td&gt;&lt;td&gt;/fu/&lt;/td&gt;&lt;td&gt;Y (.01)&lt;sup&gt;a&lt;/sup&gt;&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;598&lt;/td&gt;&lt;td&gt;.79&lt;/td&gt;&lt;td&gt;&amp;#8722;1.03&lt;/td&gt;&lt;td&gt;.11&lt;/td&gt;&lt;td&gt;0.94&lt;/td&gt;&lt;td&gt;0.79&lt;/td&gt;&lt;td&gt;.33&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;21&lt;/td&gt;&lt;td&gt;-&lt;/td&gt;&lt;td&gt;bolsa&lt;/td&gt;&lt;td&gt;/ni/&lt;/td&gt;&lt;td&gt;Y (.02)&lt;sup&gt;a&lt;/sup&gt;&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;598&lt;/td&gt;&lt;td&gt;.76&lt;/td&gt;&lt;td&gt;&amp;#8722;0.82&lt;/td&gt;&lt;td&gt;.10&lt;/td&gt;&lt;td&gt;1.07&lt;/td&gt;&lt;td&gt;1.18&lt;/td&gt;&lt;td&gt;.24&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;22&lt;/td&gt;&lt;td&gt;-&lt;/td&gt;&lt;td&gt;casa&lt;/td&gt;&lt;td&gt;/s/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;600&lt;/td&gt;&lt;td&gt;.72&lt;/td&gt;&lt;td&gt;&amp;#8722;0.54&lt;/td&gt;&lt;td&gt;.10&lt;/td&gt;&lt;td&gt;1.01&lt;/td&gt;&lt;td&gt;0.95&lt;/td&gt;&lt;td&gt;.32&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;23&lt;/td&gt;&lt;td&gt;-&lt;/td&gt;&lt;td&gt;oso&lt;/td&gt;&lt;td&gt;/in/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;594&lt;/td&gt;&lt;td&gt;.67&lt;/td&gt;&lt;td&gt;&amp;#8722;0.27&lt;/td&gt;&lt;td&gt;.10&lt;/td&gt;&lt;td&gt;0.96&lt;/td&gt;&lt;td&gt;0.94&lt;/td&gt;&lt;td&gt;.37&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;24&lt;/td&gt;&lt;td&gt;cama&lt;/td&gt;&lt;td&gt;mapa&lt;/td&gt;&lt;td&gt;/b/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;276&lt;/td&gt;&lt;td&gt;.54&lt;/td&gt;&lt;td&gt;0.29&lt;/td&gt;&lt;td&gt;.14&lt;/td&gt;&lt;td&gt;1.08&lt;/td&gt;&lt;td&gt;1.06&lt;/td&gt;&lt;td&gt;.35&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;25&lt;/td&gt;&lt;td&gt;paraguas&lt;/td&gt;&lt;td&gt;vestido&lt;/td&gt;&lt;td&gt;/c/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;279&lt;/td&gt;&lt;td&gt;.56&lt;/td&gt;&lt;td&gt;0.22&lt;/td&gt;&lt;td&gt;.14&lt;/td&gt;&lt;td&gt;1.08&lt;/td&gt;&lt;td&gt;1.07&lt;/td&gt;&lt;td&gt;.34&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;26&lt;/td&gt;&lt;td&gt;ba&amp;#241;o&lt;/td&gt;&lt;td&gt;ara&amp;#241;a&lt;/td&gt;&lt;td&gt;/ra/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;1323&lt;/td&gt;&lt;td&gt;.58&lt;/td&gt;&lt;td&gt;&amp;#8722;0.01&lt;/td&gt;&lt;td&gt;.06&lt;/td&gt;&lt;td&gt;1.00&lt;/td&gt;&lt;td&gt;1.04&lt;/td&gt;&lt;td&gt;.38&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;27&lt;/td&gt;&lt;td&gt;rana&lt;/td&gt;&lt;td&gt;uvas&lt;/td&gt;&lt;td&gt;/cu/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;279&lt;/td&gt;&lt;td&gt;.48&lt;/td&gt;&lt;td&gt;0.58&lt;/td&gt;&lt;td&gt;.14&lt;/td&gt;&lt;td&gt;1.03&lt;/td&gt;&lt;td&gt;1.11&lt;/td&gt;&lt;td&gt;.38&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;28&lt;/td&gt;&lt;td&gt;taza&lt;/td&gt;&lt;td&gt;cama&lt;/td&gt;&lt;td&gt;/pa/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;281&lt;/td&gt;&lt;td&gt;.69&lt;/td&gt;&lt;td&gt;&amp;#8722;0.50&lt;/td&gt;&lt;td&gt;.14&lt;/td&gt;&lt;td&gt;1.06&lt;/td&gt;&lt;td&gt;1.04&lt;/td&gt;&lt;td&gt;.28&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;29&lt;/td&gt;&lt;td&gt;abrigo&lt;/td&gt;&lt;td&gt;tomate&lt;/td&gt;&lt;td&gt;/or/&lt;/td&gt;&lt;td&gt;Y (.01)&lt;sup&gt;b&lt;/sup&gt;&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;280&lt;/td&gt;&lt;td&gt;.59&lt;/td&gt;&lt;td&gt;0.03&lt;/td&gt;&lt;td&gt;.14&lt;/td&gt;&lt;td&gt;1.04&lt;/td&gt;&lt;td&gt;1.08&lt;/td&gt;&lt;td&gt;.33&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;30&lt;/td&gt;&lt;td&gt;le&amp;#243;n&lt;/td&gt;&lt;td&gt;silla&lt;/td&gt;&lt;td&gt;/glo/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;283&lt;/td&gt;&lt;td&gt;.70&lt;/td&gt;&lt;td&gt;&amp;#8722;0.57&lt;/td&gt;&lt;td&gt;.14&lt;/td&gt;&lt;td&gt;0.96&lt;/td&gt;&lt;td&gt;0.98&lt;/td&gt;&lt;td&gt;.33&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;31&lt;/td&gt;&lt;td&gt;bota&lt;/td&gt;&lt;td&gt;queso&lt;/td&gt;&lt;td&gt;/gra/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;719&lt;/td&gt;&lt;td&gt;.65&lt;/td&gt;&lt;td&gt;&amp;#8722;0.46&lt;/td&gt;&lt;td&gt;.09&lt;/td&gt;&lt;td&gt;1.01&lt;/td&gt;&lt;td&gt;1.02&lt;/td&gt;&lt;td&gt;.33&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;32&lt;/td&gt;&lt;td&gt;tortilla&lt;/td&gt;&lt;td&gt;cereza&lt;/td&gt;&lt;td&gt;/n/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;576&lt;/td&gt;&lt;td&gt;.47&lt;/td&gt;&lt;td&gt;0.67&lt;/td&gt;&lt;td&gt;.10&lt;/td&gt;&lt;td&gt;1.05&lt;/td&gt;&lt;td&gt;1.06&lt;/td&gt;&lt;td&gt;.44&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;33&lt;/td&gt;&lt;td&gt;fresa&lt;/td&gt;&lt;td&gt;pollitos&lt;/td&gt;&lt;td&gt;/a/&lt;/td&gt;&lt;td&gt;Y(.01)&lt;sup&gt;b&lt;/sup&gt;&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;1616&lt;/td&gt;&lt;td&gt;.53&lt;/td&gt;&lt;td&gt;0.30&lt;/td&gt;&lt;td&gt;.06&lt;/td&gt;&lt;td&gt;1.04&lt;/td&gt;&lt;td&gt;1.03&lt;/td&gt;&lt;td&gt;.41&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;34&lt;/td&gt;&lt;td&gt;rosa&lt;/td&gt;&lt;td&gt;c&amp;#237;rculo&lt;/td&gt;&lt;td&gt;/blo/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;1620&lt;/td&gt;&lt;td&gt;.71&lt;/td&gt;&lt;td&gt;&amp;#8722;0.74&lt;/td&gt;&lt;td&gt;.06&lt;/td&gt;&lt;td&gt;0.94&lt;/td&gt;&lt;td&gt;0.95&lt;/td&gt;&lt;td&gt;.39&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;35&lt;/td&gt;&lt;td&gt;arroz&lt;/td&gt;&lt;td&gt;reloj&lt;/td&gt;&lt;td&gt;/ue/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;577&lt;/td&gt;&lt;td&gt;.68&lt;/td&gt;&lt;td&gt;&amp;#8722;0.53&lt;/td&gt;&lt;td&gt;.10&lt;/td&gt;&lt;td&gt;0.99&lt;/td&gt;&lt;td&gt;1.01&lt;/td&gt;&lt;td&gt;.38&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;36&lt;/td&gt;&lt;td&gt;toalla&lt;/td&gt;&lt;td&gt;nubes&lt;/td&gt;&lt;td&gt;/l/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;1608&lt;/td&gt;&lt;td&gt;.54&lt;/td&gt;&lt;td&gt;0.19&lt;/td&gt;&lt;td&gt;.06&lt;/td&gt;&lt;td&gt;1.03&lt;/td&gt;&lt;td&gt;1.02&lt;/td&gt;&lt;td&gt;.40&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;37&lt;/td&gt;&lt;td&gt;perro&lt;/td&gt;&lt;td&gt;galleta&lt;/td&gt;&lt;td&gt;/e/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;573&lt;/td&gt;&lt;td&gt;.45&lt;/td&gt;&lt;td&gt;0.80&lt;/td&gt;&lt;td&gt;.10&lt;/td&gt;&lt;td&gt;1.00&lt;/td&gt;&lt;td&gt;0.97&lt;/td&gt;&lt;td&gt;.48&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;38&lt;/td&gt;&lt;td&gt;ara&amp;#241;a&lt;/td&gt;&lt;td&gt;maiz&lt;/td&gt;&lt;td&gt;/ba/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;1617&lt;/td&gt;&lt;td&gt;.54&lt;/td&gt;&lt;td&gt;0.24&lt;/td&gt;&lt;td&gt;.06&lt;/td&gt;&lt;td&gt;0.88&lt;/td&gt;&lt;td&gt;0.86&lt;/td&gt;&lt;td&gt;.50&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;39&lt;/td&gt;&lt;td&gt;bus&lt;/td&gt;&lt;td&gt;sofa&lt;/td&gt;&lt;td&gt;/bol/&lt;/td&gt;&lt;td&gt;Y (.01)&lt;sup&gt;a&lt;/sup&gt;&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;574&lt;/td&gt;&lt;td&gt;.52&lt;/td&gt;&lt;td&gt;0.39&lt;/td&gt;&lt;td&gt;.10&lt;/td&gt;&lt;td&gt;1.00&lt;/td&gt;&lt;td&gt;1.06&lt;/td&gt;&lt;td&gt;.44&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;40&lt;/td&gt;&lt;td&gt;almohada&lt;/td&gt;&lt;td&gt;vaca&lt;/td&gt;&lt;td&gt;/m/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;Y(.02)&lt;sup&gt;d&lt;/sup&gt;&lt;/td&gt;&lt;td&gt;290&lt;/td&gt;&lt;td&gt;.42&lt;/td&gt;&lt;td&gt;0.94&lt;/td&gt;&lt;td&gt;.14&lt;/td&gt;&lt;td&gt;1.27&lt;/td&gt;&lt;td&gt;1.36&lt;/td&gt;&lt;td&gt;.34&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;41&lt;/td&gt;&lt;td&gt;&amp;#225;rbol&lt;/td&gt;&lt;td&gt;taza&lt;/td&gt;&lt;td&gt;/jua/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;291&lt;/td&gt;&lt;td&gt;.78&lt;/td&gt;&lt;td&gt;&amp;#8722;1.23&lt;/td&gt;&lt;td&gt;.16&lt;/td&gt;&lt;td&gt;1.00&lt;/td&gt;&lt;td&gt;0.98&lt;/td&gt;&lt;td&gt;.35&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;42&lt;/td&gt;&lt;td&gt;bolsa&lt;/td&gt;&lt;td&gt;globo&lt;/td&gt;&lt;td&gt;/ca/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;296&lt;/td&gt;&lt;td&gt;.65&lt;/td&gt;&lt;td&gt;&amp;#8722;0.41&lt;/td&gt;&lt;td&gt;.14&lt;/td&gt;&lt;td&gt;0.92&lt;/td&gt;&lt;td&gt;0.98&lt;/td&gt;&lt;td&gt;.47&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;43&lt;/td&gt;&lt;td&gt;uvas&lt;/td&gt;&lt;td&gt;plato&lt;/td&gt;&lt;td&gt;/va/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;1339&lt;/td&gt;&lt;td&gt;.53&lt;/td&gt;&lt;td&gt;0.29&lt;/td&gt;&lt;td&gt;.06&lt;/td&gt;&lt;td&gt;1.10&lt;/td&gt;&lt;td&gt;1.13&lt;/td&gt;&lt;td&gt;.37&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;44&lt;/td&gt;&lt;td&gt;cama&lt;/td&gt;&lt;td&gt;chaqueta&lt;/td&gt;&lt;td&gt;/z/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;295&lt;/td&gt;&lt;td&gt;.55&lt;/td&gt;&lt;td&gt;0.17&lt;/td&gt;&lt;td&gt;.14&lt;/td&gt;&lt;td&gt;0.90&lt;/td&gt;&lt;td&gt;0.91&lt;/td&gt;&lt;td&gt;.52&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;45&lt;/td&gt;&lt;td&gt;naranja&lt;/td&gt;&lt;td&gt;mu&amp;#241;eca&lt;/td&gt;&lt;td&gt;/o/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;295&lt;/td&gt;&lt;td&gt;.45&lt;/td&gt;&lt;td&gt;0.74&lt;/td&gt;&lt;td&gt;.14&lt;/td&gt;&lt;td&gt;1.18&lt;/td&gt;&lt;td&gt;1.25&lt;/td&gt;&lt;td&gt;.39&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;46&lt;/td&gt;&lt;td&gt;zapato&lt;/td&gt;&lt;td&gt;oreja&lt;/td&gt;&lt;td&gt;/ch/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;Y (.01)&lt;sup&gt;a&lt;/sup&gt;&lt;/td&gt;&lt;td&gt;295&lt;/td&gt;&lt;td&gt;.82&lt;/td&gt;&lt;td&gt;&amp;#8722;1.58&lt;/td&gt;&lt;td&gt;.17&lt;/td&gt;&lt;td&gt;0.93&lt;/td&gt;&lt;td&gt;1.10&lt;/td&gt;&lt;td&gt;.37&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;47&lt;/td&gt;&lt;td&gt;avi&amp;#243;n&lt;/td&gt;&lt;td&gt;huevo&lt;/td&gt;&lt;td&gt;/s/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;294&lt;/td&gt;&lt;td&gt;.49&lt;/td&gt;&lt;td&gt;0.53&lt;/td&gt;&lt;td&gt;.14&lt;/td&gt;&lt;td&gt;0.78&lt;/td&gt;&lt;td&gt;0.68&lt;/td&gt;&lt;td&gt;.62&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;48&lt;/td&gt;&lt;td&gt;llave&lt;/td&gt;&lt;td&gt;queso&lt;/td&gt;&lt;td&gt;/f/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;1332&lt;/td&gt;&lt;td&gt;.52&lt;/td&gt;&lt;td&gt;0.33&lt;/td&gt;&lt;td&gt;.06&lt;/td&gt;&lt;td&gt;0.89&lt;/td&gt;&lt;td&gt;0.88&lt;/td&gt;&lt;td&gt;.51&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;49&lt;/td&gt;&lt;td&gt;guitarra&lt;/td&gt;&lt;td&gt;bandera&lt;/td&gt;&lt;td&gt;/ser/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;Y(.01)&lt;sup&gt;c&lt;/sup&gt;&lt;/td&gt;&lt;td&gt;1591&lt;/td&gt;&lt;td&gt;.56&lt;/td&gt;&lt;td&gt;0.16&lt;/td&gt;&lt;td&gt;.06&lt;/td&gt;&lt;td&gt;1.15&lt;/td&gt;&lt;td&gt;1.19&lt;/td&gt;&lt;td&gt;.33&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;50&lt;/td&gt;&lt;td&gt;maleta&lt;/td&gt;&lt;td&gt;clavos&lt;/td&gt;&lt;td&gt;/po/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;558&lt;/td&gt;&lt;td&gt;.84&lt;/td&gt;&lt;td&gt;&amp;#8722;1.48&lt;/td&gt;&lt;td&gt;.13&lt;/td&gt;&lt;td&gt;0.95&lt;/td&gt;&lt;td&gt;0.76&lt;/td&gt;&lt;td&gt;.36&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;51&lt;/td&gt;&lt;td&gt;tomate&lt;/td&gt;&lt;td&gt;globo&lt;/td&gt;&lt;td&gt;/sir/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;557&lt;/td&gt;&lt;td&gt;.64&lt;/td&gt;&lt;td&gt;&amp;#8722;0.15&lt;/td&gt;&lt;td&gt;.10&lt;/td&gt;&lt;td&gt;0.88&lt;/td&gt;&lt;td&gt;0.77&lt;/td&gt;&lt;td&gt;.51&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;52&lt;/td&gt;&lt;td&gt;pavo&lt;/td&gt;&lt;td&gt;chicle&lt;/td&gt;&lt;td&gt;/re/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;558&lt;/td&gt;&lt;td&gt;.45&lt;/td&gt;&lt;td&gt;0.92&lt;/td&gt;&lt;td&gt;.10&lt;/td&gt;&lt;td&gt;0.85&lt;/td&gt;&lt;td&gt;0.82&lt;/td&gt;&lt;td&gt;.58&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;53&lt;/td&gt;&lt;td&gt;tenedor&lt;/td&gt;&lt;td&gt;mariposa&lt;/td&gt;&lt;td&gt;/n/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;558&lt;/td&gt;&lt;td&gt;.54&lt;/td&gt;&lt;td&gt;0.39&lt;/td&gt;&lt;td&gt;.10&lt;/td&gt;&lt;td&gt;1.01&lt;/td&gt;&lt;td&gt;1.00&lt;/td&gt;&lt;td&gt;.46&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;54&lt;/td&gt;&lt;td&gt;monta&amp;#241;a&lt;/td&gt;&lt;td&gt;sombrero&lt;/td&gt;&lt;td&gt;/ga/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;554&lt;/td&gt;&lt;td&gt;.76&lt;/td&gt;&lt;td&gt;&amp;#8722;0.93&lt;/td&gt;&lt;td&gt;.11&lt;/td&gt;&lt;td&gt;1.02&lt;/td&gt;&lt;td&gt;1.02&lt;/td&gt;&lt;td&gt;.36&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;55&lt;/td&gt;&lt;td&gt;l&amp;#225;piz&lt;/td&gt;&lt;td&gt;caballo&lt;/td&gt;&lt;td&gt;/m/&lt;/td&gt;&lt;td&gt;Y (.03)&lt;sup&gt;a&lt;/sup&gt;&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;554&lt;/td&gt;&lt;td&gt;.49&lt;/td&gt;&lt;td&gt;0.69&lt;/td&gt;&lt;td&gt;.10&lt;/td&gt;&lt;td&gt;1.18&lt;/td&gt;&lt;td&gt;1.21&lt;/td&gt;&lt;td&gt;.38&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;56&lt;/td&gt;&lt;td&gt;plato&lt;/td&gt;&lt;td&gt;bicicleta&lt;/td&gt;&lt;td&gt;/s/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;553&lt;/td&gt;&lt;td&gt;.58&lt;/td&gt;&lt;td&gt;0.21&lt;/td&gt;&lt;td&gt;.10&lt;/td&gt;&lt;td&gt;1.01&lt;/td&gt;&lt;td&gt;0.97&lt;/td&gt;&lt;td&gt;.45&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;57&lt;/td&gt;&lt;td&gt;carro&lt;/td&gt;&lt;td&gt;doctor&lt;/td&gt;&lt;td&gt;/v/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;705&lt;/td&gt;&lt;td&gt;.67&lt;/td&gt;&lt;td&gt;&amp;#8722;0.52&lt;/td&gt;&lt;td&gt;.09&lt;/td&gt;&lt;td&gt;1.02&lt;/td&gt;&lt;td&gt;0.84&lt;/td&gt;&lt;td&gt;.41&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;58&lt;/td&gt;&lt;td&gt;rosa&lt;/td&gt;&lt;td&gt;rodilla&lt;/td&gt;&lt;td&gt;/ta/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;259&lt;/td&gt;&lt;td&gt;.67&lt;/td&gt;&lt;td&gt;&amp;#8722;0.14&lt;/td&gt;&lt;td&gt;.15&lt;/td&gt;&lt;td&gt;1.01&lt;/td&gt;&lt;td&gt;0.97&lt;/td&gt;&lt;td&gt;.39&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;59&lt;/td&gt;&lt;td&gt;pelota&lt;/td&gt;&lt;td&gt;hoja&lt;/td&gt;&lt;td&gt;/be/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;Y (.02)&lt;sup&gt;a&lt;/sup&gt;&lt;/td&gt;&lt;td&gt;257&lt;/td&gt;&lt;td&gt;.49&lt;/td&gt;&lt;td&gt;0.86&lt;/td&gt;&lt;td&gt;.15&lt;/td&gt;&lt;td&gt;1.20&lt;/td&gt;&lt;td&gt;1.32&lt;/td&gt;&lt;td&gt;.33&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;60&lt;/td&gt;&lt;td&gt;libro&lt;/td&gt;&lt;td&gt;silla&lt;/td&gt;&lt;td&gt;/pla/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;262&lt;/td&gt;&lt;td&gt;.81&lt;/td&gt;&lt;td&gt;&amp;#8722;1.06&lt;/td&gt;&lt;td&gt;.17&lt;/td&gt;&lt;td&gt;0.84&lt;/td&gt;&lt;td&gt;0.69&lt;/td&gt;&lt;td&gt;.43&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;61&lt;/td&gt;&lt;td&gt;ni&amp;#241;o&lt;/td&gt;&lt;td&gt;hombre&lt;/td&gt;&lt;td&gt;/do/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;265&lt;/td&gt;&lt;td&gt;.74&lt;/td&gt;&lt;td&gt;&amp;#8722;0.58&lt;/td&gt;&lt;td&gt;.16&lt;/td&gt;&lt;td&gt;0.87&lt;/td&gt;&lt;td&gt;0.73&lt;/td&gt;&lt;td&gt;.45&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;62&lt;/td&gt;&lt;td&gt;tigre&lt;/td&gt;&lt;td&gt;leche&lt;/td&gt;&lt;td&gt;/m/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;698&lt;/td&gt;&lt;td&gt;.53&lt;/td&gt;&lt;td&gt;0.26&lt;/td&gt;&lt;td&gt;.09&lt;/td&gt;&lt;td&gt;1.10&lt;/td&gt;&lt;td&gt;1.11&lt;/td&gt;&lt;td&gt;.36&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;63&lt;/td&gt;&lt;td&gt;gorro&lt;/td&gt;&lt;td&gt;mano&lt;/td&gt;&lt;td&gt;/or/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;261&lt;/td&gt;&lt;td&gt;.69&lt;/td&gt;&lt;td&gt;0.73&lt;/td&gt;&lt;td&gt;.15&lt;/td&gt;&lt;td&gt;1.24&lt;/td&gt;&lt;td&gt;1.26&lt;/td&gt;&lt;td&gt;.32&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;64&lt;/td&gt;&lt;td&gt;vestido&lt;/td&gt;&lt;td&gt;rat&amp;#243;n&lt;/td&gt;&lt;td&gt;/ue/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;1305&lt;/td&gt;&lt;td&gt;.66&lt;/td&gt;&lt;td&gt;&amp;#8722;0.40&lt;/td&gt;&lt;td&gt;.07&lt;/td&gt;&lt;td&gt;0.95&lt;/td&gt;&lt;td&gt;0.92&lt;/td&gt;&lt;td&gt;.41&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;65&lt;/td&gt;&lt;td&gt;estufa&lt;/td&gt;&lt;td&gt;lluvia&lt;/td&gt;&lt;td&gt;/f/&lt;/td&gt;&lt;td&gt;Y (.02)&lt;sup&gt;b&lt;/sup&gt;&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;261&lt;/td&gt;&lt;td&gt;.69&lt;/td&gt;&lt;td&gt;&amp;#8722;0.27&lt;/td&gt;&lt;td&gt;.15&lt;/td&gt;&lt;td&gt;1.05&lt;/td&gt;&lt;td&gt;1.06&lt;/td&gt;&lt;td&gt;.35&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;66&lt;/td&gt;&lt;td&gt;lim&amp;#243;n&lt;/td&gt;&lt;td&gt;nido&lt;/td&gt;&lt;td&gt;/ba/&lt;/td&gt;&lt;td&gt;Y (.02)&lt;sup&gt;b&lt;/sup&gt;&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;1306&lt;/td&gt;&lt;td&gt;.54&lt;/td&gt;&lt;td&gt;0.27&lt;/td&gt;&lt;td&gt;.07&lt;/td&gt;&lt;td&gt;0.93&lt;/td&gt;&lt;td&gt;0.93&lt;/td&gt;&lt;td&gt;.47&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;67&lt;/td&gt;&lt;td&gt;lampara&lt;/td&gt;&lt;td&gt;enfermera&lt;/td&gt;&lt;td&gt;/gi/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;1297&lt;/td&gt;&lt;td&gt;.55&lt;/td&gt;&lt;td&gt;0.22&lt;/td&gt;&lt;td&gt;.07&lt;/td&gt;&lt;td&gt;0.88&lt;/td&gt;&lt;td&gt;0.84&lt;/td&gt;&lt;td&gt;.50&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;68&lt;/td&gt;&lt;td&gt;bate&lt;/td&gt;&lt;td&gt;durazno&lt;/td&gt;&lt;td&gt;/ca/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;1294&lt;/td&gt;&lt;td&gt;.68&lt;/td&gt;&lt;td&gt;&amp;#8722;0.54&lt;/td&gt;&lt;td&gt;.07&lt;/td&gt;&lt;td&gt;1.10&lt;/td&gt;&lt;td&gt;1.23&lt;/td&gt;&lt;td&gt;.28&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;69&lt;/td&gt;&lt;td&gt;pie&lt;/td&gt;&lt;td&gt;centavo&lt;/td&gt;&lt;td&gt;/chi/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;264&lt;/td&gt;&lt;td&gt;.84&lt;/td&gt;&lt;td&gt;&amp;#8722;1.32&lt;/td&gt;&lt;td&gt;.18&lt;/td&gt;&lt;td&gt;0.95&lt;/td&gt;&lt;td&gt;0.86&lt;/td&gt;&lt;td&gt;.33&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;70&lt;/td&gt;&lt;td&gt;clavos&lt;/td&gt;&lt;td&gt;avi&amp;#243;n&lt;/td&gt;&lt;td&gt;/m/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;1309&lt;/td&gt;&lt;td&gt;.50&lt;/td&gt;&lt;td&gt;0.47&lt;/td&gt;&lt;td&gt;.07&lt;/td&gt;&lt;td&gt;1.14&lt;/td&gt;&lt;td&gt;1.20&lt;/td&gt;&lt;td&gt;.34&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;71&lt;/td&gt;&lt;td&gt;gato&lt;/td&gt;&lt;td&gt;taza&lt;/td&gt;&lt;td&gt;/s/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;257&lt;/td&gt;&lt;td&gt;.49&lt;/td&gt;&lt;td&gt;0.86&lt;/td&gt;&lt;td&gt;.15&lt;/td&gt;&lt;td&gt;0.91&lt;/td&gt;&lt;td&gt;0.86&lt;/td&gt;&lt;td&gt;.52&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;72&lt;/td&gt;&lt;td&gt;leche&lt;/td&gt;&lt;td&gt;monta&amp;#241;a&lt;/td&gt;&lt;td&gt;/ca&lt;/td&gt;&lt;td&gt;Y (.03)&lt;sup&gt;a&lt;/sup&gt;&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;261&lt;/td&gt;&lt;td&gt;.69&lt;/td&gt;&lt;td&gt;&amp;#8722;0.23&lt;/td&gt;&lt;td&gt;.15&lt;/td&gt;&lt;td&gt;0.99&lt;/td&gt;&lt;td&gt;0.99&lt;/td&gt;&lt;td&gt;.37&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;73&lt;/td&gt;&lt;td&gt;mesa&lt;/td&gt;&lt;td&gt;plato&lt;/td&gt;&lt;td&gt;/e/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;261&lt;/td&gt;&lt;td&gt;.79&lt;/td&gt;&lt;td&gt;&amp;#8722;0.83&lt;/td&gt;&lt;td&gt;.17&lt;/td&gt;&lt;td&gt;1.06&lt;/td&gt;&lt;td&gt;1.35&lt;/td&gt;&lt;td&gt;.26&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;74&lt;/td&gt;&lt;td&gt;elefante&lt;/td&gt;&lt;td&gt;juguete&lt;/td&gt;&lt;td&gt;/dur/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;100&lt;/td&gt;&lt;td&gt;.40&lt;/td&gt;&lt;td&gt;0.54&lt;/td&gt;&lt;td&gt;.23&lt;/td&gt;&lt;td&gt;0.92&lt;/td&gt;&lt;td&gt;0.90&lt;/td&gt;&lt;td&gt;.44&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;75&lt;/td&gt;&lt;td&gt;mariposa&lt;/td&gt;&lt;td&gt;tren&lt;/td&gt;&lt;td&gt;/s/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;100&lt;/td&gt;&lt;td&gt;.35&lt;/td&gt;&lt;td&gt;0.81&lt;/td&gt;&lt;td&gt;.24&lt;/td&gt;&lt;td&gt;1.16&lt;/td&gt;&lt;td&gt;1.25&lt;/td&gt;&lt;td&gt;.25&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;76&lt;/td&gt;&lt;td&gt;chile&lt;/td&gt;&lt;td&gt;zebra&lt;/td&gt;&lt;td&gt;/ar/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;99&lt;/td&gt;&lt;td&gt;.44&lt;/td&gt;&lt;td&gt;0.32&lt;/td&gt;&lt;td&gt;.23&lt;/td&gt;&lt;td&gt;1.01&lt;/td&gt;&lt;td&gt;1.01&lt;/td&gt;&lt;td&gt;.36&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;77&lt;/td&gt;&lt;td&gt;paleta&lt;/td&gt;&lt;td&gt;globo&lt;/td&gt;&lt;td&gt;/f/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;104&lt;/td&gt;&lt;td&gt;.39&lt;/td&gt;&lt;td&gt;0.50&lt;/td&gt;&lt;td&gt;.22&lt;/td&gt;&lt;td&gt;0.99&lt;/td&gt;&lt;td&gt;0.99&lt;/td&gt;&lt;td&gt;.35&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;78&lt;/td&gt;&lt;td&gt;venda&lt;/td&gt;&lt;td&gt;oso&lt;/td&gt;&lt;td&gt;/ca/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;104&lt;/td&gt;&lt;td&gt;.46&lt;/td&gt;&lt;td&gt;0.17&lt;/td&gt;&lt;td&gt;.22&lt;/td&gt;&lt;td&gt;0.88&lt;/td&gt;&lt;td&gt;0.87&lt;/td&gt;&lt;td&gt;.45&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;79&lt;/td&gt;&lt;td&gt;lobo&lt;/td&gt;&lt;td&gt;abeja&lt;/td&gt;&lt;td&gt;/pa/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;104&lt;/td&gt;&lt;td&gt;.44&lt;/td&gt;&lt;td&gt;0.26&lt;/td&gt;&lt;td&gt;.22&lt;/td&gt;&lt;td&gt;0.95&lt;/td&gt;&lt;td&gt;0.92&lt;/td&gt;&lt;td&gt;.40&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;80&lt;/td&gt;&lt;td&gt;trampol&amp;#237;n&lt;/td&gt;&lt;td&gt;bloque&lt;/td&gt;&lt;td&gt;/f/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;103&lt;/td&gt;&lt;td&gt;.45&lt;/td&gt;&lt;td&gt;0.24&lt;/td&gt;&lt;td&gt;.22&lt;/td&gt;&lt;td&gt;0.95&lt;/td&gt;&lt;td&gt;1.00&lt;/td&gt;&lt;td&gt;.37&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;81&lt;/td&gt;&lt;td&gt;abeja&lt;/td&gt;&lt;td&gt;bot&amp;#243;n&lt;/td&gt;&lt;td&gt;/cur/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;152&lt;/td&gt;&lt;td&gt;.60&lt;/td&gt;&lt;td&gt;&amp;#8722;0.21&lt;/td&gt;&lt;td&gt;.18&lt;/td&gt;&lt;td&gt;1.02&lt;/td&gt;&lt;td&gt;0.98&lt;/td&gt;&lt;td&gt;.35&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;82&lt;/td&gt;&lt;td&gt;globo&lt;/td&gt;&lt;td&gt;fleche&lt;/td&gt;&lt;td&gt;/be/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;154&lt;/td&gt;&lt;td&gt;.62&lt;/td&gt;&lt;td&gt;&amp;#8722;0.30&lt;/td&gt;&lt;td&gt;.18&lt;/td&gt;&lt;td&gt;0.89&lt;/td&gt;&lt;td&gt;0.88&lt;/td&gt;&lt;td&gt;.43&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;83&lt;/td&gt;&lt;td&gt;cama&lt;/td&gt;&lt;td&gt;playa&lt;/td&gt;&lt;td&gt;/o/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;152&lt;/td&gt;&lt;td&gt;.61&lt;/td&gt;&lt;td&gt;&amp;#8722;0.22&lt;/td&gt;&lt;td&gt;.19&lt;/td&gt;&lt;td&gt;0.86&lt;/td&gt;&lt;td&gt;0.78&lt;/td&gt;&lt;td&gt;.47&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;84&lt;/td&gt;&lt;td&gt;silla&lt;/td&gt;&lt;td&gt;carro&lt;/td&gt;&lt;td&gt;/ga/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;154&lt;/td&gt;&lt;td&gt;.64&lt;/td&gt;&lt;td&gt;&amp;#8722;0.40&lt;/td&gt;&lt;td&gt;.19&lt;/td&gt;&lt;td&gt;0.87&lt;/td&gt;&lt;td&gt;0.80&lt;/td&gt;&lt;td&gt;.44&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;85&lt;/td&gt;&lt;td&gt;nubes&lt;/td&gt;&lt;td&gt;queso&lt;/td&gt;&lt;td&gt;/r/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;149&lt;/td&gt;&lt;td&gt;.44&lt;/td&gt;&lt;td&gt;0.66&lt;/td&gt;&lt;td&gt;.19&lt;/td&gt;&lt;td&gt;1.08&lt;/td&gt;&lt;td&gt;1.06&lt;/td&gt;&lt;td&gt;.38&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;86&lt;/td&gt;&lt;td&gt;desierto&lt;/td&gt;&lt;td&gt;zanahoria&lt;/td&gt;&lt;td&gt;/es/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;101&lt;/td&gt;&lt;td&gt;.40&lt;/td&gt;&lt;td&gt;1.01&lt;/td&gt;&lt;td&gt;.25&lt;/td&gt;&lt;td&gt;1.19&lt;/td&gt;&lt;td&gt;1.20&lt;/td&gt;&lt;td&gt;.42&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;87&lt;/td&gt;&lt;td&gt;tambor&lt;/td&gt;&lt;td&gt;d&amp;#243;lar&lt;/td&gt;&lt;td&gt;/pe/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;103&lt;/td&gt;&lt;td&gt;.65&lt;/td&gt;&lt;td&gt;&amp;#8722;0.41&lt;/td&gt;&lt;td&gt;.23&lt;/td&gt;&lt;td&gt;1.01&lt;/td&gt;&lt;td&gt;0.89&lt;/td&gt;&lt;td&gt;.39&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;88&lt;/td&gt;&lt;td&gt;pelo&lt;/td&gt;&lt;td&gt;llave&lt;/td&gt;&lt;td&gt;/f/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;103&lt;/td&gt;&lt;td&gt;.51&lt;/td&gt;&lt;td&gt;0.34&lt;/td&gt;&lt;td&gt;.23&lt;/td&gt;&lt;td&gt;0.96&lt;/td&gt;&lt;td&gt;1.05&lt;/td&gt;&lt;td&gt;.48&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;89&lt;/td&gt;&lt;td&gt;casa&lt;/td&gt;&lt;td&gt;mano&lt;/td&gt;&lt;td&gt;/z/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;102&lt;/td&gt;&lt;td&gt;.59&lt;/td&gt;&lt;td&gt;&amp;#8722;0.09&lt;/td&gt;&lt;td&gt;.23&lt;/td&gt;&lt;td&gt;0.84&lt;/td&gt;&lt;td&gt;0.73&lt;/td&gt;&lt;td&gt;.52&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;90&lt;/td&gt;&lt;td&gt;doctor&lt;/td&gt;&lt;td&gt;gato&lt;/td&gt;&lt;td&gt;/o/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;103&lt;/td&gt;&lt;td&gt;.45&lt;/td&gt;&lt;td&gt;0.73&lt;/td&gt;&lt;td&gt;.24&lt;/td&gt;&lt;td&gt;1.03&lt;/td&gt;&lt;td&gt;1.01&lt;/td&gt;&lt;td&gt;.49&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;91&lt;/td&gt;&lt;td&gt;ping&amp;#252;ino&lt;/td&gt;&lt;td&gt;centavo&lt;/td&gt;&lt;td&gt;/ju/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;102&lt;/td&gt;&lt;td&gt;.50&lt;/td&gt;&lt;td&gt;0.43&lt;/td&gt;&lt;td&gt;.24&lt;/td&gt;&lt;td&gt;0.96&lt;/td&gt;&lt;td&gt;0.89&lt;/td&gt;&lt;td&gt;.51&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;92&lt;/td&gt;&lt;td&gt;rata&lt;/td&gt;&lt;td&gt;olla&lt;/td&gt;&lt;td&gt;/pa/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;103&lt;/td&gt;&lt;td&gt;.68&lt;/td&gt;&lt;td&gt;&amp;#8722;0.57&lt;/td&gt;&lt;td&gt;.24&lt;/td&gt;&lt;td&gt;1.00&lt;/td&gt;&lt;td&gt;1.37&lt;/td&gt;&lt;td&gt;.35&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;93&lt;/td&gt;&lt;td&gt;mapache&lt;/td&gt;&lt;td&gt;lluvia&lt;/td&gt;&lt;td&gt;/a/&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;N&lt;/td&gt;&lt;td&gt;101&lt;/td&gt;&lt;td&gt;.42&lt;/td&gt;&lt;td&gt;0.88&lt;/td&gt;&lt;td&gt;.25&lt;/td&gt;&lt;td&gt;1.21&lt;/td&gt;&lt;td&gt;1.23&lt;/td&gt;&lt;td&gt;.40&lt;/td&gt;&lt;/tr&gt;&lt;/tbody&gt;&lt;/table&gt; </ephtml> The DIF contrast favored girls, such that the item produced an easier difficulty value than for boys. The DIF contrast favored boys, such that the item produced an easier difficulty value than for girls. The DIF contrast favored Mexican dialect, such that the item produced an easier difficulty value for Mexican Spanish than the combined Spanish group. The DIF contrast favored combined dialects, such that the item produced an easier difficulty value for the combined Spanish group than the Mexican Spanish group. <emph>Note</emph>. DIF-SEX is the DIF contrast for sex, boys vs girls. DIF-DIAL is the DIF contrast for dialect, Mexican vs combined Spanish dialects. The parenthetical value in the DIF columns is the statistical significance of the DIF result (p-value). Count is the number of children responding to the item. P-value is the proportion responding correct. b indicates the Rasch b-parameter estimate (item location in logits). SE(b) is the standard error of b-parameter estimate. INM is the Infit mean square. OUTM is the Outfit mean square. PTMA is the point measure correlation as an index of item discrimination.</p> <p>PHOTO (COLOR): Figure 1. Primeros sonidos/first sounds wright item map.</p> <p>We also examined the degree to which items differentiated between ability levels. Rasch item-level output in Winsteps provides the mean ability of persons correctly and incorrectly responding to each item. Ideally, items will show adequate differentiation between scores if the mean difference in child ability between each item score unit is at least one logit (more than twice the typical score standard error). Therefore, the average ability for children who answered the item correctly should be at least one logit higher than the average ability for children who answered the item incorrectly. Items identified with weak differentiation of mean abilities between 0 and 1 scores were removed (these results are not reported here).</p> <p>Finally, we examined item-level statistics to evaluate the contribution of chance or guessing on item-level responses and confirmed the assumptions of the Rasch model. If chance, or the effect of guessing, is playing a major role in calibration, it will produce poor fit and poorly characterize performance on the construct. Item-total correlations are attenuated when random responses (e.g., guessing) have a significant presence. If guessing is present, infit and outfit will be inappropriately high. However, since no items with poor fit were produced in the refined data set, the finalized item sets showed no detectable impact of guessing. In addition, researchers have documented longstanding controversies regarding random responses (pseudo-guessing) in a 3PL model and the value of its application (Chiu &amp; Camilli, 2013). We posit the third parameter is not a necessary inclusion in the model given the item review process we specified.</p> <p>All item-level calibration results are provided in Table 3. Initial calibration efforts showed that of the original 104 items, 11 items were not scalable because of too-small sample size and were removed from the item bank. For these items, too few item responses were collected either because the new item was added to a block late in the academic year (and therefore did not obtain enough responses) or because the new item yielded a disproportionate amount of responses listed as no response/don't know. Of the 93 scaled items, results indicated all items had adequate PTMA statistics and infit or outfit values. Six items had higher than desired <emph>p-</emph>values ranging from.81 to.89.</p> <hd id="AN0134694290-25">Summary-level descriptives</hd> <p>We also computed summary-level statistics for <emph>PS/FS</emph> using Winsteps. In a Rasch model, the mean item difficulty is fixed at 0 logits. Item difficulties ranged from −1.79 to 1.14 as illustrated by the b-parameter variable in Table 3. Item standard errors are also presented in Table 3 and ranged from 0.05 to 0.25. The distribution of child ability scores appropriately matched the item difficulty distribution (see Figure 1, the Wright item map).</p> <p>To further evaluate measure quality, we examined differential item functioning (DIF) based on sex and country of origin contrasting Mexican and non-Mexican families. Items without DIF more aptly represent the construct and are not differentially attributed to other factors, such as dialectical differences or sex. In addition, DIF is used to evaluate the extent to which measurement invariance holds across a construct-relevant group characteristic. DIF was calculated using Winsteps 4.1.0. Winsteps separately calibrates items for each dichotomously defined group (e.g., gender was compared as male vs female; dialectal representation was compared as Mexican vs all other dialects) through pairwise comparison. Each calibrated item measure (difficulty) is then statistically compared to determine if the contrast of item measures is statistically significantly different. Empirical tests reported include the Rasch-Welsch contrast statistic and the Mantel-Hanzel statistic. Items with statistically significant contrasts are flagged for potential DIF and review.</p> <p>Regarding dialect, DIF was computed comparing Mexican children to non-Mexican children. Of our sample of 970, 355 children were included in the DIF analysis. Families who reported one parent as Mexican and one parent as non-Mexican (e.g. Puerto Rican, Guatemalan etc.) were excluded from this analysis (<emph>n</emph> = 97), as well as families who did not report their ethnicity (<emph>n</emph> = 13) and children who did not have scores on the <emph>PS/FS</emph> measure for at least two of the three seasons. The Mexican group included 142 cases and the non-Mexican group included 213 cases (represented by combined ethnicities from other dialectical groups). Results indicated statistically significant contrasts (using the Rasch-Welch test) were present for five items at <emph>p</emph> &lt; .01; three contrasts favored Mexican children and two contrasts favored non-Mexican children (see Table 3). These five items were removed from the item set as a result of the DIF analysis and content-related review of the items.</p> <p>Regarding sex, DIF was computed comparing boys and girls. Of our sample of 970, 732 families reported on their children's sex. Within this group 348 were boys and 384 were girls. Results indicated statistically significant contrasts were present for 11 items at <emph>p</emph> &gt; .01; five contrasts favored boys and six contrasts favored girls (see Table 3). These 11 items were removed from the item set as a result of the DIF analysis and content-related review of the items.</p> <hd id="AN0134694290-26">Child ability descriptives</hd> <p>To answer the research question, "To what degree do <emph>PS/FS</emph> items appropriately measure child PA abilities?" we used item calibrations to produce seasonal ability scores for the 970 children in our sample as depicted in Figure 1. Results indicated the items appropriately match student ability levels, with 67% of students falling within the range between the easiest and most difficult items. The Rasch mean ability score for <emph>PS/FS</emph> was 0.54 (SD = 1.49). This statistic represents average ability of the children who interacted with items from the measure, relative to the average item location of 0.0. Larger Rasch mean scores represent higher ability. The person reliability was.78 for <emph>PS/FS</emph>. In a Rasch model, person reliability is often compared to a standard reliability coefficient in a classical test theory model, where the person reliability is more conservative (Linacre, 2008). However, a better approach to understanding how to estimate the consistency of the measure is to examine the conditional standard error of measurement (CSEM) for each ability level. Given that ability is a continuum, we report CSEM by ability levels with a LOESS smoothing line. The smallest CSEM is 0.42 and the largest, at the tail, is 1.81 logits (see Figure 2). We observed relatively small CSEM between −2.5 and 2.5 logits on the ability scale, where the average CSEM is 0.52 logits. Eighty-four percent of children's performances fell within this range.</p> <p>PHOTO (COLOR): Figure 2. Standard error of measurement LOESS curve for primeros sonidos/first sounds.</p> <hd id="AN0134694290-27">Model fit and unidimensionality</hd> <p>To make sense of the tenability of the results, we must present additional results of model-fit and assumptions. The Rasch model is most appropriately characterized as a measurement design model, not a data analysis model. One typically does not go through a model fitting exercise with the Rasch model to identify the best fitting model for analyzing item response data - and this is not our purpose. Our purpose in selecting the Rasch model was to place a strong set of assumptions on item development and requirements for item retention. These requirements are naturally relaxed, as items never perfectly fit any particular model, so that items are more-likely-than-not fitting the selected measurement design model. However, to satisfy the empirical approach to model selection, items and persons were calibrated with the Rasch, 2PL (allowing item discrimination to vary), and 3PL (allowing item discrimination and lower asymptote to vary) models using Bilog Version 3 (Du Toit, 2003; Zimowski, Muraki, Mislevy, &amp; Bock, 2003).</p> <p>To simplify the results of these multiple models, employing the same data, we examined correlations among person locations (person ability scores) and item locations (b-parameter estimates). The correlations for person locations were.98 (Rasch vs. 2PL),.98 (Rasch vs. 3PL), and.99 (2PL vs. 3PL). The correlations among item locations were.99 (Rasch vs. 2PL),.96 (Rasch vs. 3PL), and.97 (2PL vs. 3PL). We also noted that the standard errors of the item location parameters were smaller for the Rasch model (0.13), slightly larger for the 2PL model (0.15), and larger yet for the 3PL model (0.24), suggesting relatively more precise estimation of item locations with the Rasch model.</p> <p>An important assumption in the Rasch model, and all unidimensional IRT models, is that a single latent trait is being measured by the items. The extent to which a unidimensional model fit each form was evaluated through confirmatory factor analyses (CFA), with Mplus Version 7 (Muthén &amp; Muthén, 2012a). Three measures of model fit provide different aspects of fit, including the root mean-squared error of approximation (RMSEA), the extent to which the model fits reasonably well in the population; comparative fit index (CFI), the relative fit to a more restricted baseline model, and the Tucker-Lewis index (TLI), which compensates for the effect of model complexity. It is generally agreed that multiple indicators of fit should be examined (Muthén &amp; Muthén, 2012b). The general criteria for model-data fit are as follows. Model fit is indicated such that: RMSEA &lt; .05 is Good Fit; CFI &gt; .95 is Good Fit; CFI &gt; .90 is Adequate Fit; TLI &gt; .95 is Good Fit; TLI &gt; .90 is Adequate Fit (Brown, 2006). Based on these criteria, each form of the PA measure resulted in good fit to a unidimensional model, meeting the unidimensionality assumption of the Rasch model (see Table 4).</p> <p>Confirmatory factor analysis results for primeros sonidos/first sounds by form.</p> <p> <ephtml> &lt;table border="1" cellpadding="6"&gt;&lt;tbody&gt;&lt;tr&gt;&lt;td align="center"&gt;Form&lt;/td&gt;&lt;td align="center"&gt;# of Items&lt;/td&gt;&lt;td align="center"&gt;# of Children&lt;/td&gt;&lt;td align="center"&gt;RMSEA&lt;/td&gt;&lt;td align="center"&gt;CFI&lt;/td&gt;&lt;td align="center"&gt;TLI&lt;/td&gt;&lt;/tr&gt;&lt;/tbody&gt;&lt;tbody&gt;&lt;tr&gt;&lt;td&gt;101&lt;/td&gt;&lt;td&gt;25&lt;/td&gt;&lt;td&gt;315&lt;/td&gt;&lt;td&gt;.027&lt;/td&gt;&lt;td&gt;.956&lt;/td&gt;&lt;td&gt;.952&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;102&lt;/td&gt;&lt;td&gt;25&lt;/td&gt;&lt;td&gt;279&lt;/td&gt;&lt;td&gt;.031&lt;/td&gt;&lt;td&gt;.945&lt;/td&gt;&lt;td&gt;.940&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;103&lt;/td&gt;&lt;td&gt;25&lt;/td&gt;&lt;td&gt;298&lt;/td&gt;&lt;td&gt;.031&lt;/td&gt;&lt;td&gt;.979&lt;/td&gt;&lt;td&gt;.977&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;104&lt;/td&gt;&lt;td&gt;25&lt;/td&gt;&lt;td&gt;266&lt;/td&gt;&lt;td&gt;.035&lt;/td&gt;&lt;td&gt;.949&lt;/td&gt;&lt;td&gt;.944&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;105&lt;/td&gt;&lt;td&gt;15&lt;/td&gt;&lt;td&gt;1051&lt;/td&gt;&lt;td&gt;.042&lt;/td&gt;&lt;td&gt;.963&lt;/td&gt;&lt;td&gt;.957&lt;/td&gt;&lt;/tr&gt;&lt;/tbody&gt;&lt;/table&gt; </ephtml> <emph>Note</emph>. RMSEA is the root mean-squared error of approximation. CFI is the comparative fit index. TLI is the Tucker-Lewis index.</p> <p>A more typical method to examine the degree to which the data met the Rasch assumption of unidimensionality, includes examination of item level infit and outfit statistics and scree plots of eigenvalues using a principal component analysis (PCA) of Rasch residuals (components of the item variances and covariances not explained by the Rasch model). Infit and outfit statistics were appropriate, with no items producing values greater than 1.37 or less than 0.68. Residuals are presented in statistical contrasts after the primary variance due to items and abilities has been accounted. For a secondary dimension to exist, it needs to exceed a value of 2 to eclipse noise in the data (Linacre, 2008). Results from <emph>PS/FS</emph> are presented in in Table 5. Comparing the ratio of Rasch variance by items (6%) with the unexplained variance of the first contrast (1.5%) indicates that the Rasch dimension is about 4 times as large as the second dimension. An Eigenvalue of 1.9 further suggests the presence of a single dimension.</p> <p>PCA results for primeros sonidos/first sounds (n = 93).</p> <p> <ephtml> &lt;table border="1" cellpadding="4"&gt;&lt;tbody&gt;&lt;tr&gt;&lt;td /&gt;&lt;td align="center"&gt;Eigenvalue&lt;/td&gt;&lt;td align="center"&gt;Observed&lt;/td&gt;&lt;td align="center"&gt;Expected&lt;/td&gt;&lt;/tr&gt;&lt;/tbody&gt;&lt;tbody&gt;&lt;tr&gt;&lt;td&gt;Total raw variance in observations&lt;/td&gt;&lt;td&gt;129.05&lt;/td&gt;&lt;td align="center"&gt;100%&lt;/td&gt;&lt;td align="center"&gt;100%&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Raw variance explained by measures&lt;/td&gt;&lt;td&gt;31.05&lt;/td&gt;&lt;td&gt;24.1%&lt;/td&gt;&lt;td&gt;24.1%&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Raw variance explained by persons&lt;/td&gt;&lt;td&gt;23.31&lt;/td&gt;&lt;td&gt;18.1%&lt;/td&gt;&lt;td&gt;18.1%&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Raw Variance explained by items&lt;/td&gt;&lt;td&gt;7.74&lt;/td&gt;&lt;td&gt;6.0%&lt;/td&gt;&lt;td&gt;6.0%&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Raw unexplained variance (total)&lt;/td&gt;&lt;td&gt;98.00&lt;/td&gt;&lt;td&gt;75.9%&lt;/td&gt;&lt;td&gt;75.9%&lt;/td&gt;&lt;/tr&gt;&lt;tr&gt;&lt;td&gt;Unexplained variance in 1st contrast&lt;/td&gt;&lt;td&gt;1.93&lt;/td&gt;&lt;td&gt;1.5%&lt;/td&gt;&lt;td&gt;2.0%&lt;/td&gt;&lt;/tr&gt;&lt;/tbody&gt;&lt;/table&gt; </ephtml> <emph>Note</emph>. The variance explained by measures is also partitioned into the variance explained by persons and variance explained by items. The total variance is partitioned into variance explained by measures and unexplained variance.</p> <hd id="AN0134694290-28">Associations among measures</hd> <p>To respond to the research question, "To what extent is <emph>PS/FS</emph> associated with other standardized measures of Spanish early language and literacy?" we computed Pearson correlations between <emph>PS/FS</emph> child ability Rasch scores (where scores were computed without the 11 items dropped because of poor item level statistics) and <emph>TPAS</emph> initial sounds subscale and <emph>GRTR-S-R</emph> total scores. For the <emph>TPAS</emph> we hypothesized we would see weak correlations with the Rhyming and final sound subtests as Rhyming is not a salient part of the PA construct in Spanish and final sounds have few, if any studies to substantiate their contribution to the construct. Therefore, we were particularly interested in correlations between <emph>PS/FS</emph> and the <emph>TPAS</emph> initial sounds subtest. Descriptive results on the <emph>TPAS</emph> indicated raw scores ranged from 0-17 (maximum score potential of 30), with 23% of students achieving a raw score of 0 and a mean raw score of 9.79. Results indicated the correlation between <emph>PS/FS</emph> and <emph>TPAS</emph> initial sounds demonstrated virtually no association, at <emph>r = </emph>.005. The correlation between <emph>PS/FS</emph> and <emph>GRTR-S-R</emph> was also low, at <emph>r = </emph>.24, as expected.</p> <hd id="AN0134694290-29">Discussion</hd> <p>We summarized the iterative development process and the collection of validity evidence for the new <emph>S-IGDI</emph> PA measure: <emph>Primeros Sonidos/First Sounds. PS/FS</emph> is a measure that joins only a few existing preschool early literacy and language tools in the field that were developed without translating an existing English measure. Translated measures may not appropriately capture the identified construct because they cannot address conceptual and theoretical differences between languages. Results from this study contribute evidence to support the importance of measuring Spanish early literacy skills with empirically and conceptually sound assessment tools. Specifically, in the development of <emph>PS/FS</emph>, there were unique features relevant to how Spanish develops, including the relative difficulty of the phoneme versus syllable, and the salience and availability of each syllable or phoneme in Spanish language.</p> <p>Results suggest <emph>PS/FS</emph> demonstrated adequate item-level quality; the items produced adequate infit and outfit statistics, and a conservative DIF analysis indicated 16% of items showed statistical DIF across either contrast. Dimensionality testing offered evidence to align with previous findings that suggest Spanish phonological awareness is a unitary construct.</p> <p>Our results also revealed low correlations with an existing measure of Spanish phonological awareness. Even though we hypothesized these correlations would be low, this finding is worth additional attention. The <emph>TPAS</emph> is the only standardized test available that specifically tests PA in preschool-age Spanish-speaking students; however, we had deep reservations about the validity of its inferences. First, the <emph>TPAS</emph> manual provides limited information about how items were developed and reports that norms were not collected with 4-year-olds (which represents over half of our sample), suggesting any score interpretation for four-year-old DLLs is an extrapolation of older student's performance. Second, the <emph>TPAS</emph> items are yes/no, agree/disagree protocols and have no discontinue criteria. A test with 100% of items in this format may have a less robust alignment with performance on Spanish PA because children may have limited opportunity to illustrate knowledge of the construct and children are encouraged to provide a response even if they express that they don't know the answer. Third, 23% of students achieved a score of zero on the <emph>TPAS</emph>. This skewed distribution may have impacted the correlation results due to the truncated variance present in <emph>TPAS</emph> scores. Finally, the <emph>TPAS</emph> includes subtests that do not align with the Spanish PA construct. Given these constraints, it may be the case that the low correlations between <emph>PS/FS</emph> and the <emph>TPAS</emph> may be due to limited validity evidence of the <emph>TPAS</emph> measure.</p> <p>Our findings indicate <emph>PS/FS</emph> may be a promising new measure for at least two reasons. First, as noted, the measure was designed by attending to unique facets of Spanish early literacy and language development. Evidence indicates assessment for SE-DLLs must consider the unique linguistic features of Spanish and the cultural differences amongst Spanish-speaking populations in the US (Peña, 2007). Using these findings as a catalyst, we devoted specific attention to cultural and linguistic variables most salient to Spanish language to design the measure. Second, <emph>PS/FS</emph> demonstrated robust empirical results in the Rasch model at the item level. Few early literacy assessments attend to the quality of assessments at this level, and we are aware of no publicly-available Spanish early literacy screening tools that consider how Spanish develops and evaluates item-level statistics. The dearth of Spanish measures in the field may be indicative of the lag between evidence supporting the need to measure Spanish early literacy development and efforts to distill such science into practical tools that can be used in applied early childhood settings.</p> <p>It is important to note, however, that the process of collecting validity evidence to support the use of <emph>PS/FS</emph> is not yet complete. Although we described the development and calibration process, it is not enough to simply develop a bank of items. How such measures and data are used is an important part of improving instructional practices for SE-DLLs. The <emph>S-IGDI PS/FS</emph> item bank was developed to be applied within a multi-tiered system of support (MTSS) to construct sets of items for screening, which, in turn, can inform data-based decision making and differentiated instruction. In complement to the work presented here, we also have pursued establishing benchmarks for screening performance in an MTSS model (see Wackerle-Hollman et al., under review), growth metrics (Wackerle-Hollman, Durán, Palma, Miranda, &amp; Batz, 2018), and pragmatic application of English and Spanish IGDI scores (see Wackerle-Hollman et al., 2016). Moreover, high-quality Spanish phonological awareness tasks offer much potential in the field. The item sets can support ongoing research to explore associations between Spanish early intervention and child outcomes to promote long-term reading proficiency in English and Spanish. With well-designed measures of Spanish early literacy and language that have evidence to support claims of validity, educators will be better prepared to adjust instruction to meet their students' unique needs. Further, improved assessments can lead to improved intervention, which in turn can have the potential to improve the reading outcomes of SE-DLLs in US classrooms.</p> <hd id="AN0134694290-30">Limitations</hd> <p>Although the evidence provided here constitutes a valuable contribution to emerging research on Spanish early literacy and language PA measures, a few limitations could be addressed in the future. First, access to information about prior preschool experience was limited. Such experiences may have impacted the level of phonological awareness skill SE-DLLs bring to their Pre-K year, thus affecting the nature of their responses. Future studies could benefit from analyses that consider covariates that may impact child-level performance on such measures including prior preschool experience, dosage of such an experience, and language of instruction in which such experiences were provided. These variables could be addressed through DIF or entered as covariates in regression models that predict performance over time. Similarly, experience with such tests may play a role in child responses processes.</p> <p>Second, the <emph>S-IGDI PS/FS</emph> results provided here only minimally contribute to aiding in understanding dialectical differences and level of language proficiency, two of the leading conceptual issues in Spanish assessment (Wackerle-Hollman et al., under review). During the two years that these studies occurred, we made an effort to include four dialectical groups: Mexican Spanish, Caribbean Spanish, Central and South American Spanish, and Mixed Spanish representation groups, because the same image may have a different word associated with it unique to each dialect. However, our available sample only permitted DIF comparisons between Mexican and non-Mexican children. In future studies, the field could benefit from more detailed comparisons of dialectical groups on Spanish early literacy and language measures like <emph>PS/FS</emph> to illustrate the degree to which performance differences attributed to dialect may be confounded by item functioning.</p> <p>In sum, our results showcase the process of development and validation of the <emph>S-IGDI PS/FS</emph> as a PA measure of Spanish language and early literacy. Our results support ongoing efforts to build a practical, contemporary model of Spanish language and early literacy assessment for SE-DLLs. This work, along with ongoing research on dual language approaches to intervention, professional development for teachers of SE-DLLs, and continued exploration of the association between Spanish and English language and literacy acquisition are important contributions to this salient and quickly expanding need in early childhood education.</p> <hd id="AN0134694290-31">Conflict of Interest</hd> <p>Dr. Alisha Wackerle-Hollman holds equity in, and receives a consulting income from Early Learning Labs LLC, a company which has a license from the University of Minnesota to commercialize Individual Growth and Development Indicators (IGDIs). The University of Minnesota also has equity and royalty interests in ELL. These relationships have been reviewed and managed by the University of Minnesota in accordance with its conflict of interest policies.</p> <hd id="AN0134694290-32">Acknowledgments</hd> <p>This work was supported in part by grant R305A120449, Research and Development of Spanish Individual Growth and Development Indicators (S-IGDIs): Early Literacy identification measures for Spanish-English bilingual children, from the Institute of Education Sciences, U.S. Department of Education. The authors would like to thank colleagues who assisted with this project including participating childcare centers and programs in the Minneapolis/St. Paul metro area, central Florida, rural Utah and Idaho, and northwestern California. Additionally, the authors express sincere appreciation for the work contributed by the research team at Utah State University who participated in measure design and data collection. The opinions and recommendations presented in this paper are those of the authors alone, and no official endorsement from the Institute of Education Sciences should be inferred.</p> <ref id="AN0134694290-33"> <title> References </title> <blist> <bibl id="bib1" idref="ref1" type="bt">1</bibl> <bibtext> Andrich, D. ( 2004 ). Controversy and the rasch model: A characteristic of incompatible paradigms? <emph>Medical Care</emph>, 42 ( 1 ), 7 - 16. doi: 10.1097/01.mlr.0000103528.48582.7c</bibtext> </blist> <blist> <bibl id="bib2" type="bt">2</bibl> <bibtext> Anthony, J. L., &amp; Lonigan, C. J. ( 2004 ). The nature of PA: Converging evidence from four studies of preschool and early grade school children. <emph>Journal of Educational Psychology</emph>, 96 ( 1 ), 53 - 55. doi: 10.1037/0022-0663.96.1.43</bibtext> </blist> <blist> <bibl id="bib3" type="bt">3</bibl> <bibtext> Anthony, J. L., Williams, J. M., Duran, L. K., Gillam, S. L., Liang, L., Aghara, R., ... Landry, S. H. ( 2011 ). Spanish PA: Dimensionality and sequence of development during the preschool and kindergarten years. <emph>Journal of Educational Psychology</emph>, 103 ( 4 ), 857 - 876. doi: 10.1037/a0025024</bibtext> </blist> <blist> <bibl id="bib4" type="bt">4</bibl> <bibtext> Barrera, M., &amp; Liu, K. K. ( 2010 ). Challenges of general outcome measurement in the RTI progress monitoring of linguistically diverse exceptional learners. <emph>Theory into Practice</emph>, 49, 273 - 280. doi: 10.1080/00405841.2010.510713</bibtext> </blist> <blist> <bibl id="bib5" type="bt">5</bibl> <bibtext> Barrueco, S., López, M. L., Ong, C. A., &amp; Lozano, P. ( 2012 ). <emph>Assessing Spanish-English bilingual preschoolers: A guide to best measures and approaches</emph>. Baltimore, MD : Brookes Publishing.</bibtext> </blist> <blist> <bibl id="bib6" type="bt">6</bibl> <bibtext> Bond, T. G., &amp; Fox, C. M. ( 2015 ). <emph>Applying the rasch model: Fundamental measurement in the human sciences</emph>. New York, NY : Routledge.</bibtext> </blist> <blist> <bibl id="bib7" type="bt">7</bibl> <bibtext> Branum-Martin, L., Mehta, P., Fletcher, J. M., Carlson, C. D., Ortiz, A., Carlo, M., &amp; Francis, D. J. ( 2006 ). Bilingual PA: Multilevel construct validation among Spanish-speaking kindergarteners in transitional bilingual education classrooms. <emph>Journal of Educational Psychology</emph>, 98, 170 - 181. doi: 10.1037/0022-0663.98.1.170</bibtext> </blist> <blist> <bibl id="bib8" type="bt">8</bibl> <bibtext> Brown, J., &amp; Doolittle, J. ( 2008 ). A cultural, linguistic, and ecological framework for response to intervention with English language learners. <emph>Teaching Exceptional Children</emph>, 40 ( 5 ), 66 - 72. doi: 10.1177/004005990804000509</bibtext> </blist> <blist> <bibl id="bib9" type="bt">9</bibl> <bibtext> Brown, T. A. ( 2006 ). <emph>Confirmatory factor analysis for applied research</emph>. New York, NY : Guilford Press.</bibtext> </blist> <blist> <bibtext> Cárdenas-Hagan, E., Carlson, C. D., &amp; Pollard-Durodola, S. D. ( 2007 ). The cross-linguistic transfer of early literacy skills: The role of initial L1 and L2 skills and language of instruction. <emph>Language, Speech, and Hearing in the Schools</emph>, 38 ( 3 ), 249 - 259. doi: 10.1044/0161-1461(2007/026)</bibtext> </blist> <blist> <bibtext> Chiu, T. W., &amp; Camilli, G. ( 2013 ). Comment on 3PL IRT adjustment for guessing. <emph>Applied Psychological Measurement</emph>, 37 ( 1 ), 76 - 86. doi: 10.1177/0146621612459369</bibtext> </blist> <blist> <bibtext> Christ, T. ; Associates. ( 2013 ). Formative Assessment for Teachers (FAST) aReading. Minneapolis, MN : FastBridge Learning. Retrieved from <ulink href="http://www.fastbridge.org">www.fastbridge.org</ulink></bibtext> </blist> <blist> <bibtext> de Ayala, R. J. ( 2013 ). <emph>Theory and practice of item response theory</emph>. New York, NY : Guilford Press.</bibtext> </blist> <blist> <bibtext> Dickinson, D. K., McCabe, A., Clark-Chiarelli, N., &amp; Wolf, A. ( 2004 ). Cross-language transfer of PA in low-income Spanish and English bilingual preschool children. <emph>Applied Psycholinguistics</emph>, 25, 323 - 347. doi: 10.1017/S0142716404001158</bibtext> </blist> <blist> <bibtext> Du Toit, M. (Ed.). ( 2003 ). <emph>IRT from SSI: BILOG-MG, MULTILOG, PARSCALE, TESTFACT</emph>. Lincolnwood, IL : Scientific Software International.</bibtext> </blist> <blist> <bibtext> Engelhard, G. ( 2013 ). <emph>Invariant measurement: Using rasch models in the social, behavioral, and health sciences</emph>. New York, NY : Routledge.</bibtext> </blist> <blist> <bibtext> Farver, J. A. M., Lonigan, C. J., &amp; Eppe, S. ( 2009 ). Effective early literacy skill development for young Spanish‐speaking English language learners: An experimental study of two methods. <emph>Child Development</emph>, 80 ( 3 ), 703 - 719. doi: 10.1111/j.1467-8624.2009.01292.x</bibtext> </blist> <blist> <bibtext> Farver, J. M., Nakamoto, J., &amp; Lonigan, C. J. ( 2007 ). Assessing preschoolers' emergent literacy skills in English and Spanish with the get ready to read! screening tool. <emph>Annals of Dyslexia</emph>, 57, 161 - 178. doi: 10.1007/s11881-007-0007-9</bibtext> </blist> <blist> <bibtext> Fuchs, L. S., &amp; Deno, S. L. ( 1991 ). Paradigmatic distinctions between instructionally relevant measurement models. <emph>Exceptional Children</emph>, 57, 488 - 499. doi: 10.1177/001440299105700603</bibtext> </blist> <blist> <bibtext> Garcia, E., &amp; Jensen, B. ( 2009 ). Early educational opportunities for children of hispanic origins (Social Policy Rep. No. 23). Ann Arbor, MI : Society for Research in Child Development. doi: 10.1002/j.2379-3988.2009.tb00059.x</bibtext> </blist> <blist> <bibtext> Genesee, F., Geva, E., Dressler, C., &amp; Kamil, M. ( 2006 ). Synthesis: Cross-linguistic relationships. In D. August &amp; T. Shanahan (Eds.), <emph>Developing literacy in second-language learners: Report of the national literacy panel on language-minority children and youth</emph>. Mahwah, NJ : Lawrence Erlbaum Associates Publishers.</bibtext> </blist> <blist> <bibtext> Geva, E., &amp; Genesee, F. ( 2006 ). First-language oral proficiency and second-language literacy. In D. August &amp; T. Shanahan (Eds.), <emph>Developing literacy in second-language learners: Report of the national literacy panel on language-minority children and youth</emph>. Mahwah, NJ : Lawrence Erlbaum Associates Publishers.</bibtext> </blist> <blist> <bibtext> Goldenberg, C. ( 2008 ). Improving achievement for English language learners. In S. B. Neuman (Ed.), <emph>Educating the other America</emph> (pp. 139 - 162 ). Baltimore, MD : Brookes.</bibtext> </blist> <blist> <bibtext> Good, R., Baker, D., Knutson, N., &amp; Watson, J. ( 2007 ). <emph>Indicadores dinámicos del éxito en la lectura</emph>. Eugene, OR : Dynamic Measurement Group.</bibtext> </blist> <blist> <bibtext> Goodrich, J. M., Lonigan, C. J., &amp; Farver, J. M. ( 2013 ). Do early literacy skills in children's first language promote development of skills in their second language? An experimental evaluation of transfer. <emph>Journal of Educational Psychology</emph>, 105 ( 2 ), 414 - 426. doi: 10.1037/a0031780</bibtext> </blist> <blist> <bibtext> Goodrich, J. M., Lonigan, C. J., &amp; Farver, J. M. ( 2014 ). Children's expressive language skills and their impact on the relation between first-and second-language phonological awareness skills. <emph>Scientific Studies of Reading</emph>, 18 ( 2 ), 114 - 129. doi: 10.1080/10888438.2013.819355</bibtext> </blist> <blist> <bibtext> Gorman, B., &amp; Gillam, R. ( 2003 ). PA in Spanish: A tutorial for speech-language pathologists. <emph>Communication Disorders Quarterly</emph>, 25 ( 1 ), 13 - 22. doi: 10.1177/15257401030250010301</bibtext> </blist> <blist> <bibtext> Haager, D. ( 2007 ). Promises and cautions regarding using response to intervention with English language learners. <emph>Learning Disability Quarterly</emph>, 30 ( 3 ), 213 - 218. doi: 10.2307/30035565</bibtext> </blist> <blist> <bibtext> Haladyna, T. M., &amp; Rodriguez, M. C. ( 2013 ). <emph>Developing and validating test items</emph>. New York, NY : Routledge.</bibtext> </blist> <blist> <bibtext> Hammer, C. S., Jia, G., &amp; Uchikoshi, Y. ( 2011 ). Language and literacy development of dual language learners growing up in the United States: A call for research. <emph>Child Development Perspectives</emph>, 5 ( 1 ), 4 - 9. doi: 10.1111/j.1750-8606.2010.00140.x</bibtext> </blist> <blist> <bibtext> Hammer, C. S., Lawrence, F. R., &amp; Miccio, A. W. ( 2007 ). Bilingual children's language abilities and early reading outcomes in head start and kindergarten. <emph>Language, Speech, and Hearing Services in Schools</emph>, 38, 237 - 248. doi: 10.1044/0161-1461(2007/025)</bibtext> </blist> <blist> <bibtext> Hosp, J., Hosp, M., &amp; Dole, J. ( 2011 ). Potential bias in predictive validity of universal screening measures across disaggregation subgroups. <emph>School Psychology Review</emph>, 40 ( 1 ), 108.</bibtext> </blist> <blist> <bibtext> Jackson-Maldonado, D., Thal, D. J., Fenson, L., Marchman, V. A., Newton, T., &amp; Conboy, B. ( 2003 ). <emph>MacArthur inventarios del desarollo de habilidades comunicativas</emph>. Baltimore, MD : Brookes.</bibtext> </blist> <blist> <bibtext> Landry, S., Assel, M., Gunewig, S., &amp; Swank, P. ( 2004 ). <emph>Circle phonological awareness language and literacy screener</emph>. Houston, TX : Ridgeways.</bibtext> </blist> <blist> <bibtext> Leafstedt, J. M., &amp; Gerber, M. M. ( 2005 ). Crossover of phonological processing skills a study of Spanish-speaking students in two instructional settings. <emph>Remedial and Special Education</emph>, 26 ( 4 ), 226 - 235. doi: 10.1177/07419325050260040501</bibtext> </blist> <blist> <bibtext> Linacre, J. M. ( 2008 ). <emph>Winsteps (Version 3.68)</emph>. [Computer Software]. Chicago, IL : Winsteps.</bibtext> </blist> <blist> <bibtext> Lonigan, C. J. ( 2003 ). Technical report on the development of the NCLD Spanish-language Get Ready to Read! Screening tool. Retrieved from <ulink href="http://www.getreadytoread.org">http://www.getreadytoread.org</ulink></bibtext> </blist> <blist> <bibtext> López, L. M., &amp; Greenfield, D. B. ( 2004 ). The cross-language transfer of phonological skills of hispanic head start children. <emph>Bilingual Research Journal</emph>, 28, 1 - 18. doi: 10.1080/15235882.2004.10162609</bibtext> </blist> <blist> <bibtext> Lopez, M. A., &amp; Gonzalez-Barrera, A. ( 2013 ). <emph>What is the future of Spanish in the United States?</emph> Washington, DC : Pew Research Center. Retrieved from <ulink href="http://www.pewresearch.org/fact-tank/2013/09/05/what-is-the-future-of-spanish-in-the-united-states/">http://www.pewresearch.org/fact-tank/2013/09/05/what-is-the-future-of-spanish-in-the-united-states/</ulink></bibtext> </blist> <blist> <bibtext> Maneva, B., &amp; Genesee, F. ( 2002 ). Bilingual babbling: Evidence for language differentiation in dual language acquisition. In <emph>Boston University Conference on Language Development 26 Proceedings</emph> (pp. 383 - 392 ). Somerville, MA : Cascadilla Press.</bibtext> </blist> <blist> <bibtext> Mathes, P., &amp; Torgesen, J. ( 2005 ). <emph>Istation's Indicators of Progress (ISIP) Español</emph> technical report, Version 4. Dallas, TX : Istation.</bibtext> </blist> <blist> <bibtext> McConnell, S. R., Wackerle-Hollman, A. K., &amp; Bradfield, T. A. ( 2014 ). Early childhood literacy screening. In R. Kettler, T. Glover, C. Albers, &amp; K. A. Feeney-Kettler (Eds.), <emph>Universal screening in educational settings: Identification, implications, and interpretation</emph> (pp. 141 - 170 ). Washington, DC : American Psychological Association.</bibtext> </blist> <blist> <bibtext> Melby-Lervåg, M., &amp; Lervåg, A. ( 2011 ). Cross-linguistic transfer of oral language, decoding, PA and reading comprehension: A meta-analysis of the correlational evidence. <emph>Journal of Research in Reading</emph>, 34, 114 - 135. doi: 10.1111/j.1467-9817.2010.01477.x</bibtext> </blist> <blist> <bibtext> Muter, V., Hulme, C., Snowling, M. J., &amp; Stevenson, J. ( 2004 ). Phonemes, rimes, vocabulary, and grammatical skills as foundations of early reading development: Evidence from a longitudinal study. <emph>Developmental Psychology</emph>, 40, 665 - 681. doi: 10.1037/0012-1649.40.5.665</bibtext> </blist> <blist> <bibtext> Muthén, L. K., &amp; Muthén, B. O. ( 2012a ). <emph>Mplus (Version 7.0)</emph>. [Computer Software]. Los Angeles, CA : Authors.</bibtext> </blist> <blist> <bibtext> Muthén, L. K., &amp; Muthén, B. O. ( 2012b ). <emph>Mplus user's guide</emph> ( 7th ed.). Los Angeles, CA : Authors.</bibtext> </blist> <blist> <bibtext> National Center for Education Statistics. ( 2013 ). The nation's report card: A first look: 2013 mathematics and reading (NCES 2014-451). Washington, DC : U.S. Department of Education, Institute of Education Sciences.</bibtext> </blist> <blist> <bibtext> National Early Literacy Panel. ( 2008 ). <emph>Developing early literacy: Report of the National Early Literacy Panel</emph>. Jessup, MD : National Institute for Literacy. Retrieved from <ulink href="http://www.nifl.gov/publications/pdf/NELPReport09.pdf">http://www.nifl.gov/publications/pdf/NELPReport09.pdf</ulink></bibtext> </blist> <blist> <bibtext> Peña, E. D. ( 2007 ). Lost in translation: Methodological considerations in cross-cultural research. <emph>Child Development</emph>, 78, 1255 - 1264. doi: 10.1111/j.1467-8624.2007.01064.x</bibtext> </blist> <blist> <bibtext> Proctor, C. P., August, D., Carlo, M. S., &amp; Snow, C. ( 2006 ). The intriguing role of Spanish language vocabulary knowledge in predicting English reading comprehension. <emph>Journal of Educational Psychology</emph>, 98, 159 - 169. doi: 10.1037/0022-0663.98.1.159</bibtext> </blist> <blist> <bibtext> Rasch, G. ( 1980 ). <emph>Probabilistic models for some intelligence and attainment tests</emph>. Chicago, IL : The University of Chicago Press.</bibtext> </blist> <blist> <bibtext> Riccio, C. A., Imhoff, B., Hasbrouck, J. E., &amp; Davis, G. N. ( 2004 ). <emph>Test of phonological awareness in Spanish</emph>. Austin, TX : Pro-Ed.</bibtext> </blist> <blist> <bibtext> Rodriguez, M. C. ( 2005 ). Three options are optimal for multiple-choice items: A meta-analysis of 80 years of research. <emph>Educational Measurement: Issues and Practice</emph>, 24 ( 2 ), 3 - 13. doi: 10.1111/j.1745-3992.2005.00006.x</bibtext> </blist> <blist> <bibtext> Sick, J. ( 2010 ). Rasch measurement in language education part 5: Assumptions and requirements of rasch measurement. <emph>JALT Testing &amp; Evaluation SIG Newsletter</emph>, 14 ( 2 ), 23 - 29. Retrieved from <ulink href="http://jalt.org/test/news-date.htm">http://jalt.org/test/news-date.htm</ulink></bibtext> </blist> <blist> <bibtext> Smith, R. ( 1994 ). A comparison of the power of rasch total and between-item fit statistics to detect measurement disturbances. <emph>Educational and Psychological Measurement</emph>, 54 ( 1 ), 42 - 55. doi: 10.1177/0013164494054001005</bibtext> </blist> <blist> <bibtext> Swanson, L. H., Rosston, K., Gerber, M., &amp; Solari, E. ( 2008 ). Influence of oral language and phonological awareness on children's bilingual reading. <emph>Journal of School Psychology</emph>, 46 ( 4 ), 413 - 429. doi: 10.1016/j.jsp.2007.07.002</bibtext> </blist> <blist> <bibtext> Torgeson, J. K., &amp; Mathes, P. G. ( 2000 ). <emph>A basic guide to understanding, assessing, and teaching PA</emph>. Dallas, TX : Pro-ed.</bibtext> </blist> <blist> <bibtext> U.S. Census Bureau. ( 2010 ). <emph>Hispanic or Latino by type: 2010</emph>. Washington, DC : Author. Retrieved from <ulink href="http://factfinder2.census.gov/faces/tableservices/jsf/pages/productview.xhtml?pid=DEC%5f10%5fSF1%5fQTP10&amp;prodType=table">http://factfinder2.census.gov/faces/tableservices/jsf/pages/productview.xhtml?pid=DEC%5f10%5fSF1%5fQTP10&amp;prodType=table</ulink></bibtext> </blist> <blist> <bibtext> U.S. Department of Health and Human Services. ( 2009 ). <emph>Dual language learning: What does it take. Head Start dual language report</emph>. Washington, DC : U.S. Office of Head Start. Retrieved from https://drupaldemo3.cleverex.com/sites/default/files/pdf/dual-language-learning-what-does-it-take.pdf</bibtext> </blist> <blist> <bibtext> U.S. Department of Health and Human Services, Administration for Children and Families, Office of Head Start. ( 2013 ). <emph>Report to congress on dual language learners in head start and early head start programs</emph>. Washington, DC : Author. Retrieved from <ulink href="http://www.acf.hhs.gov/sites/default/files/opre/report%5fto%5fcongress.pdf">http://www.acf.hhs.gov/sites/default/files/opre/report%5fto%5fcongress.pdf</ulink></bibtext> </blist> <blist> <bibtext> Wackerle-Hollman, A., Brunner, S., Duran, L., McConnell, S., Palma, J., Kohlmier, T., ... Rodriguez, M. ( 2012 ). <emph>Technical Report #1: The Development of Early Literacy Skills in Bilingual and Spanish-speaking Preschool-age Children: A Literature Review</emph>. Retrieved from <ulink href="http://innovation.umn.edu/igdi/wp-content/uploads/sites/37/2018/08/TechnicalReport1.pdf">http://innovation.umn.edu/igdi/wp-content/uploads/sites/37/2018/08/TechnicalReport1.pdf</ulink></bibtext> </blist> <blist> <bibtext> Wackerle-Hollman, A., Durán, L., Palma, J., Miranda, A., &amp; Batz, R. ( 2018 ). The performance of Spanish-English bilingual preschoolers on Spanish and English progress monitoring measures. Paper presented at the Society for the Scientific Study of Reading Annual conference, Brighton, UK.</bibtext> </blist> <blist> <bibtext> Wackerle-Hollman, A., Durán, L., Rodriguez, M., Brunner, S., Palma, J., Kohlmeier, T., &amp; Callard, C. ( 2016 ). <emph>Spanish individual growth and development indicators technical manual</emph>. Minneapolis, MN : University of Minnesota.</bibtext> </blist> <blist> <bibtext> Wackerle-Hollman, A., Durán, L., Rodriguez, M., Brunner, S., Palma, J., &amp; Raikes, A. ( under review ). Understanding preschool Spanish early literacy and language skills in the context of bilingual language exposure profiles. <emph>International Journal of Bilingualism</emph>.</bibtext> </blist> <blist> <bibtext> Wildsmith, E., Alvira-Hammond, M., &amp; Guzman, L. ( 2016 ). <emph>A national portrait of hispanic children in need</emph>. Bethesda, MD : National Research Center on Hispanic Children and Families. Retrieved from <ulink href="http://www.childtrends.org/wp-content/uploads/2016/02/2016">http://www.childtrends.org/wp-content/uploads/2016/02/2016</ulink> 15HispChildrenInNeed.pdf</bibtext> </blist> <blist> <bibtext> Wildsmith, E., Scott, M. E., Guzman, L., &amp; Cook, E. ( 2014 ). <emph>Family structure and family formation among low-income hispanics in the U.S</emph>. Bethesda, MD : National Research Center on Hispanic Children and Families. Retrieved from <ulink href="http://www.hispanicresearchcenter.org/wp-content/uploads/2018/04/Family-Formation-Brief-V2.pdf">http://www.hispanicresearchcenter.org/wp-content/uploads/2018/04/Family-Formation-Brief-V2.pdf</ulink></bibtext> </blist> <blist> <bibtext> Wilson, M. ( 2005 ). <emph>Constructing measures: An item response modeling approach</emph>. Mahwah, NJ : Lawrence Erlbaum Associates.</bibtext> </blist> <blist> <bibtext> Zimowski, M. F., Muraki, E., Mislevy, R. J., &amp; Bock, R. D. ( 2003 ). <emph>Bilog-MG (Version 3.0)</emph>. [Computer Software]. Lincolnwood, IL : Scientific Software International.</bibtext> </blist> </ref> <aug> <p>By Alisha Wackerle-Hollman; Lillian Durán; Stephanie Brunner; Jose Palma; Theresa Kohlmeier and Michael C. Rodriguez</p> </aug> CustomLinks: – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED595878 Name: ERIC Full Text Category: fullText Text: Full Text from ERIC |
|---|---|
| Header | DbId: eric DbLabel: ERIC An: ED595878 AccessLevel: 3 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Developing a Measure of Spanish Phonological Awareness for Preschool Age Children: Spanish Individual Growth and Development Indicators – Name: Language Label: Language Group: Lang Data: English – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Wackerle-Hollman%2C+Alisha%22">Wackerle-Hollman, Alisha</searchLink><br /><searchLink fieldCode="AR" term="%22Durán%2C+Lillian%22">Durán, Lillian</searchLink><br /><searchLink fieldCode="AR" term="%22Brunner%2C+Stephanie%22">Brunner, Stephanie</searchLink><br /><searchLink fieldCode="AR" term="%22Palma%2C+Jose%22">Palma, Jose</searchLink><br /><searchLink fieldCode="AR" term="%22Kohlmeier%2C+Theresa%22">Kohlmeier, Theresa</searchLink><br /><searchLink fieldCode="AR" term="%22Rodriguez%2C+Michael+C%2E%22">Rodriguez, Michael C.</searchLink> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="SO" term="%22Grantee+Submission%22"><i>Grantee Submission</i></searchLink>. 2019 24(1):33-56. – Name: PeerReviewed Label: Peer Reviewed Group: SrcInfo Data: Y – Name: Pages Label: Page Count Group: Src Data: 25 – Name: DatePubCY Label: Publication Date Group: Date Data: 2019 – Name: SourceSuprt Label: Sponsoring Agency Group: SrcSuprt Data: Institute of Education Sciences (ED) – Name: NumberContract Label: Contract Number Group: NumCntrct Data: R305A120449 – Name: TypeDocument Label: Document Type Group: TypDoc Data: Journal Articles<br />Reports - Research – Name: Audience Label: Education Level Group: Audnce Data: <searchLink fieldCode="EL" term="%22Early+Childhood+Education%22">Early Childhood Education</searchLink><br /><searchLink fieldCode="EL" term="%22Preschool+Education%22">Preschool Education</searchLink> – Name: Subject Label: Descriptors Group: Su Data: <searchLink fieldCode="DE" term="%22Spanish%22">Spanish</searchLink><br /><searchLink fieldCode="DE" term="%22Spanish+Speaking%22">Spanish Speaking</searchLink><br /><searchLink fieldCode="DE" term="%22English%22">English</searchLink><br /><searchLink fieldCode="DE" term="%22Bilingual+Students%22">Bilingual Students</searchLink><br /><searchLink fieldCode="DE" term="%22Preschool+Education%22">Preschool Education</searchLink><br /><searchLink fieldCode="DE" term="%22Preschool+Children%22">Preschool Children</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Construction%22">Test Construction</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Items%22">Test Items</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Validity%22">Test Validity</searchLink><br /><searchLink fieldCode="DE" term="%22Hispanic+American+Students%22">Hispanic American Students</searchLink><br /><searchLink fieldCode="DE" term="%22Phonological+Awareness%22">Phonological Awareness</searchLink> – Name: Subject Label: Geographic Terms Group: Su Data: <searchLink fieldCode="DE" term="%22Minnesota%22">Minnesota</searchLink><br /><searchLink fieldCode="DE" term="%22Florida%22">Florida</searchLink><br /><searchLink fieldCode="DE" term="%22California%22">California</searchLink><br /><searchLink fieldCode="DE" term="%22Utah%22">Utah</searchLink><br /><searchLink fieldCode="DE" term="%22Kansas%22">Kansas</searchLink><br /><searchLink fieldCode="DE" term="%22Illinois%22">Illinois</searchLink> – Name: DOI Label: DOI Group: ID Data: 10.1080/10627197.2018.1545570 – Name: ISSN Label: ISSN Group: ISSN Data: 1062-7197 – Name: Abstract Label: Abstract Group: Ab Data: Spanish speakers in the United States are a steadily increasing population, up by 233% since 1980. Given the growing population of dual language learners (DLLs) and the large numbers of Spanish-speaking children enrolled in pre-kindergarten programs, addressing the educational needs of preschool-aged DLLs has become a national imperative. Specifically, the intersection of this growing population and the dearth of appropriate assessment tools to evaluate DLLs early language and literacy skills creates a need for assessments that accurately measure preschool performance. This manuscript reports on the iterative design process of a measure of Spanish phonological awareness for preschool-aged DLLs: Spanish Individual Growth and Development Indicators (S-IGDI) Primeros Sonidos. We employed measure design framework to develop the measure and tested item function within a study of 970, 4-5 year old DLLs. Results, including item level analyses and evidence regarding construct and criterion validity are reported. [This article was published in "Educational Assessment" (EJ1205857).] – Name: AbstractInfo Label: Abstractor Group: Ab Data: As Provided – Name: CodeSource Label: IES Funded Group: SrcInfo Data: Yes – Name: DateEntry Label: Entry Date Group: Date Data: 2019 – Name: AN Label: Accession Number Group: ID Data: ED595878 |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED595878 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1080/10627197.2018.1545570 Languages: – Text: English PhysicalDescription: Pagination: PageCount: 25 StartPage: 33 Subjects: – SubjectFull: Spanish Type: general – SubjectFull: Spanish Speaking Type: general – SubjectFull: English Type: general – SubjectFull: Bilingual Students Type: general – SubjectFull: Preschool Education Type: general – SubjectFull: Preschool Children Type: general – SubjectFull: Test Construction Type: general – SubjectFull: Test Items Type: general – SubjectFull: Test Validity Type: general – SubjectFull: Hispanic American Students Type: general – SubjectFull: Phonological Awareness Type: general – SubjectFull: Minnesota Type: general – SubjectFull: Florida Type: general – SubjectFull: California Type: general – SubjectFull: Utah Type: general – SubjectFull: Kansas Type: general – SubjectFull: Illinois Type: general Titles: – TitleFull: Developing a Measure of Spanish Phonological Awareness for Preschool Age Children: Spanish Individual Growth and Development Indicators Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Wackerle-Hollman, Alisha – PersonEntity: Name: NameFull: Durán, Lillian – PersonEntity: Name: NameFull: Brunner, Stephanie – PersonEntity: Name: NameFull: Palma, Jose – PersonEntity: Name: NameFull: Kohlmeier, Theresa – PersonEntity: Name: NameFull: Rodriguez, Michael C. IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 01 Type: published Y: 2019 Identifiers: – Type: issn-print Value: 1062-7197 Numbering: – Type: volume Value: 24 – Type: issue Value: 1 Titles: – TitleFull: Grantee Submission Type: main |
| ResultId | 1 |