View in EDS

Psychometric Evaluation of brightwheel's Experience Assessment

Saved in:
Bibliographic Details
Title: Psychometric Evaluation of brightwheel's Experience Assessment
Language: English
Authors: Lucia M. Reyes, Michael A. Cook, Steven M. Ross, Johns Hopkins University, Center for Research and Reform in Education (CRRE)
Source: Center for Research and Reform in Education. 2025.
Availability: Johns Hopkins Center for Research and Reform in Education, 300 East Joppa Road Suite 500, Baltimore, MD 21286. Tel: 410-616-2338; Fax: 410-324-4444; Web site: https://education.jhu.edu/crre/
Peer Reviewed: Y
Page Count: 21
Publication Date: 2025
Document Type: Reports - Research
Education Level: Early Childhood Education
Descriptors: Psychometrics, Educational Technology, Early Childhood Education, Young Children, Learning Analytics, Learning Experience, Skill Development, Scores, Measures (Individuals), Student Evaluation, Test Reliability, Test Validity, Test Items, Educational Indicators, Curriculum
Geographic Terms: Pennsylvania, Wisconsin, Virginia, Alabama, Missouri, Maine, South Dakota, Kansas
Abstract: In March of 2025, brightwheel, a San Francisco-based educational technology company, partnered with the Center for Research and Reform in Education (CRRE) at Johns Hopkins University to test brightwheel's product, the Experience Assessment. The assessment was designed to provide early childhood educators with an objective and systematic way to collect information resulting in a comprehensive and multidimensional view of young children's learning experiences and skills. The primary focus of this report is on the evidence for the assessment's reliability and validity as demonstrated by indicators of domain score distributions, internal consistency reliability, measurement invariance, and item-test correlations. To evaluate the validity and utility of the Experience Assessment, CRRE conducted a psychometric study using data collected by educators across various early childhood education centers in several U.S. states and used a purposive sample of 593 students 0-5 years of age. Trained educators used the assessment to rate students, collecting data during a 5-week period in the spring of 2025. The assessment measure consisted of eight domains divided into 73 sub-skills. Overall, the findings provided strong evidence regarding the reliability and validity of the Experience Assessment across all assessment domains and curriculum product lines, contributing initial support for the assessment as a tool to measure early learning milestones.
Abstractor: ERIC
Entry Date: 2025
Accession Number: ED675105
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED675105
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED675105
AccessLevel: 3
PubType: Report
PubTypeId: report
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Psychometric Evaluation of brightwheel's Experience Assessment
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Lucia+M%2E+Reyes%22">Lucia M. Reyes</searchLink><br /><searchLink fieldCode="AR" term="%22Michael+A%2E+Cook%22">Michael A. Cook</searchLink><br /><searchLink fieldCode="AR" term="%22Steven+M%2E+Ross%22">Steven M. Ross</searchLink><br /><searchLink fieldCode="AR" term="%22Johns+Hopkins+University%2C+Center+for+Research+and+Reform+in+Education+%28CRRE%29%22">Johns Hopkins University, Center for Research and Reform in Education (CRRE)</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Center+for+Research+and+Reform+in+Education%22"><i>Center for Research and Reform in Education</i></searchLink>. 2025.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Johns Hopkins Center for Research and Reform in Education, 300 East Joppa Road Suite 500, Baltimore, MD 21286. Tel: 410-616-2338; Fax: 410-324-4444; Web site: https://education.jhu.edu/crre/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 21
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2025
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Early+Childhood+Education%22">Early Childhood Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Psychometrics%22">Psychometrics</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Technology%22">Educational Technology</searchLink><br /><searchLink fieldCode="DE" term="%22Early+Childhood+Education%22">Early Childhood Education</searchLink><br /><searchLink fieldCode="DE" term="%22Young+Children%22">Young Children</searchLink><br /><searchLink fieldCode="DE" term="%22Learning+Analytics%22">Learning Analytics</searchLink><br /><searchLink fieldCode="DE" term="%22Learning+Experience%22">Learning Experience</searchLink><br /><searchLink fieldCode="DE" term="%22Skill+Development%22">Skill Development</searchLink><br /><searchLink fieldCode="DE" term="%22Scores%22">Scores</searchLink><br /><searchLink fieldCode="DE" term="%22Measures+%28Individuals%29%22">Measures (Individuals)</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Evaluation%22">Student Evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Reliability%22">Test Reliability</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Validity%22">Test Validity</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Items%22">Test Items</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Indicators%22">Educational Indicators</searchLink><br /><searchLink fieldCode="DE" term="%22Curriculum%22">Curriculum</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Pennsylvania%22">Pennsylvania</searchLink><br /><searchLink fieldCode="DE" term="%22Wisconsin%22">Wisconsin</searchLink><br /><searchLink fieldCode="DE" term="%22Virginia%22">Virginia</searchLink><br /><searchLink fieldCode="DE" term="%22Alabama%22">Alabama</searchLink><br /><searchLink fieldCode="DE" term="%22Missouri%22">Missouri</searchLink><br /><searchLink fieldCode="DE" term="%22Maine%22">Maine</searchLink><br /><searchLink fieldCode="DE" term="%22South+Dakota%22">South Dakota</searchLink><br /><searchLink fieldCode="DE" term="%22Kansas%22">Kansas</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: In March of 2025, brightwheel, a San Francisco-based educational technology company, partnered with the Center for Research and Reform in Education (CRRE) at Johns Hopkins University to test brightwheel's product, the Experience Assessment. The assessment was designed to provide early childhood educators with an objective and systematic way to collect information resulting in a comprehensive and multidimensional view of young children's learning experiences and skills. The primary focus of this report is on the evidence for the assessment's reliability and validity as demonstrated by indicators of domain score distributions, internal consistency reliability, measurement invariance, and item-test correlations. To evaluate the validity and utility of the Experience Assessment, CRRE conducted a psychometric study using data collected by educators across various early childhood education centers in several U.S. states and used a purposive sample of 593 students 0-5 years of age. Trained educators used the assessment to rate students, collecting data during a 5-week period in the spring of 2025. The assessment measure consisted of eight domains divided into 73 sub-skills. Overall, the findings provided strong evidence regarding the reliability and validity of the Experience Assessment across all assessment domains and curriculum product lines, contributing initial support for the assessment as a tool to measure early learning milestones.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: ERIC
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2025
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED675105
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED675105
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 21
    Subjects:
      – SubjectFull: Psychometrics
        Type: general
      – SubjectFull: Educational Technology
        Type: general
      – SubjectFull: Early Childhood Education
        Type: general
      – SubjectFull: Young Children
        Type: general
      – SubjectFull: Learning Analytics
        Type: general
      – SubjectFull: Learning Experience
        Type: general
      – SubjectFull: Skill Development
        Type: general
      – SubjectFull: Scores
        Type: general
      – SubjectFull: Measures (Individuals)
        Type: general
      – SubjectFull: Student Evaluation
        Type: general
      – SubjectFull: Test Reliability
        Type: general
      – SubjectFull: Test Validity
        Type: general
      – SubjectFull: Test Items
        Type: general
      – SubjectFull: Educational Indicators
        Type: general
      – SubjectFull: Curriculum
        Type: general
      – SubjectFull: Pennsylvania
        Type: general
      – SubjectFull: Wisconsin
        Type: general
      – SubjectFull: Virginia
        Type: general
      – SubjectFull: Alabama
        Type: general
      – SubjectFull: Missouri
        Type: general
      – SubjectFull: Maine
        Type: general
      – SubjectFull: South Dakota
        Type: general
      – SubjectFull: Kansas
        Type: general
    Titles:
      – TitleFull: Psychometric Evaluation of brightwheel's Experience Assessment
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Johns Hopkins University, Center for Research and Reform in Education (CRRE)
      – PersonEntity:
          Name:
            NameFull: Lucia M. Reyes
      – PersonEntity:
          Name:
            NameFull: Michael A. Cook
      – PersonEntity:
          Name:
            NameFull: Steven M. Ross
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 07
              Type: published
              Y: 2025
          Titles:
            – TitleFull: Center for Research and Reform in Education
              Type: main
ResultId 1