View in EDS

Analysis of Category Level Performance on the 'Praxis®' Earth and Space Science: Content Knowledge Test: Implications for Professional Learning

Saved in:
Bibliographic Details
Title: Analysis of Category Level Performance on the 'Praxis®' Earth and Space Science: Content Knowledge Test: Implications for Professional Learning
Language: English
Authors: Ndembera, Rachel, Ray, Herman E., Shah, Lisa (ORCID 0000-0001-8700-0924), Rushton, Gregory T. (ORCID 0000-0002-8687-132X)
Source: Journal of Geoscience Education. 2023 71(2):208-221.
Availability: Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Peer Reviewed: Y
Page Count: 14
Publication Date: 2023
Sponsoring Agency: National Science Foundation (NSF)
Contract Number: DUE1557285
DUE1557292
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Earth Science, Space Sciences, Knowledge Base for Teaching, Knowledge Level, Tests, Preservice Teachers, Preservice Teacher Education, Student Characteristics, Factor Analysis, Regression (Statistics), Achievement, Teacher Certification, Teacher Persistence
Assessment and Survey Identifiers: Praxis Series
DOI: 10.1080/10899995.2022.2138067
ISSN: 1089-9995
Abstract: A large body of work has shown that science teacher knowledge is one of the most fundamental components of effective teaching and learning. Our study analyzes the Praxis® Earth and Space Science Content Knowledge Test (ESS CKT) from May 2006 to June 2016. We present one of the largest datasets comprising 11,273 ESS teacher candidates in order to provide information about their demonstrated ESS CK. Understanding that the benefits associated with teacher retention outweigh the cost of hiring new teachers, our results can be used to design targeted professional learning (PL) experiences for pre- and inservice teachers. Findings from this study are particularly useful while planning inservice topic specific PL for teachers pre- and inservice ESS teachers by answering the following research questions (1) How have examinees performed as a whole in each category on the Praxis® ESS CKT? (2) Which personal and/or professional characteristics are most associated with examinee performance in each category and how does this inform professional learning? Examinee performance at the category level was analyzed through a five-part process: 1. Confirmatory Factor Analysis: 2. Percent correct; 3. Regression; 4. ANOVA; 5. Scaled points lost. Our findings revealed that examinees demonstrated strongest performance in the topics assessing "Earth's Atmosphere & Hydrosphere," "Earth Materials & Surface Processes," and "Tectonics & Internal Earth Processes" and identity "History of the Earth and its Life-Forms" as topics in need of support. Across categories, we found differences in achievement associated with undergraduate major, gender, and ethnicity. Test-takers with geoscience majors consistently lost fewer points than their out-of-field counterparts, that men outperformed women in the study, and White test-takers lost fewer scaled points than Black and Hispanic candidates. Our recommendations include reviewing our results for alignment with state standards in order to develop comprehensive CK development that will be used as an anchor for focused support on those topics where test-takers tend to demonstrate lowest proficiency.
Abstractor: As Provided
Entry Date: 2023
Accession Number: EJ1387487
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1387487
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Analysis of Category Level Performance on the 'Praxis®' Earth and Space Science: Content Knowledge Test: Implications for Professional Learning
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Ndembera%2C+Rachel%22">Ndembera, Rachel</searchLink><br /><searchLink fieldCode="AR" term="%22Ray%2C+Herman+E%2E%22">Ray, Herman E.</searchLink><br /><searchLink fieldCode="AR" term="%22Shah%2C+Lisa%22">Shah, Lisa</searchLink> (ORCID <externalLink term="http://orcid.org/0000-0001-8700-0924">0000-0001-8700-0924</externalLink>)<br /><searchLink fieldCode="AR" term="%22Rushton%2C+Gregory+T%2E%22">Rushton, Gregory T.</searchLink> (ORCID <externalLink term="http://orcid.org/0000-0002-8687-132X">0000-0002-8687-132X</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Journal+of+Geoscience+Education%22"><i>Journal of Geoscience Education</i></searchLink>. 2023 71(2):208-221.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 14
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2023
– Name: SourceSuprt
  Label: Sponsoring Agency
  Group: SrcSuprt
  Data: National Science Foundation (NSF)
– Name: NumberContract
  Label: Contract Number
  Group: NumCntrct
  Data: DUE1557285<br />DUE1557292
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Earth+Science%22">Earth Science</searchLink><br /><searchLink fieldCode="DE" term="%22Space+Sciences%22">Space Sciences</searchLink><br /><searchLink fieldCode="DE" term="%22Knowledge+Base+for+Teaching%22">Knowledge Base for Teaching</searchLink><br /><searchLink fieldCode="DE" term="%22Knowledge+Level%22">Knowledge Level</searchLink><br /><searchLink fieldCode="DE" term="%22Tests%22">Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Preservice+Teachers%22">Preservice Teachers</searchLink><br /><searchLink fieldCode="DE" term="%22Preservice+Teacher+Education%22">Preservice Teacher Education</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Characteristics%22">Student Characteristics</searchLink><br /><searchLink fieldCode="DE" term="%22Factor+Analysis%22">Factor Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Regression+%28Statistics%29%22">Regression (Statistics)</searchLink><br /><searchLink fieldCode="DE" term="%22Achievement%22">Achievement</searchLink><br /><searchLink fieldCode="DE" term="%22Teacher+Certification%22">Teacher Certification</searchLink><br /><searchLink fieldCode="DE" term="%22Teacher+Persistence%22">Teacher Persistence</searchLink>
– Name: SubjectThesaurus
  Label: Assessment and Survey Identifiers
  Group: Su
  Data: <searchLink fieldCode="SU" term="%22Praxis+Series%22">Praxis Series</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1080/10899995.2022.2138067
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 1089-9995
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: A large body of work has shown that science teacher knowledge is one of the most fundamental components of effective teaching and learning. Our study analyzes the Praxis® Earth and Space Science Content Knowledge Test (ESS CKT) from May 2006 to June 2016. We present one of the largest datasets comprising 11,273 ESS teacher candidates in order to provide information about their demonstrated ESS CK. Understanding that the benefits associated with teacher retention outweigh the cost of hiring new teachers, our results can be used to design targeted professional learning (PL) experiences for pre- and inservice teachers. Findings from this study are particularly useful while planning inservice topic specific PL for teachers pre- and inservice ESS teachers by answering the following research questions (1) How have examinees performed as a whole in each category on the Praxis® ESS CKT? (2) Which personal and/or professional characteristics are most associated with examinee performance in each category and how does this inform professional learning? Examinee performance at the category level was analyzed through a five-part process: 1. Confirmatory Factor Analysis: 2. Percent correct; 3. Regression; 4. ANOVA; 5. Scaled points lost. Our findings revealed that examinees demonstrated strongest performance in the topics assessing "Earth's Atmosphere & Hydrosphere," "Earth Materials & Surface Processes," and "Tectonics & Internal Earth Processes" and identity "History of the Earth and its Life-Forms" as topics in need of support. Across categories, we found differences in achievement associated with undergraduate major, gender, and ethnicity. Test-takers with geoscience majors consistently lost fewer points than their out-of-field counterparts, that men outperformed women in the study, and White test-takers lost fewer scaled points than Black and Hispanic candidates. Our recommendations include reviewing our results for alignment with state standards in order to develop comprehensive CK development that will be used as an anchor for focused support on those topics where test-takers tend to demonstrate lowest proficiency.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2023
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1387487
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1387487
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1080/10899995.2022.2138067
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 14
        StartPage: 208
    Subjects:
      – SubjectFull: Earth Science
        Type: general
      – SubjectFull: Space Sciences
        Type: general
      – SubjectFull: Knowledge Base for Teaching
        Type: general
      – SubjectFull: Knowledge Level
        Type: general
      – SubjectFull: Tests
        Type: general
      – SubjectFull: Preservice Teachers
        Type: general
      – SubjectFull: Preservice Teacher Education
        Type: general
      – SubjectFull: Student Characteristics
        Type: general
      – SubjectFull: Factor Analysis
        Type: general
      – SubjectFull: Regression (Statistics)
        Type: general
      – SubjectFull: Achievement
        Type: general
      – SubjectFull: Teacher Certification
        Type: general
      – SubjectFull: Teacher Persistence
        Type: general
      – SubjectFull: Praxis Series
        Type: general
    Titles:
      – TitleFull: Analysis of Category Level Performance on the 'Praxis®' Earth and Space Science: Content Knowledge Test: Implications for Professional Learning
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Ndembera, Rachel
      – PersonEntity:
          Name:
            NameFull: Ray, Herman E.
      – PersonEntity:
          Name:
            NameFull: Shah, Lisa
      – PersonEntity:
          Name:
            NameFull: Rushton, Gregory T.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2023
          Identifiers:
            – Type: issn-print
              Value: 1089-9995
          Numbering:
            – Type: volume
              Value: 71
            – Type: issue
              Value: 2
          Titles:
            – TitleFull: Journal of Geoscience Education
              Type: main
ResultId 1