View in EDS

Examination of the Validity and Reliability of the Kansas Clinical Assessment Tool. Study Brief. REL 2021-095

Saved in:
Bibliographic Details
Title: Examination of the Validity and Reliability of the Kansas Clinical Assessment Tool. Study Brief. REL 2021-095
Language: English
Authors: Joyce, J., Brodersen, R., M., Meyer, Haines, M., Weston-Sementelli, J., National Center for Education Evaluation and Regional Assistance (NCEE) (ED/IES), Regional Educational Laboratory Central (ED), Marzano Research
Source: Regional Educational Laboratory Central. 2021.
Availability: Regional Educational Laboratory Central. Available from: Institute of Education Sciences. 550 12th Street SW, Washington, DC 20202. Tel: 202-245-6940; Web site: https://ies.ed.gov/ncee/edlabs/regions/central/index.asp
Peer Reviewed: Y
Page Count: 5
Publication Date: 2021
Contract Number: EDIES17C0005
Document Type: Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Test Validity, Test Reliability, Evaluation Methods, Preservice Teachers, Student Evaluation, Cooperating Teachers, Clinical Supervision (of Teachers), Preservice Teacher Education, Student Teacher Supervisors, State Standards, Portfolios (Background Materials)
Geographic Terms: Kansas
Assessment and Survey Identifiers: Praxis Series
Abstract: Although national assessments for evaluating teacher candidates are available, some state education agencies and education preparation programs have developed their own assessments. These locally developed assessments are based on observations of teaching and other artifacts such as lesson plans and student assignments. However, local assessment developers often lack information about the validity and reliability of data collected with their assessments. The Council for the Accreditation of Educator Preparation (CAEP) has provided guidance for demonstrating the validity and reliability of locally developed teacher candidate assessments, yet few educator preparation programs have the capacity to generate this evidence. The Regional Educational Laboratory Central partnered with educator preparation programs in Kansas to examine the validity and reliability of the Kansas Clinical Assessment Tool (K-CAT), a newly developed tool for assessing the performance of teacher candidates. The study was designed to align with CAEP guidance. The study found that cooperating teachers reported that the K-CAT accurately represented existing teaching performance standards (face validity). Two skilled raters found that the content of the K-CAT was mostly aligned to existing teaching performance standards (content validity). In addition, K-CAT scores for the same teacher candidate, provided by cooperating teachers and supervising faculty, were positively related (convergent validity). K-CAT indicator scores showed internal consistency, or correlations among related indicators, for standards and for the tool overall (reliability). K-CAT scores showed small relationships with teacher candidate scores on other measures of teaching performance (criterion-related validity). [For the full report, see ED613622. For the Study Snapshot, see ED613623. For the appendixes, see ED613625.]
Abstractor: As Provided
IES Funded: Yes
IES Publication: https://ies.ed.gov/ncee/edlabs/projects/project.asp?projectID=5682
Entry Date: 2021
Accession Number: ED613624
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED613624
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED613624
AccessLevel: 3
PubType: Report
PubTypeId: report
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Examination of the Validity and Reliability of the Kansas Clinical Assessment Tool. Study Brief. REL 2021-095
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Joyce%2C+J%2E%22">Joyce, J.</searchLink><br /><searchLink fieldCode="AR" term="%22Brodersen%2C+R%2E%22">Brodersen, R.</searchLink><br /><searchLink fieldCode="AR" term="%22M%2E%2C+Meyer%22">M., Meyer</searchLink><br /><searchLink fieldCode="AR" term="%22Haines%2C+M%2E%22">Haines, M.</searchLink><br /><searchLink fieldCode="AR" term="%22Weston-Sementelli%2C+J%2E%22">Weston-Sementelli, J.</searchLink><br /><searchLink fieldCode="AR" term="%22National+Center+for+Education+Evaluation+and+Regional+Assistance+%28NCEE%29+%28ED%2FIES%29%22">National Center for Education Evaluation and Regional Assistance (NCEE) (ED/IES)</searchLink><br /><searchLink fieldCode="AR" term="%22Regional+Educational+Laboratory+Central+%28ED%29%22">Regional Educational Laboratory Central (ED)</searchLink><br /><searchLink fieldCode="AR" term="%22Marzano+Research%22">Marzano Research</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Regional+Educational+Laboratory+Central%22"><i>Regional Educational Laboratory Central</i></searchLink>. 2021.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Regional Educational Laboratory Central. Available from: Institute of Education Sciences. 550 12th Street SW, Washington, DC 20202. Tel: 202-245-6940; Web site: https://ies.ed.gov/ncee/edlabs/regions/central/index.asp
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 5
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2021
– Name: NumberContract
  Label: Contract Number
  Group: NumCntrct
  Data: EDIES17C0005
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Test+Validity%22">Test Validity</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Reliability%22">Test Reliability</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluation+Methods%22">Evaluation Methods</searchLink><br /><searchLink fieldCode="DE" term="%22Preservice+Teachers%22">Preservice Teachers</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Evaluation%22">Student Evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Cooperating+Teachers%22">Cooperating Teachers</searchLink><br /><searchLink fieldCode="DE" term="%22Clinical+Supervision+%28of+Teachers%29%22">Clinical Supervision (of Teachers)</searchLink><br /><searchLink fieldCode="DE" term="%22Preservice+Teacher+Education%22">Preservice Teacher Education</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Teacher+Supervisors%22">Student Teacher Supervisors</searchLink><br /><searchLink fieldCode="DE" term="%22State+Standards%22">State Standards</searchLink><br /><searchLink fieldCode="DE" term="%22Portfolios+%28Background+Materials%29%22">Portfolios (Background Materials)</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Kansas%22">Kansas</searchLink>
– Name: SubjectThesaurus
  Label: Assessment and Survey Identifiers
  Group: Su
  Data: <searchLink fieldCode="SU" term="%22Praxis+Series%22">Praxis Series</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Although national assessments for evaluating teacher candidates are available, some state education agencies and education preparation programs have developed their own assessments. These locally developed assessments are based on observations of teaching and other artifacts such as lesson plans and student assignments. However, local assessment developers often lack information about the validity and reliability of data collected with their assessments. The Council for the Accreditation of Educator Preparation (CAEP) has provided guidance for demonstrating the validity and reliability of locally developed teacher candidate assessments, yet few educator preparation programs have the capacity to generate this evidence. The Regional Educational Laboratory Central partnered with educator preparation programs in Kansas to examine the validity and reliability of the Kansas Clinical Assessment Tool (K-CAT), a newly developed tool for assessing the performance of teacher candidates. The study was designed to align with CAEP guidance. The study found that cooperating teachers reported that the K-CAT accurately represented existing teaching performance standards (face validity). Two skilled raters found that the content of the K-CAT was mostly aligned to existing teaching performance standards (content validity). In addition, K-CAT scores for the same teacher candidate, provided by cooperating teachers and supervising faculty, were positively related (convergent validity). K-CAT indicator scores showed internal consistency, or correlations among related indicators, for standards and for the tool overall (reliability). K-CAT scores showed small relationships with teacher candidate scores on other measures of teaching performance (criterion-related validity). [For the full report, see ED613622. For the Study Snapshot, see ED613623. For the appendixes, see ED613625.]
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: CodeSource
  Label: IES Funded
  Group: SrcInfo
  Data: Yes
– Name: CodeSource
  Label: IES Publication
  Group: SrcInfo
  Data: <link linkTarget="URL" linkTerm="https://ies.ed.gov/ncee/edlabs/projects/project.asp?projectID=5682" linkWindow="_blank">https://ies.ed.gov/ncee/edlabs/projects/project.asp?projectID=5682</link>
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2021
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED613624
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED613624
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 5
    Subjects:
      – SubjectFull: Test Validity
        Type: general
      – SubjectFull: Test Reliability
        Type: general
      – SubjectFull: Evaluation Methods
        Type: general
      – SubjectFull: Preservice Teachers
        Type: general
      – SubjectFull: Student Evaluation
        Type: general
      – SubjectFull: Cooperating Teachers
        Type: general
      – SubjectFull: Clinical Supervision (of Teachers)
        Type: general
      – SubjectFull: Preservice Teacher Education
        Type: general
      – SubjectFull: Student Teacher Supervisors
        Type: general
      – SubjectFull: State Standards
        Type: general
      – SubjectFull: Portfolios (Background Materials)
        Type: general
      – SubjectFull: Kansas
        Type: general
      – SubjectFull: Praxis Series
        Type: general
    Titles:
      – TitleFull: Examination of the Validity and Reliability of the Kansas Clinical Assessment Tool. Study Brief. REL 2021-095
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: National Center for Education Evaluation and Regional Assistance (NCEE) (ED/IES)
      – PersonEntity:
          Name:
            NameFull: Regional Educational Laboratory Central (ED)
      – PersonEntity:
          Name:
            NameFull: Marzano Research
      – PersonEntity:
          Name:
            NameFull: Joyce, J.
      – PersonEntity:
          Name:
            NameFull: Brodersen, R.
      – PersonEntity:
          Name:
            NameFull: M., Meyer
      – PersonEntity:
          Name:
            NameFull: Haines, M.
      – PersonEntity:
          Name:
            NameFull: Weston-Sementelli, J.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 07
              Type: published
              Y: 2021
          Titles:
            – TitleFull: Regional Educational Laboratory Central
              Type: main
ResultId 1