The Causal Mechanism Claim in Evaluation: Does the Prophecy Fulfill?
Saved in:
| Title: | The Causal Mechanism Claim in Evaluation: Does the Prophecy Fulfill? |
|---|---|
| Authors: | Schmitt, Johannes1 (AUTHOR) johannes.schmitt@deval.org |
| Source: | New Directions for Evaluation. Fall2020, Vol. 2020 Issue 167, p11-26. 16p. |
| Subject Terms: | Definitions |
| Abstract: | Despite increased discussions in the community and a common understanding about the virtue of mechanism‐based explanation, little is known about the true benefits and challenges of applying causal mechanism analysis in practice. This chapter aims to introduce the reader to the topic of causal mechanisms and synthesize significant findings on this special issue. It begins by laying out definitions and concepts of causal mechanisms in evaluation literature and proposes a two‐way classification of causal mechanisms along which the chapters to this issue are structured. The chapter continues by introducing the Causal Mechanism Claim and elaborates on how analyzing causal mechanisms is expected to increase policy relevance and causal capacity in evaluations. Drawing on this issue's rich corpus of firsthand practical experience, this introduction synthesizes key lessons that support or contradict the Causal Mechanism Claim. We find that both parts of the claim—increased policy relevance and strengthened causal capacity—are supported by the authors' experiences as bundled in this issue. However, we also identify challenges related to cross‐cutting issues such as communication and practical applicability and point to the importance of method integration. [ABSTRACT FROM AUTHOR] |
| Copyright of New Directions for Evaluation is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Education Research Complete |
| FullText | Links: – Type: pdflink Text: Availability: 0 |
|---|---|
| Header | DbId: ehh DbLabel: Education Research Complete An: 146296984 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: The Causal Mechanism Claim in Evaluation: Does the Prophecy Fulfill? – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Schmitt%2C+Johannes%22">Schmitt, Johannes</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> johannes.schmitt@deval.org</i> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22New+Directions+for+Evaluation%22">New Directions for Evaluation</searchLink>. Fall2020, Vol. 2020 Issue 167, p11-26. 16p. – Name: Subject Label: Subject Terms Group: Su Data: <searchLink fieldCode="DE" term="%22Definitions%22">Definitions</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: Despite increased discussions in the community and a common understanding about the virtue of mechanism‐based explanation, little is known about the true benefits and challenges of applying causal mechanism analysis in practice. This chapter aims to introduce the reader to the topic of causal mechanisms and synthesize significant findings on this special issue. It begins by laying out definitions and concepts of causal mechanisms in evaluation literature and proposes a two‐way classification of causal mechanisms along which the chapters to this issue are structured. The chapter continues by introducing the Causal Mechanism Claim and elaborates on how analyzing causal mechanisms is expected to increase policy relevance and causal capacity in evaluations. Drawing on this issue's rich corpus of firsthand practical experience, this introduction synthesizes key lessons that support or contradict the Causal Mechanism Claim. We find that both parts of the claim—increased policy relevance and strengthened causal capacity—are supported by the authors' experiences as bundled in this issue. However, we also identify challenges related to cross‐cutting issues such as communication and practical applicability and point to the importance of method integration. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of New Directions for Evaluation is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=146296984 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1002/ev.20421 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 16 StartPage: 11 Subjects: – SubjectFull: Definitions Type: general Titles: – TitleFull: The Causal Mechanism Claim in Evaluation: Does the Prophecy Fulfill? Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Schmitt, Johannes IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 09 Text: Fall2020 Type: published Y: 2020 Identifiers: – Type: issn-print Value: 10976736 Numbering: – Type: volume Value: 2020 – Type: issue Value: 167 Titles: – TitleFull: New Directions for Evaluation Type: main |
| ResultId | 1 |
