Discovering Internal Validity Threats and Operational Concerns in Single-Case Experimental Designs Through Directed Acyclic Graphs.
Saved in:
| Title: | Discovering Internal Validity Threats and Operational Concerns in Single-Case Experimental Designs Through Directed Acyclic Graphs. |
|---|---|
| Authors: | Hall, Garret J. (AUTHOR), Putzeys, Sophia (AUTHOR), Kratochwill, Thomas R. (AUTHOR), Levin, Joel R. (AUTHOR) |
| Source: | Educational Psychology Review. Dec2024, Vol. 36 Issue 4, p1-38. 38p. |
| Abstract: | Single-case experimental designs (SCEDs) have a long history in clinical and educational disciplines. One underdeveloped area in advancing SCED design and analysis is understanding the process of how internal validity threats and operational concerns are avoided or mitigated. Two strategies to ameliorate such issues in SCED involve replication and randomization. Although replication and randomization are indispensable tools in improving the internal validity of SCEDs, little attention has been paid to (a) why this is the case; or (b) the ways in which these design features are not immune from internal validity threats and operational concerns. In the current paper, we describe the use of directed acyclic graphs (DAGs) to better understand, discover, and mitigate internal validity threats and operational concerns in SCEDs. DAGs are a tool for visualizing causal relations among variables and can help researchers identify both causal and noncausal relations among their variables according to specific algorithms. We introduce the use of DAGs in SCEDs to prompt applied researchers to conceptualize internal validity threats and operational concerns, even when an SCED includes replication and randomization in the design structure. We discuss the general principles of causal inference in conventional “group” designs and in SCEDs, the unique factors impacting SCEDs, and how DAGs can be incorporated into SCEDs. We also discuss the limitations of DAGs applied to SCEDs, as well as future directions for this area of work. [ABSTRACT FROM AUTHOR] |
| Copyright of Educational Psychology Review is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Psychology and Behavioral Sciences Collection |
|
Full text is not displayed to guests.
Login for full access.
|
|
| Abstract: | Single-case experimental designs (SCEDs) have a long history in clinical and educational disciplines. One underdeveloped area in advancing SCED design and analysis is understanding the process of how internal validity threats and operational concerns are avoided or mitigated. Two strategies to ameliorate such issues in SCED involve replication and randomization. Although replication and randomization are indispensable tools in improving the internal validity of SCEDs, little attention has been paid to (a) why this is the case; or (b) the ways in which these design features are not immune from internal validity threats and operational concerns. In the current paper, we describe the use of directed acyclic graphs (DAGs) to better understand, discover, and mitigate internal validity threats and operational concerns in SCEDs. DAGs are a tool for visualizing causal relations among variables and can help researchers identify both causal and noncausal relations among their variables according to specific algorithms. We introduce the use of DAGs in SCEDs to prompt applied researchers to conceptualize internal validity threats and operational concerns, even when an SCED includes replication and randomization in the design structure. We discuss the general principles of causal inference in conventional “group” designs and in SCEDs, the unique factors impacting SCEDs, and how DAGs can be incorporated into SCEDs. We also discuss the limitations of DAGs applied to SCEDs, as well as future directions for this area of work. [ABSTRACT FROM AUTHOR] |
|---|---|
| ISSN: | 1040726X |
| DOI: | 10.1007/s10648-024-09962-2 |