Assessing the Degree of Ecological Validity of Your Study: Introducing the Multidimensional Assessment of Research in Context (MARC) Tool

Saved in:
Bibliographic Details
Title: Assessing the Degree of Ecological Validity of Your Study: Introducing the Multidimensional Assessment of Research in Context (MARC) Tool
Language: English
Authors: Naumann, Sandra (ORCID 0000-0001-8992-2930), Byrne, Michelle L. (ORCID 0000-0002-4180-8095), de la Fuente, Alethia (ORCID 0000-0002-5689-1709), Harrewijn, Anita (ORCID 0000-0001-9938-4048), Nugiel, Tehila (ORCID 0000-0001-5547-1852), Rosen, Maya (ORCID 0000-0002-4649-9965), van Atteveldt, Nienke (ORCID 0000-0002-3387-6151), Matusz, Pawel J. (ORCID 0000-0003-1721-4868)
Source: Mind, Brain, and Education. Aug 2022 16(3):228-238.
Availability: Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Peer Reviewed: Y
Page Count: 11
Publication Date: 2022
Document Type: Journal Articles
Reports - Descriptive
Tests/Questionnaires
Descriptors: Evaluation Methods, Neurosciences, Educational Research, Validity, Research Methodology
DOI: 10.1111/mbe.12318
ISSN: 1751-2271
1751-228X
Abstract: In cognitive neurosciences, fundamental principles of mental processes and functional brain organization have been established with highly controlled tasks and testing environments. Recent technical advances allowed the investigation of these functions and their brain mechanisms in naturalistic settings. The diversity in those approaches have been recently (Matusz, P. J., Dikker, S., Huth, A. G., & Perrodin, C. (2019). Are we ready for real-world neuroscience? "Journal of Cognitive Neuroscience," 31(3), 327-338. doi:10.1162/jocn_e_01276) classified via a three-category cycle, including "controlled laboratory," "partially naturalistic laboratory," and "naturalistic real-world research." Based on this model, we developed the Multidimensional Assessment of Research in Context (MARC) tool to easily delineate the approach researchers have taken in their study. MARC provides means to describe the degree of ecological validity for each component of a study (e.g., sample, stimuli, measures, etc.), and the study's location on the cycle. The tool comprises seven questions concerning a study's characteristics. It outputs a summary of those and a compass plot, which can be used for presentations, preregistration, grant proposals, and papers. It aims to improve drawing conclusions across studies and raise awareness about the generalizability of research findings.
Abstractor: As Provided
Entry Date: 2022
Accession Number: EJ1343744
Database: ERIC
Full text is not displayed to guests.
Description
Abstract:In cognitive neurosciences, fundamental principles of mental processes and functional brain organization have been established with highly controlled tasks and testing environments. Recent technical advances allowed the investigation of these functions and their brain mechanisms in naturalistic settings. The diversity in those approaches have been recently (Matusz, P. J., Dikker, S., Huth, A. G., & Perrodin, C. (2019). Are we ready for real-world neuroscience? "Journal of Cognitive Neuroscience," 31(3), 327-338. doi:10.1162/jocn_e_01276) classified via a three-category cycle, including "controlled laboratory," "partially naturalistic laboratory," and "naturalistic real-world research." Based on this model, we developed the Multidimensional Assessment of Research in Context (MARC) tool to easily delineate the approach researchers have taken in their study. MARC provides means to describe the degree of ecological validity for each component of a study (e.g., sample, stimuli, measures, etc.), and the study's location on the cycle. The tool comprises seven questions concerning a study's characteristics. It outputs a summary of those and a compass plot, which can be used for presentations, preregistration, grant proposals, and papers. It aims to improve drawing conclusions across studies and raise awareness about the generalizability of research findings.
ISSN:1751-2271
1751-228X
DOI:10.1111/mbe.12318