Can an Algorithm Tell How Spiritual You Are? Using Generative Pretrained Transformers for Sophisticated Forms of Text Analysis.
Saved in:
| Title: | Can an Algorithm Tell How Spiritual You Are? Using Generative Pretrained Transformers for Sophisticated Forms of Text Analysis. |
|---|---|
| Authors: | Prinzing, Michael (AUTHOR), Bounds, Elizabeth (AUTHOR), Melton, Karen (AUTHOR), Glanzer, Perry (AUTHOR), Fredrickson, Barbara (AUTHOR), Schnitker, Sarah (AUTHOR) |
| Source: | Journal of Personality. Dec2025, Vol. 93 Issue 6, p1258-1270. 13p. |
| Subjects: | Spirituality, Generative pre-trained transformers, Research assistants, Content analysis, Narratives, Algorithms, Empirical research, Behavioral sciences |
| Abstract: | Objective: Text analysis is a form of psychological assessment that involves converting qualitative information (text) into quantitative data. We tested whether automated text analysis using Generative Pre‐trained Transformers (GPTs) can match the "gold standard" of manual text analysis, even when assessing a highly nuanced construct like spirituality. Method: In Study 1, N = 2199 US undergraduates wrote about their goals (N = 6597 texts) and completed self‐reports of spirituality and theoretically related constructs (religiousness and mental health). In Study 2, N = 357 community adults wrote short essays (N = 714 texts) and completed trait self‐reports, 5 weeks of daily diaries, and behavioral measures of spirituality. Trained research assistants and GPTs then coded the texts for spirituality. Results: The GPTs performed just as well as human raters. Human‐ and GPT‐generated scores were remarkably consistent and showed equivalent associations with other measures of spirituality and theoretically related constructs. Conclusions: GPTs can match the gold standard set by human raters, even in sophisticated forms of text analysis, but require a fraction of the time and labor. [ABSTRACT FROM AUTHOR] |
| Copyright of Journal of Personality is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Psychology and Behavioral Sciences Collection |
|
Full text is not displayed to guests.
Login for full access.
|
|
| Abstract: | Objective: Text analysis is a form of psychological assessment that involves converting qualitative information (text) into quantitative data. We tested whether automated text analysis using Generative Pre‐trained Transformers (GPTs) can match the "gold standard" of manual text analysis, even when assessing a highly nuanced construct like spirituality. Method: In Study 1, N = 2199 US undergraduates wrote about their goals (N = 6597 texts) and completed self‐reports of spirituality and theoretically related constructs (religiousness and mental health). In Study 2, N = 357 community adults wrote short essays (N = 714 texts) and completed trait self‐reports, 5 weeks of daily diaries, and behavioral measures of spirituality. Trained research assistants and GPTs then coded the texts for spirituality. Results: The GPTs performed just as well as human raters. Human‐ and GPT‐generated scores were remarkably consistent and showed equivalent associations with other measures of spirituality and theoretically related constructs. Conclusions: GPTs can match the gold standard set by human raters, even in sophisticated forms of text analysis, but require a fraction of the time and labor. [ABSTRACT FROM AUTHOR] |
|---|---|
| ISSN: | 00223506 |
| DOI: | 10.1111/jopy.13006 |
