Analysing Nontraditional Students' ChatGPT Interaction, Engagement, Self-Efficacy and Performance: A Mixed-Methods Approach
Saved in:
| Title: | Analysing Nontraditional Students' ChatGPT Interaction, Engagement, Self-Efficacy and Performance: A Mixed-Methods Approach |
|---|---|
| Language: | English |
| Authors: | Mohan Yang (ORCID |
| Source: | British Journal of Educational Technology. 2025 56(5):1973-2000. |
| Availability: | Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us |
| Peer Reviewed: | Y |
| Page Count: | 28 |
| Publication Date: | 2025 |
| Document Type: | Journal Articles Reports - Research |
| Education Level: | Higher Education Postsecondary Education |
| Descriptors: | Nontraditional Students, Artificial Intelligence, Technology Uses in Education, Man Machine Systems, Interaction, Learner Engagement, Self Efficacy, Academic Achievement, Performance, College Students, Predictor Variables, Prompting, Novices, Resistance (Psychology), Computer Attitudes, Adoption (Ideas), Assignments, Digital Literacy |
| DOI: | 10.1111/bjet.13588 |
| ISSN: | 0007-1013 1467-8535 |
| Abstract: | Generative artificial intelligence brings opportunities and unique challenges to nontraditional higher education students, stemming, in part, from the experience of the digital divide. Providing access and practice is critical to bridge this divide and equip students with needed digital competencies. This mixed-methods study investigated how nontraditional higher education students interact with ChatGPT in multiple courses and examined relationships between ChatGPT interactions, engagement, self-efficacy and performance. Data were collected from 73 undergraduate and graduate students through chat logs, course reflections and artefacts, surveys and interviews. ChatGPT interactions were analysed using four metrics: prompt number, depth of knowledge (DoK), prompt relevance and originality. Results showed that ChatGPT prompt numbers ([beta] = 0.256, p < 0.03) and engagement ([beta] = 0.267, p < 0.05) significantly predicted performance, while self-efficacy did not. Students' DoK (r = 0.40, p < 0.01) and prompt relevance (r = 0.42, p < 0.01) were positively correlated with performance. Text mining analysis identified distinct interaction patterns, with 'strategic inquirers' demonstrating significantly higher performance than 'exploratory inquirers' through more sophisticated follow-up questioning. Qualitative findings revealed that while most students were first-time ChatGPT users who initially showed resistance, they developed growing acceptance. Still, students tended to use ChatGPT sparingly and, even then, as only a starting point for assignments. The study highlights the need for targeted guidance in prompt engineering and AI literacy training to help nontraditional higher education students leverage ChatGPT more effectively for higher-order thinking tasks. |
| Abstractor: | As Provided |
| Entry Date: | 2025 |
| Accession Number: | EJ1480022 |
| Database: | ERIC |
|
Full text is not displayed to guests.
Login for full access.
|
|
| Abstract: | Generative artificial intelligence brings opportunities and unique challenges to nontraditional higher education students, stemming, in part, from the experience of the digital divide. Providing access and practice is critical to bridge this divide and equip students with needed digital competencies. This mixed-methods study investigated how nontraditional higher education students interact with ChatGPT in multiple courses and examined relationships between ChatGPT interactions, engagement, self-efficacy and performance. Data were collected from 73 undergraduate and graduate students through chat logs, course reflections and artefacts, surveys and interviews. ChatGPT interactions were analysed using four metrics: prompt number, depth of knowledge (DoK), prompt relevance and originality. Results showed that ChatGPT prompt numbers ([beta] = 0.256, p < 0.03) and engagement ([beta] = 0.267, p < 0.05) significantly predicted performance, while self-efficacy did not. Students' DoK (r = 0.40, p < 0.01) and prompt relevance (r = 0.42, p < 0.01) were positively correlated with performance. Text mining analysis identified distinct interaction patterns, with 'strategic inquirers' demonstrating significantly higher performance than 'exploratory inquirers' through more sophisticated follow-up questioning. Qualitative findings revealed that while most students were first-time ChatGPT users who initially showed resistance, they developed growing acceptance. Still, students tended to use ChatGPT sparingly and, even then, as only a starting point for assignments. The study highlights the need for targeted guidance in prompt engineering and AI literacy training to help nontraditional higher education students leverage ChatGPT more effectively for higher-order thinking tasks. |
|---|---|
| ISSN: | 0007-1013 1467-8535 |
| DOI: | 10.1111/bjet.13588 |
