Examining the Idea Density and Semantic Distance of Responses Given by AI to Tests of Divergent Thinking.
Saved in:
| Title: | Examining the Idea Density and Semantic Distance of Responses Given by AI to Tests of Divergent Thinking. |
|---|---|
| Authors: | Runco, Mark A.1,2 (AUTHOR), Turkman, Burak3 (AUTHOR), Acar, Selcuk4 (AUTHOR), Abdulla Alabbasi, Ahmed M.5 (AUTHOR) ahmedmda@agu.edu.bh |
| Source: | Journal of Creative Behavior. Sep2025, Vol. 59 Issue 3, p1-11. 11p. |
| Subject Terms: | *Generative artificial intelligence, *Divergent thinking, *Creative ability, *Evaluation methodology, *Artificial intelligence, *Cognitive testing, Originality |
| Abstract: | Research suggests that generative AI (GAI) responds to divergent thinking (DT) prompts with multiple ideas, some of which seem to be original. The present investigation administered 55 DT tasks to three GAI services (Bard, GPT 3.5, and GPT 4.0). Instead of examining individual responses, an Idea Density algorithm was used to assess the output. This algorithm quantifies the ideas within responses, controlling for the number of words. A subset of the DT tests administered to the GAI were also scored for Semantic Distance, which estimates originality. Results indicated that the three GAI models differed in the Idea Density of the output. There were also significant differences between Realistic and Nonrealistic DT tasks. As has been the case in human samples, directions given when the GAI received the prompts also had a significant impact, with more Idea Density following directions that explicitly prompted original responses. Adjusted scores removed all verbiage in the output, which did not actually address the questions conveyed by the prompts. These corrected scores shared approximately 50% of the variance with the uncorrected "raw" responses, implying that the typical output of GAI is not always relevant. This was interpreted in the context of the standard definition of creativity, which emphasizes effectiveness, as well as originality. [ABSTRACT FROM AUTHOR] |
| Copyright of Journal of Creative Behavior is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Education Research Complete |
|
Full text is not displayed to guests.
Login for full access.
|
|
| FullText | Links: – Type: pdflink Text: Availability: 1 |
|---|---|
| Header | DbId: ehh DbLabel: Education Research Complete An: 187843392 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Examining the Idea Density and Semantic Distance of Responses Given by AI to Tests of Divergent Thinking. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Runco%2C+Mark+A%2E%22">Runco, Mark A.</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Turkman%2C+Burak%22">Turkman, Burak</searchLink><relatesTo>3</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Acar%2C+Selcuk%22">Acar, Selcuk</searchLink><relatesTo>4</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Abdulla+Alabbasi%2C+Ahmed+M%2E%22">Abdulla Alabbasi, Ahmed M.</searchLink><relatesTo>5</relatesTo> (AUTHOR)<i> ahmedmda@agu.edu.bh</i> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Journal+of+Creative+Behavior%22">Journal of Creative Behavior</searchLink>. Sep2025, Vol. 59 Issue 3, p1-11. 11p. – Name: Subject Label: Subject Terms Group: Su Data: *<searchLink fieldCode="DE" term="%22Generative+artificial+intelligence%22">Generative artificial intelligence</searchLink><br />*<searchLink fieldCode="DE" term="%22Divergent+thinking%22">Divergent thinking</searchLink><br />*<searchLink fieldCode="DE" term="%22Creative+ability%22">Creative ability</searchLink><br />*<searchLink fieldCode="DE" term="%22Evaluation+methodology%22">Evaluation methodology</searchLink><br />*<searchLink fieldCode="DE" term="%22Artificial+intelligence%22">Artificial intelligence</searchLink><br />*<searchLink fieldCode="DE" term="%22Cognitive+testing%22">Cognitive testing</searchLink><br /><searchLink fieldCode="DE" term="%22Originality%22">Originality</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: Research suggests that generative AI (GAI) responds to divergent thinking (DT) prompts with multiple ideas, some of which seem to be original. The present investigation administered 55 DT tasks to three GAI services (Bard, GPT 3.5, and GPT 4.0). Instead of examining individual responses, an Idea Density algorithm was used to assess the output. This algorithm quantifies the ideas within responses, controlling for the number of words. A subset of the DT tests administered to the GAI were also scored for Semantic Distance, which estimates originality. Results indicated that the three GAI models differed in the Idea Density of the output. There were also significant differences between Realistic and Nonrealistic DT tasks. As has been the case in human samples, directions given when the GAI received the prompts also had a significant impact, with more Idea Density following directions that explicitly prompted original responses. Adjusted scores removed all verbiage in the output, which did not actually address the questions conveyed by the prompts. These corrected scores shared approximately 50% of the variance with the uncorrected "raw" responses, implying that the typical output of GAI is not always relevant. This was interpreted in the context of the standard definition of creativity, which emphasizes effectiveness, as well as originality. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Journal of Creative Behavior is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=187843392 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1002/jocb.1528 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 11 StartPage: 1 Subjects: – SubjectFull: Generative artificial intelligence Type: general – SubjectFull: Divergent thinking Type: general – SubjectFull: Creative ability Type: general – SubjectFull: Evaluation methodology Type: general – SubjectFull: Artificial intelligence Type: general – SubjectFull: Cognitive testing Type: general – SubjectFull: Originality Type: general Titles: – TitleFull: Examining the Idea Density and Semantic Distance of Responses Given by AI to Tests of Divergent Thinking. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Runco, Mark A. – PersonEntity: Name: NameFull: Turkman, Burak – PersonEntity: Name: NameFull: Acar, Selcuk – PersonEntity: Name: NameFull: Abdulla Alabbasi, Ahmed M. IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 09 Text: Sep2025 Type: published Y: 2025 Identifiers: – Type: issn-print Value: 00220175 Numbering: – Type: volume Value: 59 – Type: issue Value: 3 Titles: – TitleFull: Journal of Creative Behavior Type: main |
| ResultId | 1 |
