View in EDS

Exploring ChatGPT's Ability to Classify the Structure of Literature Reviews in Engineering Research Articles

Saved in:
Bibliographic Details
Title: Exploring ChatGPT's Ability to Classify the Structure of Literature Reviews in Engineering Research Articles
Language: English
Authors: Maha Issa (ORCID 0009-0005-3319-4811), Marwa Faraj (ORCID 0009-0001-0158-9895), Niveen AbiGhannam (ORCID 0000-0002-8823-3479)
Source: IEEE Transactions on Learning Technologies. 2024 17:1859-1868.
Availability: Institute of Electrical and Electronics Engineers, Inc. 445 Hoes Lane, Piscataway, NJ 08854. Tel: 732-981-0060; Web site: http://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=4620076
Peer Reviewed: Y
Page Count: 10
Publication Date: 2024
Document Type: Journal Articles
Reports - Research
Descriptors: Artificial Intelligence, Intelligent Tutoring Systems, Research Reports, Literature Reviews, Content Analysis, Engineering, Editing, Quality Control, Technical Writing
DOI: 10.1109/TLT.2024.3409514
ISSN: 1939-1382
Abstract: ChatGPT is a newly emerging artificial intelligence (AI) tool that can generate and assess written text. In this study, we aim to examine the extent to which it can correctly identify the structure of literature review sections in engineering research articles. For this purpose, we conducted a manual content analysis by classifying paragraphs of literature review sections into their corresponding categories that are based on Kwan's model, which is a labeling scheme for structuring literature reviews. We then asked ChatGPT to perform the same categorization and compared both outcomes. Numerical results do not imply a satisfactory performance of ChatGPT; therefore, writers cannot fully depend on it to edit their literature reviews. However, the AI chatbot displays an understanding of the given prompt and is able to respond beyond the classification task by giving supportive and useful explanations for the users. Such findings can be especially helpful for beginners who usually struggle to write comprehensive literature review sections since they highlight how users can benefit from this AI chatbot to revise their drafts at the level of content and organization. With further investigations and advancement, AI chatbots can also be used for teaching proper literature review writing and editing.
Abstractor: As Provided
Entry Date: 2024
Accession Number: EJ1429542
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1429542
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Exploring ChatGPT's Ability to Classify the Structure of Literature Reviews in Engineering Research Articles
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Maha+Issa%22">Maha Issa</searchLink> (ORCID <externalLink term="https://orcid.org/0009-0005-3319-4811">0009-0005-3319-4811</externalLink>)<br /><searchLink fieldCode="AR" term="%22Marwa+Faraj%22">Marwa Faraj</searchLink> (ORCID <externalLink term="https://orcid.org/0009-0001-0158-9895">0009-0001-0158-9895</externalLink>)<br /><searchLink fieldCode="AR" term="%22Niveen+AbiGhannam%22">Niveen AbiGhannam</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-8823-3479">0000-0002-8823-3479</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22IEEE+Transactions+on+Learning+Technologies%22"><i>IEEE Transactions on Learning Technologies</i></searchLink>. 2024 17:1859-1868.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Institute of Electrical and Electronics Engineers, Inc. 445 Hoes Lane, Piscataway, NJ 08854. Tel: 732-981-0060; Web site: http://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=4620076
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 10
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2024
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Artificial+Intelligence%22">Artificial Intelligence</searchLink><br /><searchLink fieldCode="DE" term="%22Intelligent+Tutoring+Systems%22">Intelligent Tutoring Systems</searchLink><br /><searchLink fieldCode="DE" term="%22Research+Reports%22">Research Reports</searchLink><br /><searchLink fieldCode="DE" term="%22Literature+Reviews%22">Literature Reviews</searchLink><br /><searchLink fieldCode="DE" term="%22Content+Analysis%22">Content Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Engineering%22">Engineering</searchLink><br /><searchLink fieldCode="DE" term="%22Editing%22">Editing</searchLink><br /><searchLink fieldCode="DE" term="%22Quality+Control%22">Quality Control</searchLink><br /><searchLink fieldCode="DE" term="%22Technical+Writing%22">Technical Writing</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1109/TLT.2024.3409514
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 1939-1382
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: ChatGPT is a newly emerging artificial intelligence (AI) tool that can generate and assess written text. In this study, we aim to examine the extent to which it can correctly identify the structure of literature review sections in engineering research articles. For this purpose, we conducted a manual content analysis by classifying paragraphs of literature review sections into their corresponding categories that are based on Kwan's model, which is a labeling scheme for structuring literature reviews. We then asked ChatGPT to perform the same categorization and compared both outcomes. Numerical results do not imply a satisfactory performance of ChatGPT; therefore, writers cannot fully depend on it to edit their literature reviews. However, the AI chatbot displays an understanding of the given prompt and is able to respond beyond the classification task by giving supportive and useful explanations for the users. Such findings can be especially helpful for beginners who usually struggle to write comprehensive literature review sections since they highlight how users can benefit from this AI chatbot to revise their drafts at the level of content and organization. With further investigations and advancement, AI chatbots can also be used for teaching proper literature review writing and editing.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2024
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1429542
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1429542
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1109/TLT.2024.3409514
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 10
        StartPage: 1859
    Subjects:
      – SubjectFull: Artificial Intelligence
        Type: general
      – SubjectFull: Intelligent Tutoring Systems
        Type: general
      – SubjectFull: Research Reports
        Type: general
      – SubjectFull: Literature Reviews
        Type: general
      – SubjectFull: Content Analysis
        Type: general
      – SubjectFull: Engineering
        Type: general
      – SubjectFull: Editing
        Type: general
      – SubjectFull: Quality Control
        Type: general
      – SubjectFull: Technical Writing
        Type: general
    Titles:
      – TitleFull: Exploring ChatGPT's Ability to Classify the Structure of Literature Reviews in Engineering Research Articles
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Maha Issa
      – PersonEntity:
          Name:
            NameFull: Marwa Faraj
      – PersonEntity:
          Name:
            NameFull: Niveen AbiGhannam
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2024
          Identifiers:
            – Type: issn-electronic
              Value: 1939-1382
          Numbering:
            – Type: volume
              Value: 17
          Titles:
            – TitleFull: IEEE Transactions on Learning Technologies
              Type: main
ResultId 1