Analyzing Operator States and the Impact of AI-Enhanced Decision Support in Control Rooms: A Human-in-the-Loop Specialized Reinforcement Learning Framework for Intervention Strategies.

Saved in:
Bibliographic Details
Title: Analyzing Operator States and the Impact of AI-Enhanced Decision Support in Control Rooms: A Human-in-the-Loop Specialized Reinforcement Learning Framework for Intervention Strategies.
Authors: Abbas, Ammar N. (AUTHOR), Amazu, Chidera W. (AUTHOR), Mietkiewicz, Joseph (AUTHOR), Briwa, Houda (AUTHOR), Perez, Andres Alonso (AUTHOR), Baldissone, Gabriele (AUTHOR), Demichela, Micaela (AUTHOR), Chasparis, Georgios C. (AUTHOR), Kelleher, John D. (AUTHOR), Leva, Maria Chiara (AUTHOR)
Source: International Journal of Human-Computer Interaction. Jun2025, Vol. 41 Issue 12, p7218-7252. 35p.
Subjects: Deep reinforcement learning, Decision support systems, Artificial intelligence, Chemical process control, Hidden Markov models, Reinforcement learning, Eye tracking
Abstract: In complex industrial and chemical process control rooms, effective decision-making is crucial for safety and efficiency. The experiments in this paper evaluate the impact and applications of an AI-based decision support system integrated into an improved human-machine interface, using dynamic influence diagrams, a hidden Markov model, and deep reinforcement learning. The enhanced support system aims to reduce operator workload, improve situational awareness, and provide different intervention strategies to the operator adapted to the current state of both the system and human performance. Such a system can be particularly useful in cases of information overload when many alarms and inputs are presented all within the same time window, or for junior operators during training. A comprehensive cross-data analysis was conducted, involving 47 participants and a diverse range of data sources such as smartwatch metrics, eye-tracking data, process logs, and responses from questionnaires. The results indicate interesting insights regarding the effectiveness of the approach in aiding decision-making, decreasing perceived workload, and increasing situational awareness for the scenarios considered. Additionally, the results provide insights to compare differences between styles of information gathering when using the system by individual participants. These findings are particularly relevant when predicting the overall performance of the individual participant and their capacity to successfully handle a plant upset and the alarms connected to it using process and human-machine interaction logs in real-time which resulted in a 95.8% prediction accuracy using hidden Markov model. These predictions enable the development of more effective intervention strategies. [ABSTRACT FROM AUTHOR]
Copyright of International Journal of Human-Computer Interaction is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Psychology and Behavioral Sciences Collection
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: pbh
DbLabel: Psychology and Behavioral Sciences Collection
An: 185859958
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Analyzing Operator States and the Impact of AI-Enhanced Decision Support in Control Rooms: A Human-in-the-Loop Specialized Reinforcement Learning Framework for Intervention Strategies.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Abbas%2C+Ammar+N%2E%22">Abbas, Ammar N.</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Amazu%2C+Chidera+W%2E%22">Amazu, Chidera W.</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Mietkiewicz%2C+Joseph%22">Mietkiewicz, Joseph</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Briwa%2C+Houda%22">Briwa, Houda</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Perez%2C+Andres+Alonso%22">Perez, Andres Alonso</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Baldissone%2C+Gabriele%22">Baldissone, Gabriele</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Demichela%2C+Micaela%22">Demichela, Micaela</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Chasparis%2C+Georgios+C%2E%22">Chasparis, Georgios C.</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Kelleher%2C+John+D%2E%22">Kelleher, John D.</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Leva%2C+Maria+Chiara%22">Leva, Maria Chiara</searchLink> (AUTHOR)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22International+Journal+of+Human-Computer+Interaction%22">International Journal of Human-Computer Interaction</searchLink>. Jun2025, Vol. 41 Issue 12, p7218-7252. 35p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Deep+reinforcement+learning%22">Deep reinforcement learning</searchLink><br /><searchLink fieldCode="DE" term="%22Decision+support+systems%22">Decision support systems</searchLink><br /><searchLink fieldCode="DE" term="%22Artificial+intelligence%22">Artificial intelligence</searchLink><br /><searchLink fieldCode="DE" term="%22Chemical+process+control%22">Chemical process control</searchLink><br /><searchLink fieldCode="DE" term="%22Hidden+Markov+models%22">Hidden Markov models</searchLink><br /><searchLink fieldCode="DE" term="%22Reinforcement+learning%22">Reinforcement learning</searchLink><br /><searchLink fieldCode="DE" term="%22Eye+tracking%22">Eye tracking</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: In complex industrial and chemical process control rooms, effective decision-making is crucial for safety and efficiency. The experiments in this paper evaluate the impact and applications of an AI-based decision support system integrated into an improved human-machine interface, using dynamic influence diagrams, a hidden Markov model, and deep reinforcement learning. The enhanced support system aims to reduce operator workload, improve situational awareness, and provide different intervention strategies to the operator adapted to the current state of both the system and human performance. Such a system can be particularly useful in cases of information overload when many alarms and inputs are presented all within the same time window, or for junior operators during training. A comprehensive cross-data analysis was conducted, involving 47 participants and a diverse range of data sources such as smartwatch metrics, eye-tracking data, process logs, and responses from questionnaires. The results indicate interesting insights regarding the effectiveness of the approach in aiding decision-making, decreasing perceived workload, and increasing situational awareness for the scenarios considered. Additionally, the results provide insights to compare differences between styles of information gathering when using the system by individual participants. These findings are particularly relevant when predicting the overall performance of the individual participant and their capacity to successfully handle a plant upset and the alarms connected to it using process and human-machine interaction logs in real-time which resulted in a 95.8% prediction accuracy using hidden Markov model. These predictions enable the development of more effective intervention strategies. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of International Journal of Human-Computer Interaction is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=pbh&AN=185859958
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1080/10447318.2024.2391605
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 35
        StartPage: 7218
    Subjects:
      – SubjectFull: Deep reinforcement learning
        Type: general
      – SubjectFull: Decision support systems
        Type: general
      – SubjectFull: Artificial intelligence
        Type: general
      – SubjectFull: Chemical process control
        Type: general
      – SubjectFull: Hidden Markov models
        Type: general
      – SubjectFull: Reinforcement learning
        Type: general
      – SubjectFull: Eye tracking
        Type: general
    Titles:
      – TitleFull: Analyzing Operator States and the Impact of AI-Enhanced Decision Support in Control Rooms: A Human-in-the-Loop Specialized Reinforcement Learning Framework for Intervention Strategies.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Abbas, Ammar N.
      – PersonEntity:
          Name:
            NameFull: Amazu, Chidera W.
      – PersonEntity:
          Name:
            NameFull: Mietkiewicz, Joseph
      – PersonEntity:
          Name:
            NameFull: Briwa, Houda
      – PersonEntity:
          Name:
            NameFull: Perez, Andres Alonso
      – PersonEntity:
          Name:
            NameFull: Baldissone, Gabriele
      – PersonEntity:
          Name:
            NameFull: Demichela, Micaela
      – PersonEntity:
          Name:
            NameFull: Chasparis, Georgios C.
      – PersonEntity:
          Name:
            NameFull: Kelleher, John D.
      – PersonEntity:
          Name:
            NameFull: Leva, Maria Chiara
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 15
              M: 06
              Text: Jun2025
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-print
              Value: 10447318
          Numbering:
            – Type: volume
              Value: 41
            – Type: issue
              Value: 12
          Titles:
            – TitleFull: International Journal of Human-Computer Interaction
              Type: main
ResultId 1