View in EDS

Visual Interaction with Deep Learning Models through Collaborative Semantic Inference.

Saved in:
Bibliographic Details
Title: Visual Interaction with Deep Learning Models through Collaborative Semantic Inference.
Authors: Gehrmann, Sebastian1 gehrmann@seas.harvard.edu, Strobelt, Hendrik2 hendrik.strobelt@ibm.com, Kruger, Robert3, Pfister, Hanspeter3, Rush, Alexander M.1
Source: IEEE Transactions on Visualization & Computer Graphics. Jan2020, Vol. 26 Issue 1, p884-894. 11p.
Subjects: Decision making, Interface structures, Deep learning, Instructional systems
Abstract: Automation of tasks can have critical consequences when humans lose agency over decision processes. Deep learning models are particularly susceptible since current black-box approaches lack explainable reasoning. We argue that both the visual interface and model structure of deep learning systems need to take into account interaction design. We propose a framework of collaborative semantic inference (CSI) for the co-design of interactions and models to enable visual collaboration between humans and algorithms. The approach exposes the intermediate reasoning process of models which allows semantic interactions with the visual metaphors of a problem, which means that a user can both understand and control parts of the model reasoning process. We demonstrate the feasibility of CSI with a co-designed case study of a document summarization system. [ABSTRACT FROM AUTHOR]
Copyright of IEEE Transactions on Visualization & Computer Graphics is the property of IEEE and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
FullText Text:
  Availability: 0
Header DbId: egs
DbLabel: Engineering Source
An: 139869251
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Visual Interaction with Deep Learning Models through Collaborative Semantic Inference.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Gehrmann%2C+Sebastian%22">Gehrmann, Sebastian</searchLink><relatesTo>1</relatesTo><i> gehrmann@seas.harvard.edu</i><br /><searchLink fieldCode="AR" term="%22Strobelt%2C+Hendrik%22">Strobelt, Hendrik</searchLink><relatesTo>2</relatesTo><i> hendrik.strobelt@ibm.com</i><br /><searchLink fieldCode="AR" term="%22Kruger%2C+Robert%22">Kruger, Robert</searchLink><relatesTo>3</relatesTo><br /><searchLink fieldCode="AR" term="%22Pfister%2C+Hanspeter%22">Pfister, Hanspeter</searchLink><relatesTo>3</relatesTo><br /><searchLink fieldCode="AR" term="%22Rush%2C+Alexander+M%2E%22">Rush, Alexander M.</searchLink><relatesTo>1</relatesTo>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22IEEE+Transactions+on+Visualization+%26+Computer+Graphics%22">IEEE Transactions on Visualization & Computer Graphics</searchLink>. Jan2020, Vol. 26 Issue 1, p884-894. 11p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Decision+making%22">Decision making</searchLink><br /><searchLink fieldCode="DE" term="%22Interface+structures%22">Interface structures</searchLink><br /><searchLink fieldCode="DE" term="%22Deep+learning%22">Deep learning</searchLink><br /><searchLink fieldCode="DE" term="%22Instructional+systems%22">Instructional systems</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Automation of tasks can have critical consequences when humans lose agency over decision processes. Deep learning models are particularly susceptible since current black-box approaches lack explainable reasoning. We argue that both the visual interface and model structure of deep learning systems need to take into account interaction design. We propose a framework of collaborative semantic inference (CSI) for the co-design of interactions and models to enable visual collaboration between humans and algorithms. The approach exposes the intermediate reasoning process of models which allows semantic interactions with the visual metaphors of a problem, which means that a user can both understand and control parts of the model reasoning process. We demonstrate the feasibility of CSI with a co-designed case study of a document summarization system. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of IEEE Transactions on Visualization & Computer Graphics is the property of IEEE and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=139869251
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1109/TVCG.2019.2934595
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 11
        StartPage: 884
    Subjects:
      – SubjectFull: Decision making
        Type: general
      – SubjectFull: Interface structures
        Type: general
      – SubjectFull: Deep learning
        Type: general
      – SubjectFull: Instructional systems
        Type: general
    Titles:
      – TitleFull: Visual Interaction with Deep Learning Models through Collaborative Semantic Inference.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Gehrmann, Sebastian
      – PersonEntity:
          Name:
            NameFull: Strobelt, Hendrik
      – PersonEntity:
          Name:
            NameFull: Kruger, Robert
      – PersonEntity:
          Name:
            NameFull: Pfister, Hanspeter
      – PersonEntity:
          Name:
            NameFull: Rush, Alexander M.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Text: Jan2020
              Type: published
              Y: 2020
          Identifiers:
            – Type: issn-print
              Value: 10772626
          Numbering:
            – Type: volume
              Value: 26
            – Type: issue
              Value: 1
          Titles:
            – TitleFull: IEEE Transactions on Visualization & Computer Graphics
              Type: main
ResultId 1