View in EDS HTML Full Text PDF Full Text

The differences in essential facial areas for impressions between humans and deep learning models: An eye‐tracking and explainable AI approach.

Saved in:
Bibliographic Details
Title: The differences in essential facial areas for impressions between humans and deep learning models: An eye‐tracking and explainable AI approach.
Authors: Sano, Takanori (AUTHOR), Shi, Jun (AUTHOR), Kawabata, Hideaki (AUTHOR)
Source: British Journal of Psychology. May2026, Vol. 117 Issue 2, p503-527. 25p.
Subjects: Facial anatomy, Pearson correlation (Statistics), Research funding, Eye movement measurements, Artificial intelligence, Masculinity, Femininity, Descriptive statistics, Social dominance, Social attitudes, Attention, Personal beauty, Deep learning, Analysis of variance, Visual perception, Data analysis software, Facial expression, Sexual dimorphism
Abstract: This study explored the facial impressions of attractiveness, dominance and sexual dimorphism using experimental and computational methods. In Study 1, we generated face images with manipulated morphological features using geometric morphometrics. In Study 2, we conducted eye tracking and impression evaluation experiments using these images to examine how facial features influence impression evaluations and explored differences based on the sex of the face images and participants. In Study 3, we employed deep learning methods, specifically using gradient‐weighted class activation mapping (Grad‐CAM), an explainable artificial intelligence (AI) technique, to extract important features for each impression using the face images and impression evaluation results from Studies 1 and 2. The findings revealed that eye‐tracking and deep learning use different features as cues. In the eye‐tracking experiments, attention was focused on features such as the eyes, nose and mouth, whereas the deep learning analysis highlighted broader features, including eyebrows and superciliary arches. The computational approach using explainable AI suggests that the determinants of facial impressions can be extracted independently of visual attention. [ABSTRACT FROM AUTHOR]
Copyright of British Journal of Psychology is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Psychology and Behavioral Sciences Collection
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: pbh
DbLabel: Psychology and Behavioral Sciences Collection
An: 192785883
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: The differences in essential facial areas for impressions between humans and deep learning models: An eye‐tracking and explainable AI approach.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Sano%2C+Takanori%22">Sano, Takanori</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Shi%2C+Jun%22">Shi, Jun</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Kawabata%2C+Hideaki%22">Kawabata, Hideaki</searchLink> (AUTHOR)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22British+Journal+of+Psychology%22">British Journal of Psychology</searchLink>. May2026, Vol. 117 Issue 2, p503-527. 25p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Facial+anatomy%22">Facial anatomy</searchLink><br /><searchLink fieldCode="DE" term="%22Pearson+correlation+%28Statistics%29%22">Pearson correlation (Statistics)</searchLink><br /><searchLink fieldCode="DE" term="%22Research+funding%22">Research funding</searchLink><br /><searchLink fieldCode="DE" term="%22Eye+movement+measurements%22">Eye movement measurements</searchLink><br /><searchLink fieldCode="DE" term="%22Artificial+intelligence%22">Artificial intelligence</searchLink><br /><searchLink fieldCode="DE" term="%22Masculinity%22">Masculinity</searchLink><br /><searchLink fieldCode="DE" term="%22Femininity%22">Femininity</searchLink><br /><searchLink fieldCode="DE" term="%22Descriptive+statistics%22">Descriptive statistics</searchLink><br /><searchLink fieldCode="DE" term="%22Social+dominance%22">Social dominance</searchLink><br /><searchLink fieldCode="DE" term="%22Social+attitudes%22">Social attitudes</searchLink><br /><searchLink fieldCode="DE" term="%22Attention%22">Attention</searchLink><br /><searchLink fieldCode="DE" term="%22Personal+beauty%22">Personal beauty</searchLink><br /><searchLink fieldCode="DE" term="%22Deep+learning%22">Deep learning</searchLink><br /><searchLink fieldCode="DE" term="%22Analysis+of+variance%22">Analysis of variance</searchLink><br /><searchLink fieldCode="DE" term="%22Visual+perception%22">Visual perception</searchLink><br /><searchLink fieldCode="DE" term="%22Data+analysis+software%22">Data analysis software</searchLink><br /><searchLink fieldCode="DE" term="%22Facial+expression%22">Facial expression</searchLink><br /><searchLink fieldCode="DE" term="%22Sexual+dimorphism%22">Sexual dimorphism</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: This study explored the facial impressions of attractiveness, dominance and sexual dimorphism using experimental and computational methods. In Study 1, we generated face images with manipulated morphological features using geometric morphometrics. In Study 2, we conducted eye tracking and impression evaluation experiments using these images to examine how facial features influence impression evaluations and explored differences based on the sex of the face images and participants. In Study 3, we employed deep learning methods, specifically using gradient‐weighted class activation mapping (Grad‐CAM), an explainable artificial intelligence (AI) technique, to extract important features for each impression using the face images and impression evaluation results from Studies 1 and 2. The findings revealed that eye‐tracking and deep learning use different features as cues. In the eye‐tracking experiments, attention was focused on features such as the eyes, nose and mouth, whereas the deep learning analysis highlighted broader features, including eyebrows and superciliary arches. The computational approach using explainable AI suggests that the determinants of facial impressions can be extracted independently of visual attention. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of British Journal of Psychology is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=pbh&AN=192785883
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1111/bjop.12744
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 25
        StartPage: 503
    Subjects:
      – SubjectFull: Facial anatomy
        Type: general
      – SubjectFull: Pearson correlation (Statistics)
        Type: general
      – SubjectFull: Research funding
        Type: general
      – SubjectFull: Eye movement measurements
        Type: general
      – SubjectFull: Artificial intelligence
        Type: general
      – SubjectFull: Masculinity
        Type: general
      – SubjectFull: Femininity
        Type: general
      – SubjectFull: Descriptive statistics
        Type: general
      – SubjectFull: Social dominance
        Type: general
      – SubjectFull: Social attitudes
        Type: general
      – SubjectFull: Attention
        Type: general
      – SubjectFull: Personal beauty
        Type: general
      – SubjectFull: Deep learning
        Type: general
      – SubjectFull: Analysis of variance
        Type: general
      – SubjectFull: Visual perception
        Type: general
      – SubjectFull: Data analysis software
        Type: general
      – SubjectFull: Facial expression
        Type: general
      – SubjectFull: Sexual dimorphism
        Type: general
    Titles:
      – TitleFull: The differences in essential facial areas for impressions between humans and deep learning models: An eye‐tracking and explainable AI approach.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Sano, Takanori
      – PersonEntity:
          Name:
            NameFull: Shi, Jun
      – PersonEntity:
          Name:
            NameFull: Kawabata, Hideaki
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 05
              Text: May2026
              Type: published
              Y: 2026
          Identifiers:
            – Type: issn-print
              Value: 00071269
          Numbering:
            – Type: volume
              Value: 117
            – Type: issue
              Value: 2
          Titles:
            – TitleFull: British Journal of Psychology
              Type: main
ResultId 1