View in EDS HTML Full Text PDF Full Text

From 2D to 3D real-time expression transfer for facial animation.

Saved in:
Bibliographic Details
Title: From 2D to 3D real-time expression transfer for facial animation.
Authors: Ekmen, Beste1, Ekenel, Hazım Kemal1
Source: Multimedia Tools & Applications. May2019, Vol. 78 Issue 9, p12519-12535. 17p.
Subjects: Animation (Cinematography), Tracking & trailing, Face, Calibration, Training, Cell phones
Abstract: In this paper, we present a three-stage approach, which creates realistic facial animations by tracking expressions of a human face in 2D and transferring them to a human-like 3D model in real-time. Our calibration-free method, which is based on an average human face, does not require training. The tracking is performed using a single camera to enable several practical applications, for example, using tablets and mobile devices, and the expressions are transferred with a joint-based system to improve the quality and persuasiveness of animations. In the first step of the method, a joint-based facial rig providing mobility to pseudo-muscles is attached to the 3D model. The second stage covers the tracking of 2D positions of the facial landmarks from a single camera view and transfer of 3D relative movement data to move the respective joints on the model. The last step includes the recording of animation using a partially automated key-framing technique. Experiments on the extended Cohn-Kanade dataset using peak frames in frontal-view videos have shown that the presented method produces visually satisfying facial animations. [ABSTRACT FROM AUTHOR]
Copyright of Multimedia Tools & Applications is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: egs
DbLabel: Engineering Source
An: 136405480
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: From 2D to 3D real-time expression transfer for facial animation.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Ekmen%2C+Beste%22">Ekmen, Beste</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Ekenel%2C+Hazım+Kemal%22">Ekenel, Hazım Kemal</searchLink><relatesTo>1</relatesTo>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Multimedia+Tools+%26+Applications%22">Multimedia Tools & Applications</searchLink>. May2019, Vol. 78 Issue 9, p12519-12535. 17p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Animation+%28Cinematography%29%22">Animation (Cinematography)</searchLink><br /><searchLink fieldCode="DE" term="%22Tracking+%26+trailing%22">Tracking & trailing</searchLink><br /><searchLink fieldCode="DE" term="%22Face%22">Face</searchLink><br /><searchLink fieldCode="DE" term="%22Calibration%22">Calibration</searchLink><br /><searchLink fieldCode="DE" term="%22Training%22">Training</searchLink><br /><searchLink fieldCode="DE" term="%22Cell+phones%22">Cell phones</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: In this paper, we present a three-stage approach, which creates realistic facial animations by tracking expressions of a human face in 2D and transferring them to a human-like 3D model in real-time. Our calibration-free method, which is based on an average human face, does not require training. The tracking is performed using a single camera to enable several practical applications, for example, using tablets and mobile devices, and the expressions are transferred with a joint-based system to improve the quality and persuasiveness of animations. In the first step of the method, a joint-based facial rig providing mobility to pseudo-muscles is attached to the 3D model. The second stage covers the tracking of 2D positions of the facial landmarks from a single camera view and transfer of 3D relative movement data to move the respective joints on the model. The last step includes the recording of animation using a partially automated key-framing technique. Experiments on the extended Cohn-Kanade dataset using peak frames in frontal-view videos have shown that the presented method produces visually satisfying facial animations. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Multimedia Tools & Applications is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=136405480
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1007/s11042-018-6785-8
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 17
        StartPage: 12519
    Subjects:
      – SubjectFull: Animation (Cinematography)
        Type: general
      – SubjectFull: Tracking & trailing
        Type: general
      – SubjectFull: Face
        Type: general
      – SubjectFull: Calibration
        Type: general
      – SubjectFull: Training
        Type: general
      – SubjectFull: Cell phones
        Type: general
    Titles:
      – TitleFull: From 2D to 3D real-time expression transfer for facial animation.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Ekmen, Beste
      – PersonEntity:
          Name:
            NameFull: Ekenel, Hazım Kemal
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 05
              Text: May2019
              Type: published
              Y: 2019
          Identifiers:
            – Type: issn-print
              Value: 13807501
          Numbering:
            – Type: volume
              Value: 78
            – Type: issue
              Value: 9
          Titles:
            – TitleFull: Multimedia Tools & Applications
              Type: main
ResultId 1