Interactive model-based reconstruction of the human head using an RGB-D sensor.

Saved in:
Bibliographic Details
Title: Interactive model-based reconstruction of the human head using an RGB-D sensor.
Authors: Zollhöfer, Michael1, Thies, Justus1, Colaianni, Matteo1, Stamminger, Marc1, Greiner, Günther1
Source: Computer Animation & Virtual Worlds. May-Aug2014, Vol. 25 Issue 3/4, p213-222. 10p.
Subjects: Detectors, Interactive model (Communication), Computer-generated imagery, Algorithms, Model theory, Computer science, Graphics processing units
Abstract: ABSTRACT We present a novel method for the interactive markerless reconstruction of human heads using a single commodity RGB-D sensor. Our entire reconstruction pipeline is implemented on the graphics processing unit and allows to obtain high-quality reconstructions of the human head using an interactive and intuitive reconstruction paradigm. The core of our method is a fast graphics processing unit-based nonlinear quasi-Newton solver that allows us to leverage all information of the RGB-D stream and fit a statistical head model to the observations at interactive frame rates. By jointly solving for shape, albedo and illumination parameters, we are able to reconstruct high-quality models including illumination corrected textures. All obtained reconstructions have a common topology and can be directly used as assets for games, films and various virtual reality applications. We show motion retargeting, retexturing and relighting examples. The accuracy of the presented algorithm is evaluated by a comparison against ground truth data. Copyright © 2014 John Wiley & Sons, Ltd. [ABSTRACT FROM AUTHOR]
Copyright of Computer Animation & Virtual Worlds is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: egs
DbLabel: Engineering Source
An: 96152470
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Interactive model-based reconstruction of the human head using an RGB-D sensor.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Zollhöfer%2C+Michael%22">Zollhöfer, Michael</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Thies%2C+Justus%22">Thies, Justus</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Colaianni%2C+Matteo%22">Colaianni, Matteo</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Stamminger%2C+Marc%22">Stamminger, Marc</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Greiner%2C+Günther%22">Greiner, Günther</searchLink><relatesTo>1</relatesTo>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Computer+Animation+%26+Virtual+Worlds%22">Computer Animation & Virtual Worlds</searchLink>. May-Aug2014, Vol. 25 Issue 3/4, p213-222. 10p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Detectors%22">Detectors</searchLink><br /><searchLink fieldCode="DE" term="%22Interactive+model+%28Communication%29%22">Interactive model (Communication)</searchLink><br /><searchLink fieldCode="DE" term="%22Computer-generated+imagery%22">Computer-generated imagery</searchLink><br /><searchLink fieldCode="DE" term="%22Algorithms%22">Algorithms</searchLink><br /><searchLink fieldCode="DE" term="%22Model+theory%22">Model theory</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+science%22">Computer science</searchLink><br /><searchLink fieldCode="DE" term="%22Graphics+processing+units%22">Graphics processing units</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: ABSTRACT We present a novel method for the interactive markerless reconstruction of human heads using a single commodity RGB-D sensor. Our entire reconstruction pipeline is implemented on the graphics processing unit and allows to obtain high-quality reconstructions of the human head using an interactive and intuitive reconstruction paradigm. The core of our method is a fast graphics processing unit-based nonlinear quasi-Newton solver that allows us to leverage all information of the RGB-D stream and fit a statistical head model to the observations at interactive frame rates. By jointly solving for shape, albedo and illumination parameters, we are able to reconstruct high-quality models including illumination corrected textures. All obtained reconstructions have a common topology and can be directly used as assets for games, films and various virtual reality applications. We show motion retargeting, retexturing and relighting examples. The accuracy of the presented algorithm is evaluated by a comparison against ground truth data. Copyright © 2014 John Wiley & Sons, Ltd. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Computer Animation & Virtual Worlds is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=96152470
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1002/cav.1584
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 10
        StartPage: 213
    Subjects:
      – SubjectFull: Detectors
        Type: general
      – SubjectFull: Interactive model (Communication)
        Type: general
      – SubjectFull: Computer-generated imagery
        Type: general
      – SubjectFull: Algorithms
        Type: general
      – SubjectFull: Model theory
        Type: general
      – SubjectFull: Computer science
        Type: general
      – SubjectFull: Graphics processing units
        Type: general
    Titles:
      – TitleFull: Interactive model-based reconstruction of the human head using an RGB-D sensor.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Zollhöfer, Michael
      – PersonEntity:
          Name:
            NameFull: Thies, Justus
      – PersonEntity:
          Name:
            NameFull: Colaianni, Matteo
      – PersonEntity:
          Name:
            NameFull: Stamminger, Marc
      – PersonEntity:
          Name:
            NameFull: Greiner, Günther
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 05
              Text: May-Aug2014
              Type: published
              Y: 2014
          Identifiers:
            – Type: issn-print
              Value: 15464261
          Numbering:
            – Type: volume
              Value: 25
            – Type: issue
              Value: 3/4
          Titles:
            – TitleFull: Computer Animation & Virtual Worlds
              Type: main
ResultId 1