Interactive model-based reconstruction of the human head using an RGB-D sensor.
Saved in:
| Title: | Interactive model-based reconstruction of the human head using an RGB-D sensor. |
|---|---|
| Authors: | Zollhöfer, Michael1, Thies, Justus1, Colaianni, Matteo1, Stamminger, Marc1, Greiner, Günther1 |
| Source: | Computer Animation & Virtual Worlds. May-Aug2014, Vol. 25 Issue 3/4, p213-222. 10p. |
| Subjects: | Detectors, Interactive model (Communication), Computer-generated imagery, Algorithms, Model theory, Computer science, Graphics processing units |
| Abstract: | ABSTRACT We present a novel method for the interactive markerless reconstruction of human heads using a single commodity RGB-D sensor. Our entire reconstruction pipeline is implemented on the graphics processing unit and allows to obtain high-quality reconstructions of the human head using an interactive and intuitive reconstruction paradigm. The core of our method is a fast graphics processing unit-based nonlinear quasi-Newton solver that allows us to leverage all information of the RGB-D stream and fit a statistical head model to the observations at interactive frame rates. By jointly solving for shape, albedo and illumination parameters, we are able to reconstruct high-quality models including illumination corrected textures. All obtained reconstructions have a common topology and can be directly used as assets for games, films and various virtual reality applications. We show motion retargeting, retexturing and relighting examples. The accuracy of the presented algorithm is evaluated by a comparison against ground truth data. Copyright © 2014 John Wiley & Sons, Ltd. [ABSTRACT FROM AUTHOR] |
| Copyright of Computer Animation & Virtual Worlds is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
|
Full text is not displayed to guests.
Login for full access.
|
|
| FullText | Links: – Type: pdflink Text: Availability: 1 |
|---|---|
| Header | DbId: egs DbLabel: Engineering Source An: 96152470 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Interactive model-based reconstruction of the human head using an RGB-D sensor. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Zollhöfer%2C+Michael%22">Zollhöfer, Michael</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Thies%2C+Justus%22">Thies, Justus</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Colaianni%2C+Matteo%22">Colaianni, Matteo</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Stamminger%2C+Marc%22">Stamminger, Marc</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Greiner%2C+Günther%22">Greiner, Günther</searchLink><relatesTo>1</relatesTo> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Computer+Animation+%26+Virtual+Worlds%22">Computer Animation & Virtual Worlds</searchLink>. May-Aug2014, Vol. 25 Issue 3/4, p213-222. 10p. – Name: Subject Label: Subjects Group: Su Data: <searchLink fieldCode="DE" term="%22Detectors%22">Detectors</searchLink><br /><searchLink fieldCode="DE" term="%22Interactive+model+%28Communication%29%22">Interactive model (Communication)</searchLink><br /><searchLink fieldCode="DE" term="%22Computer-generated+imagery%22">Computer-generated imagery</searchLink><br /><searchLink fieldCode="DE" term="%22Algorithms%22">Algorithms</searchLink><br /><searchLink fieldCode="DE" term="%22Model+theory%22">Model theory</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+science%22">Computer science</searchLink><br /><searchLink fieldCode="DE" term="%22Graphics+processing+units%22">Graphics processing units</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: ABSTRACT We present a novel method for the interactive markerless reconstruction of human heads using a single commodity RGB-D sensor. Our entire reconstruction pipeline is implemented on the graphics processing unit and allows to obtain high-quality reconstructions of the human head using an interactive and intuitive reconstruction paradigm. The core of our method is a fast graphics processing unit-based nonlinear quasi-Newton solver that allows us to leverage all information of the RGB-D stream and fit a statistical head model to the observations at interactive frame rates. By jointly solving for shape, albedo and illumination parameters, we are able to reconstruct high-quality models including illumination corrected textures. All obtained reconstructions have a common topology and can be directly used as assets for games, films and various virtual reality applications. We show motion retargeting, retexturing and relighting examples. The accuracy of the presented algorithm is evaluated by a comparison against ground truth data. Copyright © 2014 John Wiley & Sons, Ltd. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Computer Animation & Virtual Worlds is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=96152470 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1002/cav.1584 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 10 StartPage: 213 Subjects: – SubjectFull: Detectors Type: general – SubjectFull: Interactive model (Communication) Type: general – SubjectFull: Computer-generated imagery Type: general – SubjectFull: Algorithms Type: general – SubjectFull: Model theory Type: general – SubjectFull: Computer science Type: general – SubjectFull: Graphics processing units Type: general Titles: – TitleFull: Interactive model-based reconstruction of the human head using an RGB-D sensor. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Zollhöfer, Michael – PersonEntity: Name: NameFull: Thies, Justus – PersonEntity: Name: NameFull: Colaianni, Matteo – PersonEntity: Name: NameFull: Stamminger, Marc – PersonEntity: Name: NameFull: Greiner, Günther IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 05 Text: May-Aug2014 Type: published Y: 2014 Identifiers: – Type: issn-print Value: 15464261 Numbering: – Type: volume Value: 25 – Type: issue Value: 3/4 Titles: – TitleFull: Computer Animation & Virtual Worlds Type: main |
| ResultId | 1 |