View in EDS HTML Full Text PDF Full Text

VolTeMorph: Real‐time, Controllable and Generalizable Animation of Volumetric Representations.

Saved in:
Bibliographic Details
Title: VolTeMorph: Real‐time, Controllable and Generalizable Animation of Volumetric Representations.
Authors: Garbin, Stephan J.1 (AUTHOR), Kowalski, Marek1 (AUTHOR) Marek.Kowalski@microsoft.com, Estellers, Virginia1 (AUTHOR) Virginia.Estellers@microsoft.com, Szymanowicz, Stanislaw2 (AUTHOR) stan@robots.ox.ac.uk, Rezaeifar, Shideh1 (AUTHOR) srezaeifar@microsoft.com, Shen, Jingjing1 (AUTHOR), Johnson, Matthew A.1 (AUTHOR) matjoh@microsoft.com, Valentin, Julien1 (AUTHOR) Valentin.Julien@microsoft.com
Source: Computer Graphics Forum. Sep2024, Vol. 43 Issue 6, p1-21. 21p.
Subjects: Editing software, Telepresence, Extrapolation, Popularity, Geometry, Avatars (Virtual reality)
Abstract: The recent increase in popularity of volumetric representations for scene reconstruction and novel view synthesis has put renewed focus on animating volumetric content at high visual quality and in real‐time. While implicit deformation methods based on learned functions can produce impressive results, they are 'black boxes' to artists and content creators, they require large amounts of training data to generalize meaningfully, and they do not produce realistic extrapolations outside of this data. In this work, we solve these issues by introducing a volume deformation method which is real‐time even for complex deformations, easy to edit with off‐the‐shelf software and can extrapolate convincingly. To demonstrate the versatility of our method, we apply it in two scenarios: physics‐based object deformation and telepresence where avatars are controlled using blendshapes. We also perform thorough experiments showing that our method compares favourably to both volumetric approaches combined with implicit deformation and methods based on mesh deformation. [ABSTRACT FROM AUTHOR]
Copyright of Computer Graphics Forum is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: egs
DbLabel: Engineering Source
An: 179808106
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: VolTeMorph: Real‐time, Controllable and Generalizable Animation of Volumetric Representations.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Garbin%2C+Stephan+J%2E%22">Garbin, Stephan J.</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Kowalski%2C+Marek%22">Kowalski, Marek</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> Marek.Kowalski@microsoft.com</i><br /><searchLink fieldCode="AR" term="%22Estellers%2C+Virginia%22">Estellers, Virginia</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> Virginia.Estellers@microsoft.com</i><br /><searchLink fieldCode="AR" term="%22Szymanowicz%2C+Stanislaw%22">Szymanowicz, Stanislaw</searchLink><relatesTo>2</relatesTo> (AUTHOR)<i> stan@robots.ox.ac.uk</i><br /><searchLink fieldCode="AR" term="%22Rezaeifar%2C+Shideh%22">Rezaeifar, Shideh</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> srezaeifar@microsoft.com</i><br /><searchLink fieldCode="AR" term="%22Shen%2C+Jingjing%22">Shen, Jingjing</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Johnson%2C+Matthew+A%2E%22">Johnson, Matthew A.</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> matjoh@microsoft.com</i><br /><searchLink fieldCode="AR" term="%22Valentin%2C+Julien%22">Valentin, Julien</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> Valentin.Julien@microsoft.com</i>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Computer+Graphics+Forum%22">Computer Graphics Forum</searchLink>. Sep2024, Vol. 43 Issue 6, p1-21. 21p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Editing+software%22">Editing software</searchLink><br /><searchLink fieldCode="DE" term="%22Telepresence%22">Telepresence</searchLink><br /><searchLink fieldCode="DE" term="%22Extrapolation%22">Extrapolation</searchLink><br /><searchLink fieldCode="DE" term="%22Popularity%22">Popularity</searchLink><br /><searchLink fieldCode="DE" term="%22Geometry%22">Geometry</searchLink><br /><searchLink fieldCode="DE" term="%22Avatars+%28Virtual+reality%29%22">Avatars (Virtual reality)</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: The recent increase in popularity of volumetric representations for scene reconstruction and novel view synthesis has put renewed focus on animating volumetric content at high visual quality and in real‐time. While implicit deformation methods based on learned functions can produce impressive results, they are 'black boxes' to artists and content creators, they require large amounts of training data to generalize meaningfully, and they do not produce realistic extrapolations outside of this data. In this work, we solve these issues by introducing a volume deformation method which is real‐time even for complex deformations, easy to edit with off‐the‐shelf software and can extrapolate convincingly. To demonstrate the versatility of our method, we apply it in two scenarios: physics‐based object deformation and telepresence where avatars are controlled using blendshapes. We also perform thorough experiments showing that our method compares favourably to both volumetric approaches combined with implicit deformation and methods based on mesh deformation. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Computer Graphics Forum is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=179808106
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1111/cgf.15117
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 21
        StartPage: 1
    Subjects:
      – SubjectFull: Editing software
        Type: general
      – SubjectFull: Telepresence
        Type: general
      – SubjectFull: Extrapolation
        Type: general
      – SubjectFull: Popularity
        Type: general
      – SubjectFull: Geometry
        Type: general
      – SubjectFull: Avatars (Virtual reality)
        Type: general
    Titles:
      – TitleFull: VolTeMorph: Real‐time, Controllable and Generalizable Animation of Volumetric Representations.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Garbin, Stephan J.
      – PersonEntity:
          Name:
            NameFull: Kowalski, Marek
      – PersonEntity:
          Name:
            NameFull: Estellers, Virginia
      – PersonEntity:
          Name:
            NameFull: Szymanowicz, Stanislaw
      – PersonEntity:
          Name:
            NameFull: Rezaeifar, Shideh
      – PersonEntity:
          Name:
            NameFull: Shen, Jingjing
      – PersonEntity:
          Name:
            NameFull: Johnson, Matthew A.
      – PersonEntity:
          Name:
            NameFull: Valentin, Julien
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 09
              Text: Sep2024
              Type: published
              Y: 2024
          Identifiers:
            – Type: issn-print
              Value: 01677055
          Numbering:
            – Type: volume
              Value: 43
            – Type: issue
              Value: 6
          Titles:
            – TitleFull: Computer Graphics Forum
              Type: main
ResultId 1