NovelPoseNet: Synthesizing novel views of 2D poses for absolute and relative monocular 3D human pose estimation.
Saved in:
| Title: | NovelPoseNet: Synthesizing novel views of 2D poses for absolute and relative monocular 3D human pose estimation. |
|---|---|
| Authors: | Upadhyay, Avinash1 (AUTHOR) e21soep0026@bennett.edu.in, Shukla, Ankit1 (AUTHOR) v-ankit.shukla@bennett.edu.in, Sharma, Manoj1 (AUTHOR) manoj.sharma1@bennett.edu.in |
| Source: | Pattern Recognition Letters. Apr2026, Vol. 202, p141-148. 8p. |
| Subjects: | Triangulation, Artificial neural networks, Three-dimensional imaging |
| Abstract: | • Novel approach: Proposed a new approach to monocular 3D pose estimation using viewpoint information as prior. • Multi-modal network: Introduced a novel ResNet-transformer network for pose synthesis from 2D pose latent information and hypothetical camera parameters. • Triangulation-based 3D Reconstruction: Used triangulation to reconstruct 3D pose from novel poses generated from a monocular image. • Absolute 3D pose estimation: Estimated absolute 3D pose from monocular images. Monocular 3D human pose estimation aims to recover the 3D joint coordinates of a person from a single 2D image, a task made inherently difficult by the loss of depth cues during image projection. To overcome the resulting depth ambiguity, we propose NovelPoseNet, a multi-modal ResNet-Transformer framework that explicitly generates novel 2D poses from unseen viewpoints conditioned on learned 2D pose features and hypothetical camera extrinsics. Unlike prior works that impose multi-view consistency as a supervision constraint, NovelPoseNet synthesizes explicit 2D pose representations from new camera perspectives, thereby enabling true multi-view triangulation from a single image. The reconstructed 3D pose is obtained by fusing these synthesized viewpoints through geometric triangulation, yielding both absolute and relative 3D joint positions. Extensive experiments on Human3.6M and MPI-INF-3DHP datasets demonstrate that NovelPoseNet achieves state-of-the-art performance, surpassing existing reprojection- and synthesis-based methods. [ABSTRACT FROM AUTHOR] |
| Copyright of Pattern Recognition Letters is the property of Elsevier B.V. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
| FullText | Text: Availability: 0 |
|---|---|
| Header | DbId: egs DbLabel: Engineering Source An: 192227082 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: NovelPoseNet: Synthesizing novel views of 2D poses for absolute and relative monocular 3D human pose estimation. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Upadhyay%2C+Avinash%22">Upadhyay, Avinash</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> e21soep0026@bennett.edu.in</i><br /><searchLink fieldCode="AR" term="%22Shukla%2C+Ankit%22">Shukla, Ankit</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> v-ankit.shukla@bennett.edu.in</i><br /><searchLink fieldCode="AR" term="%22Sharma%2C+Manoj%22">Sharma, Manoj</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> manoj.sharma1@bennett.edu.in</i> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Pattern+Recognition+Letters%22">Pattern Recognition Letters</searchLink>. Apr2026, Vol. 202, p141-148. 8p. – Name: Subject Label: Subjects Group: Su Data: <searchLink fieldCode="DE" term="%22Triangulation%22">Triangulation</searchLink><br /><searchLink fieldCode="DE" term="%22Artificial+neural+networks%22">Artificial neural networks</searchLink><br /><searchLink fieldCode="DE" term="%22Three-dimensional+imaging%22">Three-dimensional imaging</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: • Novel approach: Proposed a new approach to monocular 3D pose estimation using viewpoint information as prior. • Multi-modal network: Introduced a novel ResNet-transformer network for pose synthesis from 2D pose latent information and hypothetical camera parameters. • Triangulation-based 3D Reconstruction: Used triangulation to reconstruct 3D pose from novel poses generated from a monocular image. • Absolute 3D pose estimation: Estimated absolute 3D pose from monocular images. Monocular 3D human pose estimation aims to recover the 3D joint coordinates of a person from a single 2D image, a task made inherently difficult by the loss of depth cues during image projection. To overcome the resulting depth ambiguity, we propose NovelPoseNet, a multi-modal ResNet-Transformer framework that explicitly generates novel 2D poses from unseen viewpoints conditioned on learned 2D pose features and hypothetical camera extrinsics. Unlike prior works that impose multi-view consistency as a supervision constraint, NovelPoseNet synthesizes explicit 2D pose representations from new camera perspectives, thereby enabling true multi-view triangulation from a single image. The reconstructed 3D pose is obtained by fusing these synthesized viewpoints through geometric triangulation, yielding both absolute and relative 3D joint positions. Extensive experiments on Human3.6M and MPI-INF-3DHP datasets demonstrate that NovelPoseNet achieves state-of-the-art performance, surpassing existing reprojection- and synthesis-based methods. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Pattern Recognition Letters is the property of Elsevier B.V. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=192227082 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1016/j.patrec.2026.02.007 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 8 StartPage: 141 Subjects: – SubjectFull: Triangulation Type: general – SubjectFull: Artificial neural networks Type: general – SubjectFull: Three-dimensional imaging Type: general Titles: – TitleFull: NovelPoseNet: Synthesizing novel views of 2D poses for absolute and relative monocular 3D human pose estimation. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Upadhyay, Avinash – PersonEntity: Name: NameFull: Shukla, Ankit – PersonEntity: Name: NameFull: Sharma, Manoj IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 04 Text: Apr2026 Type: published Y: 2026 Identifiers: – Type: issn-print Value: 01678655 Numbering: – Type: volume Value: 202 Titles: – TitleFull: Pattern Recognition Letters Type: main |
| ResultId | 1 |