Robust novel view synthesis from multi-view feature stereo matching priors: Robust novel view synthesis from multi-view...: J. Wang et al.
Saved in:
| Title: | Robust novel view synthesis from multi-view feature stereo matching priors: Robust novel view synthesis from multi-view...: J. Wang et al. |
|---|---|
| Authors: | Wang, Jianxin1 (AUTHOR) jxwang@stu.just.edu.cn, Shao, Haijian1,2 (AUTHOR) jsj_shj@just.edu.cn, Deng, Xing1 (AUTHOR) xdeng@just.edu.cn, Lian, Shuheng1 (AUTHOR) 222210714217@stu.just.edu.cn |
| Source: | Multimedia Systems. Jun2025, Vol. 31 Issue 3, p1-14. 14p. |
| Subjects: | Stereo image processing, Gaussian function, Robust optimization, Artificial intelligence, Radiance |
| Abstract: | NeRF (Neural Radiance Fields) exhibits the capability to synthesize images from unknown views. However, it faces challenges stemming from factors such as occlusion, non-Lambertian surfaces, sparse inputs, and weak textures commonly encountered in multi-view images. These complexities often result in fitting erroneous scene geometries, leading to suboptimal novel view synthesis quality. This paper addresses this challenge by harnessing the potential of feature-based Multi-View Stereo Matching (MVS) priors to assist NeRF in perceiving deeper information within the scene. The method is distinguished by its adaptive construction of Gaussian functions based on MVS-estimated depth values, uncertainties, and depth intervals, offering flexibility and adaptability to arbitrarily scaled scenes. Building upon this, the optimization of NeRF's training process is achieved by comparing the difference between this distribution and the weight distribution of sampled points on the volume rendering ray. Furthermore, we propose an effective Riemann sum approximation strategy to further enhance the performance of depth loss. Quantitative metrics applied to three real-scene datasets, namely LLFF, IBRNet, and DTU, demonstrate that the method presented in this paper significantly improves the quality of novel view synthesis compared to current advanced methods, achieving enhancements ranging from 3.8% to 26.9%. Visualization experiments reveal robust optimization results, particularly in challenging regions where conventional NeRF encounters difficulties. [ABSTRACT FROM AUTHOR] |
| Copyright of Multimedia Systems is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
|
Full text is not displayed to guests.
Login for full access.
|
|
| FullText | Links: – Type: pdflink Text: Availability: 1 |
|---|---|
| Header | DbId: egs DbLabel: Engineering Source An: 184324952 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Robust novel view synthesis from multi-view feature stereo matching priors: Robust novel view synthesis from multi-view...: J. Wang et al. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Wang%2C+Jianxin%22">Wang, Jianxin</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> jxwang@stu.just.edu.cn</i><br /><searchLink fieldCode="AR" term="%22Shao%2C+Haijian%22">Shao, Haijian</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<i> jsj_shj@just.edu.cn</i><br /><searchLink fieldCode="AR" term="%22Deng%2C+Xing%22">Deng, Xing</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> xdeng@just.edu.cn</i><br /><searchLink fieldCode="AR" term="%22Lian%2C+Shuheng%22">Lian, Shuheng</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> 222210714217@stu.just.edu.cn</i> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Multimedia+Systems%22">Multimedia Systems</searchLink>. Jun2025, Vol. 31 Issue 3, p1-14. 14p. – Name: Subject Label: Subjects Group: Su Data: <searchLink fieldCode="DE" term="%22Stereo+image+processing%22">Stereo image processing</searchLink><br /><searchLink fieldCode="DE" term="%22Gaussian+function%22">Gaussian function</searchLink><br /><searchLink fieldCode="DE" term="%22Robust+optimization%22">Robust optimization</searchLink><br /><searchLink fieldCode="DE" term="%22Artificial+intelligence%22">Artificial intelligence</searchLink><br /><searchLink fieldCode="DE" term="%22Radiance%22">Radiance</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: NeRF (Neural Radiance Fields) exhibits the capability to synthesize images from unknown views. However, it faces challenges stemming from factors such as occlusion, non-Lambertian surfaces, sparse inputs, and weak textures commonly encountered in multi-view images. These complexities often result in fitting erroneous scene geometries, leading to suboptimal novel view synthesis quality. This paper addresses this challenge by harnessing the potential of feature-based Multi-View Stereo Matching (MVS) priors to assist NeRF in perceiving deeper information within the scene. The method is distinguished by its adaptive construction of Gaussian functions based on MVS-estimated depth values, uncertainties, and depth intervals, offering flexibility and adaptability to arbitrarily scaled scenes. Building upon this, the optimization of NeRF's training process is achieved by comparing the difference between this distribution and the weight distribution of sampled points on the volume rendering ray. Furthermore, we propose an effective Riemann sum approximation strategy to further enhance the performance of depth loss. Quantitative metrics applied to three real-scene datasets, namely LLFF, IBRNet, and DTU, demonstrate that the method presented in this paper significantly improves the quality of novel view synthesis compared to current advanced methods, achieving enhancements ranging from 3.8% to 26.9%. Visualization experiments reveal robust optimization results, particularly in challenging regions where conventional NeRF encounters difficulties. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Multimedia Systems is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=184324952 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1007/s00530-025-01757-x Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 14 StartPage: 1 Subjects: – SubjectFull: Stereo image processing Type: general – SubjectFull: Gaussian function Type: general – SubjectFull: Robust optimization Type: general – SubjectFull: Artificial intelligence Type: general – SubjectFull: Radiance Type: general Titles: – TitleFull: Robust novel view synthesis from multi-view feature stereo matching priors: Robust novel view synthesis from multi-view...: J. Wang et al. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Wang, Jianxin – PersonEntity: Name: NameFull: Shao, Haijian – PersonEntity: Name: NameFull: Deng, Xing – PersonEntity: Name: NameFull: Lian, Shuheng IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 06 Text: Jun2025 Type: published Y: 2025 Identifiers: – Type: issn-print Value: 09424962 Numbering: – Type: volume Value: 31 – Type: issue Value: 3 Titles: – TitleFull: Multimedia Systems Type: main |
| ResultId | 1 |
