Optimizing real-time stereo image retargeting for AR/VR: Lightweight disparity CNNs on AI-Driven edge architectures.
Saved in:
| Title: | Optimizing real-time stereo image retargeting for AR/VR: Lightweight disparity CNNs on AI-Driven edge architectures. |
|---|---|
| Authors: | T. Jagtap, Mahendra1,2 (AUTHOR) mtjagtap05@gmail.com, Unhelkar, Bhuvan3 (AUTHOR), Kshirsagar, Pravin R.4 (AUTHOR), Rakesh, Nitin5 (AUTHOR), Thiagarajan, R.6 (AUTHOR), Patil, Vishal7 (AUTHOR) |
| Source: | African Journal of Science, Technology, Innovation & Development. Feb2026, Vol. 18 Issue 1, p46-66. 21p. |
| Subjects: | Stereo image processing, Convolutional neural networks, Augmented reality, Depth maps (Digital image processing), Virtual reality, Computer performance, Edge computing |
| Abstract: | Real-time stereo image retargeting for augmented reality (AR) and virtual reality (VR) necessitates precise per-pixel depth estimation and ultra-low latency performance on resource-limited edge devices. Current disparity convolutional neural networks (CNNs) and retargeting pipelines are unable to meet these demanding requirements concurrently. This paper presents EASNet, a compact end-to-end framework that unifies geometry-aware proposal generation, parallax-aligned feature encoding, sparse candidate aggregation, and uncertainty-guided refinement to enable high-fidelity stereo retargeting on edge architectures. This system enhances stereo vision through Epipolar-Adaptive Disparity Proposals (EADP) for search space reduction, a Parallax-Directed Deformable Encoder (PaDDE) for improved matching in repetitive and low-texture areas, Sparse Epipolar Candidate Volume (SECV) with Edge-Consistent Routing (ECR) for efficient, boundary-preserving cost aggregation, and Lightweight Uncertainty-Guided Refinement (LUGR) for sub-pixel structure and occlusion correction. Evaluated on high-resolution indoor stereo data, EASNet attains a favourable trade-off between accuracy and efficiency (≈0.21 M parameters, 3.42 GFLOPs) while improving disparity fidelity and visual coherence required for retargeting (reported EPE ≈ 1.78 px, D1 ≈ 5.02%, VC ≈ 93.7%). The design emphasizes quantization compatibility and deterministic latency, enabling practical deployment on AR/VR edge devices. We analyze ablations, per-scene behaviour, and k-fold stability, discussing limitations like indoor bias, extreme occlusion, large baselines, and future EASNet extensions. [ABSTRACT FROM AUTHOR] |
| Copyright of African Journal of Science, Technology, Innovation & Development is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
| FullText | Text: Availability: 0 |
|---|---|
| Header | DbId: egs DbLabel: Engineering Source An: 192657133 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Optimizing real-time stereo image retargeting for AR/VR: Lightweight disparity CNNs on AI-Driven edge architectures. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22T%2E+Jagtap%2C+Mahendra%22">T. Jagtap, Mahendra</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<i> mtjagtap05@gmail.com</i><br /><searchLink fieldCode="AR" term="%22Unhelkar%2C+Bhuvan%22">Unhelkar, Bhuvan</searchLink><relatesTo>3</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Kshirsagar%2C+Pravin+R%2E%22">Kshirsagar, Pravin R.</searchLink><relatesTo>4</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Rakesh%2C+Nitin%22">Rakesh, Nitin</searchLink><relatesTo>5</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Thiagarajan%2C+R%2E%22">Thiagarajan, R.</searchLink><relatesTo>6</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Patil%2C+Vishal%22">Patil, Vishal</searchLink><relatesTo>7</relatesTo> (AUTHOR) – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22African+Journal+of+Science%2C+Technology%2C+Innovation+%26+Development%22">African Journal of Science, Technology, Innovation & Development</searchLink>. Feb2026, Vol. 18 Issue 1, p46-66. 21p. – Name: Subject Label: Subjects Group: Su Data: <searchLink fieldCode="DE" term="%22Stereo+image+processing%22">Stereo image processing</searchLink><br /><searchLink fieldCode="DE" term="%22Convolutional+neural+networks%22">Convolutional neural networks</searchLink><br /><searchLink fieldCode="DE" term="%22Augmented+reality%22">Augmented reality</searchLink><br /><searchLink fieldCode="DE" term="%22Depth+maps+%28Digital+image+processing%29%22">Depth maps (Digital image processing)</searchLink><br /><searchLink fieldCode="DE" term="%22Virtual+reality%22">Virtual reality</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+performance%22">Computer performance</searchLink><br /><searchLink fieldCode="DE" term="%22Edge+computing%22">Edge computing</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: Real-time stereo image retargeting for augmented reality (AR) and virtual reality (VR) necessitates precise per-pixel depth estimation and ultra-low latency performance on resource-limited edge devices. Current disparity convolutional neural networks (CNNs) and retargeting pipelines are unable to meet these demanding requirements concurrently. This paper presents EASNet, a compact end-to-end framework that unifies geometry-aware proposal generation, parallax-aligned feature encoding, sparse candidate aggregation, and uncertainty-guided refinement to enable high-fidelity stereo retargeting on edge architectures. This system enhances stereo vision through Epipolar-Adaptive Disparity Proposals (EADP) for search space reduction, a Parallax-Directed Deformable Encoder (PaDDE) for improved matching in repetitive and low-texture areas, Sparse Epipolar Candidate Volume (SECV) with Edge-Consistent Routing (ECR) for efficient, boundary-preserving cost aggregation, and Lightweight Uncertainty-Guided Refinement (LUGR) for sub-pixel structure and occlusion correction. Evaluated on high-resolution indoor stereo data, EASNet attains a favourable trade-off between accuracy and efficiency (≈0.21 M parameters, 3.42 GFLOPs) while improving disparity fidelity and visual coherence required for retargeting (reported EPE ≈ 1.78 px, D1 ≈ 5.02%, VC ≈ 93.7%). The design emphasizes quantization compatibility and deterministic latency, enabling practical deployment on AR/VR edge devices. We analyze ablations, per-scene behaviour, and k-fold stability, discussing limitations like indoor bias, extreme occlusion, large baselines, and future EASNet extensions. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of African Journal of Science, Technology, Innovation & Development is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=192657133 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1080/20421338.2025.2601663 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 21 StartPage: 46 Subjects: – SubjectFull: Stereo image processing Type: general – SubjectFull: Convolutional neural networks Type: general – SubjectFull: Augmented reality Type: general – SubjectFull: Depth maps (Digital image processing) Type: general – SubjectFull: Virtual reality Type: general – SubjectFull: Computer performance Type: general – SubjectFull: Edge computing Type: general Titles: – TitleFull: Optimizing real-time stereo image retargeting for AR/VR: Lightweight disparity CNNs on AI-Driven edge architectures. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: T. Jagtap, Mahendra – PersonEntity: Name: NameFull: Unhelkar, Bhuvan – PersonEntity: Name: NameFull: Kshirsagar, Pravin R. – PersonEntity: Name: NameFull: Rakesh, Nitin – PersonEntity: Name: NameFull: Thiagarajan, R. – PersonEntity: Name: NameFull: Patil, Vishal IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 02 Text: Feb2026 Type: published Y: 2026 Identifiers: – Type: issn-print Value: 20421338 Numbering: – Type: volume Value: 18 – Type: issue Value: 1 Titles: – TitleFull: African Journal of Science, Technology, Innovation & Development Type: main |
| ResultId | 1 |