Point cloud annotation in virtual reality based on selection of control points by gaze or hand pointing.
Saved in:
| Title: | Point cloud annotation in virtual reality based on selection of control points by gaze or hand pointing. |
|---|---|
| Authors: | Monica, Riccardo1 (AUTHOR) riccardo.monica@unipr.it, Aleotti, Jacopo2 (AUTHOR) jacopo.aleotti@unipr.it |
| Source: | Virtual Reality. Jun2026, Vol. 30 Issue 2, p1-14. 14p. |
| Subjects: | Virtual reality, Annotations, Pointing (Gesture), Head-mounted displays, Spanning trees, Eye tracking |
| Abstract: | Computer-assisted point cloud annotation is the process where a user assigns labels to points within a 3D point cloud. Research studies indicate that annotation in an immersive virtual reality (VR) environment can provide advantages over conventional 2D annotation tools. Most point cloud annotation methods in VR are based on the selection of groups of points by drawing a bounding volume. However, point selection using bounding volumes may suffer in complex scenarios due to the point cloud containing irregular shapes. This paper proposes a novel computer-assisted approach for point cloud annotation in a VR environment featuring a head-mounted display (HMD). The approach only requires the user to select and label a sparse number of control points. Points in the nearest neighborhood of a selected control point are automatically annotated by applying an algorithm based on a shortest path tree. Two point selection modes, based on ray casting, are also proposed and evaluated: a first mode where control points are selected by pointing with the HMD hand controller, and a second mode where control points are selected through HMD eye-tracking. Due to the high density of points, a data filtering process over multiple frames is also proposed to reduce the effect of ray noise on the selection. The proposed approach has been compared against a state-of-the-art method for point cloud annotation in VR based on bounding box selection. The results show that both selection modes of the proposed approach improve annotation quality and reduce annotation time. [ABSTRACT FROM AUTHOR] |
| Copyright of Virtual Reality is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
|
Full text is not displayed to guests.
Login for full access.
|
|
| FullText | Links: – Type: pdflink Text: Availability: 1 |
|---|---|
| Header | DbId: egs DbLabel: Engineering Source An: 191658287 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Point cloud annotation in virtual reality based on selection of control points by gaze or hand pointing. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Monica%2C+Riccardo%22">Monica, Riccardo</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> riccardo.monica@unipr.it</i><br /><searchLink fieldCode="AR" term="%22Aleotti%2C+Jacopo%22">Aleotti, Jacopo</searchLink><relatesTo>2</relatesTo> (AUTHOR)<i> jacopo.aleotti@unipr.it</i> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Virtual+Reality%22">Virtual Reality</searchLink>. Jun2026, Vol. 30 Issue 2, p1-14. 14p. – Name: Subject Label: Subjects Group: Su Data: <searchLink fieldCode="DE" term="%22Virtual+reality%22">Virtual reality</searchLink><br /><searchLink fieldCode="DE" term="%22Annotations%22">Annotations</searchLink><br /><searchLink fieldCode="DE" term="%22Pointing+%28Gesture%29%22">Pointing (Gesture)</searchLink><br /><searchLink fieldCode="DE" term="%22Head-mounted+displays%22">Head-mounted displays</searchLink><br /><searchLink fieldCode="DE" term="%22Spanning+trees%22">Spanning trees</searchLink><br /><searchLink fieldCode="DE" term="%22Eye+tracking%22">Eye tracking</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: Computer-assisted point cloud annotation is the process where a user assigns labels to points within a 3D point cloud. Research studies indicate that annotation in an immersive virtual reality (VR) environment can provide advantages over conventional 2D annotation tools. Most point cloud annotation methods in VR are based on the selection of groups of points by drawing a bounding volume. However, point selection using bounding volumes may suffer in complex scenarios due to the point cloud containing irregular shapes. This paper proposes a novel computer-assisted approach for point cloud annotation in a VR environment featuring a head-mounted display (HMD). The approach only requires the user to select and label a sparse number of control points. Points in the nearest neighborhood of a selected control point are automatically annotated by applying an algorithm based on a shortest path tree. Two point selection modes, based on ray casting, are also proposed and evaluated: a first mode where control points are selected by pointing with the HMD hand controller, and a second mode where control points are selected through HMD eye-tracking. Due to the high density of points, a data filtering process over multiple frames is also proposed to reduce the effect of ray noise on the selection. The proposed approach has been compared against a state-of-the-art method for point cloud annotation in VR based on bounding box selection. The results show that both selection modes of the proposed approach improve annotation quality and reduce annotation time. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Virtual Reality is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=191658287 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1007/s10055-026-01324-3 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 14 StartPage: 1 Subjects: – SubjectFull: Virtual reality Type: general – SubjectFull: Annotations Type: general – SubjectFull: Pointing (Gesture) Type: general – SubjectFull: Head-mounted displays Type: general – SubjectFull: Spanning trees Type: general – SubjectFull: Eye tracking Type: general Titles: – TitleFull: Point cloud annotation in virtual reality based on selection of control points by gaze or hand pointing. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Monica, Riccardo – PersonEntity: Name: NameFull: Aleotti, Jacopo IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 06 Text: Jun2026 Type: published Y: 2026 Identifiers: – Type: issn-print Value: 13594338 Numbering: – Type: volume Value: 30 – Type: issue Value: 2 Titles: – TitleFull: Virtual Reality Type: main |
| ResultId | 1 |
