A Hierarchical Semantic Consistency Constraint Framework for Hyperspectral and LiDAR Data Joint Classification.
Saved in:
| Title: | A Hierarchical Semantic Consistency Constraint Framework for Hyperspectral and LiDAR Data Joint Classification. |
|---|---|
| Authors: | Shen, Jie1,2 (AUTHOR), Ma, Yimeng1,2 (AUTHOR), Yang, Houqun1,2 (AUTHOR) yhq@hainanu.edu.cn |
| Source: | Remote Sensing. Jun2026, Vol. 18 Issue 12, p2058. 26p. |
| Subjects: | Multisensor data fusion, Remote sensing, Resemblance (Philosophy), Remote-sensing images, Land use mapping |
| Geographic Terms: | Augsburg (Germany) |
| Abstract: | Highlights: What are the main findings? A hierarchical semantic consistency constraint framework (HSCC) is proposed for joint classification of HSI and LiDAR data. The framework progressively strengthens cross-modal interaction through a progressive interactive fusion network (PIFNet) and introduces a semantic consistency constraint (SCC) strategy to explicitly enforce feature similarity for the same object across different modalities and levels, effectively mitigating semantic drift. What are the implications of the main findings? HSCC achieves state-of-the-art classification performance on three public datasets, providing a high-accuracy solution for multi-source remote sensing data fusion in complex land-cover scenes. HSCC offers a hierarchical semantic alignment paradigm for heterogeneous feature fusion of multi-source remote sensing data, which can be extended to other multimodal tasks. Hyperspectral image (HSI) and LiDAR data fusion is valuable for land-cover classification in complex surface scenes. Existing methods typically extract features from each modality independently and then consider how to fuse them, ignoring the semantic consistency between features of different modalities and across different hierarchical levels. Moreover, fully mining and exploiting the complementary information between multimodal remote sensing data remains a critical issue. To address these challenges, this paper proposes a hierarchical semantic consistency constraint (HSCC) framework for HSI and LiDAR data joint classification. The framework is co-constructed by a progressive interactive fusion network (PIFNet) and a semantic consistency constraint (SCC) strategy. Specifically, PIFNet progressively calibrates the semantic representations of multimodal features at different abstraction levels through Cross-Modal Shared Attention and Symmetric Cross-Attention mechanisms, promoting information parity in deep interactions. The SCC strategy establishes multi-level semantic associations and employs a semantic consistency constraint loss to guide the network to autonomously maintain the consistency of the same land-cover object across heterogeneous feature representations, thereby further enhancing the discriminative power of the fused features. Experiments on three public datasets, MUUFL, Houston2013, and Augsburg, demonstrate that HSCC outperforms current state-of-the-art methods, validating its effectiveness in multi-source remote sensing data fusion classification tasks. [ABSTRACT FROM AUTHOR] |
| Copyright of Remote Sensing is the property of MDPI and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
|
Full text is not displayed to guests.
Login for full access.
|
|
| FullText | Links: – Type: pdflink Text: Availability: 1 |
|---|---|
| Header | DbId: egs DbLabel: Engineering Source An: 194915191 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: A Hierarchical Semantic Consistency Constraint Framework for Hyperspectral and LiDAR Data Joint Classification. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Shen%2C+Jie%22">Shen, Jie</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Ma%2C+Yimeng%22">Ma, Yimeng</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Yang%2C+Houqun%22">Yang, Houqun</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<i> yhq@hainanu.edu.cn</i> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Remote+Sensing%22">Remote Sensing</searchLink>. Jun2026, Vol. 18 Issue 12, p2058. 26p. – Name: Subject Label: Subjects Group: Su Data: <searchLink fieldCode="DE" term="%22Multisensor+data+fusion%22">Multisensor data fusion</searchLink><br /><searchLink fieldCode="DE" term="%22Remote+sensing%22">Remote sensing</searchLink><br /><searchLink fieldCode="DE" term="%22Resemblance+%28Philosophy%29%22">Resemblance (Philosophy)</searchLink><br /><searchLink fieldCode="DE" term="%22Remote-sensing+images%22">Remote-sensing images</searchLink><br /><searchLink fieldCode="DE" term="%22Land+use+mapping%22">Land use mapping</searchLink> – Name: SubjectGeographic Label: Geographic Terms Group: Su Data: <searchLink fieldCode="DE" term="%22Augsburg+%28Germany%29%22">Augsburg (Germany)</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: Highlights: What are the main findings? A hierarchical semantic consistency constraint framework (HSCC) is proposed for joint classification of HSI and LiDAR data. The framework progressively strengthens cross-modal interaction through a progressive interactive fusion network (PIFNet) and introduces a semantic consistency constraint (SCC) strategy to explicitly enforce feature similarity for the same object across different modalities and levels, effectively mitigating semantic drift. What are the implications of the main findings? HSCC achieves state-of-the-art classification performance on three public datasets, providing a high-accuracy solution for multi-source remote sensing data fusion in complex land-cover scenes. HSCC offers a hierarchical semantic alignment paradigm for heterogeneous feature fusion of multi-source remote sensing data, which can be extended to other multimodal tasks. Hyperspectral image (HSI) and LiDAR data fusion is valuable for land-cover classification in complex surface scenes. Existing methods typically extract features from each modality independently and then consider how to fuse them, ignoring the semantic consistency between features of different modalities and across different hierarchical levels. Moreover, fully mining and exploiting the complementary information between multimodal remote sensing data remains a critical issue. To address these challenges, this paper proposes a hierarchical semantic consistency constraint (HSCC) framework for HSI and LiDAR data joint classification. The framework is co-constructed by a progressive interactive fusion network (PIFNet) and a semantic consistency constraint (SCC) strategy. Specifically, PIFNet progressively calibrates the semantic representations of multimodal features at different abstraction levels through Cross-Modal Shared Attention and Symmetric Cross-Attention mechanisms, promoting information parity in deep interactions. The SCC strategy establishes multi-level semantic associations and employs a semantic consistency constraint loss to guide the network to autonomously maintain the consistency of the same land-cover object across heterogeneous feature representations, thereby further enhancing the discriminative power of the fused features. Experiments on three public datasets, MUUFL, Houston2013, and Augsburg, demonstrate that HSCC outperforms current state-of-the-art methods, validating its effectiveness in multi-source remote sensing data fusion classification tasks. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Remote Sensing is the property of MDPI and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=194915191 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.3390/rs18122058 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 26 StartPage: 2058 Subjects: – SubjectFull: Multisensor data fusion Type: general – SubjectFull: Remote sensing Type: general – SubjectFull: Resemblance (Philosophy) Type: general – SubjectFull: Remote-sensing images Type: general – SubjectFull: Land use mapping Type: general – SubjectFull: Augsburg (Germany) Type: general Titles: – TitleFull: A Hierarchical Semantic Consistency Constraint Framework for Hyperspectral and LiDAR Data Joint Classification. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Shen, Jie – PersonEntity: Name: NameFull: Ma, Yimeng – PersonEntity: Name: NameFull: Yang, Houqun IsPartOfRelationships: – BibEntity: Dates: – D: 15 M: 06 Text: Jun2026 Type: published Y: 2026 Identifiers: – Type: issn-print Value: 20724292 Numbering: – Type: volume Value: 18 – Type: issue Value: 12 Titles: – TitleFull: Remote Sensing Type: main |
| ResultId | 1 |