Benchmarking Open-Access Building Footprints: A Multi-Dimensional Assessment with High-Fidelity References.
Saved in:
| Title: | Benchmarking Open-Access Building Footprints: A Multi-Dimensional Assessment with High-Fidelity References. |
|---|---|
| Authors: | Zhou, Taiqing1 (AUTHOR), Liao, Yifan1,2 (AUTHOR) liaoyifan01@whu.edu.cn, Gan, Wenxiang1,3 (AUTHOR), Chen, Zhijie2,4 (AUTHOR), Li, Chuchu1,2 (AUTHOR), Zhao, Geyi2 (AUTHOR), Chen, Qi2,3 (AUTHOR), Xue, Qian4 (AUTHOR), Tao, Pengjie1 (AUTHOR) |
| Source: | Remote Sensing. Sep2026, Vol. 18 Issue 17, p2895. 31p. |
| Subjects: | Data quality, Geospatial data, Evaluation methodology, Urban research, Statistical accuracy |
| Abstract: | Highlights: What are the main findings? Open-access building footprint datasets generally underestimate building count and area; object recovery and spatial agreement remain limited, while matched-pair morphology fidelity varies substantially. No product led all three tiers: GABLE ranked highest in statistical consistency, Microsoft Global ML Building Footprints in object recovery and spatial fidelity, and Google Research Open Buildings in matched-pair morphology fidelity within the evaluated coverage. What are the implications of the main findings? Local validation is advisable when reliable completeness, positional accuracy, or boundary fidelity is required. Tier-specific rankings support selection of the most suitable available product for a given region and application. The rapid proliferation of open-access vector building footprint datasets has created substantial opportunities for large-scale urban analysis, yet their reliability remains difficult to assess effectively and consistently. This challenge arises primarily from the scarcity of large-scale, high-fidelity reference benchmarks across diverse urban environments. To address these limitations, we construct a benchmark-grade reference dataset comprising over 200,000 manually annotated building footprints across 10 purposively selected cities across diverse global regions through an exhaustive curation campaign and strict manual-automated quality validation. Using this dataset, we develop a three-tier evaluation framework that assesses statistical consistency, object recovery and spatial accuracy, and morphology fidelity among matched building pairs. Evaluating 11 mainstream datasets reveals pervasive underestimation in both building area (average bias: −14.9%) and count (−34.0%). Average city-level intersection-over-union values range from 29.1% to 58.3%, indicating low-to-moderate spatial overlap. For matched building pairs, the datasets demonstrate relatively high geometric fidelity, with morphological similarity scores of 0.495 to 0.803. Pronounced regional performance variations indicate that no single dataset is universally optimal. Specifically, Microsoft Global ML Building Footprints offers the most balanced multi-city performance, Google Research Open Buildings is recommended for boundary shape fidelity, and regional datasets remain competitive for local analyses. [ABSTRACT FROM AUTHOR] |
| Copyright of Remote Sensing is the property of MDPI and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
|
Full text is not displayed to guests.
Login for full access.
|
|
| FullText | Links: – Type: pdflink Text: Availability: 1 |
|---|---|
| Header | DbId: egs DbLabel: Engineering Source An: 197043745 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Benchmarking Open-Access Building Footprints: A Multi-Dimensional Assessment with High-Fidelity References. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Zhou%2C+Taiqing%22">Zhou, Taiqing</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Liao%2C+Yifan%22">Liao, Yifan</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<i> liaoyifan01@whu.edu.cn</i><br /><searchLink fieldCode="AR" term="%22Gan%2C+Wenxiang%22">Gan, Wenxiang</searchLink><relatesTo>1,3</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Chen%2C+Zhijie%22">Chen, Zhijie</searchLink><relatesTo>2,4</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Li%2C+Chuchu%22">Li, Chuchu</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Zhao%2C+Geyi%22">Zhao, Geyi</searchLink><relatesTo>2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Chen%2C+Qi%22">Chen, Qi</searchLink><relatesTo>2,3</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Xue%2C+Qian%22">Xue, Qian</searchLink><relatesTo>4</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Tao%2C+Pengjie%22">Tao, Pengjie</searchLink><relatesTo>1</relatesTo> (AUTHOR) – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Remote+Sensing%22">Remote Sensing</searchLink>. Sep2026, Vol. 18 Issue 17, p2895. 31p. – Name: Subject Label: Subjects Group: Su Data: <searchLink fieldCode="DE" term="%22Data+quality%22">Data quality</searchLink><br /><searchLink fieldCode="DE" term="%22Geospatial+data%22">Geospatial data</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluation+methodology%22">Evaluation methodology</searchLink><br /><searchLink fieldCode="DE" term="%22Urban+research%22">Urban research</searchLink><br /><searchLink fieldCode="DE" term="%22Statistical+accuracy%22">Statistical accuracy</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: Highlights: What are the main findings? Open-access building footprint datasets generally underestimate building count and area; object recovery and spatial agreement remain limited, while matched-pair morphology fidelity varies substantially. No product led all three tiers: GABLE ranked highest in statistical consistency, Microsoft Global ML Building Footprints in object recovery and spatial fidelity, and Google Research Open Buildings in matched-pair morphology fidelity within the evaluated coverage. What are the implications of the main findings? Local validation is advisable when reliable completeness, positional accuracy, or boundary fidelity is required. Tier-specific rankings support selection of the most suitable available product for a given region and application. The rapid proliferation of open-access vector building footprint datasets has created substantial opportunities for large-scale urban analysis, yet their reliability remains difficult to assess effectively and consistently. This challenge arises primarily from the scarcity of large-scale, high-fidelity reference benchmarks across diverse urban environments. To address these limitations, we construct a benchmark-grade reference dataset comprising over 200,000 manually annotated building footprints across 10 purposively selected cities across diverse global regions through an exhaustive curation campaign and strict manual-automated quality validation. Using this dataset, we develop a three-tier evaluation framework that assesses statistical consistency, object recovery and spatial accuracy, and morphology fidelity among matched building pairs. Evaluating 11 mainstream datasets reveals pervasive underestimation in both building area (average bias: −14.9%) and count (−34.0%). Average city-level intersection-over-union values range from 29.1% to 58.3%, indicating low-to-moderate spatial overlap. For matched building pairs, the datasets demonstrate relatively high geometric fidelity, with morphological similarity scores of 0.495 to 0.803. Pronounced regional performance variations indicate that no single dataset is universally optimal. Specifically, Microsoft Global ML Building Footprints offers the most balanced multi-city performance, Google Research Open Buildings is recommended for boundary shape fidelity, and regional datasets remain competitive for local analyses. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Remote Sensing is the property of MDPI and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=197043745 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.3390/rs18172895 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 31 StartPage: 2895 Subjects: – SubjectFull: Data quality Type: general – SubjectFull: Geospatial data Type: general – SubjectFull: Evaluation methodology Type: general – SubjectFull: Urban research Type: general – SubjectFull: Statistical accuracy Type: general Titles: – TitleFull: Benchmarking Open-Access Building Footprints: A Multi-Dimensional Assessment with High-Fidelity References. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Zhou, Taiqing – PersonEntity: Name: NameFull: Liao, Yifan – PersonEntity: Name: NameFull: Gan, Wenxiang – PersonEntity: Name: NameFull: Chen, Zhijie – PersonEntity: Name: NameFull: Li, Chuchu – PersonEntity: Name: NameFull: Zhao, Geyi – PersonEntity: Name: NameFull: Chen, Qi – PersonEntity: Name: NameFull: Xue, Qian – PersonEntity: Name: NameFull: Tao, Pengjie IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 09 Text: Sep2026 Type: published Y: 2026 Identifiers: – Type: issn-print Value: 20724292 Numbering: – Type: volume Value: 18 – Type: issue Value: 17 Titles: – TitleFull: Remote Sensing Type: main |
| ResultId | 1 |