Benchmarking Open-Access Building Footprints: A Multi-Dimensional Assessment with High-Fidelity References.

Saved in:
Bibliographic Details
Title: Benchmarking Open-Access Building Footprints: A Multi-Dimensional Assessment with High-Fidelity References.
Authors: Zhou, Taiqing1 (AUTHOR), Liao, Yifan1,2 (AUTHOR) liaoyifan01@whu.edu.cn, Gan, Wenxiang1,3 (AUTHOR), Chen, Zhijie2,4 (AUTHOR), Li, Chuchu1,2 (AUTHOR), Zhao, Geyi2 (AUTHOR), Chen, Qi2,3 (AUTHOR), Xue, Qian4 (AUTHOR), Tao, Pengjie1 (AUTHOR)
Source: Remote Sensing. Sep2026, Vol. 18 Issue 17, p2895. 31p.
Subjects: Data quality, Geospatial data, Evaluation methodology, Urban research, Statistical accuracy
Abstract: Highlights: What are the main findings? Open-access building footprint datasets generally underestimate building count and area; object recovery and spatial agreement remain limited, while matched-pair morphology fidelity varies substantially. No product led all three tiers: GABLE ranked highest in statistical consistency, Microsoft Global ML Building Footprints in object recovery and spatial fidelity, and Google Research Open Buildings in matched-pair morphology fidelity within the evaluated coverage. What are the implications of the main findings? Local validation is advisable when reliable completeness, positional accuracy, or boundary fidelity is required. Tier-specific rankings support selection of the most suitable available product for a given region and application. The rapid proliferation of open-access vector building footprint datasets has created substantial opportunities for large-scale urban analysis, yet their reliability remains difficult to assess effectively and consistently. This challenge arises primarily from the scarcity of large-scale, high-fidelity reference benchmarks across diverse urban environments. To address these limitations, we construct a benchmark-grade reference dataset comprising over 200,000 manually annotated building footprints across 10 purposively selected cities across diverse global regions through an exhaustive curation campaign and strict manual-automated quality validation. Using this dataset, we develop a three-tier evaluation framework that assesses statistical consistency, object recovery and spatial accuracy, and morphology fidelity among matched building pairs. Evaluating 11 mainstream datasets reveals pervasive underestimation in both building area (average bias: −14.9%) and count (−34.0%). Average city-level intersection-over-union values range from 29.1% to 58.3%, indicating low-to-moderate spatial overlap. For matched building pairs, the datasets demonstrate relatively high geometric fidelity, with morphological similarity scores of 0.495 to 0.803. Pronounced regional performance variations indicate that no single dataset is universally optimal. Specifically, Microsoft Global ML Building Footprints offers the most balanced multi-city performance, Google Research Open Buildings is recommended for boundary shape fidelity, and regional datasets remain competitive for local analyses. [ABSTRACT FROM AUTHOR]
Copyright of Remote Sensing is the property of MDPI and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: egs
DbLabel: Engineering Source
An: 197043745
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Benchmarking Open-Access Building Footprints: A Multi-Dimensional Assessment with High-Fidelity References.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Zhou%2C+Taiqing%22">Zhou, Taiqing</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Liao%2C+Yifan%22">Liao, Yifan</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<i> liaoyifan01@whu.edu.cn</i><br /><searchLink fieldCode="AR" term="%22Gan%2C+Wenxiang%22">Gan, Wenxiang</searchLink><relatesTo>1,3</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Chen%2C+Zhijie%22">Chen, Zhijie</searchLink><relatesTo>2,4</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Li%2C+Chuchu%22">Li, Chuchu</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Zhao%2C+Geyi%22">Zhao, Geyi</searchLink><relatesTo>2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Chen%2C+Qi%22">Chen, Qi</searchLink><relatesTo>2,3</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Xue%2C+Qian%22">Xue, Qian</searchLink><relatesTo>4</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Tao%2C+Pengjie%22">Tao, Pengjie</searchLink><relatesTo>1</relatesTo> (AUTHOR)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Remote+Sensing%22">Remote Sensing</searchLink>. Sep2026, Vol. 18 Issue 17, p2895. 31p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Data+quality%22">Data quality</searchLink><br /><searchLink fieldCode="DE" term="%22Geospatial+data%22">Geospatial data</searchLink><br /><searchLink fieldCode="DE" term="%22Evaluation+methodology%22">Evaluation methodology</searchLink><br /><searchLink fieldCode="DE" term="%22Urban+research%22">Urban research</searchLink><br /><searchLink fieldCode="DE" term="%22Statistical+accuracy%22">Statistical accuracy</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Highlights: What are the main findings? Open-access building footprint datasets generally underestimate building count and area; object recovery and spatial agreement remain limited, while matched-pair morphology fidelity varies substantially. No product led all three tiers: GABLE ranked highest in statistical consistency, Microsoft Global ML Building Footprints in object recovery and spatial fidelity, and Google Research Open Buildings in matched-pair morphology fidelity within the evaluated coverage. What are the implications of the main findings? Local validation is advisable when reliable completeness, positional accuracy, or boundary fidelity is required. Tier-specific rankings support selection of the most suitable available product for a given region and application. The rapid proliferation of open-access vector building footprint datasets has created substantial opportunities for large-scale urban analysis, yet their reliability remains difficult to assess effectively and consistently. This challenge arises primarily from the scarcity of large-scale, high-fidelity reference benchmarks across diverse urban environments. To address these limitations, we construct a benchmark-grade reference dataset comprising over 200,000 manually annotated building footprints across 10 purposively selected cities across diverse global regions through an exhaustive curation campaign and strict manual-automated quality validation. Using this dataset, we develop a three-tier evaluation framework that assesses statistical consistency, object recovery and spatial accuracy, and morphology fidelity among matched building pairs. Evaluating 11 mainstream datasets reveals pervasive underestimation in both building area (average bias: −14.9%) and count (−34.0%). Average city-level intersection-over-union values range from 29.1% to 58.3%, indicating low-to-moderate spatial overlap. For matched building pairs, the datasets demonstrate relatively high geometric fidelity, with morphological similarity scores of 0.495 to 0.803. Pronounced regional performance variations indicate that no single dataset is universally optimal. Specifically, Microsoft Global ML Building Footprints offers the most balanced multi-city performance, Google Research Open Buildings is recommended for boundary shape fidelity, and regional datasets remain competitive for local analyses. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Remote Sensing is the property of MDPI and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=197043745
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.3390/rs18172895
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 31
        StartPage: 2895
    Subjects:
      – SubjectFull: Data quality
        Type: general
      – SubjectFull: Geospatial data
        Type: general
      – SubjectFull: Evaluation methodology
        Type: general
      – SubjectFull: Urban research
        Type: general
      – SubjectFull: Statistical accuracy
        Type: general
    Titles:
      – TitleFull: Benchmarking Open-Access Building Footprints: A Multi-Dimensional Assessment with High-Fidelity References.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Zhou, Taiqing
      – PersonEntity:
          Name:
            NameFull: Liao, Yifan
      – PersonEntity:
          Name:
            NameFull: Gan, Wenxiang
      – PersonEntity:
          Name:
            NameFull: Chen, Zhijie
      – PersonEntity:
          Name:
            NameFull: Li, Chuchu
      – PersonEntity:
          Name:
            NameFull: Zhao, Geyi
      – PersonEntity:
          Name:
            NameFull: Chen, Qi
      – PersonEntity:
          Name:
            NameFull: Xue, Qian
      – PersonEntity:
          Name:
            NameFull: Tao, Pengjie
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 09
              Text: Sep2026
              Type: published
              Y: 2026
          Identifiers:
            – Type: issn-print
              Value: 20724292
          Numbering:
            – Type: volume
              Value: 18
            – Type: issue
              Value: 17
          Titles:
            – TitleFull: Remote Sensing
              Type: main
ResultId 1