Technical note: Benchmarking large-domain model performance under sampling uncertainty.
Saved in:
| Title: | Technical note: Benchmarking large-domain model performance under sampling uncertainty. |
|---|---|
| Authors: | Gründemann, Gaby J.1 (AUTHOR), Knoben, Wouter J. M.1 (AUTHOR) wouter.knoben@ucalgary.ca, Song, Yalan2 (AUTHOR), van Werkhoven, Katie3 (AUTHOR), Clark, Martyn P.1 (AUTHOR) |
| Source: | Hydrology & Earth System Sciences. 2026, Vol. 30 Issue 11, p3439-3453. 15p. |
| Subject Terms: | *Benchmark problems (Computer science), *Sampling errors, *Runoff, *Hydrologic models, *Model validation |
| Geographic Terms: | United States |
| Abstract: | Large-domain hydrologic modeling studies are becoming increasingly common. The evaluation of the resulting models is however often limited to the use of aggregated performance scores that show where model accuracy is higher and lower. Moreover, the inherent uncertainty in such scores (i.e., the sampling uncertainty), stemming from the choice of time periods used for their calculation, often remains unaccounted for. Here we use a collection of simple benchmarks whilst accounting for this sampling uncertainty to provide context for the performance scores of a large-domain hydrologic model. These benchmarks are simple ways of predicting the variable of interest and include, for example, the long-term daily mean flow, daily precipitation scaled by the average rainfall-runoff ratio, and a basic 2-parameter model that represents a catchment's diffusive response to precipitation inputs. Our test case consists of simulations from the National Water Model v3.0 for approximately 4900 basins across the United States. The benchmarks suggest that there are considerable constraints on the model's performance in approximately one-third of the basins used for model calibration and in approximately half of the basins where model parameters are regionalized. Sampling uncertainty has limited impact: in most basins the model is either clearly better or worse than the benchmarks, though numerous cases remain where sampling uncertainty makes it difficult to clearly distinguish between model and benchmark performance. The areas where the benchmarks outperform the model only partially overlap with areas where the model achieves lower performance scores, and this suggests that improvements may be possible in more regions than a first glance at model performance values may indicate. A key advantage of using these benchmarks is that they are easy and fast to compute, particularly compared to the cost of configuring and running the model. This makes benchmarking a valuable tool that can complement more detailed model evaluation techniques by quickly identifying areas that should be investigated more thoroughly. [ABSTRACT FROM AUTHOR] |
| Database: | Energy & Power Source |
|
Full text is not displayed to guests.
Login for full access.
|
|
| FullText | Links: – Type: pdflink Text: Availability: 1 |
|---|---|
| Header | DbId: enr DbLabel: Energy & Power Source An: 194731013 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Technical note: Benchmarking large-domain model performance under sampling uncertainty. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Gründemann%2C+Gaby J%2E%22">Gründemann, Gaby J.</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Knoben%2C+Wouter J%2E M%2E%22">Knoben, Wouter J. M.</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> wouter.knoben@ucalgary.ca</i><br /><searchLink fieldCode="AR" term="%22Song%2C+Yalan%22">Song, Yalan</searchLink><relatesTo>2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22van Werkhoven%2C+Katie%22">van Werkhoven, Katie</searchLink><relatesTo>3</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Clark%2C+Martyn P%2E%22">Clark, Martyn P.</searchLink><relatesTo>1</relatesTo> (AUTHOR) – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Hydrology+%26+Earth+System+Sciences%22">Hydrology & Earth System Sciences</searchLink>. 2026, Vol. 30 Issue 11, p3439-3453. 15p. – Name: Subject Label: Subject Terms Group: Su Data: *<searchLink fieldCode="DE" term="%22Benchmark+problems+%28Computer+science%29%22">Benchmark problems (Computer science)</searchLink><br />*<searchLink fieldCode="DE" term="%22Sampling+errors%22">Sampling errors</searchLink><br />*<searchLink fieldCode="DE" term="%22Runoff%22">Runoff</searchLink><br />*<searchLink fieldCode="DE" term="%22Hydrologic+models%22">Hydrologic models</searchLink><br />*<searchLink fieldCode="DE" term="%22Model+validation%22">Model validation</searchLink> – Name: SubjectGeographic Label: Geographic Terms Group: Su Data: <searchLink fieldCode="DE" term="%22United+States%22">United States</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: Large-domain hydrologic modeling studies are becoming increasingly common. The evaluation of the resulting models is however often limited to the use of aggregated performance scores that show where model accuracy is higher and lower. Moreover, the inherent uncertainty in such scores (i.e., the sampling uncertainty), stemming from the choice of time periods used for their calculation, often remains unaccounted for. Here we use a collection of simple benchmarks whilst accounting for this sampling uncertainty to provide context for the performance scores of a large-domain hydrologic model. These benchmarks are simple ways of predicting the variable of interest and include, for example, the long-term daily mean flow, daily precipitation scaled by the average rainfall-runoff ratio, and a basic 2-parameter model that represents a catchment's diffusive response to precipitation inputs. Our test case consists of simulations from the National Water Model v3.0 for approximately 4900 basins across the United States. The benchmarks suggest that there are considerable constraints on the model's performance in approximately one-third of the basins used for model calibration and in approximately half of the basins where model parameters are regionalized. Sampling uncertainty has limited impact: in most basins the model is either clearly better or worse than the benchmarks, though numerous cases remain where sampling uncertainty makes it difficult to clearly distinguish between model and benchmark performance. The areas where the benchmarks outperform the model only partially overlap with areas where the model achieves lower performance scores, and this suggests that improvements may be possible in more regions than a first glance at model performance values may indicate. A key advantage of using these benchmarks is that they are easy and fast to compute, particularly compared to the cost of configuring and running the model. This makes benchmarking a valuable tool that can complement more detailed model evaluation techniques by quickly identifying areas that should be investigated more thoroughly. [ABSTRACT FROM AUTHOR] |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=enr&AN=194731013 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.5194/hess-30-3439-2026 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 15 StartPage: 3439 Subjects: – SubjectFull: Benchmark problems (Computer science) Type: general – SubjectFull: Sampling errors Type: general – SubjectFull: Runoff Type: general – SubjectFull: Hydrologic models Type: general – SubjectFull: Model validation Type: general – SubjectFull: United States Type: general Titles: – TitleFull: Technical note: Benchmarking large-domain model performance under sampling uncertainty. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Gründemann, Gaby J. – PersonEntity: Name: NameFull: Knoben, Wouter J. M. – PersonEntity: Name: NameFull: Song, Yalan – PersonEntity: Name: NameFull: van Werkhoven, Katie – PersonEntity: Name: NameFull: Clark, Martyn P. IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 06 Text: 2026 Type: published Y: 2026 Identifiers: – Type: issn-print Value: 10275606 Numbering: – Type: volume Value: 30 – Type: issue Value: 11 Titles: – TitleFull: Hydrology & Earth System Sciences Type: main |
| ResultId | 1 |
