SCALE-SELECTIVE VALIDATION OF MORPHODYNAMIC MODELS
ICCE 2014 Cover Image
PDF

Keywords

morphodynamic modelling
model validation
spatial scales
local statistics
skill

How to Cite

Bosboom, J., & Reniers, A. (2014). SCALE-SELECTIVE VALIDATION OF MORPHODYNAMIC MODELS. Coastal Engineering Proceedings, 1(34), sediment.75. https://doi.org/10.9753/icce.v34.sediment.75

Abstract

Although it is generally acknowledged that the practical predictability at smaller scales may be limited, output of high-resolution morphodynamic area models is mostly presented at the resolution of the computational grid. The so- presented fields typically are realistic looking, but not necessarily of similar quality at all spatial scales. Unfortunately, commonly used single-number validation measures do not provide the necessary guidance as to which scales in the output can be considered skilful. Also, differences in skill throughout the model domain cannot be discerned. Here, we present a new, scale-selective validation method for 2D morphological predictions that provides information on the variation of model skill with spatial scale and within the model domain. The employed skill score weighs how well the morphological structure and variability are simulated, while avoiding the double penalty effect by which point-wise accuracy metrics tend to reward the underestimation of variability. The method enables us to tailor model validation to the study objectives and scales of interest, establish the resolution at which results are ideally presented and target model development specifically at certain morphological scales.
https://doi.org/10.9753/icce.v34.sediment.75
PDF

References

Achete, F.M., A.P. Luijendijk, P.K. Tonnon, M.J.F. Stive, M.A. de Schipper. 2011. Morphodynamics of the Ameland Bornrif: an analogue for the Sand Engine, MSc thesis TU Delft. http://resolver.tudelft.nl/uuid:76aabdcf-c3da-4a45-9720-39d2702e5c29.

Bosboom, J. and A.J.H.M. Reniers. 2014. Displacement-based error metrics for morphodynamic models. Advances in Geosciences, 39, 37-43. http://dx.doi.org/10.5194/adgeo-39-37-2014.

Bosboom, J., A.J.H.M. Reniers, and A.P. Luijendijk. In press. On the perception of morphodynamic model skill, accepted for publication in Coastal Engineering. http://dx.doi.org/10.1016/j.coastaleng.2014.08.008.

Fotheringham A.S., C. Brunsdon C., and M. Charlton. 2002. Geographically weighted regression: the analysis of spatially varying relationships, Wiley, New York, 284 pp.

Gilleland, E. , D.A. Ahijevych, B.G. Brown, and E.E. Ebert. 2010. Verifying Forecasts Spatially, Bulletin of the American Meteorological Society, 91, 1365-1373.

http://dx.doi.org/10.1175/2010BAMS2819.1.

Koh, T.Y., S. Wang, and B.C. Bhatt. 2012. A diagnostic suite to assess NWP performance, J. Geophysical Research, 117, D13109. http://dx.doi.org./10.1029/2011JD017103.

Roberts, N.M and H.W. Lean. 2008. Scale-selective verification of rainfall accumulations from high-resolution forecasts of convective events. Monthly Weather Review, 136.1, 78-97. http://dx.doi.org/10.1175/2007MWR2123.1.

Sutherland J., A.H. Peet, and R.L. Soulsby. 2004.

Evaluating the performance of morphological models, Coastal Engineering, 51, 917-939. http://dx.doi.org/10.1016/j.coastaleng.2004.07.015.

Taylor, K.E. 2001. Summarizing multiple aspects of model performance in a single diagram, J. Geophysical Research: Atmospheres, 106, 7183-7192. http://dx.doi.org/10.1029/2000JD900719.

Wang, Z., E.P. Simoncelli, and A.C. Bovik. 2004. Multiscale structural similarity for image quality assessment, Proceedings of the 37th Conference on Signals, Systems and Computers, 2003, 2, 1398-1402. http://dx.doi.org/10.1109/ACSSC.2003.1292216.

Authors retain copyright and grant the Proceedings right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this Proceedings.