Journal cover Journal topic
Hydrology and Earth System Sciences An interactive open-access journal of the European Geosciences Union
doi:10.5194/hess-2016-46
© Author(s) 2016. This work is distributed
under the Creative Commons Attribution 3.0 License.
Research article
15 Feb 2016
Review status
This discussion paper has been under review for the journal Hydrology and Earth System Sciences (HESS). A final paper in HESS is not foreseen.
Evaluating Hydrological Model Performance using Information Theory-based Metrics
Yakov A. Pachepsky1, Gonzalo Martinez2, Feng Pan3,4, Thorsten Wagener5, and Thomas Nicholson6 1USDA - ARS Environmental Microbial and Food Safety Laboratory, Beltsville, MD 20705, USA
2Department of Agronomy, University of Cordoba, 14071, Cordoba, Spain
3Department of Civil & Environmental Engineering, the University of Utah, Salt Lake City, UT 84112, USA
4Energy & Geoscience Institu te, the University of Utah, Salt Lake City, UT 84108, USA
5Department of Civil Engineering, University of Bristol, Bristol, UK
6Office of Regulatory Research, US Nuclear Regulatory Commission, Rockville, MD 20852, USA
Abstract. The accuracy-based model performance metrics not necessarily reflect the qualitative correspondence between simulated and measured streamflow time series. The objective of this work was to use the information theory-based metrics to see whether they can be used as complementary tool for hydrologic model evaluation and selection. We simulated 10-year streamflow time series in five watersheds located in Texas, North Carolina, Mississippi, and West Virginia. Eight model of different complexity were applied. The information theory based metrics were obtained after representing the time series as strings of symbols where different symbols corresponded to different quantiles of the probability distribution of streamflow. The symbol alphabet was used. Three metrics were computed for those strings – mean information gain that measures the randomness of the signal, effective measure complexity that characterizes predictability and fluctuation complexity that characterizes the presence of a pattern in the signal. The observed streamflow time series has smaller information content and larger complexity metrics than the precipitation time series. Watersheds served as information filters and and streamflow time series were less random and more complex than the ones of precipitation. This is reflected by the fact that the watershed acts as the information filter in the hydrologic conversion process from precipitation to streamflow. The Nash Sutcliffe efficiency metric increased as the complexity of models increased, but in many cases several model had this efficiency values not statistically significant from each other. In such cases, ranking models by the closeness of the information theory based parameters in simulated and measured streamflow time series can provide an additional criterion for the evaluation of hydrologic model performance.

Citation: Pachepsky, Y. A., Martinez, G., Pan, F., Wagener, T., and Nicholson, T.: Evaluating Hydrological Model Performance using Information Theory-based Metrics, Hydrol. Earth Syst. Sci. Discuss., doi:10.5194/hess-2016-46, 2016.
Yakov A. Pachepsky et al.
Yakov A. Pachepsky et al.

Viewed

Total article views: 383 (including HTML, PDF, and XML)

HTML PDF XML Total Supplement BibTeX EndNote
242 138 3 383 27 4 12

Views and downloads (calculated since 15 Feb 2016)

Cumulative views and downloads (calculated since 15 Feb 2016)

Saved

Discussed

Latest update: 24 Apr 2017
Publications Copernicus
Download
Short summary
Hydrological models are frequently evaluated in terms of their accuracy to predict observations. However, we noticed that such approaches could not fully reflect the differences in their ability to represent the patterns of the observations nor the differences between the abstractions assumed in the models. We showed that information theory-based metrics are very useful for that purpose and provide additional criterion to choose the most appropriate models for specific watershed characterisitcs.
Hydrological models are frequently evaluated in terms of their accuracy to predict observations....
Share