Journal cover Journal topic
Hydrology and Earth System Sciences An interactive open-access journal of the European Geosciences Union
Journal topic

Journal metrics

Journal metrics

  • IF value: 4.936 IF 4.936
  • IF 5-year value: 5.615 IF 5-year
    5.615
  • CiteScore value: 4.94 CiteScore
    4.94
  • SNIP value: 1.612 SNIP 1.612
  • IPP value: 4.70 IPP 4.70
  • SJR value: 2.134 SJR 2.134
  • Scimago H <br class='hide-on-tablet hide-on-mobile'>index value: 107 Scimago H
    index 107
  • h5-index value: 63 h5-index 63
Discussion papers
https://doi.org/10.5194/hess-2019-196
© Author(s) 2019. This work is distributed under
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/hess-2019-196
© Author(s) 2019. This work is distributed under
the Creative Commons Attribution 4.0 License.

Submitted as: research article 16 May 2019

Submitted as: research article | 16 May 2019

Review status
This discussion paper is a preprint. It is a manuscript under review for the journal Hydrology and Earth System Sciences (HESS).

Using Deep Learning to Fill Spatio-Temporal Data Gaps in Hydrological Monitoring Networks

Huiying Ren1, Erol Cromwell2, Ben Kravitz3,4, and Xingyuan Chen4 Huiying Ren et al.
  • 1Earth Systems Science Division, Pacific Northwest National Laboratory, WA, USA
  • 2Advanced Computing, Mathematics, and Data Division, Pacific Northwest National Laboratory, WA, USA
  • 3Department of Earth and Atmospheric Sciences, Indiana University, Bloomington, IN, USA
  • 4Atmospheric Sciences and Global Change Division, Pacific Northwest National Laboratory, WA, USA

Abstract. Long-term spatio-temporal changes in subsurface hydrological flow are usually quantified through a network of wells; however, such observations often are spatially sparse and temporal gaps exist due to poor quality or instrument failure. In this study, we explore the ability of deep neural networks to fill in gaps in spatially distributed time-series data. We selected a location at the U.S. Department of Energy's Hanford site to demonstrate and evaluate the new method, using a 10-year spatio-temporal hydrological dataset of temperature, specific conductance, and groundwater table elevation from 42 wells that monitor the dynamic and heterogeneous hydrologic exchanges between the Columbia River and its adjacent groundwater aquifer. We employ a long short-term memory (LSTM)-based architecture, which is specially designed to address both spatial and temporal variations in the property fields. The performance of gap filling using an LSTM framework is evaluated using test datasets with synthetic data gaps created by assuming the observations were missing for a given time window (i.e., gap length), such that the mean absolute percentage error can be calculated against true observations. Such test datasets also allow us to examine how well the original nonlinear dynamics are captured in gap-filled time series beyond the error statistics. The performance of the LSTM-based gap-filling method is compared to that of a traditional, popular gap-filling method: autoregressive integrated moving average (ARIMA). Although ARIMA appears to perform slightly better than LSTM on average error statistics, LSTM is better able to capture nonlinear dynamics that are present in time series. Thus, LSTMs show promising potential to outperform ARIMA for gap filling in highly dynamic time-series observations characterized by multiple dominant modes of variability. Capturing such dynamics is essential to generate the most valuable observations to advance our understanding of dynamic complex systems.

Huiying Ren et al.
Interactive discussion
Status: open (until 23 Sep 2019)
Status: open (until 23 Sep 2019)
AC: Author comment | RC: Referee comment | SC: Short comment | EC: Editor comment
[Subscribe to comment alert] Printer-friendly Version - Printer-friendly version Supplement - Supplement
Huiying Ren et al.
Huiying Ren et al.
Viewed  
Total article views: 356 (including HTML, PDF, and XML)
HTML PDF XML Total Supplement BibTeX EndNote
257 98 1 356 17 5 5
  • HTML: 257
  • PDF: 98
  • XML: 1
  • Total: 356
  • Supplement: 17
  • BibTeX: 5
  • EndNote: 5
Views and downloads (calculated since 16 May 2019)
Cumulative views and downloads (calculated since 16 May 2019)
Viewed (geographical distribution)  
Total article views: 291 (including HTML, PDF, and XML) Thereof 288 with geography defined and 3 with unknown origin.
Country # Views %
  • 1
1
 
 
 
 
Cited  
Saved  
No saved metrics found.
Discussed  
No discussed metrics found.
Latest update: 20 Aug 2019
Publications Copernicus
Download
Short summary
We used a deep learning method called Long Short-Term Memory (LSTM) to fill gaps in data collected by hydrologic monitoring networks. LSTM accounted for correlations in space and time and nonlinear trends in data. Compared to a traditional regression based time series method, LSTM performed comparably when filling gaps in data with smooth patterns, while it better captured highly dynamic patterns in data . Capturing such dynamics is critical for understanding dynamic complex system behaviors.
We used a deep learning method called Long Short-Term Memory (LSTM) to fill gaps in data...
Citation