End-to-end Anomaly Detection, Correction and Prediction of Missing Values in Historical Daily Temperature Timeseries

Mitchel Alioscha-Perez, Meshia Cédric Oveneke, Abel Diaz Berenguer, Cédric BERTRAND, Hichem Sahli

Research output: Chapter in Book/Report/Conference proceedingConference paper

Abstract

In this paper, we present a deep learning solution to detect and correct anomalous values present in historical temperature timeseries, that are likely associated to human and weather instruments errors. Our solution consists in a joint peaks detection and end-to-end sequence prediction involving synchronous measurements of individual meteorological stations along with their neighboring peers. We designed our models in a way that the false positive rate (FPR) of the anomaly detection is minimized and the accuracy maximized, so that the historical records are corrected as less as possible. The method was applied to temperature records of 24 meteorological stations in Belgium, and allowed to automatically correct more than 80% of all errors in both max/min daily temperature records by modifying less than 15% of all the timeseries values, with an overall detection accuracy of 90%. The corrected temperature timeseries yielded a perfect match with respect to errors-free signals in several climate indicators. Our method can be potentially applied to other historical timeseries such as precipitation.

Original languageEnglish
Title of host publicationProceedings of the 31st Benelux Conference on Artificial Intelligence (BNAIC2019) and the 28th Belgian Dutch Conference on Machine Learning (Benelearn2019)
PublisherCEUR Workshop Proceedings
Pages1-2
Number of pages2
Volume2491
Publication statusPublished - 7 Nov 2019
EventBNAIC 2019 - Brussels, Belgium
Duration: 7 Nov 20198 Nov 2019

Publication series

NameCEUR Workshop Proceedings
PublisherRWTH Aachen
ISSN (Print)1613-0073

Conference

ConferenceBNAIC 2019
CountryBelgium
CityBrussels
Period7/11/198/11/19

Fingerprint

Dive into the research topics of 'End-to-end Anomaly Detection, Correction and Prediction of Missing Values in Historical Daily Temperature Timeseries'. Together they form a unique fingerprint.

Cite this