Toggle Main Menu Toggle Search

Open Access padlockePrints

Unsupervised Bayesian Nonparametric Approach with Incremental Similarity Tracking of Unlabeled Water Demand Time Series for Anomaly Detection

Lookup NU author(s): Teck CHAN, Professor Cheng Chin

Downloads


Licence

This work is licensed under a Creative Commons Attribution 4.0 International License (CC BY 4.0).


Abstract

In this paper, a fusion of unsupervised clustering and incremental similarity tracking of hourly water demand series is proposed. Current research using unsupervised methodologies to detect anomalous water is limited and may possess several limitations such as a large amount of dataset, the need to select an optimal cluster number, or low detection accuracy. Our proposed approach aims to address the need for a large amount of dataset by detecting anomaly through (1) clustering points that are relatively similar at each time step, (2) clustering points at each time step by the similarity in how they vary from each time step, and (3) to compare the incoming points with a reference shape for online anomalous trend detection. Secondly, through the use of Bayesian nonparametric approach such as the Dirichlet Process Mixture Model, the need to choose an optimal cluster number is eliminated and provides a subtle solution for ‘reserving’ an empty cluster for the future anomaly. Among the 165 randomly generated anomalies, the proposed approach detected a total of 159 anomalies and other anomalous trends present in the data. As the data is unlabeled, identified anomalous trends cannot be verified. However, results show great potential in using minimally unlabeled water demand data for a preliminary anomaly detection.


Publication metadata

Author(s): Chan TK, Chin CS

Publication type: Article

Publication status: Published

Journal: Water

Year: 2019

Volume: 11

Issue: 10

Online publication date: 03/10/2019

Acceptance date: 30/09/2019

Date deposited: 21/10/2019

ISSN (print): 2073-4441

ISSN (electronic): 2073-4441

Publisher: MDPI

URL: https://doi.org/10.3390/w11102066

DOI: 10.3390/w11102066


Altmetrics

Altmetrics provided by Altmetric


Share