Browse by author
Lookup NU author(s): Teck CHAN, Professor Cheng Chin
This work is licensed under a Creative Commons Attribution 4.0 International License (CC BY 4.0).
In this paper, a fusion of unsupervised clustering and incremental similarity tracking of hourly water demand series is proposed. Current research using unsupervised methodologies to detect anomalous water is limited and may possess several limitations such as a large amount of dataset, the need to select an optimal cluster number, or low detection accuracy. Our proposed approach aims to address the need for a large amount of dataset by detecting anomaly through (1) clustering points that are relatively similar at each time step, (2) clustering points at each time step by the similarity in how they vary from each time step, and (3) to compare the incoming points with a reference shape for online anomalous trend detection. Secondly, through the use of Bayesian nonparametric approach such as the Dirichlet Process Mixture Model, the need to choose an optimal cluster number is eliminated and provides a subtle solution for ‘reserving’ an empty cluster for the future anomaly. Among the 165 randomly generated anomalies, the proposed approach detected a total of 159 anomalies and other anomalous trends present in the data. As the data is unlabeled, identified anomalous trends cannot be verified. However, results show great potential in using minimally unlabeled water demand data for a preliminary anomaly detection.
Author(s): Chan TK, Chin CS
Publication type: Article
Publication status: Published
Journal: Water
Year: 2019
Volume: 11
Issue: 10
Online publication date: 03/10/2019
Acceptance date: 30/09/2019
Date deposited: 21/10/2019
ISSN (print): 2073-4441
ISSN (electronic): 2073-4441
Publisher: MDPI
URL: https://doi.org/10.3390/w11102066
DOI: 10.3390/w11102066
Altmetrics provided by Altmetric
