Machine learning approaches for anomaly detection of water quality on a real-world data set

Citations Over TimeTop 10% of 2019 papers

Abstract

Accurate detection of water quality changes is a crucial task of water companies. Water supply companies must provide safe drinking water. Nowadays in different areas, we find sensible sensors which monitor data during the time. Normally the data registered by the sensors contain a meaning, such as there can be any event. Sometimes the data are ill-understood and stating if there is an event which is difficult. This work represents the description of several approaches to identifying changes or anomalies occurring on water quality time series data. This work also discusses and proposes a solution to some challenges when dealing with time series data. The following models are applied to water quality data: logistic regression, linear discriminant analysis, support vector machines (SVM), artificial neural network (ANN), deep neural network (DNN), recurrent neural network (RNN) and long short-term memory (LSTM). The performance evaluation is conducted using F-score metric. A simulation study is conducted to check the performance of each algorithm using F-score. Solving imbalanced data is basically intentionally biasing the data to get interesting results instead of accurate results. The results show that all algorithms are vulnerable although SVM, ANN and logistic regressions tend to be a little less vulnerable, while DNN, RNN and LSTM are very vulnerable.

Related Papers

• → Classification using support vector machines with graded resolution(2005)31 cited
• → Discrimination of Apples Using Near Infrared Spectroscopy and Sorting Discriminant Analysis(2015)27 cited
• → The matrix form for weighted linear discriminant analysis and fractional linear discriminant analysis(2009)5 cited
• Enhanced Linear Discriminant Analysis Based on Canonical Correlation Analysis(2007)
• → Comparison of Linear Discriminant Analysis with Robust Linear Discriminant Analysis(2024)