Journal of Applied Sciences ›› 2006, Vol. 24 ›› Issue (3): 256-261.

• Articles • Previous Articles     Next Articles

Detection and Repairing Method for Outliers over Data Streams

WANG Yong-li1,2, XU Hong-bing1, DONG Yi-sheng1, QIAN Jiang-bo1, LIU Xue-jun1   

  1. 1. Department of Computer Science & Engineering, Southeast University, Nanjing 210018, China;
    2. Department of Computer for Public Teaching, Jiamusi University, Jiamusi 154007, China
  • Received:2005-01-20 Revised:2005-05-24 Online:2006-05-31 Published:2006-05-31

Abstract: Outlier detection and repairing in a data stream environment are discussed.An online detection method for outliers over data streams, called amnesia Kalman filtering (AKF), is proposed.In order to identify outliers, an improved Kalman filter is applied with the amnesia factor to forecast data-value in the future times tamp. A novel online adaptive repairing method for outliers over data streams, called adaptive interpolating wavelet (AdaptiveIW), is then proposed.The AdaptiveIW applies a method of variable-resolution interpolation, named the interpolation wavelet with adaptive resolution, to repair outliers, which determines interpolation resolution based on the number of continuous outliers.It adapts to different requested precision for out lier repairing over evolving data streams very well.Experimental results on actual power load data show that this method can provide precise instantaneous detection and accurate repairing for outliers over data streams.

Key words: adaptive, data streams, outlier detection and repairing, Kalman filtering, interpolating wavelet

CLC Number: