Effective Anomaly detection in Sensor Network Data Streams
MetadataShow full item record
This paper addresses a major challenge in datamining applications where the full information about the underlying processes, such as sensor networks or large online database, cannot be practically obtained due to physical limitations such as low bandwidth or memory, storage, or computing power. Motivated by the recent theory on direct information sampling called compressed sensing (CS), we propose a framework for detecting anomalies from these large scale data mining applications where the full information is not practically possible to obtain. Exploiting the fact that the intrinsic dimension of the data in these applications are typically small relative to the raw dimension and the fact that compressed sensing is capable of capturing most information with few measurements, our work show that spectral methods that used for volume anomaly detection can be directly applied to the CS data with guarantee on performance. Our theoretical contributions are supported by extensive experimental results on large datasets which show satisfactory performance.
Copyright © 2009 IEEE This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.
Showing items related by title, author, creator and subject.
Chenrai, Piyaphong (2008)The Comet Gold Mine is in the Murchison mineral field which lies within the Yilgarn Craton of Western Australia. Several different geophysical methods were used in this study to define the geophysical signatures of ...
Application of the continuous wavelet transform on seismic data for mapping of channel deposits and gas detection at the CO<inf>2</inf> SINK site, Ketzin, GermanyKazemeini, S.; Juhlin, Christopher; Zinck-Jørgensen, K.; Norden, B. (2009)Conventional seismic data are band limited and therefore, provide limited geological information. Every method that can push the limits is desirable for seismic data analysis. Recently, time-frequency decomposition methods ...
Pham, DucSon; Saha, Budhaditya; Phung, Dinh; Venkatesh, Svetha (2012)The data deluge has created a great challenge for data mining applications wherein the rare topics of interest are often buried in the flood of major headlines. We identify and formulate a novel problem: cross-channel ...