Curtin University Homepage
  • Library
  • Help
    • Admin

    espace - Curtin’s institutional repository

    JavaScript is disabled for your browser. Some features of this site may not work without it.
    View Item 
    • espace Home
    • espace
    • Curtin Research Publications
    • View Item
    • espace Home
    • espace
    • Curtin Research Publications
    • View Item

    LS-ADT: Lightweight and scalable anomaly detection for cloud datacentres

    Access Status
    Fulltext not available
    Authors
    Barbhuiya, Salim
    Papazachos, Z.
    Kilpatrick, P.
    Nikolopoulos, D.
    Date
    2016
    Type
    Conference Paper
    
    Metadata
    Show full item record
    Citation
    Barbhuiya, S. and Papazachos, Z. and Kilpatrick, P. and Nikolopoulos, D. 2016. LS-ADT: Lightweight and scalable anomaly detection for cloud datacentres, pp. 135-152.
    Source Title
    Communications in Computer and Information Science
    DOI
    10.1007/978-3-319-29582-4_8
    ISBN
    9783319295817
    School
    Department of Civil Engineering
    URI
    http://hdl.handle.net/20.500.11937/55175
    Collection
    • Curtin Research Publications
    Abstract

    © Springer International Publishing Switzerland 2016. Cloud data centres are implemented as large-scale clusters with demanding requirements for service performance, availability and cost of operation. As a result of scale and complexity, data centres typically exhibit large numbers of system anomalies resulting from operator error, resource over/under provisioning, hardware or software failures and security issus anomalies are inherently difficult to identify and resolve promptly via human inspection. Therefore, it is vital in a cloud system to have automatic system monitoring that detects potential anomalies and identifies their source. In this paper we present a lightweight anomaly detection tool for Cloud data centres which combines extended log analysis and rigorous correlation of system metrics, implemented by an efficient correlation algorithm which does not require training or complex infrastructure set up. The LADT algorithm is based on the premise that there is a strong correlation between node level and VM level metrics in a cloud system. This correlation will drop significantly in the event of any performance anomaly at the node-level and a continuous drop in the correlation can indicate the presence of a true anomaly in the node. The log analysis of LADT assists in determining whether the correlation drop could be caused by naturally occurring cloud management activity such as VM migration, creation, suspension, termination or resizing. In this way, any potential anomaly alerts are reasoned about to prevent false positives that could be caused by the cloud operator’s activity. We demonstrate LADT with log analysis in a Cloud environment to show how the log analysis is combined with the correlation of systems metrics to achieve accurate anomaly detection.

    Related items

    Showing items related by title, author, creator and subject.

    • A lightweight tool for anomaly detection in cloud data centres
      Barbhuiya, Salim; Papazachos, Z.; Kilpatrick, P.; Nikolopoulos, D. (2015)
      Cloud data centres are critical business infrastructures and the fastest growing service providers. Detecting anomalies in Cloud data centre operation is vital. Given the vast complexity of the data centre system software ...
    • Explaining anomalies in coal proximity and coal processing data with Shapley and tree-based models
      Liu, Xiu ; Aldrich, Chris (2022)
      Modelling the characteristics and composition of coal is important, as proximity data and other measurements to do so are typically expensive or hard to acquire in real-time. Understanding anomalies in these relatively ...
    • A spatially weighted singularity mapping method applied to identify epithermal Ag and Pb-Zn polymetallic mineralization associated geochemical anomaly in Northwest Zhejiang, China
      Xiao, F.; Chen, J.; Hou, W.; Wang, Z.; Zhou, Y.; Erten, Oktay (2016)
      The ordinary singularity mapping (OSM) approach utilizing regular square window and ignoring the representativeness of geochemical samples may not characterize the anisotropic geochemical anomaly features. To overcome the ...
    Advanced search

    Browse

    Communities & CollectionsIssue DateAuthorTitleSubjectDocument TypeThis CollectionIssue DateAuthorTitleSubjectDocument Type

    My Account

    Admin

    Statistics

    Most Popular ItemsStatistics by CountryMost Popular Authors

    Follow Curtin

    • 
    • 
    • 
    • 
    • 

    CRICOS Provider Code: 00301JABN: 99 143 842 569TEQSA: PRV12158

    Copyright | Disclaimer | Privacy statement | Accessibility

    Curtin would like to pay respect to the Aboriginal and Torres Strait Islander members of our community by acknowledging the traditional owners of the land on which the Perth campus is located, the Whadjuk people of the Nyungar Nation; and on our Kalgoorlie campus, the Wongutha people of the North-Eastern Goldfields.