umu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
An unsupervised approach to online noisy-neighbor detection in cloud data centers
University of Deusto.
University of Deusto.
Umeå University, Faculty of Science and Technology, Department of Computing Science. (Distributed Systems)
Umeå University, Faculty of Science and Technology, Department of Computing Science. (Distributed Systems)
Show others and affiliations
2017 (English)In: Expert systems with applications, ISSN 0957-4174, E-ISSN 1873-6793, Vol. 89, p. 188-204Article in journal (Refereed) Published
Abstract [en]

Resource sharing is an inherent characteristic of cloud data centers. Virtual Machines (VMs) and/or Containers that are co-located in the same physical server often compete for resources leading to interference. The noisy neighbor’s effect refers to an anomaly caused by a VM/container limiting resources accessed by another one. Our main contribution is an online, lightweight and application-agnostic solution for anomaly detection, that follows an unsupervised approach. It is based on comparing models for different lags: Dirichlet Process Gaussian Mixture Models to characterize the resource usage profile of the application, and distance measures to score the similarity among models. An alarm is raised when there is an abrupt change in short-term lag (i.e. high distance score for short-term models), while the long-term state remains constant. We test the algorithm for different cloud workloads: websites, periodic batch applications, Spark-based applications, and Memcached server. We are able to detect anomalies in the CPU and memory resource usage with up to 82–96% accuracy (recall) depending on the scenario. Compared to other baseline methods, our approach is able to detect anomalies successfully, while raising low number of false positives, even in the case of applications with unusual normal behavior (e.g. periodic). Experiments show that our proposed algorithm is a lightweight and effective solution to detect noisy neighbor effect without any historical info about the application, that could also be potentially applied to other kind of anomalies.

Place, publisher, year, edition, pages
Elsevier, 2017. Vol. 89, p. 188-204
Keywords [en]
Anomaly detection, Virtual machine, Cloud computing, DPGMM, Noisy-neighbor effect, Similarity distances
National Category
Other Computer and Information Science
Identifiers
URN: urn:nbn:se:umu:diva-138402DOI: 10.1016/j.eswa.2017.07.038ISI: 000411420200016OAI: oai:DiVA.org:umu-138402DiVA, id: diva2:1134987
Available from: 2017-08-22 Created: 2017-08-22 Last updated: 2018-06-09Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full text

Authority records BETA

Tomás, LuisTordsson, Johan

Search in DiVA

By author/editor
Tomás, LuisTordsson, Johan
By organisation
Department of Computing Science
In the same journal
Expert systems with applications
Other Computer and Information Science

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 167 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf