Open this publication in new window or tab >>Show others...
2016 (English)In: 2016 16th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid), IEEE, 2016Conference paper, Published paper (Refereed)
Abstract [en]
In large scale data centers, a single fault can lead to correlated failures of several physical machines and the tasks running on them, simultaneously. Such correlated failures can severely damage the reliability of a service or a job running on the failed hardware. This paper models the impact of stochastic and correlated failures on job reliability in a data center. We focus on correlated failures caused by power outages or failures of network components, on jobs running multiple replicas of identical tasks. We present a statistical reliability model and an approximation technique for computing a job’s reliability in the presence of correlated failures. In addition, we address the problem of scheduling a job with reliability constraints.We formulate the scheduling problem as an optimization problem, with the aim being to maintain the desired reliability with the minimum number of extra tasks to resist failures.We present a scheduling algorithm that approximates the minimum number of required tasks and a placement to achieve a desired job reliability. We study the efficiency of our algorithm using an analytical approach and by simulating a cluster with different failure sources and reliabilities. The results show that the algorithm can effectively approximate the minimum number of extra tasks required to achieve the job’s reliability.
Place, publisher, year, edition, pages
IEEE, 2016
Keywords
Cloud computing, Scheduling; Reliability, Fault tolerance, Correlated failures
National Category
Computer Sciences
Research subject
Computer Science
Identifiers
urn:nbn:se:umu:diva-116791 (URN)10.1109/CCGrid.2016.11 (DOI)2-s2.0-84979776469 (Scopus ID)
Conference
16th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID), Cartagena, Colombia, May 16-19, 2016
Note
Originally published in manuscript form.
2016-02-112016-02-112023-03-23Bibliographically approved