Change search
ReferencesLink to record
Permanent link

Direct link
Workload prediction for resource management in data centers
Umeå University, Faculty of Science and Technology, Department of Computing Science.
2016 (English)Independent thesis Advanced level (degree of Master (One Year)), 10 credits / 15 HE creditsStudent thesis
Abstract [en]

Resource management is to arrange and allocate resources for computing operations and applications. In large scale data centers that contain thousands of servers, resource management is critical for efficient operation. To know workload characteristics in advance helps us proactively control resources in data centers, leading to benefits such as power savings and improved service performance. Workload prediction can be used, e.g., to decide how many resources to allocate for each application in a data center in the future. The accuracy of workload prediction varies depending on the used prediction methods and the characteristics of the workload. In this thesis work, we investigate three different methods: Linear Regression (LR), Adaptive Neuro-Fuzzy Inference Systems (ANFIS), and Nonlinear Autoregressive Network with Exogenous Inputs (NARX). These methods are used to build models of resource consumption such as memory, CPU, and disk. Based on these models, future workload resource usage is predicted, and the accuracy of prediction is assessed. We analyze a trace from a production cluster at Google, predict resource consumption for different time intervals, and compute the error between predicted and actual values. The results show that NARX gives higher accuracy than ANFIS and LR when forecasting one-step ahead prediction, and that the ANFIS method provides the best result with multi-step ahead prediction compared to the others. Finally, time to train and re-train LR, ANFIS and NARX are computed. The running times are short, suggesting that the methods can be used in real-time operation.

Place, publisher, year, edition, pages
2016. , 42 p.
, UMNAD, 1051
National Category
Engineering and Technology
URN: urn:nbn:se:umu:diva-124985OAI: diva2:957163
Educational program
Master's Programme in Computational Science and Engineering
Available from: 2016-09-01 Created: 2016-09-01 Last updated: 2016-09-01Bibliographically approved

Open Access in DiVA

fulltext(1362 kB)46 downloads
File information
File name FULLTEXT01.pdfFile size 1362 kBChecksum SHA-512
Type fulltextMimetype application/pdf

By organisation
Department of Computing Science
Engineering and Technology

Search outside of DiVA

GoogleGoogle Scholar
Total: 46 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 97 hits
ReferencesLink to record
Permanent link

Direct link