umu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Managing Resource Usage and Allocations in Multi-Cluster Clouds
Umeå University, Faculty of Science and Technology, Department of Computing Science. (Cloud and Grid Computing)
2013 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

 The emergence of large-scale Internet services has fueled a trend toward large-scale systems composed of geographically distributed clusters. Managing resource allocations and resource usage is an important task for such services.

Resource allocations and resource usage management mechanisms for services running across clusters play vital roles in the performance of the entire system, economical sustainability of the provider, and level of customers satisfaction provided by the system. However, when providing the utmost customer satisfaction the service provider ought to make sure not to over-commit resources beyond the agreed limit between the customer and the provider. Moreover, statistics of resources consumed by different services should be monitored and collected using an efficient mechanism with minimal overhead and interference on the system and the services. Thus, resource usage collection and allocations mechanisms should impose economical constraints to both sides, the customer and the cloud provider.

This thesis focuses on decentralized resource allocation and resource usage management for services running in multi cluster environments. Theoretical as well as experimental results indicate that our proposed approaches provide efficient management of resources for services running in a large-scale geographically distributed systems.

Place, publisher, year, edition, pages
Umeå: Umeå universitet , 2013. , 26 p.
Series
Report / UMINF, ISSN 0348-0542 ; 13.16
National Category
Engineering and Technology Computer Science
Research subject
Computer Science
Identifiers
URN: urn:nbn:se:umu:diva-87580ISBN: 978-91-7459-687-8 (print)OAI: oai:DiVA.org:umu-87580DiVA: diva2:710096
Presentation
2013-06-13, MA121, MIT-building, Umeå University, Umeå, 10:00 (English)
Opponent
Supervisors
Funder
EU, FP7, Seventh Framework ProgrammeeSSENCE - An eScience Collaboration
Available from: 2014-04-08 Created: 2014-04-04 Last updated: 2014-04-08Bibliographically approved
List of papers
1. Management of distributed resource allocations in multi-cluster environments
Open this publication in new window or tab >>Management of distributed resource allocations in multi-cluster environments
2012 (English)In: Performance Computing and Communications Conference (IPCCC) 2012, 31st International, IEEE, New York, USA: IEEE , 2012, 275-284 p.Conference paper, Published paper (Other academic)
Abstract [en]

We present a fully distributed solution for managing resource allocation for services running across multiple clusters in a large-scale cloud computing environment. Our solution allows individual services running across clusters to compete dynamically for allocations based on their rate of consumption while maintaining the global cloud level allocation limits. The solution monitors resource consumption by services that are spread over a number of clusters. Global polls are triggered only when the allocated balance in a cluster decreases below a threshold and allocations are reassigned in a manner that avoids further immediate global polls. Our solution achieves scalability by minimizing global message exchanges, increases performance by distributing requests, and improves availability by avoiding a single point of failure. We perform a range of simulations to verify the accuracy of our approach, to validate our theoretical results, and to evaluate against competing approaches.

Place, publisher, year, edition, pages
New York, USA: IEEE, 2012
Series
2012 IEEE 31ST International performance computing and communications conference (IPCCC), ISSN 1097-2641
Keyword
Distributed monitoring, distributed resource allocations management, distributed quota management
National Category
Computer Science
Identifiers
urn:nbn:se:umu:diva-66430 (URN)10.1109/PCCC.2012.6407768 (DOI)000313524400040 ()978-1-4673-4881-2 (ISBN)
Conference
IEEE 31st International Performance Computing and Communications Conference (IPCCC)2012-12-01--03, Austin, Texas, USA
Available from: 2013-02-22 Created: 2013-02-19 Last updated: 2015-09-01Bibliographically approved
2. A Scalable Accounting Solution for Prepaid Services in Cloud Systems
Open this publication in new window or tab >>A Scalable Accounting Solution for Prepaid Services in Cloud Systems
2012 (English)In: Proceedings of the 2012 IEEE Ninth International Conference on Services Computing, 2012, 81-89 p.Conference paper, Published paper (Refereed)
Abstract [en]

Prepaid charging, an essential option for the accounting of cloud services, provides effective financial control for both service providers and customers. However, it has to be supported by real-time credit checking and cost calculation. These real-time actions consume resources of the providers' network and impose high overhead. To tackle this issue, we present a scalable accounting solution in which an accounting component is hosted in every cluster constituting a cloud system. Each of our accounting component supervises service consumptions based on a calculated interval of a service bundle that is composed of all services hosted in a cluster and consumed by one customer simultaneously. Credit will be re-allocated when a customer's credit in one cluster is not enough to compensate further usage, and the allocation is performed based on service consumptions. This work is intended to reduce the cost of prepaid services and to ensure service provision is not hampered by the charging part. Additionally, we perform theoretical and experimental analyses that indicate this work can provide an inexpensive accounting solution for the long-lived services in storage clouds.

Series
SCC ’12
Keyword
Accounting Systems, prepaid accounting
National Category
Engineering and Technology Computer and Information Science
Identifiers
urn:nbn:se:umu:diva-80122 (URN)10.1109/SCC.2012.40 (DOI)978-1-4673-3049-7 (ISBN)
Conference
IEEE Ninth International Conference on Services Computing, Honolulu, HI, 24-29 June 2012
Available from: 2013-09-09 Created: 2013-09-09 Last updated: 2014-04-08Bibliographically approved
3. A synchronization mechanism for cloud accounting systems
Open this publication in new window or tab >>A synchronization mechanism for cloud accounting systems
Show others...
2014 (English)In: 2014 International Conference on Cloud and Autonomic Computing (ICCAC 2014), 2014, 111-120 p.Conference paper, Published paper (Refereed)
Abstract [en]

In current cloud systems, services run across multiple geographically distributed clusters and continuously generate resource usage data due to constant resource consumption. In the context of accounting, resource usage data generated from each cluster during service runtime must be collected and aggregated into a single cloud-wide record so that a single bill can be created. This paper presents a mechanism to synchronize accounting records among distributed accounting system peers. Run time resource usage generated from different clusters is synchronized to maintain a single cloud-wide view of the data so that a single bill can be created. We provide a set of accounting system requirements and an evaluation which verifies that the solution fulfills these requirements. Experimental results show that our solution produces less overhead in terms of data exchange and scales near-linearly with the size of clusters with no single point of failure.

Keyword
Distributed Accounting, Postpaid, Cloud, Synchronization
National Category
Computer and Information Science
Identifiers
urn:nbn:se:umu:diva-87753 (URN)10.1109/ICCAC.2014.11 (DOI)000370731000016 ()978-1-4799-5841-2 (ISBN)
Conference
2014 IEEE International Conference on Cloud and Autonomic Computing (ICCAC), Imperial College, London, ENGLAND, SEP 08-12, 2014
Available from: 2014-04-08 Created: 2014-04-08 Last updated: 2017-01-17Bibliographically approved

Open Access in DiVA

fulltext(685 kB)409 downloads
File information
File name FULLTEXT02.pdfFile size 685 kBChecksum SHA-512
cffbcf6515cf8960c846b8e6eda2b9c9c0581c8d9523c74d44ff459d9bb6cb1f883a9fa3821d9d3d82fe40624f21ca02ed99dfbefb7ba8169c67964223330d96
Type fulltextMimetype application/pdf

Search in DiVA

By author/editor
Lakew, Ewnetu Bayuh
By organisation
Department of Computing Science
Engineering and TechnologyComputer Science

Search outside of DiVA

GoogleGoogle Scholar
Total: 409 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 196 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf