Umeå University's logo

umu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Quality-Elasticity: Improved Resource Utilization, Throughput, and Response Times Via Adjusting Output Quality to Current Operating Conditions
Umeå University, Faculty of Science and Technology, Department of Computing Science.ORCID iD: 0000-0001-5860-6695
Department of Electrical and Information Technology, Lund University, Sweden.ORCID iD: 0000-0003-1316-8059
Umeå University, Faculty of Science and Technology, Department of Computing Science.ORCID iD: 0000-0003-0106-3049
Umeå University, Faculty of Science and Technology, Department of Computing Science.ORCID iD: 0000-0002-2633-6798
2019 (English)In: 2019 IEEE International Conference on Autonomic Computing (ICAC), IEEE, 2019, p. 52-62Conference paper, Published paper (Refereed)
Abstract [en]

This work addresses two related problems for on-line services, namely poor resource utilization during regular operating conditions, and low throughput, long response times, or poor performance under periods of high system load. To address these problems, we introduce our notion of quality-elasticity as a manner of dynamically adapting response qualities from software services along a fine-grained spectrum. When resources are abundant, response quality can be increased, and when resources are scarce, responses are delivered at a lower quality to prioritize throughput and response times. We present an example of how a complex online shopping site can be made quality-elastic. Experiments show that, compared to state of the art, improvements in throughput (57% more served queries), lowered response times (8 time reduction for 95th percentile responses), and an estimated 40% profitability increase can be made using our quality-elastic approach. When resources are abundant, our approach may achieve upwards of twice as high resource utilization as prior work in this field.

Place, publisher, year, edition, pages
IEEE, 2019. p. 52-62
Series
Proceedings of the International Conference on Autonomic Computing, ISSN 2474-0764, E-ISSN 2474-0756
Keywords [en]
cloud computing, service delivery, adaptive software, brownout
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:umu:diva-174392DOI: 10.1109/ICAC.2019.00017ISI: 000589508500007Scopus ID: 2-s2.0-85073231355ISBN: 978-1-7281-2411-7 (electronic)OAI: oai:DiVA.org:umu-174392DiVA, id: diva2:1460037
Conference
IEEE International Conference on Autonomic Computing (ICAC), Umeå, Swede, June 16-20, 2019
Funder
eSSENCE - An eScience CollaborationSwedish Research Council, C0590801Wallenberg AI, Autonomous Systems and Software Program (WASP)Knut and Alice Wallenberg FoundationAvailable from: 2020-08-21 Created: 2020-08-21 Last updated: 2020-12-29Bibliographically approved
In thesis
1. Managing cloud resource scarcity
Open this publication in new window or tab >>Managing cloud resource scarcity
2020 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

According to the Infrastructure-as-a-Service conceptualization of cloud computing, Infrastructure Providers offer utility-like pay-as-you-go access to computing resources (e.g., data processing, networks, and storage) to Service Providers, who use those resources to host applications for the benefit of end users. The quantity of resources available to Infrastructure Providers at any given moment is limited, as is the quantity of resources allocated to the applications of each Service Provider.

This thesis examines the management of cloud resource scarcity from the perspectives of both Infrastructure and Service Providers, with the aim of finding ways to ensure that the end user experience is minimally affected.

We consider three main strategies for managing cloud resource scarcity. First, we explore ways to efficiently construct collaborative federations of autonomous and independent Infrastructure Providers that allow local resource scarcity to be masked by extension using capacity from remote sites. Second, we consider how scheduling both within a cloud site and across a federation can be made aware of restrictions imposed by Service Providers for, e.g., performance or legal reasons. Third, we suggest ways of making applications conscious of resource availability so that they can apply quality elasticity under resource constraints.

The thesis is the culmination of 11 years of work within academia and industry. Based on the unique perspective granted by this long experience, the introductory chapters present a historical view of each subtopic mentioned above. Specifically, they discuss how cloud computing has evolved in conjunction with ways of developing applications to the symbiotic benefit of both, leading to the emergence of cloud-native software that allows Infrastructure Providers to use their infrastructure more efficiently and offer it more affordably while simultaneously granting Service Providers improved availability and performance in cloud-based environments.

Abstract [sv]

I molnet (cloud computing), ur Infrastructure-as-a-Service-perspektivet, ger infrastruktursleverantörer tillgång till datorresurser (såsom databehandlings-, nätverks- och lagringskapacitet) med en löpande betalningsmodell till tjänsteleverantörer så att dessa kan erbjuda applikationer till fördel för slutanvändare. För infrastruktursleverantörer finns det en begränsning i mängden datorresurser som är tillgängliga vid varje givet tillfälle. För tjänsteleverantörer finns det en begränsning i hur många sådana resurser som är allokerade till deras applikationer.

Det övergripande målet med denna doktorsavhandling är att studera olika sätt att hantera resursbrister i molnet ur både infrastruktursleverantörers och tjänsteleverantörers perspektiv, så att slutanvändares upplevelse blir minimalt påverkad.

Våra ansatser till att hantera resursbrister i molnet kommer från tre huvudsakliga områden. Först utforskar vi federationer av autonoma och oberoende infrastruktursleverantörer, som möjliggör att lokala resursbrister kan maskeras genom att utöka och nyttja resurser från andra leverantörer. Därnäst undersöker vi hur schemaläggning både inom och mellan molnsajter i en federation kan göras medveten om begränsningar som tjänsteleverantörer kräver av exempelvis prestanda- eller legala skäl. Slutligen föreslår vi olika sätt hur applikationer kan göras medvetna om nuvarande resurstillgång och göras kvalitetselastiska.

Avhandlingen utgör kulmen av 11 års arbete inom akademins och industrins värld. Baserat på de unika möjligheter en sådan erfarenhet ger presenteras även ett historiskt perspektiv av dessa områden i de inledande kapitlen. I dessa kapitel diskuterar vi hur molnet har utvecklats tillsammans med hur applikationer levereras till slutkunder och hur ett symbiotiskt förhållande uppstått dem emellan. Resultatet är mjukvara som är cloud-native, vilket möjliggör för infrastruktursleverantörer att till högre grad effektivt utnyttja sin infrastruktur och erbjuda tillgång till den på ett mer kostnadseffektivt sätt, samt ger tjänsteleverantörer ökad tillgänglighet och prestanda i molnbaserade miljöer.

Place, publisher, year, edition, pages
Umeå: Umeå universitet, 2020. p. 109
Series
Report / UMINF, ISSN 0348-0542 ; 20.07
Keywords
cloud computing, edge computing, kubernetes, federation, scheduling, quality elasticity
National Category
Computer Sciences
Identifiers
urn:nbn:se:umu:diva-174509 (URN)978-91-7855-328-0 (ISBN)978-91-7855-329-7 (ISBN)
Public defence
2020-10-16, Aula Biologica, Biologihuset, Umeå, 10:00 (English)
Opponent
Supervisors
Available from: 2020-09-25 Created: 2020-08-26 Last updated: 2020-10-20Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Larsson, LarsKlein, CristianElmroth, Erik

Search in DiVA

By author/editor
Larsson, LarsTärneberg, WilliamKlein, CristianElmroth, Erik
By organisation
Department of Computing Science
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 467 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf