Umeå University's logo

umu.sePublications
4647484950515249 of 473
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Evaluating The Serverless Orchestrator With Real And Synthetically Generated Workloads
Umeå University, Faculty of Science and Technology, Department of Computing Science.
2026 (English)Independent thesis Basic level (degree of Bachelor), 10 credits / 15 HE creditsStudent thesis
Abstract [en]

Serverless computing uses complex orchestration to manage resource scaling and initialization. Evaluating these orchestrators requires advanced benchmarking. A way of testing these orchestrators is to rely on ”naive” synthetic methodologies that use uniform or Gaussian distributions. This thesis investigates the extent to which synthetic benchmarks distort perceived system performance compared to trace driven testing based on real world data. Using an OpenFaaS test bed with a modified Locust load generator we conducted a comparative analysis between standard synthetic benchmarks and a replay of the Azure Functions production trace. We implemented a ”universal function” to simulate a wide array of workload profiles mimicking the Zipfian popularity and Log Normal execution distributions found in the production data. The results show that standard uniform function selection creates an artificially ”warm” environment masking the penalties of cold starts. The synthetic model also fails in generating out-liers responsible for head of line blocking and resource contention. It can be concluded that naive synthetic benchmarking leads to an overestimation of system throughput and stability. To achieve performance evaluations that covers all cases future research should adopt trace driven methodologies that preserve the statistical irregularities of real world traffic

Place, publisher, year, edition, pages
2026.
Series
UMNAD ; 1598
National Category
Computer Systems
Identifiers
URN: urn:nbn:se:umu:diva-249171OAI: oai:DiVA.org:umu-249171DiVA, id: diva2:2033509
Educational program
Bachelor of Science Programme in Computing Science
Supervisors
Examiners
Available from: 2026-02-05 Created: 2026-01-29 Last updated: 2026-02-05Bibliographically approved

Open Access in DiVA

fulltext(2576 kB)2 downloads
File information
File name FULLTEXT01.pdfFile size 2576 kBChecksum SHA-512
419f8a66138c22cb72aa2440dd350d32761907197017d87a32d458011b53feb5030672a9407477068cd994c6dd75288ec53f590357b8c180d6d776853e99e3ff
Type fulltextMimetype application/pdf

By organisation
Department of Computing Science
Computer Systems

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 62 hits
4647484950515249 of 473
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf