Umeå University's logo

umu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
AdCom: Adaptive combiner for streaming aggregations
Umeå University, Faculty of Science and Technology, Department of Computing Science.
2021 (English)In: Advances in Database Technology - EDBT / [ed] Velegrakis Y.; Velegrakis Y.; Zeinalipour D.; Chrysanthis P.K.; Chrysanthis P.K.; Guerra F., OpenProceedings, 2021, Vol. 2021-March, p. 403-414Conference paper, Published paper (Refereed)
Abstract [en]

Continuous applications such as device monitoring and anomaly detection often require real-time aggregated statistics over unbounded data streams. While existing stream processing systems such as Flink, Spark, and Storm support processing of streaming aggregations, their optimizations are limited with respect to the dynamic nature of the data, and therefore are suboptimal when the workload changes and/or when there is data skew. In this paper we present AdCom, which is an adaptive combiner for stream processing engines. The use of AdCom in aggregation queries enables pre-aggregating tuples upstream (i.e., before data shuffling) followed by global aggregation downstream. In contrast to existing approaches, AdCom can automatically adjust the number of tuples to pre-aggregate depending on the data rate and available network. Our experimental study using real-world streaming workloads shows that using AdCom leads to 2.5-9× higher sustainable throughput without compromising latency.

Place, publisher, year, edition, pages
OpenProceedings, 2021. Vol. 2021-March, p. 403-414
Series
Advances in Database Technology, E-ISSN 2367-2005
National Category
Computer Sciences
Research subject
computer and systems sciences
Identifiers
URN: urn:nbn:se:umu:diva-187179DOI: 10.5441/002/edbt.2021.43Scopus ID: 2-s2.0-85113710327ISBN: 9783893180844 (electronic)OAI: oai:DiVA.org:umu-187179DiVA, id: diva2:1591182
Conference
Advances in Database Technology - 24th International Conference on Extending Database Technology, EDBT 2021, Virtual, March 23-26, 2021.
Funder
EU, Horizon 2020, 765452Available from: 2021-09-06 Created: 2021-09-06 Last updated: 2021-09-06Bibliographically approved

Open Access in DiVA

fulltext(1146 kB)83 downloads
File information
File name FULLTEXT01.pdfFile size 1146 kBChecksum SHA-512
fa1840c9e90c5aacb6a57990962d4f05f59cc9afbf324f29eeccaffcd1156d2e9637c557fa07b95c55dfedf270d55be90a522ee521486c8aa0829257ec9c4a89
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Authority records

Souza, Abel

Search in DiVA

By author/editor
Souza, Abel
By organisation
Department of Computing Science
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar
Total: 83 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 145 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf