Umeå University's logo

umu.sePublikasjoner
Endre søk
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
AdCom: Adaptive combiner for streaming aggregations
Umeå universitet, Teknisk-naturvetenskapliga fakulteten, Institutionen för datavetenskap.
2021 (engelsk)Inngår i: Advances in Database Technology - EDBT / [ed] Velegrakis Y.; Velegrakis Y.; Zeinalipour D.; Chrysanthis P.K.; Chrysanthis P.K.; Guerra F., OpenProceedings, 2021, Vol. 2021-March, s. 403-414Konferansepaper, Publicerat paper (Fagfellevurdert)
Abstract [en]

Continuous applications such as device monitoring and anomaly detection often require real-time aggregated statistics over unbounded data streams. While existing stream processing systems such as Flink, Spark, and Storm support processing of streaming aggregations, their optimizations are limited with respect to the dynamic nature of the data, and therefore are suboptimal when the workload changes and/or when there is data skew. In this paper we present AdCom, which is an adaptive combiner for stream processing engines. The use of AdCom in aggregation queries enables pre-aggregating tuples upstream (i.e., before data shuffling) followed by global aggregation downstream. In contrast to existing approaches, AdCom can automatically adjust the number of tuples to pre-aggregate depending on the data rate and available network. Our experimental study using real-world streaming workloads shows that using AdCom leads to 2.5-9× higher sustainable throughput without compromising latency.

sted, utgiver, år, opplag, sider
OpenProceedings, 2021. Vol. 2021-March, s. 403-414
Serie
Advances in Database Technology, E-ISSN 2367-2005
HSV kategori
Forskningsprogram
data- och systemvetenskap
Identifikatorer
URN: urn:nbn:se:umu:diva-187179DOI: 10.5441/002/edbt.2021.43Scopus ID: 2-s2.0-85113710327ISBN: 9783893180844 (digital)OAI: oai:DiVA.org:umu-187179DiVA, id: diva2:1591182
Konferanse
Advances in Database Technology - 24th International Conference on Extending Database Technology, EDBT 2021, Virtual, March 23-26, 2021.
Forskningsfinansiär
EU, Horizon 2020, 765452Tilgjengelig fra: 2021-09-06 Laget: 2021-09-06 Sist oppdatert: 2021-09-06bibliografisk kontrollert

Open Access i DiVA

fulltext(1146 kB)86 nedlastinger
Filinformasjon
Fil FULLTEXT01.pdfFilstørrelse 1146 kBChecksum SHA-512
fa1840c9e90c5aacb6a57990962d4f05f59cc9afbf324f29eeccaffcd1156d2e9637c557fa07b95c55dfedf270d55be90a522ee521486c8aa0829257ec9c4a89
Type fulltextMimetype application/pdf

Andre lenker

Forlagets fulltekstScopus

Person

Souza, Abel

Søk i DiVA

Av forfatter/redaktør
Souza, Abel
Av organisasjonen

Søk utenfor DiVA

GoogleGoogle Scholar
Totalt: 86 nedlastinger
Antall nedlastinger er summen av alle nedlastinger av alle fulltekster. Det kan for eksempel være tidligere versjoner som er ikke lenger tilgjengelige

doi
isbn
urn-nbn

Altmetric

doi
isbn
urn-nbn
Totalt: 151 treff
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf