Umeå University's logo

umu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Energy efficient and QoS-aware model selection for DNN inference in edge intelligence
Umeå University, Faculty of Science and Technology, Department of Computing Science.
Umeå University, Faculty of Science and Technology, Department of Computing Science.ORCID iD: 0000-0002-2633-6798
2025 (English)In: Proceedings - 2025 IEEE International Conference on Cloud Computing Technology and Science, CloudCom 2025, Institute of Electrical and Electronics Engineers (IEEE), 2025Conference paper, Published paper (Refereed)
Abstract [en]

Edge intelligence is about enabling deep learning applications to run on edge platforms, often under strict Quality of Service (QoS) constraints (e.g., deadlines and accuracy). The heterogeneity and limited computational and energy capacities of edge servers necessitate further study on energy-efficient Deep Neural Network (DNN) inference. While availability of DNN model variants enables adaptive selection without compromising accuracy, it increases the complexity of the solution space. Also, existing research on model selection for DNN inference lacks efficient estimation of energy consumption. This paper proposes a polynomial-time joint strategy for QoS-aware model instance provisioning and selection, based on many-to-many stable matching. Our novel formulation uses the number of floating-point operations (FLOPs) of each model along with hardware-level characteristics of edge servers to minimize total energy usage while maximizing successful inference completions. The proposed strategy is evaluated under different preference functions. Experimental results, compared to optimal and evolutionary algorithms, demonstrate the runtime efficiency of our strategy. Furthermore, extensive evaluations against baselines highlights its superior performance and the importance of jointly considering both system- and application-level parameters in the solution.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2025.
Series
IEEE International Conference on Cloud Computing Technology and Science (CloudCom), ISSN 2330-2194, E-ISSN 2380-8004
Keywords [en]
DNN Inference, Edge Intelligence, Energy Efficiency, Model Se-lection, QoS Requirements, Stable Matching
National Category
Computer Sciences Computer Systems
Identifiers
URN: urn:nbn:se:umu:diva-252671DOI: 10.1109/CloudCom67567.2025.11331487Scopus ID: 2-s2.0-105034656451ISBN: 9798331566340 (electronic)ISBN: 9798331566357 (print)OAI: oai:DiVA.org:umu-252671DiVA, id: diva2:2061568
Conference
2025 IEEE 16th International Conference on Cloud Computing Technology and Science, IEEE CloudCom 2025, Shenzhen, China, 14-16 November 2025
Funder
The Kempe Foundations, 3161Available from: 2026-05-21 Created: 2026-05-21 Last updated: 2026-05-21Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Siar, HajarElmroth, Erik

Search in DiVA

By author/editor
Siar, HajarElmroth, Erik
By organisation
Department of Computing Science
Computer SciencesComputer Systems

Search outside of DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 29 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf