Umeå University's logo

umu.sePublications
System disruptions
There are recurring service disruptions on some of the search portals due to high traffic. We are working to resolve the issue, you may temporarily encounter an error message.
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Towards deployable demand-side management: a reinforcement-learning-enabled digital twin framework for single-family houses
Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics.
Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics.
Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics.ORCID iD: 0000-0002-8704-8538
Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics.
2026 (English)In: BuildSim Nordic 2026: book of abstracts / [ed] Santhan Reddy Penaka, Umeå: Umeå University, 2026, p. 22-22Conference paper, Oral presentation with published abstract (Refereed)
Abstract [en]

This paper presents a digital twin-enabled demand-side management framework for single-family houses. The aim is to develop an integrated platform that can systematically coordinate heterogeneous residential energy resources and support real-time optimization of home energy management by responding to dynamic electricity pricing. The digital twin environment (DTE) includes a multi-zone building thermal model, photovoltaic (PV) generation, battery storage system (BSS), electric-vehicle (EV) model, and schedulable electric appliances. The Soft Actor-Critic (SAC) algorithm is adopted as the embedded reinforcement learning optimizer in the DTE to determine optimal control actions for these resources by minimizing cost and comfort deviation. The framework is linked to a Modelica-based high-fidelity building emulator for data generation and subsequent validation. Compared with a rule-based strategy, the results demonstrate that the proposed RL-digital twin framework can effectively manage flexible resources while saving the electricity cost. In addition, the RL-digital twin efficiently satisfies occupants’ needs on thermal comfort and domestic hot water, which are significantly compromised under the rule-based strategy. The obtained results demonstrate the RL-digital twin framework potential for real-world deployment in residential demand-side management.

Place, publisher, year, edition, pages
Umeå: Umeå University, 2026. p. 22-22
National Category
Electrical Engineering, Electronic Engineering, Information Engineering Mechanical Engineering
Identifiers
URN: urn:nbn:se:umu:diva-258224ISBN: 978-91-6850-090-4 (electronic)OAI: oai:DiVA.org:umu-258224DiVA, id: diva2:2096174
Conference
12th BuildSimNordic Conference & 4th IBPSA Nordic Conference
Funder
Swedish Research Council Formas, 2022-01475Available from: 2026-08-28 Created: 2026-08-28 Last updated: 2026-08-28Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Book of abstracts

Authority records

Liu, PengjuChokwitthaya, ChanachokOlofsson, ThomasLu, Weizhuo

Search in DiVA

By author/editor
Liu, PengjuChokwitthaya, ChanachokOlofsson, ThomasLu, Weizhuo
By organisation
Department of Applied Physics and Electronics
Electrical Engineering, Electronic Engineering, Information EngineeringMechanical Engineering

Search outside of DiVA

GoogleGoogle Scholar

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 42 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf