Umeå University's logo

umu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Simulation-to-reality transfer to control a forwarder with active suspensions through deep reinforcement learning
Umeå University, Faculty of Science and Technology, Department of Physics. (Digital Physics)
Umeå University, Faculty of Science and Technology, Department of Physics. (Digital Physics)
Umeå University, Faculty of Science and Technology, Department of Computing Science.ORCID iD: 0000-0001-8704-9584
Skogforsk.
Show others and affiliations
2022 (English)In: Proceedings of the joint 44th annual meeting of council on forest engineering (COFE), the 54th international symposiumon forest mechanization (FORMEC), and 2022 IUFRO all-division 3 meeting: One big family - shaping our future together / [ed] Woodam Chung; Christian Kanzian; Peter McNeary, Council of forest engineering , 2022, p. 138-138Conference paper, Oral presentation with published abstract (Refereed)
Abstract [en]

Automating the loaded and unloaded driving of a forwarder has the potential to reduce operational costsup to 10% in cut-to-length logging, but remains a challening and unsolved task. The complex interaction between the vehicle and terrain requires the controller to percieve its surroundings and thestate of the vehicle to plan for traversal. Because the state space is high dimensional and the systemdynamics cannot be formulated in closed form or easily approximated, traditional control methods areinadequate. Under these conditions, where learning to act in the environement is easier than learning thesystem dynamics, model free reinforcement learning is a promising option. We use deep reinforcementlearning for control of a 16-tonne forwarder with actively articulated suspensions. To efficiently gathergeneralizable experience, the control policies were safetly trained in simulation while varying severaldomain parameters. Each policy is trained during what correponds to roughly one month of real time.In simulation, the controller shows the ability to traverse rough terrains reconstruced from high-densitylaser scans and handles slopes up to 27◦. To compare the simulated to real performance we transfer thecontrol policies to the physical vehicle. Our results provide insight on how to improve policy transfer toheavy and expensive forest machines.

Place, publisher, year, edition, pages
Council of forest engineering , 2022. p. 138-138
National Category
Robotics and automation Computer graphics and computer vision Other Physics Topics
Research subject
Physics
Identifiers
URN: urn:nbn:se:umu:diva-199447ISBN: 979-8-9855282-1-3 (print)OAI: oai:DiVA.org:umu-199447DiVA, id: diva2:1696591
Conference
International Conference of Forest Engineering COFE-FORMEC-IUFRO, One Big Family: Shaping Our Future Together, Corvallis, Oregon, USA, October 4-7, 2022
Available from: 2022-09-17 Created: 2022-09-17 Last updated: 2025-02-05Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Conference abstracts

Authority records

Wiberg, ViktorWallin, ErikWadbro, EddieServin, Martin

Search in DiVA

By author/editor
Wiberg, ViktorWallin, ErikWadbro, EddieServin, Martin
By organisation
Department of PhysicsDepartment of Computing Science
Robotics and automationComputer graphics and computer visionOther Physics Topics

Search outside of DiVA

GoogleGoogle Scholar

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 491 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf