Umeå University's logo

umu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
World modeling for autonomous wheel loaders
Umeå University, Faculty of Science and Technology, Department of Physics. Komatsu Ltd., Akasaka, Minato-ku, Tokyo, Japan. (Digital Physics)
Umeå University, Faculty of Science and Technology, Department of Physics. (Digital Physics)
Umeå University, Faculty of Science and Technology, Department of Computing Science. Department of Mathematics and Computer Science, Karlstad University, Karlstad, Sweden.ORCID iD: 0000-0001-8704-9584
Umeå University, Faculty of Science and Technology, Department of Physics. Algoryx Simulation AB, Umeå, Sweden. (Digital Physics)ORCID iD: 0000-0002-0787-4988
2024 (English)In: Automation, ISSN 2673-4052, Vol. 5, no 3, p. 259-281Article in journal (Refereed) Published
Abstract [en]

This paper presents a method for learning world models for wheel loaders performing automatic loading actions on a pile of soil. Data-driven models were learned to output the resulting pile state, loaded mass, time, and work for a single loading cycle given inputs that include a heightmap of the initial pile shape and action parameters for an automatic bucket-filling controller. Long-horizon planning of sequential loading in a dynamically changing environment is thus enabled as repeated model inference. The models, consisting of deep neural networks, were trained on data from a 3D multibody dynamics simulation of over 10,000 random loading actions in gravel piles of different shapes. The accuracy and inference time for predicting the loading performance and the resulting pile state were, on average, 95% in 1.21.2 ms and 97% in 4.54.5 ms, respectively. Long-horizon predictions were found feasible over 40 sequential loading actions.

Place, publisher, year, edition, pages
MDPI, 2024. Vol. 5, no 3, p. 259-281
Keywords [en]
wheel loader, earthmoving, automation, bucket-filling, world modeling, deep learning, multibody simulation
National Category
Robotics and automation Computer graphics and computer vision Other Physics Topics
Research subject
Physics; Automatic Control
Identifiers
URN: urn:nbn:se:umu:diva-227746DOI: 10.3390/automation5030016ISI: 001323274900001Scopus ID: 2-s2.0-85205125062OAI: oai:DiVA.org:umu-227746DiVA, id: diva2:1882767
Funder
Wallenberg AI, Autonomous Systems and Software Program (WASP)Available from: 2024-07-07 Created: 2024-07-07 Last updated: 2025-02-05Bibliographically approved
In thesis
1. High-performance autonomous wheel loading: a computational approach
Open this publication in new window or tab >>High-performance autonomous wheel loading: a computational approach
2025 (English)Doctoral thesis, comprehensive summary (Other academic)
Alternative title[sv]
Högpresterande autonom hjullastning : en beräkningsmetod
Abstract [en]

Smart and autonomous earthmoving equipment enhances energy efficiency,productivity, and safety at construction sites and mines. The innovations provide means to reach high-set sustainability goals and be profitable despite increasing labor shortages. In addition, recent technological breakthroughs in artificial intelligence highlight the potential of superhuman capabilities to further enhance operations. This thesis presents a computational approach to end-to-end optimization of autonomous wheel loaders operating in a dynamic environment. Wheel loaders are mainly used for repeatedly loading material and carrying it to load receivers in quarries and mines. The difficulty lies in that each loading action alters the state of the material pile. The resulting state affects the possible outcomes of the subsequent loading process and, ultimately, the total performance. Thus, the challenge is to achieve both autonomous and high-performance wheel loading over a sequence of tasks. Achieving this requires the ability to predict future outcomes and account for the cumulative effect of loading actions. The thesis constructs a real-time wheel loader simulator, develops world models for sequential loading actions with evolving pile states, formulates the end-to-end optimization problem, and introduces a look-ahead tree search method to solve the problem. These contributions provide insights into utilizing physics-based simulation in combination with machine learning to further improve sustainability in mining and construction.

Place, publisher, year, edition, pages
Umeå: Umeå University, 2025. p. 31
Keywords
Earthmoving, Automation, Wheel loader, Bucket-filling, Multibody and soil dynamics, Realtime simulation, Sim-to-real gap, World modeling, Deep learning, Optimization
National Category
Computer Sciences
Research subject
Computer Science
Identifiers
urn:nbn:se:umu:diva-233090 (URN)978-91-8070-567-7 (ISBN)978-91-8070-568-4 (ISBN)
Public defence
2025-01-24, MIT.A.121, Umeå, 09:00 (English)
Opponent
Supervisors
Available from: 2025-01-07 Created: 2024-12-20 Last updated: 2025-01-07Bibliographically approved

Open Access in DiVA

fulltext(22829 kB)248 downloads
File information
File name FULLTEXT01.pdfFile size 22829 kBChecksum SHA-512
46402bd2f2e8df7121911bb6ebbed51571fc29822c19663826c3e6bf9ab1809a97a57c2d37c9a759589283bbe6f0c0181af6b68774a1ac4da65c2a96585b2a3c
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Authority records

Aoshima, KojiFälldin, ArvidWadbro, EddieServin, Martin

Search in DiVA

By author/editor
Aoshima, KojiFälldin, ArvidWadbro, EddieServin, Martin
By organisation
Department of PhysicsDepartment of Computing Science
Robotics and automationComputer graphics and computer visionOther Physics Topics

Search outside of DiVA

GoogleGoogle Scholar
Total: 248 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 1131 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf