Umeå University's logo

umu.sePublications
12345673 of 11
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
High-performance autonomous wheel loading: a computational approach
Umeå University, Faculty of Science and Technology, Department of Physics.ORCID iD: 0009-0000-7928-3944
2025 (English)Doctoral thesis, comprehensive summary (Other academic)Alternative title
Högpresterande autonom hjullastning : en beräkningsmetod (Swedish)
Abstract [en]

Smart and autonomous earthmoving equipment enhances energy efficiency,productivity, and safety at construction sites and mines. The innovations provide means to reach high-set sustainability goals and be profitable despite increasing labor shortages. In addition, recent technological breakthroughs in artificial intelligence highlight the potential of superhuman capabilities to further enhance operations. This thesis presents a computational approach to end-to-end optimization of autonomous wheel loaders operating in a dynamic environment. Wheel loaders are mainly used for repeatedly loading material and carrying it to load receivers in quarries and mines. The difficulty lies in that each loading action alters the state of the material pile. The resulting state affects the possible outcomes of the subsequent loading process and, ultimately, the total performance. Thus, the challenge is to achieve both autonomous and high-performance wheel loading over a sequence of tasks. Achieving this requires the ability to predict future outcomes and account for the cumulative effect of loading actions. The thesis constructs a real-time wheel loader simulator, develops world models for sequential loading actions with evolving pile states, formulates the end-to-end optimization problem, and introduces a look-ahead tree search method to solve the problem. These contributions provide insights into utilizing physics-based simulation in combination with machine learning to further improve sustainability in mining and construction.

Place, publisher, year, edition, pages
Umeå: Umeå University, 2025. , p. 31
Keywords [en]
Earthmoving, Automation, Wheel loader, Bucket-filling, Multibody and soil dynamics, Realtime simulation, Sim-to-real gap, World modeling, Deep learning, Optimization
National Category
Computer Sciences
Research subject
Computer Science
Identifiers
URN: urn:nbn:se:umu:diva-233090ISBN: 978-91-8070-567-7 (print)ISBN: 978-91-8070-568-4 (electronic)OAI: oai:DiVA.org:umu-233090DiVA, id: diva2:1923171
Public defence
2025-01-24, MIT.A.121, Umeå, 09:00 (English)
Opponent
Supervisors
Available from: 2025-01-07 Created: 2024-12-20 Last updated: 2025-01-07Bibliographically approved
List of papers
1. Simulation-Based Optimization of High-Performance Wheel Loading
Open this publication in new window or tab >>Simulation-Based Optimization of High-Performance Wheel Loading
2021 (English)In: Proceedings of the 38th International Symposium on Automation and Robotics in Construction (ISARC) / [ed] Chen Feng; Thomas Linner; Ioannis Brilakis, Dubai: International Association for Automation and Robotics in Construction (IAARC) , 2021, p. 688-695Conference paper, Published paper (Refereed)
Abstract [en]

Having smart and autonomous earthmoving in mind, we explore high-performance wheel loading in a simulated environment. This paper introduces a wheel loader simulator that combines contacting 3D multibody dynamics with a hybrid continuum-particle terrain model, supporting realistic digging forces and soil displacements at real-time performance. A total of 270,000 simulations are run with different loading actions, pile slopes, and soil to analyze how they affect the loading performance. The results suggest that the preferred digging actions should preserve and exploit a steep pile slope. High digging speed favors high productivity, while energy-efficient loading requires a lower dig speed. 

Place, publisher, year, edition, pages
Dubai: International Association for Automation and Robotics in Construction (IAARC), 2021
Series
ISARC Proceedings, ISSN 2413-5844
Keywords
Wheel loader, Autonomous, Simulation-Based Optimization, Multibody and soil dynamics
National Category
Robotics Computer Sciences Applied Mechanics
Research subject
Physics; Computer Science
Identifiers
urn:nbn:se:umu:diva-187949 (URN)10.22260/ISARC2021/0093 (DOI)2-s2.0-85127564717 (Scopus ID)978-952-69524-1-3 (ISBN)
Conference
ISARC 2021: 38th International Symposium on Automation and Robotics in Construction, Dubai, United Arab Emirates, November 1-5, 2021
Available from: 2021-09-27 Created: 2021-09-27 Last updated: 2024-12-30Bibliographically approved
2. Examining the simulation-to-reality gap of a wheel loader digging in deformable terrain
Open this publication in new window or tab >>Examining the simulation-to-reality gap of a wheel loader digging in deformable terrain
2024 (English)In: Multibody system dynamics, ISSN 1384-5640, E-ISSN 1573-272XArticle in journal (Refereed) Epub ahead of print
Abstract [en]

We investigate how well a physics-based simulator can replicate a real wheel loader performing bucket filling in a pile of soil. The comparison is made using field-test time series of the vehicle motion and actuation forces, loaded mass, and total work. The vehicle was modeled as a rigid multibody system with frictional contacts, driveline, and linear actuators. For the soil, we tested discrete-element models of different resolutions, with and without multiscale acceleration. The spatiotemporal resolution ranged between 50–400 mm and 2–500 ms, and the computational speed was between 1/10,000 to 5 times faster than real time. The simulation-to-reality gap was found to be around 10% and exhibited a weak dependence on the level of fidelity, e.g., compatible with real-time simulation. Furthermore, the sensitivity of an optimized force-feedback controller under transfer between different simulation domains was investigated. The domain bias was observed to cause a performance reduction of 5% despite the domain gap being about 15%.

Place, publisher, year, edition, pages
Springer Nature, 2024
Keywords
Earth-moving simulation, Multiscale, Real-time simulation, Soil dynamics, Validation, Vehicle dynamics
National Category
Robotics Applied Mechanics Other Physics Topics
Research subject
Physics; Automatic Control; computer and systems sciences
Identifiers
urn:nbn:se:umu:diva-227951 (URN)10.1007/s11044-024-10005-5 (DOI)001272281300002 ()2-s2.0-85198934485 (Scopus ID)
Available from: 2024-07-20 Created: 2024-07-20 Last updated: 2024-12-30
3. World modeling for autonomous wheel loaders
Open this publication in new window or tab >>World modeling for autonomous wheel loaders
2024 (English)In: Automation, ISSN 2673-4052, Vol. 5, no 3, p. 259-281Article in journal (Refereed) Published
Abstract [en]

This paper presents a method for learning world models for wheel loaders performing automatic loading actions on a pile of soil. Data-driven models were learned to output the resulting pile state, loaded mass, time, and work for a single loading cycle given inputs that include a heightmap of the initial pile shape and action parameters for an automatic bucket-filling controller. Long-horizon planning of sequential loading in a dynamically changing environment is thus enabled as repeated model inference. The models, consisting of deep neural networks, were trained on data from a 3D multibody dynamics simulation of over 10,000 random loading actions in gravel piles of different shapes. The accuracy and inference time for predicting the loading performance and the resulting pile state were, on average, 95% in 1.21.2 ms and 97% in 4.54.5 ms, respectively. Long-horizon predictions were found feasible over 40 sequential loading actions.

Place, publisher, year, edition, pages
MDPI, 2024
Keywords
wheel loader, earthmoving, automation, bucket-filling, world modeling, deep learning, multibody simulation
National Category
Robotics Computer Vision and Robotics (Autonomous Systems) Other Physics Topics
Research subject
Physics; Automatic Control
Identifiers
urn:nbn:se:umu:diva-227746 (URN)10.3390/automation5030016 (DOI)001323274900001 ()2-s2.0-85205125062 (Scopus ID)
Funder
Wallenberg AI, Autonomous Systems and Software Program (WASP)
Available from: 2024-07-07 Created: 2024-07-07 Last updated: 2024-12-20Bibliographically approved
4. Optimizing wheel loader performance: an end-to-end approach
Open this publication in new window or tab >>Optimizing wheel loader performance: an end-to-end approach
(English)Manuscript (preprint) (Other academic)
Abstract [en]

Wheel loaders in mines and construction sites repeatedly load soil from a pile to load receivers. This task presents a challenging optimization problem since each loading’s performance depends on the pile state, which depends on previous loadings. We investigate an end-toend optimization approach considering future loading outcomes and V-cycle transportation costs. To predict the evolution of the pile state and the loading performance, we use world models that leverage deep neural networks trained on numerous simulated loading cycles. A look-ahead tree search optimizes the sequence of loading actions by evaluating the performance of thousands of action candidates, which expand into subsequent action candidates under the predicted pile states recursively. Test results demonstrate that, over a horizon of 15 sequential loadings, the look-ahead tree search is 6 % more efficient than a greedy strategy, which always selects the action that maximizes the current single loading performance, and 14 % more efficient than using a fixed loading controller optimized for the nominal case.

National Category
Computer Sciences Computational Mathematics Other Physics Topics
Research subject
Physics
Identifiers
urn:nbn:se:umu:diva-233065 (URN)
Available from: 2024-12-18 Created: 2024-12-18 Last updated: 2024-12-30Bibliographically approved

Open Access in DiVA

fulltext(1029 kB)24 downloads
File information
File name FULLTEXT01.pdfFile size 1029 kBChecksum SHA-512
6e6f242873c2738e9a39e6107dfc0f2f24394b0a88ff4ba330e043fa88d133027edb6d8864e2b3cb3464eeb5bd5a39ba188b23548303da935eb87ae0cdc0805a
Type fulltextMimetype application/pdf
spikblad(149 kB)12 downloads
File information
File name SPIKBLAD01.pdfFile size 149 kBChecksum SHA-512
a4b4efc663a4ec73d619582f1ab647939352ab55254f6c6d82de8a3904ddbd39e7bf542ebbd86fe421ef7eb9669beb407b3d545ba24f12ca0e4fa7ceac37495a
Type spikbladMimetype application/pdf

Authority records

Aoshima, Koji

Search in DiVA

By author/editor
Aoshima, Koji
By organisation
Department of Physics
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar
Total: 24 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

isbn
urn-nbn

Altmetric score

isbn
urn-nbn
Total: 231 hits
12345673 of 11
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf