Umeå University's logo

umu.sePublications
Change search
Refine search result
1234 1 - 50 of 189
CiteExportLink to result list
Permanent link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Rows per page
  • 5
  • 10
  • 20
  • 50
  • 100
  • 250
Sort
  • Standard (Relevance)
  • Author A-Ö
  • Author Ö-A
  • Title A-Ö
  • Title Ö-A
  • Publication type A-Ö
  • Publication type Ö-A
  • Issued (Oldest first)
  • Issued (Newest first)
  • Created (Oldest first)
  • Created (Newest first)
  • Last updated (Oldest first)
  • Last updated (Newest first)
  • Disputation date (earliest first)
  • Disputation date (latest first)
  • Standard (Relevance)
  • Author A-Ö
  • Author Ö-A
  • Title A-Ö
  • Title Ö-A
  • Publication type A-Ö
  • Publication type Ö-A
  • Issued (Oldest first)
  • Issued (Newest first)
  • Created (Oldest first)
  • Created (Newest first)
  • Last updated (Oldest first)
  • Last updated (Newest first)
  • Disputation date (earliest first)
  • Disputation date (latest first)
Select
The maximal number of hits you can export is 250. When you want to export more records please use the Create feeds function.
  • 1. Aguilar, Luis T.
    et al.
    Boiko, Igor M.
    Fridman, Leonid M.
    Freidovich, Leonid B.
    Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics.
    Generating oscillations in inertia wheel pendulum via two-relay controller2012In: International Journal of Robust and Nonlinear Control, ISSN 1049-8923, E-ISSN 1099-1239, Vol. 22, no 3, p. 318-330Article in journal (Refereed)
    Abstract [en]

    The problem of generating oscillations of the inertia wheel pendulum is considered. We combine exact feedback linearization with two-relay controller, tuned using frequency-domain tools, such as computing the locus of a perturbed relay system. Explicit expressions for the parameters of the controller in terms of the desired frequency and amplitude are derived. Sufficient conditions for orbital asymptotic stability of the closed-loop system are obtained with the help of the Poincare map. Performance is validated via experiments. The approach can be easily applied for a minimum phase system, provided the behavior of the states of the zero dynamics is of no concern. Copyright (C) 2011 John Wiley & Sons, Ltd.

  • 2.
    Aguilar, Luis T.
    et al.
    CITEDI, National Polytechnic Institute, Tijuana, BC, Mexico.
    Freidovich, Leonid
    Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics.
    Orlov, Yury
    CICESE Research Center, Ensenada, Baja California, Mexico.
    Merida, Jovan
    CITEDI, National Polytechnic Institute, Tijuana, BC, Mexico.
    Performance Analysis of Relay Feedback Position Regulators for Manipulators with Coulomb Friction2013In: Proc. 12th European Control Conference, NEW YORK, NY 10017 USA: IEEE , 2013, p. 3754-3759Conference paper (Refereed)
    Abstract [en]

    The purpose of the paper is to analyze the performance of several global position regulators for robot manipulators with Coulomb friction. All the controllers include a proportional-differential part and a switched part whereas the difference between the controllers is in the way of compensation of the gravitational forces. Stability analysis is also revisited within the nonsmooth Lyapunov function framework for the controllers with and without gravity pre-compensation. Performance issues of the proposed controllers are evaluated in an experimental study of a five degrees-of-freedom robot manipulator. In the experiments, we choose two criteria for performance analysis. In the first set of experiments, we set the same gains to all the controllers. In the second set of experiments, the gains of the controller were chosen such that the work done by the manipulator is similar.

  • 3.
    Andersson, Jennifer
    et al.
    Umeå University, Faculty of Science and Technology, Department of Physics. Umeå universitet.
    Bodin, Kenneth
    Algoryx Simulation AB, Umeå, Sweden.
    Lindmark, Daniel
    Algoryx Simulation AB, Umeå, Sweden.
    Servin, Martin
    Umeå University, Faculty of Science and Technology, Department of Physics. Algoryx Simulation AB, Umeå, Sweden.
    Wallin, Erik
    Umeå University, Faculty of Science and Technology, Department of Physics.
    Reinforcement Learning Control of a Forestry Crane Manipulator2021In: 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2021): Proceedings, Prague: IEEE Robotics and Automation Society, 2021, p. 2121-2126Conference paper (Refereed)
    Abstract [en]

    Forestry machines are heavy vehicles performing complex manipulation tasks in unstructured production forest environments. Together with the complex dynamics of the on-board hydraulically actuated cranes, the rough forest terrains have posed a particular challenge in forestry automation. In this study, the feasibility of applying reinforcement learning control to forestry crane manipulators is investigated in a simulated environment. Our results show that it is possible to learn successful actuator-space control policies for energy efficient log grasping by invoking a simple curriculum in a deep reinforcement learning setup. Given the pose of the selected logs, our best control policy reaches a grasping success rate of 97%. Including an energy-optimization goal in the reward function, the energy consumption is significantly reduced compared to control policies learned without incentive for energy optimization, while the increase in cycle time is marginal. The energy-optimization effects can be observed in the overall smoother motion and acceleration profiles during crane manipulation. 

    Download full text (pdf)
    fulltext
  • 4.
    Aoshima, Koji
    et al.
    Umeå University, Faculty of Science and Technology, Department of Physics. Komatsu Ltd..
    Fälldin, Arvid
    Umeå University, Faculty of Science and Technology, Department of Physics.
    Wadbro, Eddie
    Umeå University, Faculty of Science and Technology, Department of Computing Science. Karlstad University, Sweden.
    Servin, Martin
    Umeå University, Faculty of Science and Technology, Department of Physics. Algoryx Simulation.
    Data-driven models for predicting the outcome of autonomous wheel loader operationsManuscript (preprint) (Other academic)
    Abstract [en]

    This paper presents a method using data-driven models for selecting actions and predicting the total performance of autonomous wheel loader operations over many loading cycles in a changing environment. The performance includes loaded mass, loading time, work. The data-driven models input the control parameters of a loading action and the heightmap of the initial pile state to output the inference of either the performance or the resulting pile state. By iteratively utilizing the resulting pile state as the initial pile state for consecutive predictions, the prediction method enables long-horizon forecasting. Deep neural networks were trained on data from over 10,000 random loading actions in gravel piles of different shapes using 3D multibody dynamics simulation. The models predict the performance and the resulting pile state with, on average, 95% accuracy in 1.2 ms, and 97% in 4.5 ms, respectively. The performance prediction was found to be even faster in exchange for accuracy by reducing the model size with the lower dimensional representation of the pile state using its slope and curvature. The feasibility of long-horizon predictions was confirmed with 40 sequential loading actions at a large pile. With the aid of a physics-based model, the pile state predictions are kept sufficiently accurate for longer-horizon use.

  • 5.
    Aoshima, Koji
    et al.
    Umeå University, Faculty of Science and Technology, Department of Physics. Komatsu Ltd., Japan.
    Servin, Martin
    Umeå University, Faculty of Science and Technology, Department of Physics.
    Wadbro, Eddie
    Umeå University, Faculty of Science and Technology, Department of Computing Science. Karlstad University, Sweden.
    Simulation-Based Optimization of High-Performance Wheel Loading2021In: Proceedings of the 38th International Symposium on Automation and Robotics in Construction (ISARC), Dubai: International Association for Automation and Robotics in Construction (IAARC) , 2021, p. 688-695Conference paper (Refereed)
    Abstract [en]

    Having smart and autonomous earthmoving in mind, we explore high-performance wheel loading in a simulated environment. This paper introduces a wheel loader simulator that combines contacting 3D multibody dynamics with a hybrid continuum-particle terrain model, supporting realistic digging forces and soil displacements at real-time performance. A total of 270,000 simulations are run with different loading actions, pile slopes, and soil to analyze how they affect the loading performance. The results suggest that the preferred digging actions should preserve and exploit a steep pile slope. High digging speed favors high productivity, while energy-efficient loading requires a lower dig speed. 

    Download full text (pdf)
    fulltext
  • 6.
    Aoshima, Koji
    et al.
    Umeå University, Faculty of Science and Technology, Department of Physics. Komatsu Ltd., Japan.
    Servin, Martin
    Umeå University, Faculty of Science and Technology, Department of Physics.
    Wadbro, Eddie
    Umeå University, Faculty of Science and Technology, Department of Computing Science. Karlstad University, Karlstad, Sweden.
    Simulation-Based Optimization of High-Performance Wheel Loading2021In: 2021 Proceedings of the 38th ISARC, Dubai, UAE / [ed] Chen Feng; Thomas Linner; Ioannis Brilakis, International Association for Automation and Robotics in Construction (IAARC) , 2021, p. 688-695Conference paper (Refereed)
    Abstract [en]

    Having smart and autonomous earthmoving in mind, we explore high-performance wheel loading in a simulated environment. This paper introduces a wheel loader simulator that combines contacting 3D multibody dynamics with a hybrid continuum-particle terrain model, supporting realistic digging forces and soil displacements at real-time performance. A total of 270,000 simulations are run with different loading actions, pile slopes, and soil to analyze how they affect the loading performance. The results suggest that the preferred digging actions should preserve and exploit a steep pile slope. High digging speed favors high productivity, while energy-efficient loading requires a lower dig speed.

  • 7.
    Appelgren, Jessica
    et al.
    Totalförsvarets forskningsinstitut (FOI).
    Beran, Tâm
    Totalförsvarets forskningsinstitut (FOI).
    Musco Eklund, Amanda
    Umeå University, Faculty of Social Sciences, Department of Law. Totalförsvarets forskningsinstitut (FOI).
    Hagström, Martin
    Totalförsvarets forskningsinstitut (FOI).
    Autonoma vapensystem – dagens debatt och en väg framåt: tekniska, legala och etiska aspekter2022Report (Other academic)
    Abstract [sv]

    Framstegen inom AI väcker frågor kring den militära tilllämpningen av tekniken och tillåten grad av automatisering av vapensystem. Debatten om AI i militära tillämpningar förs både av civilsamhällets organisationer och av stater. Debatten började med det mycket specifika ifrågasättandet av fullt autonoma vapensystem, ofta kallade Lethal Autonomous Weapon Systems (LAWS), men debatten och ifrågasättandet har vidgats till att omfatta införandet av AI i militära tillämpningar. Diskussionen är mångfacetterad och präglas av flera olika perspektiv på ställningstaganden och argumentation. Autonoma system har många användningsområden i militära tillämpningar och det är viktigt att förstå hur integrationen av högautomatiserade system ska kunna göras medavseende på de rättsliga ramverk som försvaret lyder under.

    Även om debatten till viss del har sitt ursprung i det senaste decenniets drönarkrigföring är de flesta parter överens omatt dagens debatt snarare handlar om framtida teknik. De tekniska, militära och juridiska aspekterna är centrala i diskussionen men även etiska, psykologiska och säkerhetspolitiska aspekter tar plats i debatten.

  • 8.
    Arad, Boaz
    et al.
    Department of Computer Science, Ben‐Gurion University of the Negev, Beer‐Sheva, Israel.
    Balendonck, Jos
    Greenhouse Horticulture, Wageningen University & Research, Wageningen, The Netherlands.
    Barth, Ruud
    Greenhouse Horticulture, Wageningen University & Research, Wageningen, The Netherlands.
    Ben-Shahar, Ohad
    Department of Computer Science, Ben‐Gurion University of the Negev, Beer‐Sheva, Israel.
    Edan, Yael
    Department of Industrial Engineering and Management, Ben‐Gurion University of the Negev, Beer‐Sheva, Israel.
    Hellström, Thomas
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Hemming, Jochen
    Greenhouse Horticulture, Wageningen University & Research, Wageningen, The Netherlands.
    Kurtser, Polina
    Department of Industrial Engineering and Management, Ben‐Gurion University of the Negev, Beer‐Sheva, Israel.
    Ringdahl, Ola
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Tielen, Toon
    Greenhouse Horticulture, Wageningen University & Research, Wageningen, The Netherlands.
    van Tuijl, Bart
    Greenhouse Horticulture, Wageningen University & Research, Wageningen, The Netherlands.
    Development of a sweet pepper harvesting robot2020In: Journal of Field Robotics, ISSN 1556-4959, E-ISSN 1556-4967, Vol. 37, no 6, p. 1027-1039Article in journal (Refereed)
    Abstract [en]

    This paper presents the development, testing and validation of SWEEPER, a robot for harvesting sweet pepper fruit in greenhouses. The robotic system includes a six degrees of freedom industrial arm equipped with a specially designed end effector, RGB-D camera, high-end computer with graphics processing unit, programmable logic controllers, other electronic equipment, and a small container to store harvested fruit. All is mounted on a cart that autonomously drives on pipe rails and concrete floor in the end-user environment. The overall operation of the harvesting robot is described along with details of the algorithms for fruit detection and localization, grasp pose estimation, and motion control. The main contributions of this paper are the integrated system design and its validation and extensive field testing in a commercial greenhouse for different varieties and growing conditions. A total of 262 fruits were involved in a 4-week long testing period. The average cycle time to harvest a fruit was 24 s. Logistics took approximately 50% of this time (7.8 s for discharge of fruit and 4.7 s for platform movements). Laboratory experiments have proven that the cycle time can be reduced to 15 s by running the robot manipulator at a higher speed. The harvest success rates were 61% for the best fit crop conditions and 18% in current crop conditions. This reveals the importance of finding the best fit crop conditions and crop varieties for successful robotic harvesting. The SWEEPER robot is the first sweet pepper harvesting robot to demonstrate this kind of performance in a commercial greenhouse.

    Download full text (pdf)
    fulltext
  • 9.
    Asaro, Peter M.
    Umeå University, Faculty of Arts, Humlab.
    A Body to Kick, but Still No Soul to Damn: Legal Perspectives on Robotics2012In: Robot Ethics: The Ethical and Social Implications of Robotics / [ed] Patrick Lin, Keith Abney and George A. Bekey, CAMBRIDGE: MIT Press, 2012, p. 169-186Chapter in book (Other academic)
  • 10.
    Augustian, Midhumol
    Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics.
    Neural network based fault detection on painted surface2017Independent thesis Advanced level (degree of Master (Two Years)), 80 credits / 120 HE creditsStudent thesis
    Abstract [en]

    Machine vision systems combined with classification algorithms are being increasingly used for different applications in the age of automation. One such application would be the quality control of the painted automobile parts. The fundamental elements of the machine vision system include camera, illumination, image acquisition software and computer vision algorithms. Traditional way of thinking puts too much importance on camera systems and ignores other elements while designing a machine vision system. In this thesis work, it is shown that selecting an appropriate illumination for illuminating the surface being examined is equally important in case of machine vision system for examining specular surface. Knowledge about the nature of the surface, type and properties of the defect to be detected and classified are important factors while choosing the illumination system for the machine vision system. The main illumination system tested were bright field, dark field and structured illumination and out of the three, dark field and structured illumination gave best results.

    This thesis work proposes a dark field illumination based machine vision system for fault detection on specular painted surface. A single layer Artificial Neural Network model is employed for the classification of defects in intensity images of painted surface acquired with this machine vision system. The results of this research work proved that the quality of the images and size of data set used for training the Neural Network model play a vital role in the performance of the classifier algorithm.

    Download full text (pdf)
    Neural network based fault detection on painted surface_Midhumol_Augustian_MasterThesis
  • 11.
    Augustian, Midhumol
    et al.
    Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics.
    ur Réhman, Shafiq
    Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics.
    Sandvig, Axel
    Umeå University, Faculty of Medicine, Department of Pharmacology and Clinical Neuroscience, Clinical Neuroscience. Norwegian University of Science and Technology (NTNU), Norway.
    Kotikawatte, Thivra
    Umeå University, Faculty of Medicine, Department of Pharmacology and Clinical Neuroscience, Clinical Neuroscience.
    Yongcui, Mi
    Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics.
    Evensmoen, Hallvard Røe
    Norwegian University of Science and Technology (NTNU), Norway.
    EEG Analysis from Motor Imagery to Control a Forestry Crane2018In: Intelligent Human Systems Integration (IHSI 2018) / [ed] Waldemar Karwowski; Tareq Ahram, Springer, 2018, Vol. 722, p. 281-286Conference paper (Refereed)
    Abstract [en]

    Brain-computer interface (BCI) systems can provide people with ability to communicate and control real world systems using neural activities. Therefore, it makes sense to develop an assistive framework for command and control of a future robotic system which can assist the human robot collaboration. In this paper, we have employed electroencephalographic (EEG) signals recorded by electrodes placed over the scalp. The human-hand movement based motor imagery mentalization is used to collect brain signals over the motor cortex area. The collected µ-wave (8–13 Hz) EEG signals were analyzed with event-related desynchronization/synchronization (ERD/ERS) quantification to extract a threshold between hand grip and release movement and this information can be used to control forestry crane grasping and release functionality. The experiment was performed with four healthy persons to demonstrate the proof-of concept BCI system. From this study, it is demonstrated that the proposed method has potential to assist the manual operation of crane operators performing advanced task with heavy cognitive work load.

  • 12.
    Backman, Sofi
    et al.
    Algoryx Simulation AB, Umeå, Sweden.
    Lindmark, Daniel
    Algoryx Simulation AB, Umeå, Sweden.
    Bodin, Kenneth
    Umeå University, Faculty of Science and Technology, Department of Physics. Algoryx Simulation AB, Umeå, Sweden.
    Servin, Martin
    Umeå University, Faculty of Science and Technology, Department of Physics. Algoryx Simulation AB, Umeå, Sweden.
    Mörk, Joakim
    Algoryx Simulation AB, Umeå, Sweden.
    Löfgren, Håkan
    Epiroc AB, Nacka, Sweden.
    Continuous Control of an Underground Loader Using Deep Reinforcement Learning2021In: Machines, E-ISSN 2075-1702, Vol. 9, no 10, article id 216Article in journal (Refereed)
    Abstract [en]

    The reinforcement learning control of an underground loader was investigated in a simulated environment by using a multi-agent deep neural network approach. At the start of each loading cycle, one agent selects the dig position from a depth camera image of a pile of fragmented rock. A second agent is responsible for continuous control of the vehicle, with the goal of filling the bucket at the selected loading point while avoiding collisions, getting stuck, or losing ground traction. This relies on motion and force sensors, as well as on a camera and lidar. Using a soft actor–critic algorithm, the agents learn policies for efficient bucket filling over many subsequent loading cycles, with a clear ability to adapt to the changing environment. The best results—on average, 75% of the max capacity—were obtained when including a penalty for energy usage in the reward.

    Download full text (pdf)
    fulltext
  • 13.
    Bagheri, Shahriar
    Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics.
    Modeling, Simulation and Control System Design for Civil Unmanned Aerial Vehicle (UAV)2014Independent thesis Advanced level (degree of Master (Two Years)), 20 credits / 30 HE creditsStudent thesis
    Abstract [en]

    Unmanned aerial systems have been widely used for variety of civilian applications over the past few years. Some of these applications require accurate guidance and control. Consequently, Unmanned Aerial Vehicle (UAV) guidance and control attracted many researchers in both control theory and aerospace engineering. Flying wings, as a particular type of UAV, are considered to have one of the most efficient aerodynamic structures. It is however difficult to design robust controller for such systems. This is due to the fact that flying wings are highly sensitive to control inputs.

    The focus of this thesis is on modeling and control design for a UAV system. The platform understudy is a flying wing developed by SmartPlanes Co. located in Skellefteå, Sweden. This UAV is particularly used for topological mapping and aerial photography.

    The novel approach suggested in this thesis is to use two controllers in sequence. More precisely, Linear Quadratic Regulator (LQR) is suggested to provide robust stability, and Proportional, Integral, Derivative (PID) controller is suggested to provide reference signal regulation. The idea behind this approach is that with LQR in the loop, the system becomes more stable and less sensitive to control signals. Thus, PID controller has an easier task to do, and is only used to provide the required transient response.

    The closed-loop system containing the developed controller and a UAV non-linear dynamic model was simulated in Simulink. Simulated controller was then tested for stability and robustness with respect to some parametric uncertainty. Obtained results revealed that the LQR successfully managed to provide robust stability, and PID provided reference signal regulation.

    Download full text (pdf)
    Thesis_Shahriar_Bagheri
  • 14.
    Banerjee, Sourasekhar
    et al.
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Vu, Xuan-Son
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Bhuyan, Monowar H.
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Optimized and adaptive federated learning for straggler-resilient device selection2022In: 2022 International Joint Conference on Neural Networks (IJCNN), IEEE, 2022, p. 1-9Conference paper (Refereed)
    Abstract [en]

    Federated Learning (FL) has evolved as a promising distributed learning paradigm in which data samples are disseminated over massively connected devices in an IID (Identical and Independent Distribution) or non-IID manner. FL follows a collaborative training approach where each device uses local training data to train local models, and the server generates a global model by combining the local model's parameters. However, FL is vulnerable to system heterogeneity when local devices have varying computational, storage, and communication capabilities over time. The presence of stragglers or low-performing devices in the learning process severely impacts the scalability of FL algorithms and significantly delays convergence. To mitigate this problem, we propose Fed-MOODS, a Multi-Objective Optimization-based Device Selection approach to reduce the effect of stragglers in the FL process. The primary criteria for optimization are to maximize: (i) the availability of the processing capacity of each device, (ii) the availability of the memory in devices, and (iii) the bandwidth capacity of the participating devices. The multi-objective optimization prioritizes devices from fast to slow. The approach involves faster devices in early global rounds and gradually incorporating slower devices from the Pareto fronts to improve the model's accuracy. The overall training time of Fed-MOODS is 1.8× and 1.48× faster than the baseline model (FedAvg) with random device selection for MNIST and FMNIST non-IID data, respectively. Fed-MOODS is extensively evaluated under multiple experimental settings, and the results show that Fed-MOODS has significantly improved model's convergence and performance. Fed-MOODS maintains fairness in the prioritized participation of devices and the model for both IID and non-IID settings.

  • 15.
    Baranwal, Neha
    et al.
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Singh, Avinash
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Bensch, Suna
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Extracting Primary Objects and Spatial Relations from Sentences2019Conference paper (Refereed)
    Abstract [en]

    In verbal human-robot interaction natural language utterances have to be grounded in visual scenes by the robot. Visual language grounding is a challenging task that includes identifying a primary object among several objects, together with the object properties and spatial relations among the objects. In this paper we focus on extracting this information from sentences only. We propose two language modelling techniques, one uses regular expressions and the other one utilizes Euclidian distance. We compare these two proposed techniques with two other techniques that utilize tree structures, namely an extended Hobb’s algorithm and an algorithm that utilizes a Stanford parse tree. A comparative analysis between all language modelling techniques shows that our proposed two approaches require less computational time than the tree-based approaches. All approaches perform good identifying the primary object and its property, but for spatial relation extraction the Stanford parse tree algorithm performs better than the other language modelling techniques. Time elapsed for the Stanford parse tree algorithm is higher than for the other techniques.

    Download full text (pdf)
    fulltext
  • 16.
    Baranwal, Neha
    et al.
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Singh, Avinash
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Hellström, Thomas
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Fusion of Gesture and Speech for Increased Accuracy in Human Robot Interaction2019In: 2019 24th International Conference on Methods and Models in Automation and Robotics (MMAR), IEEE, 2019, p. 139-144Conference paper (Refereed)
    Abstract [en]

    An approach for decision-level fusion for gesture and speech based human-robot interaction (HRI) is proposed. A rule-based method is compared with several machine learning approaches. Gestures and speech signals are initially classified using hidden Markov models, reaching accuracies of 89.6% and 84% respectively. The rule-based approach reached 91.6% while SVM, which was the best of all evaluated machine learning algorithms, reached an accuracy of 98.2% on the test data. A complete framework is deployed in real time humanoid robot (NAO) which proves the efficacy of the system.

  • 17.
    Barth, Ruud
    et al.
    Greenhouse Horticulture, Wageningen University & Research Center.
    Baur, Jörg
    Institute of Applied Mechanics, Technische Universität München.
    Buschmann, Thomas
    Institute of Applied Mechanics, Technische Universität München.
    Edan, Yael
    Department of Industrial Engineering and Management, Ben-Gurion University of the Negev.
    Hellström, Thomas
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Nguyen, Thanh
    KU Leuven, Department of Biosystems.
    Ringdahl, Ola
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Saeys, Wouter
    KU Leuven, Department of Biosystems.
    Salinas, Carlota
    Centre for Automation and Robotics UPM-CSIC.
    Vitzrabin, Efi
    Department of Industrial Engineering and Management, Ben-Gurion University of the Negev.
    Using ROS for agricultural robotics: design considerations and experiences2014In: RHEA-2014 / [ed] Pablo Gonzalez-de-Santos and Angela Ribeiro, 2014, p. 509-518Conference paper (Refereed)
    Abstract [en]

    We report on experiences of using the ROS middleware for developmentof agricultural robots. We describe software related design considerations for all maincomponents in developed subsystems as well as drawbacks and advantages with thechosen approaches. This work was partly funded by the European Commission(CROPS GA no 246252).

  • 18.
    Bensch, Suna
    et al.
    Umeå University, Faculty of Science and Technology, Department of Computing Science. Department of Computing Science.
    Jevtic, Aleksandar
    Institut de Robotica i Informatica Industrial, Technical University of Catalonia, Spain.
    Hellström, Thomas
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    On Interaction Quality in Human-Robot Interaction2017In: Proceedings of the 9th International Conference on Agents and Artificial Intelligence / [ed] H. Jaap van den Herik, Ana Paula Rocha, Joaquim Filipe, Setúbal: SciTePress, 2017, Vol. 1, p. 182-189Conference paper (Refereed)
    Abstract [en]

    In many complex robotics systems, interaction takes place in all directions between human, robot, and environment. Performance of such a system depends on this interaction, and a proper evaluation of a system must build on a proper modeling of interaction, a relevant set of performance metrics, and a methodology to combine metrics into a single performance value. In this paper, existing models of human-robot interaction are adapted to fit complex scenarios with one or several humans and robots. The interaction and the evaluation process is formalized, and a general method to fuse performance values over time and for several performance metrics is presented. The resulting value, denoted interaction quality, adds a dimension to ordinary performance metrics by being explicit about the interplay between performance metrics, and thereby provides a formal framework to understand, model, and address complex aspects of evaluation of human-robot interaction. 

  • 19.
    Bensch, Suna
    et al.
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Sun, Jiangeng
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Bandera Rubio, Juan Pedro
    Department of Electronic Technology, University of Málaga, Málaga, Spain.
    Romero-Garcés, Adrián
    Department of Electronic Technology, University of Málaga, Málaga, Spain.
    Hellström, Thomas
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Personalised multi-modal communication for HRI2023Conference paper (Refereed)
    Abstract [en]

    One important aspect when designing understandable robots is how robots should communicate with a human user to be understood in the best way. In elder care applications this is particularly important, and also difficult since many older adults suffer from various kinds of impairments. In this paper we present a solution where communication modality and communication parameters are adapted to fit both a user profile and an environment model comprising information about light and sound conditions that may affect communication. The Rasa dialogue manager is complemented with necessary functionality, and the operation is verified with a Pepper robot interacting with several personas with impaired vision, hearing, and cognition. Several relevant ethical questions are identified and briefly discussed, as a contribution to the WARN workshop.

    Download full text (pdf)
    fulltext
  • 20.
    Beyer, Rasmus
    Umeå University, Faculty of Science and Technology, Department of Physics.
    Teleoperation of an Autonomous Ground-Penetrating Radar for Non-Destructive Surveying: Design and Implementation2023Independent thesis Advanced level (professional degree), 20 credits / 30 HE creditsStudent thesis
    Abstract [en]

    A lot of features that need to be scanned underground should not be disturbed, from waterlines to unmarked graves. A non-invasive way of probing underground is Ground-Penetrating Radar (GPR). GPR finds differences in materials with radar waves. However, GPR is human-operated and its position is generally determined with a GPS. In some cases, the presence of a human operator can be dangerous, and in other cases, the GPS is not reliable (i.e. mines, glaciers). Therefore there are situations where an autonomous and non-GPS-reliant solution is preferable. The current state of the autonomous GPR system targeted in this work has a non-intuitive GUI that requires an experienced hand to operate. I present an updated hardware and software platform with an intuitive GUI. This updated autonomous system continuously builds a map of its surroundings with Simultaneous Mapping And Localization (SLAM). SLAM localizes itself within the map through sensor-fused position estimates. After the survey is completed the positions are saved and integrated with radar data to be visualized. Robot Operating System 2 (ROS2) is the software I used that allows communications between hardware components, software systems, and the GUI. The new hardware package uses only one source of power and is built using quick connectors that allow for quick removal from the GPR platform. This system allows for intuitive autonomous survey planning and execution in any field paired with a simple way of visualizing data.

    Download full text (pdf)
    fulltext
  • 21.
    Billing, Erik
    et al.
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Hellström, Thomas
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Janlert, Lars Erik
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Simultaneous control and recognition of demonstrated behavior2011Report (Other academic)
    Abstract [en]

    A method for Learning from Demonstration (LFD) is presented and evaluated on a simulated Robosoft Kompai robot. The presented algorithm, called Predictive Sequence Learning (PSL), builds fuzzy rules describing temporal relations between sensory-motor events recorded while a human operator is tele-operating the robot. The generated rule base can be used to control the robot and to predict expected sensor events in response to executed actions. The rule base can be trained under different contexts, represented as fuzzy sets. In the present work, contexts are used to represent different behaviors. Several behaviors can in this way be stored in the same rule base and partly share information. The context that best matches present circumstances can be identified using the predictive model and the robot can in this way automatically identify the most suitable behavior for precent circumstances. The performance of PSL as a method for LFD is evaluated with, and without, contextual information. The results indicate that PSL without contexts can learn and reproduce simple behaviors. The system also successfully identifies the most suitable context in almost all test cases. The robot's ability to reproduce more complex behaviors, with partly overlapping and conflicting information, significantly increases with the use of contexts. The results support a further development of PSL as a component of a dynamic hierarchical system performing control and predictions on several levels of abstraction. 

    Download full text (pdf)
    fulltext
  • 22. Bontsema, J.
    et al.
    Hemming, J.
    Pekkeriet, E.
    Saeys, W.
    Edan, Y.
    Shapiro, A.
    Hočevar, M.
    Hellström, Thomas
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Oberti, R.
    Armada, M.
    Ulbrich, H.
    Baur, J.
    Debilde, B.
    Best, S.
    Evain, S.
    Gauchel, W.
    Ringdahl, Ola
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    CROPS: high tech agricultural robots2014Conference paper (Other academic)
  • 23.
    Burman, Hannes
    Umeå University, Faculty of Science and Technology, Department of Physics.
    Computer vision for automatic opening of fuming slag-furnace2021Independent thesis Advanced level (professional degree), 20 credits / 30 HE creditsStudent thesis
    Abstract [en]

    This thesis covers the implementation of visual algorithms for a robot that is to operate at a smelter furnace. The goal is for the robot to replace a human in the opening, closing and flow regulation process as danger can arise when 1300°C slag flows out of the furnace. A thermal lance is used for opening the furnace which means the robot also has to understand if the lance is burning or not. A heat camera with temperature intervals 0-660°C and 300-2000°C was used to record the furnace during these critical moments which has been used to test different vision and tracking algorithms, such as mean shift and continuously adaptive mean shift. The heat images were filtered to extract only the relevant slag flow part, which then were used to track if slag was flowing, and see how large the slag flow was. Opening of the furnace was possible to identify for both temperature intervals. For the closing of the furnace both intervals were also successful, but the lower interval used a different algorithm for this case to be successful. A relative slag flow has been identified which looks promising for further real life studies. The ignition of the lance result is inconclusive as the data recorded was not fit for analysing this case, though a few conclusions could be made indicating a thermal camera may be unfit to track the thermal lance state.

    Download full text (pdf)
    fulltext
  • 24.
    Butt, Waqqas ur Rehman
    et al.
    Comp Info Sciences (CIS), Higher Colleges of Technology Ras Al Khaimah, UAE.
    Servin, Martin
    Umeå University, Faculty of Science and Technology, Department of Physics.
    Samara, Khalid
    Comp Info Sciences (CIS), Higher Colleges of Technology Ras Al Khaimah, UAE.
    Rahman, Emad Abd Al
    Comp Info Sciences (CIS), Higher Colleges of Technology Ras Al Khaimah, UAE.
    Kouki, Samia
    Comp Info Sciences (CIS), Higher Colleges of Technology Ras Al Khaimah, UAE; Latice Laboratory, University of Tunis, Tunisia.
    Bouchahma, Majed
    Comp Info Sciences (CIS), Higher Colleges of Technology Ras Al Khaimah, UAE.
    Static and Moving Object Detection and Segmentation in Videos2019In: 2019 Sixth HCT Information Technology Trends (ITT): Emerging Technologies – Blockchain and IoT, IEEE, 2019, p. 197-201Conference paper (Refereed)
    Abstract [en]

    This paper presents static object detection and segmentation method in videos. In this context, background subtraction BS technique based on the frame difference concept is applied to the identification of static objects. First, we estimate a frame differencing foreground mask by computing the difference of each frame with respect to a static reference frame image. The Mixture of Gaussian MOG method is applied to detect the moving particles and then outcome foreground mask is subtracted from frame differencing mask. Pre-processing techniques are applied to reduce the noise from the scene. Finally, morphological operation and largest connected component analysis are applied to segment the object. The proposed method was effectively validated with two public data sets. The results demonstrate the proposed approach can robustly detect, and segment the static objects without any prior information of tracking.

  • 25.
    Butt, Waqqas-ur-Rehman
    et al.
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Servin, Martin
    Umeå University, Faculty of Science and Technology, Department of Physics.
    The importance of silhouette optimization in 3D shape reconstruction system from multiple object scenesManuscript (preprint) (Other academic)
    Abstract [en]

    This paper presents a multistage 3D shape reconstruction system of multiple object scenes by considering the silhouette inconsistencies in the shape-from silhouette SFS method. These inconsistencies are common in multiple view images due to object occlusions in different views, segmentation, and shadows or reflection due to objects or light directions. These factors raise huge challenges when attempting to construct the 3D shape by using existing approaches that reconstruct only that part of the volume which projects consistently in all the silhouettes, leaving the rest unreconstructed. As a result, the final shape is not robust due to multiview objects' occlusion and shadows. In this regard, we consider the primary factors affecting reconstruction by analyzing the multiple images and perform pre-processing steps to optimize the silhouettes. Finally, the 3D shape is reconstructed by using the volumetric approach SFS. Theory and experimental results show that the performance of the modified algorithm was efficiently improved, which can improve the accuracy of the reconstructed shape and be robust to errors in the silhouettes, volume, and computationally inexpensive.

  • 26. Byrne, Tamara
    et al.
    Wold, Svante
    Umeå University, Faculty of Science and Technology, Department of Chemistry.
    Data Mining using PLS-Trees and other Projection Methods2011In: 2011 22nd Annual IEEE/SEMI Advanced Semiconductor Manufacturing Conference (ASMC), IEEE, 2011Conference paper (Refereed)
    Abstract [en]

    The amount of data measured during a typical manufacturing process is immense. To efficiently utilize these data without becoming overwhelmed with confusing and often conflicting information is difficult to impossible when using traditional univariate methods. Multivariate data mining methods can be used to examine large data sets by extracting relationships between variables to highlight variable correlations and deviations. Specifically, PLS-trees can be used to quickly identify significant clusters in large datasets and to highlight the differences within the groups.

  • 27.
    Bätz, Georg
    et al.
    Institute of Automatic Control Engineering, Technische Universität München, München, Germany.
    Mettin, Uwe
    Department of Engineering Cybernetics, Norwegian University of Science and Technology, Trondheim, Norway.
    Schmidts, Alexander
    Institute of Automatic Control Engineering, Technische Universität München, München, Germany.
    Scheint, Michael
    Institute of Automatic Control Engineering, Technische Universität München, München, Germany.
    Wollherr, Dirk
    Institute of Automatic Control Engineering, Technische Universität München, D-80290 München, Germany; Institute of Advanced Study, Technische Universität München, München, Germany.
    Shiriaev, Anton
    Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics. Department of Engineering Cybernetics, Norwegian University of Science and Technology, Trondheim, Norway.
    Ball dribbling with an underactuated continuous-time control phase: Theory & experiments2010In: 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, IEEE, 2010, p. 2890-2895, article id 5654307Conference paper (Refereed)
    Abstract [en]

    Ball dribbling is a central element of basketball. One main challenge for realizing basketball robots is to stabilize periodic motion of the ball. The task is nontrivial due to the discrete-continuous nature of the corresponding dynamics. This paper proposes to add an elastic element to the manipulator so the ball can be controlled in a continuous-time phase instead of an intermittent contact. Optimal catching and pushing trajectories are planned for the underactuated system based on the virtual holonomic constraints approach. First experimental studies are presented to evaluate the approach. 

  • 28.
    Castillo, Ismael
    et al.
    Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics.
    Freidovich, Leonid B.
    Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics.
    Barrier sliding mode control and on-line trajectory generation for the automation of a mobile hydraulic crane2018In: 15th International Workshop on Variable Structure Systems (VSS), IEEE, 2018, p. 162-167, article id 8460409Conference paper (Refereed)
    Abstract [en]

    In this paper we propose an implementation scheme of independent joint control for a four-degree-of-freedom heavy-duty hydraulic actuated crane. First, on-line generation of feasible trajectories, following a driver's lead and satisfying the actuator constrains for the redundant kinematic chain, is performed. Second, an implementation of two new Sliding Mode algorithms with variable barrier function gains, which allow robust tracking of the generated trajectory with alleviation of high frequency oscillations, is presented. Experimental results are presented to show the effectiveness of the proposed semi-automation scheme, exploiting the forestry application motivated low accuracy requirement.

  • 29.
    Chiou, Manolis
    et al.
    University of Birmingham, Birmingham, United Kingdom.
    Booth, Serena
    Massachusetts Institute of Technology, MA, Cambridge, United States.
    Lacerda, Bruno
    University of Oxford, Oxford, United Kingdom.
    Theodorou, Andreas
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Rothfuß, Simon
    Karlsruhe Institute of Technology, Karlsruhe, Germany.
    Variable Autonomy for Human-Robot Teaming (VAT)2023In: HRI '23: Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction, ACM Digital Library, 2023, p. 932-932Conference paper (Refereed)
    Abstract [en]

    As robots are introduced to various domains and applications, Human-Robot Teaming (HRT) capabilities are essential. Such capabilities involve teaming with humans in/on/out-the-loop at different levels of abstraction, leveraging the complementing capabilities of humans and robots. This requires robotic systems with the ability to dynamically vary their level or degree of autonomy to collaborate with the human(s) efficiently and overcome various challenging circumstances. Variable Autonomy (VA) is an umbrella term encompassing such research, including but not limited to shared control and shared autonomy, mixed-initiative, adjustable autonomy, and sliding autonomy. This workshop is driven by the timely need to bring together VA-related research and practices that are often disconnected across different communities as the field is relatively young. The workshop's goal is to consolidate research in VA. To this end, and given the complexity and span of Human-Robot systems, this workshop will adopt a holistic trans-disciplinary approach aiming to a) identify and classify related common challenges and opportunities; b) identify the disciplines that need to come together to tackle the challenges; c) identify and define common terminology, approaches, methodologies, benchmarks, and metrics; d) define short- and longterm research goals for the community. To achieve these objectives, this workshop aims to bring together industry stakeholders, researchers from fields under the banner of VA, and specialists from other highly related fields such as human factors and psychology. The workshop will consist of a mix of invited talks, contributed papers, and an interactive discussion panel, toward a shared vision for VA.

  • 30.
    Coser, Omar
    et al.
    Unit of Computer Systems and Bioinformatics, Università Campus Bio-Medico di Roma, Rome, Italy; Unit of Advanced Robotics and Human-Centered Technologies, Università Campus Bio-Medico di Roma, Rome, Italy.
    Tamantini, Christian
    Unit of Advanced Robotics and Human-Centered Technologies, Università Campus Bio-Medico di Roma, Rome, Italy.
    Soda, Paolo
    Umeå University, Faculty of Medicine, Department of Radiation Sciences, Radiation Physics. Umeå University, Faculty of Medicine, Department of Diagnostics and Intervention. Unit of Computer Systems and Bioinformatics, Università Campus Bio-Medico di Roma, Rome, Italy.
    Zollo, Loredana
    Unit of Advanced Robotics and Human-Centered Technologies, Università Campus Bio-Medico di Roma, Rome, Italy.
    AI-based methodologies for exoskeleton-assisted rehabilitation of the lower limb: a review2024In: Frontiers in Robotics and AI, E-ISSN 2296-9144, Vol. 11, article id 1341580Article, review/survey (Refereed)
    Abstract [en]

    Over the past few years, there has been a noticeable surge in efforts to design novel tools and approaches that incorporate Artificial Intelligence (AI) into rehabilitation of persons with lower-limb impairments, using robotic exoskeletons. The potential benefits include the ability to implement personalized rehabilitation therapies by leveraging AI for robot control and data analysis, facilitating personalized feedback and guidance. Despite this, there is a current lack of literature review specifically focusing on AI applications in lower-limb rehabilitative robotics. To address this gap, our work aims at performing a review of 37 peer-reviewed papers. This review categorizes selected papers based on robotic application scenarios or AI methodologies. Additionally, it uniquely contributes by providing a detailed summary of input features, AI model performance, enrolled populations, exoskeletal systems used in the validation process, and specific tasks for each paper. The innovative aspect lies in offering a clear understanding of the suitability of different algorithms for specific tasks, intending to guide future developments and support informed decision-making in the realm of lower-limb exoskeleton and AI applications.

    Download full text (pdf)
    fulltext
  • 31.
    Dong, Xiaowei
    et al.
    Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics.
    Mendoza-Trejo, Omar
    Ortiz Morales, Daniel
    Lindroos, Ola
    La Hera, Pedro
    Simulation-based comparison between two crane-bunk systems for loading work when considering energy-optimal motion planning2020In: International Journal of Forest Engineering, ISSN 1494-2119, E-ISSN 1913-2220, Vol. 31, no 1, p. 70-77Article in journal (Refereed)
    Abstract [en]

    Performing work for extended periods of time while using the lowest amount of resources is an important aspect for productivity in many industries. In forestry, the productivity of a forwarder is seen as the volume of material it can extract to a roadside landing in a certain amount of time, where the process of loading and unloading logs represents a large part of the work. During this process, the esnergy consumed by the machine is directly related to the speed of the crane. Thus, increasing productivity implies increasing the operating velocity of cranes. But according to current design of forestry cranes, this conversely leads to an undesired increase in consumption of resources (e.g. fuel). A second method is to alter the machine's design, such as rotating the log bunk. This article considers both methods through a simulation-based comparison aiming to evaluate the energy consumption of two crane-bunk systems when loading. The first simulation system considers a forestry crane with a fixed log bunk (forwarder-like crane). The second simulation system takes into account a forestry crane and a rotating log bunk (harwarder-like crane). The analysis presented considers the fundamental mathematics required to analyze the dynamics of forestry cranes and the principles required to plan energy-optimal motions. The simulation results show that energy savings of 43% to 61% can be obtained by determining energy-optimal motions and using a harwarder-like crane architecture.

    Download full text (pdf)
    fulltext
  • 32.
    Edström, Filip
    et al.
    Umeå University, Faculty of Social Sciences, Umeå School of Business and Economics (USBE), Statistics.
    Hellström, Thomas
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    de Luna, Xavier
    Umeå University, Faculty of Social Sciences, Umeå School of Business and Economics (USBE), Statistics.
    Robot causal discovery aided by human interaction2023In: 2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), IEEE, 2023, p. 1731-1736Conference paper (Refereed)
    Abstract [en]

    Causality is relatively unexplored in robotics even if it is highly relevant, in several respects. In this paper, we study how a robot’s causal understanding can be improved by allowing the robot to ask humans causal questions. We propose a general algorithm for selecting direct causal effects to ask about, given a partial causal representation (using partially directed acyclic graphs, PDAGs) obtained from observational data. We propose three versions of the algorithm inspired by different causal discovery techniques, such as constraint-based, score-based, and interventions. We evaluate the versions in a simulation study and our results show that asking causal questions improves the causal representation over all simulated scenarios. Further, the results show that asking causal questions based on PDAGs discovered from data provides a significant improvement compared to asking questions at random, and the version inspired by score-based techniques performs particularly well over all simulated experiments.

  • 33.
    Elebro, Christoffer
    Umeå University, Faculty of Science and Technology, Department of Physics.
    Enhancing GPR Measurements using Real Time Kinematics and LiDAR Mapping2022Independent thesis Advanced level (professional degree), 20 credits / 30 HE creditsStudent thesis
    Abstract [en]

    A Ground Penetrating Radar (GPR) is a non-invasive measurement tool to locate objects

    in the subsurface. The GPR transmits electromagnetic waves into the ground and

    records the waves reflected from surface interfaces of different materials. To accurately

    find these surfaces after measuring, it is important to record the precise location of

    the GPR and minimize reflected noise. Since a GPR cannot distinguish the direction

    from which the waves were reflected, this can result in a misinterpretation of the data

    if waves are reflected from surrounding objects. This problem can be reduced by also

    mapping objects in the surroundings. The work of this thesis is aimed at implementing

    a system that uses a Real-Time Kinematics (RTK) GNSS (Global Navigation Satellite

    System) receiver for precise positioning together with a 2D-LiDAR (Light Detection

    And Ranging) to record a 3D map of the surroundings. We used the 3D-LiDAR system

    to record vertical planes (cross-sections) that were processed into a 3D volume

    map. We found that the RTK GNSS receiver performed well and delivered the position

    within centimeters when provided with corrections, while it was about 2.5 m off

    without corrections. The performance was compared with a professional-grade Leica

    RTK receiver and the difference in latitude and longitude ranged from 0.001-0.002 m

    and 0.002-0.004 m, respectively. By fusing the RTK position with the LiDAR data using

    the software Robot Operating System (ROS), we created 3D maps that represented

    the surroundings along the traveled path. Our developed system, consisting of an RTK

    GNSS receiver and the 2D LiDAR, gave promising results and we are optimistic that

    combining the system with a GPR can improve the interpretation of the subsurface.

    Thus, the proposed method seems promising to be used during GPR mapping.

    Download full text (pdf)
    fulltext
  • 34. Eriksson, Lennart
    et al.
    Trygg, Johan
    Umeå University, Faculty of Science and Technology, Department of Chemistry.
    Wold, Svante
    Umeå University, Faculty of Science and Technology, Department of Chemistry. Umetrics Inc., 42 Pine Hill Rd, Hollis, NH 03049, USA.
    PLS-trees (R), a top-down clustering approach2009In: Journal of Chemometrics, ISSN 0886-9383, E-ISSN 1099-128X, Vol. 23, no 11, p. 569-580Article in journal (Refereed)
    Abstract [en]

    A hierarchical clustering approach based on a set of PLS models is presented. Called PLS-Trees (R), this approach is analogous to classification and regression trees (CART), but uses the scores of PLS regression models as the basis for splitting the clusters, instead of the individual X-variables. The split of one cluster into two is made along the sorted first X-score (t(1)) of a PLS model of the cluster, but may potentially be made along a direction corresponding to a combination of scores. The position of the split is selected according to the improvement of a weighted combination of (a) the variance of the X-score, (b) the variance of Y and (c) a penalty function discouraging an unbalanced split with very different numbers of observations. Cross-validation is used to terminate the branches of the tree, and to determine the number of components of each cluster PLS model. Some obvious extensions of the approach to OPLS-Trees and trees based on hierarchical PLS or OPLS models with the variables divided in blocks depending on their type, are also mentioned. The possibility to greatly reduce the number of variables in each PLS model on the basis of their PLS w-coefficients is also pointed out. The approach is illustrated by means of three examples. The first two examples are quantitative structure-activity relationship (QSAR) data sets, while the third is based on hyperspectral images of liver tissue for identifying different sources of variability in the liver samples.

  • 35.
    Fodor, Szabolcs
    Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics.
    Towards semi-automation of forestry cranes: automated trajectory planning and active vibration damping2017Doctoral thesis, comprehensive summary (Other academic)
    Abstract [en]

    Forests represent one of the biggest terrestrial ecosystems of Earth, that can produce important raw renewable materials such as wood with the help of sun, air and water. To efficiently extract these raw materials, the tree harvesting process is highly mechanized in developed countries, meaning that advanced forestry machines are continuously used to fell, to process and to transport the logs and biomass obtained from the forests. However, working with these machines is demanding both mentally and physically, which are known factors to negatively affect operator productivity. Mental fatigue is mostly due to the manual operation of the on-board knuckleboom crane, which requires advanced cognitive work with two joystick levers, while the most serious physical strains arise from cabin vibrations. These vibrations are generated from knuckleboom crane vibrations as a result of aggressive manual operation.

    To enhance operator workload, well-being, and to increase productivity of the logging process, semi-automation functions are suggested, which are supervised automatic executions of specific work elements. Some of the related issues are addressed in the current thesis. Therefore, the content is divided into: (1) the design and development of a semi-automation function focused only on the base joint actuator (slewing actuator) of a knuckleboom crane, and (2) active vibration damping solutions to treat crane structure vibrations induced by the main lift cylinder (inner boom actuator). The considered reference machine is a downsized knuckleboom crane of a forwarder machine, which is used to pick up log assortments from a harvesting site.

    The proposed semi-automation function presented in the first part could be beneficial for operators to use during log loading/unloading scenarios. It consists from a closed-loop position control architecture, to which smooth reference slewing trajectories are provided by a trajectory planner that is automated via operator commands. The used trajectory generation algorithms are taken from conventional robotics and adapted to semi-automation context with proposed modifications that can be customizable by operators.

    Further, the proposed active vibration damping solutions are aimed to reduce vibrations of the knuckleboom crane excited by the inner boom actuator due to aggressive manual commands. First, a popular input shaping control technique combined with a practical switching logic was investigated to deal with the excited payload oscillations. This technique proved to be useful with a fixed crane pose, however it did not provide much robustness in terms of different link configurations. To tackle this problem an H2-optimal controller is developed, which is active in the pressure feedback-loop and its solely purpose is to damp the same payload oscillations. During the design process, operator commands are treated and explained from input disturbance viewpoint.

    All of the hypothesis throughout this thesis were verified with extensive experimental studies using the reference machine.

    Download full text (pdf)
    fulltext
    Download (pdf)
    spikblad
    Download (png)
    presentationsbild
  • 36.
    Fodor, Szabolcs
    et al.
    Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics.
    Freidovich, Leonid
    Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics.
    Active vibration damping using H2-optimal feedback control design for forestry cranesManuscript (preprint) (Other academic)
    Abstract [en]

    Nowadays, forest harvesting is highly mechanized. The commercially available forestry machines are equipped with knuckleboom cranes that are hydraulically actuated, and manually controlled through a set of joysticks and buttons. A common problem that human operators face during manipulation of such knuckleboom cranes, are the crane structure oscillations created by non-smooth or too aggressive manual joystick-based commands. These oscillations not only contribute to actuator wear, but are also dangerous for operators and the environment as well. The current paper investigates the oscillation attenuation induced by the motion of the inner boom actuator and is based on H2-optimal controller synthesis active in the pressure feedback loop. Furthermore, the controller robustness is verified experimentally considering different working conditions of the reference machine, which also verifies the effectiveness of the approach. 

  • 37.
    Fodor, Szabolcs
    et al.
    Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics.
    Freidovich, Leonid
    Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics.
    Vázquez, Carlos
    Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics.
    Practical trajectory designs for semi-automation of forestry cranes2016In: Proceedings of  ISR 2016: 47th International Symposium on Robotics, VDE Verlag GmbH, 2016, p. 1-8Conference paper (Refereed)
    Abstract [en]

    Simplifying the operation of forestry machines with operator-centered semi-automation is needed in the modern timber harvesting industry in order to increase operator productivity and comfort, to reduce learning time of novice operators and to ensure safer manipulation of the cranes. In this paper, useful tools towards operator-centered semi-automation of the base joint actuator of a forwarder crane are proposed. The main goal is to allow comfortable automated motions that do not excite dangerous oscillations of the freely-hanging grapple. Moreover, operator commands are used interactively with a closed-loop position control scheme to assure automated slewing motions. Smooth reference trajectories are provided for the position controller with an on-line trajectory generation algorithm that is developed by combining properties of two standard trajectory generation methods. A practical algorithm based on experiments is introduced to find the trajectory that guaranties minimal grapple oscillations within a set of relatively fast trajectories. Further on, the log loading/unloading tasks are discussed and verified experimentally using the proposed approach on a forwarder crane prototype.

  • 38.
    Fodor, Szabolcs
    et al.
    Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics.
    Vázquez, Carlos
    Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics.
    Freidovich, Leonid
    Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics.
    Automation of slewing motions for forestry cranes2015In: 2015 15th International Conference on Control, Automation and Systems (ICCAS), IEEE, 2015, p. 796-801Conference paper (Refereed)
    Abstract [en]

    The modern timber harvesting industry would be ineffective without heavy duty advanced machinery used for logging. However, with benefits of mechanization comes the operation complexity. Introducing automation is expected to reduce the mental and physical load on the operator and improve the machine use efficiency. Nonetheless, with current technology fully autonomous timber harvesting is impossible. In this paper a semi-automation scenario is presented using the base joint actuator of a forestry forwarder crane taking into consideration the need to attenuate unwanted oscillations of its hanging grapple. We address the necessary motion planning and motion stabilization tasks. To reduce oscillations along a nominal trajectory, we design smooth reference profiles based on experiments. Meanwhile, a practical structure for a feedback controller is proposed and tested. In this process, actuator nonlinearities are dealt with feasible identification and compensation techniques.

  • 39.
    Fodor, Szabolcs
    et al.
    Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics.
    Vázquez, Carlos
    Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics.
    Freidovich, Leonid
    Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics.
    Interactive on-line trajectories for semi-automation: case study of a forwarder crane2016In: Proceedings of 2016 IEEE International Conference on Automation Science and Engineering (CASE), IEEE, 2016, p. 928-933Conference paper (Refereed)
    Abstract [en]

    Working with forestry cranes is not easy due to their complex mechanical structure, non-linear behavior of the hydraulic actuation system, and non-intuitive joint-based control; however, with automation, the level of manipulation difficulty can be reduced. This is potentially useful for the operators since they are prone to be more productive if semi-automation functions are introduced to a certain level. In this paper, a semi-automation function for the base joint actuator of a forestry forwarder crane is proposed. The semi-automation function is based on a design of an interactive on-line trajectory generation algorithm with variable final time that acts as a reference signal to a closed-loop position controller. Moreover, the advantage of this scheme is that the operators are kept in the loop by directly being in charge of controlling the final time for the on-line trajectory generation algorithm. Experiments with a downsized industry-standard forwarder crane verify the applicability and advantage of the proposed scheme.

  • 40.
    Fodor, Szabolcs
    et al.
    Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics.
    Vázquez, Carlos
    Ålö AB, Umeå, Sweden.
    Freidovich, Leonid
    Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics.
    Sepehri, Nariman
    Towards oscillation reduction in forestry cranes2016In: Proceedings of the Bath/ASME 2016 Symposium on Fluid Power and Motion Control, ASME Press, 2016, article id V001T01A049Conference paper (Refereed)
    Abstract [en]

    Smooth operation of heavy-duty forestry cranes is not an easy task for the operators with the current joystick-based control method that is complex and non-intuitive. Moreover, abrupt movements of the same joysticks provoke aggressive signals that can lead to oscillatory motions in the actuators and in the entire crane. These oscillations, not only contribute to wear of the joint actuators but also can cause damage to both the operators and the environment; therefore, they must be attenuated. The proposed approach in this paper uses the popular input shaping control technique combined with a practical switching logic to deal with different frequency payload oscillations induced by the motion of the inner boom actuator of a forwarder crane. The results show a significant improvement in terms of visible oscillation reduction monitored through their appearance in the torque signal computed from pressure measurements. Experiments performed on a down-sized forestry crane verifies the effectiveness of the approach.

  • 41.
    Fonooni, Benjamin
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Cognitive Interactive Robot Learning2014Doctoral thesis, comprehensive summary (Other academic)
    Abstract [en]

    Building general purpose autonomous robots that suit a wide range of user-specified applications, requires a leap from today's task-specific machines to more flexible and general ones. To achieve this goal, one should move from traditional preprogrammed robots to learning robots that easily can acquire new skills. Learning from Demonstration (LfD) and Imitation Learning (IL), in which the robot learns by observing a human or robot tutor, are among the most popular learning techniques. Showing the robot how to perform a task is often more natural and intuitive than figuring out how to modify a complex control program. However, teaching robots new skills such that they can reproduce the acquired skills under any circumstances, on the right time and in an appropriate way, require good understanding of all challenges in the field. Studies of imitation learning in humans and animals show that several cognitive abilities are engaged to learn new skills correctly. The most remarkable ones are the ability to direct attention to important aspects of demonstrations, and adapting observed actions to the agents own body. Moreover, a clear understanding of the demonstrator's intentions and an ability to generalize to new situations are essential. Once learning is accomplished, various stimuli may trigger the cognitive system to execute new skills that have become part of the robot's repertoire. The goal of this thesis is to develop methods for learning from demonstration that mainly focus on understanding the tutor's intentions, and recognizing which elements of a demonstration need the robot's attention. An architecture containing required cognitive functions for learning and reproduction of high-level aspects of demonstrations is proposed. Several learning methods for directing the robot's attention and identifying relevant information are introduced. The architecture integrates motor actions with concepts, objects and environmental states to ensure correct reproduction of skills. Another major contribution of this thesis is methods to resolve ambiguities in demonstrations where the tutor's intentions are not clearly expressed and several demonstrations are required to infer intentions correctly. The provided solution is inspired by human memory models and priming mechanisms that give the robot clues that increase the probability of inferring intentions correctly. In addition to robot learning, the developed techniques are applied to a shared control system based on visual servoing guided behaviors and priming mechanisms. The architecture and learning methods are applied and evaluated in several real world scenarios that require clear understanding of intentions in the demonstrations. Finally, the developed learning methods are compared, and conditions where each of them has better applicability are discussed.

    Download full text (pdf)
    fulltext
    Download (pdf)
    spikblad
  • 42.
    Fonooni, Benjamin
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Robot Learning and Reproduction of High-Level Behaviors2013Licentiate thesis, comprehensive summary (Other academic)
    Abstract [en]

    Learning techniques are drawing extensive attention in the robotics community. Some reasons behind moving from traditional preprogrammed robots to more advanced human fashioned techniques are to save time and energy, and allow non-technical users to easily work with robots. Learning from Demonstration (LfD) and Imitation Learning (IL) are among the most popular learning techniques to teach robots new skills by observing a human or robot tutor.

    Flawlessly teaching robots new skills by LfD requires good understanding of all challenges in the field. Studies of imitation learning in humans and animals show that several cognitive abilities are engaged to correctly learn new skills. The most remarkable ones are the ability to direct attention to important aspects of demonstrations, and adapting observed actions to the agents own body. Moreover, a clear understanding of the demonstrator's intentions is essential for correctly and completely replicating the behavior with the same effects on the world. Once learning is accomplished, various stimuli may trigger the cognitive system to execute new skills that have become part of the repertoire.

    Considering identified main challenges, the current thesis attempts to model imitation learning in robots, mainly focusing on understanding the tutor's intentions and recognizing what elements of the demonstration need the robot's attention. Thereby, an architecture containing required cognitive functions for learning and reproducing high-level aspects of demonstrations is proposed. Several learning methods for directing the robot's attention and identifying relevant information are introduced. The architecture integrates motor actions with concepts, objects and environmental states to ensure correct reproduction of skills. This is further applied in learning object affordances, behavior arbitration and goal emulation.

    The architecture and learning methods are applied and evaluated in several real world scenarios that require clear understanding of goals and what to look for in the demonstrations. Finally, the developed learning methods are compared, and conditions where each of them has better applicability is specified.

    Download full text (pdf)
    Robot Learning and Reproduction of High-Level Behaviors
  • 43.
    Fonooni, Benjamin
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Sequential Learning From Demonstration Based On Semantic Networks2012In: Proceedings of Umeå's 15th Student Conference in Computing Science (USCCS 2012) / [ed] Suna Bensch, Frank Drewes, Håkan Gulliksson and Thomas Mejtoft, Umeå: Umeå University , 2012, p. 39-47Conference paper (Refereed)
    Abstract [en]

    Most of the humans day to day tasks include sequences ofactions that lead to a desired goal. In domains which humans are replacedby robots, the ability of learning new skills easy and fast plays animportant role. The aim of this research paper is to incorporate sequentiallearning into Learning from Demonstration (LfD) in an architecturewhich mainly focuses on high-level representation of behaviors. The primarygoal of the research is to investigate the possibility of utilizingSemantic Networks in order to enable the robot to learn new skills insequences.

    Download full text (pdf)
    fulltext
  • 44.
    Fonooni, Benjamin
    et al.
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Hellström, Thomas
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Janlert, Lars-Erik
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Learning High-Level Behaviors From Demonstration Through Semantic Networks2012In: Proceedings of 4th International Conference on Agents and Artificial Intelligence, 2012, p. 419-426Conference paper (Refereed)
    Abstract [en]

    In this paper we present an approach for high-level behavior recognition and selection integrated with alow-level controller to help the robot to learn new skills from demonstrations. By means of SemanticNetwork as the core of the method, the robot gains the ability to model the world with concepts and relatethem to low-level sensory-motor states. We also show how the generalization ability of Semantic Networkscan be used to extend learned skills to new situations.

    Download full text (pdf)
    fulltext
  • 45.
    Fonooni, Benjamin
    et al.
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Hellström, Thomas
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Janlert, Lars-Erik
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Towards Goal Based Architecture Design for Learning High-Level Representation of Behaviors from Demonstration2013In: 2013 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support (CogSIMA), 2013, p. 67-74Conference paper (Refereed)
    Abstract [en]

    This paper gives a brief overview of challenges indesigning cognitive architectures for Learning fromDemonstration. By investigating features and functionality ofsome related architectures, we propose a modular architectureparticularly suited for sequential learning high-levelrepresentations of behaviors. We head towards designing andimplementing goal based imitation learning that not only allowsthe robot to learn necessary conditions for executing particularbehaviors, but also to understand the intents of the tutor andreproduce the same behaviors accordingly.

  • 46.
    Fonooni, Benjamin
    et al.
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Thomas, Hellström
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Applying a Priming Mechanism for Intention Recognition in Shared Control2015In: 2015 IEEE INTERNATIONAL MULTI-DISCIPLINARY CONFERENCE ON COGNITIVE METHODS IN SITUATION AWARENESS AND DECISION SUPPORT (COGSIMA), 2015, p. 35-41Conference paper (Refereed)
    Abstract [en]

    In many robotics shared control applications, users are forced to focus hard on the robot due to the task’s high sensitivity or the robot’s misunderstanding of the user’s intention. This brings frustration and dissatisfaction to the user and reduces overall efficiency. The user’s intention is sometimes unclear and hard to identify without some kind of bias in the identification process. In this paper, we present a solution in which an attentional mechanism helps the robot to recognize the user’s intention. The solution uses a priming mechanism and parameterized behavior primitives to support intention recognition and improve shared control for teleoperation tasks.

  • 47.
    Fonooni, Benjamin
    et al.
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Thomas, Hellström
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    On the Similarities Between Control Based and Behavior Based Visual Servoing2015In: Proceedings of the 30th Annual ACM Symposium on Applied Computing, New York: Association for Computing Machinery (ACM), 2015, p. 320-326Conference paper (Refereed)
    Abstract [en]

    Abstract Robotics is tightly connected to both artificial intelligence (AI) and control theory. Both AI and control based robotics are active and successful research areas, but research is often conducted by well separated communities. In this paper, we compare the two approaches in a case study for the design of a robot that should move its arm towards an object with the help of camera data. The control based approach is a model-free version of Image Based Visual Servoing (IBVS), which is based on mathematical modeling of the sensing and motion task. The AI approach, here denoted Behavior-Based Visual Servoing (BBVS), contains elements that are biologically plausible and inspired by schema-theory. We show how the two approaches lead to very similar solutions, even identical given a few simplifying assumptions. This similarity is shown both analytically and numerically. However, in a simple picking task with a 3 DoF robot arm, BBVS shows significantly higher performance than the IBVS approach, partly because it contains more manually tuned parameters. While the results obviously do not apply to all tasks and solutions, it illustrates both strengths and weaknesses with both approaches, and how they are tightly connected and share many similarities despite very different starting points and methodologies.

  • 48.
    Fonooni, Benjamin
    et al.
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Thomas, Hellström
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Janlert, Lars-Erik
    Umeå University, Faculty of Science and Technology, Department of Computing Science.
    Priming as a means to reduce ambiguity in learning from demonstration2016In: International Journal of Social Robotics, ISSN 1875-4791, E-ISSN 1875-4805, Vol. 8, no 1, p. 5-19Article in journal (Refereed)
    Abstract [en]

    Learning from Demonstration (LfD) is an established robot learning technique by which a robot acquires a skill by observing a human or robot teacher demonstrating the skill. In this paper we address the ambiguity involved in inferring the intention with one or several demonstrations. We suggest a method based on priming, and a memory model with similarities to human learning. Conducted experiments show that the developed method leads to faster and improved understanding of the intention with a demonstration by reducing ambiguity.

  • 49.
    Freidovich, Leonid
    Michigan State University.
    Constrained joint PD plus controller for flexible link robots2000Conference paper (Refereed)
    Abstract [en]

    A class of globally asymptotically stable regulators for a finite-dimensional model of robot arm with flexible links under gravity is presented. The control law is formed as the sum of static compensation of gravity at the desired position and constrained state feedback. Only some of generalized coordinates (joint positions and velocities) are assumed available for measurement and saturation in amplifier characteristic curves is taken into account. Copyright (C) 2000 IFAC.

  • 50.
    Freidovich, Leonid
    Umeå University, Faculty of Science and Technology, Department of Applied Physics and Electronics.
    Control methods for robotic applications: lecture notes2013Book (Other academic)
1234 1 - 50 of 189
CiteExportLink to result list
Permanent link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf