TY - CHAP A1 - Eichenbaum, Julian A1 - Nikolovski, Gjorgji A1 - Mülhens, Leon A1 - Reke, Michael A1 - Ferrein, Alexander A1 - Scholl, Ingrid T1 - Towards a lifelong mapping approach using Lanelet 2 for autonomous open-pit mine operations T2 - 2023 IEEE 19th International Conference on Automation Science and Engineering (CASE) N2 - Autonomous agents require rich environment models for fulfilling their missions. High-definition maps are a well-established map format which allows for representing semantic information besides the usual geometric information of the environment. These are, for instance, road shapes, road markings, traffic signs or barriers. The geometric resolution of HD maps can be as precise as of centimetre level. In this paper, we report on our approach of using HD maps as a map representation for autonomous load-haul-dump vehicles in open-pit mining operations. As the mine undergoes constant change, we also need to constantly update the map. Therefore, we follow a lifelong mapping approach for updating the HD maps based on camera-based object detection and GPS data. We show our mapping algorithm based on the Lanelet 2 map format and show our integration with the navigation stack of the Robot Operating System. We present experimental results on our lifelong mapping approach from a real open-pit mine. Y1 - 2023 SN - 979-8-3503-2069-5 (Online) SN - 979-8-3503-2070-1 (Print) U6 - http://dx.doi.org/10.1109/CASE56687.2023.10260526 N1 - 19th International Conference on Automation Science and Engineering (CASE), 26-30 August 2023, Auckland, New Zealand. PB - IEEE ER - TY - CHAP A1 - Nikolovski, Gjorgji A1 - Limpert, Nicolas A1 - Nessau, Hendrik A1 - Reke, Michael A1 - Ferrein, Alexander T1 - Model-predictive control with parallelised optimisation for the navigation of autonomous mining vehicles T2 - 2023 IEEE Intelligent Vehicles Symposium (IV) N2 - The work in modern open-pit and underground mines requires the transportation of large amounts of resources between fixed points. The navigation to these fixed points is a repetitive task that can be automated. The challenge in automating the navigation of vehicles commonly used in mines is the systemic properties of such vehicles. Many mining vehicles, such as the one we have used in the research for this paper, use steering systems with an articulated joint bending the vehicle’s drive axis to change its course and a hydraulic drive system to actuate axial drive components or the movements of tippers if available. To address the difficulties of controlling such a vehicle, we present a model-predictive approach for controlling the vehicle. While the control optimisation based on a parallel error minimisation of the predicted state has already been established in the past, we provide insight into the design and implementation of an MPC for an articulated mining vehicle and show the results of real-world experiments in an open-pit mine environment. KW - Mpc KW - Control KW - Path-following KW - Navigation KW - Automation Y1 - 2023 SN - 979-8-3503-4691-6 (Online) SN - 979-8-3503-4692-3 (Print) U6 - http://dx.doi.org/10.1109/IV55152.2023.10186806 N1 - IEEE Symposium on Intelligent Vehicle, 4.-7. June 2023, Anchorage, AK, USA. PB - IEEE ER - TY - CHAP A1 - Nikolovski, Gjorgji A1 - Reke, Michael A1 - Elsen, Ingo A1 - Schiffer, Stefan T1 - Machine learning based 3D object detection for navigation in unstructured environments T2 - 2021 IEEE Intelligent Vehicles Symposium Workshops (IV Workshops) N2 - In this paper we investigate the use of deep neural networks for 3D object detection in uncommon, unstructured environments such as in an open-pit mine. While neural nets are frequently used for object detection in regular autonomous driving applications, more unusual driving scenarios aside street traffic pose additional challenges. For one, the collection of appropriate data sets to train the networks is an issue. For another, testing the performance of trained networks often requires tailored integration with the particular domain as well. While there exist different solutions for these problems in regular autonomous driving, there are only very few approaches that work for special domains just as well. We address both the challenges above in this work. First, we discuss two possible ways of acquiring data for training and evaluation. That is, we evaluate a semi-automated annotation of recorded LIDAR data and we examine synthetic data generation. Using these datasets we train and test different deep neural network for the task of object detection. Second, we propose a possible integration of a ROS2 detector module for an autonomous driving platform. Finally, we present the performance of three state-of-the-art deep neural networks in the domain of 3D object detection on a synthetic dataset and a smaller one containing a characteristic object from an open-pit mine. KW - 3D object detection KW - LiDAR KW - autonomous driving KW - Deep learning KW - Three-dimensional displays Y1 - 2021 SN - 978-1-6654-7921-9 U6 - http://dx.doi.org/10.1109/IVWorkshops54471.2021.9669218 N1 - 2021 IEEE Intelligent Vehicles Symposium Workshops (IV Workshops), 11-17 July 2021, Nagoya, Japan. SP - 236 EP - 242 PB - IEEE ER -