TY - CHAP A1 - Michaux, Frank A1 - Brunn, André A1 - Willert, Christian A1 - Kallweit, Stephan T1 - Automatic setup and calibration of a Robotic-PIV system using fiducial markers T2 - 21st International Symposium on Application of Laser and Imaging Techniques to Fluid Mechanics N2 - The use of industrial robots allows the precise manipulation of all components necessary for setting up a large-scale particle image velocimetry (PIV) system. The known internal calibration matrix of the cameras in combination with the actual pose of the industrial robots and the calculated transform from the fiducial markers to camera coordinates allow the precise positioning of the individual PIV components according to the measurement demands. In addition, the complete calibration procedure for generating the external camera matrix and the mapping functions for e.g. dewarping the stereo images can be automatically determined without further user interaction and thus the degree of automation can be extended to nearly 100%. This increased degree of automation expands the applications range of PIV systems, in particular for measurement tasks with severe time constraints. KW - PIV calibration KW - Automation KW - Robotics KW - Fiducial marker system KW - Recognition algorithms Y1 - 2024 U6 - https://doi.org/10.55037/lxlaser.21st.163 N1 - 21st International Symposium on Application of Laser and Imaging Techniques to Fluid Mechanics, Lisbon, Portugal, July 8-11, 2024 ER - TY - CHAP A1 - Ferrein, Alexander A1 - Nikolovski, Gjorgji A1 - Limpert, Nicolas A1 - Reke, Michael A1 - Schiffer, Stefan A1 - Scholl, Ingrid ED - Küçük, Serdar T1 - Controlling a Fleet of Autonomous LHD Vehicles in Mining Operation T2 - Multi-Robot Systems - New Advances N2 - In this chapter, we report on our activities to create and maintain a fleet of autonomous load haul dump (LHD) vehicles for mining operations. The ever increasing demand for sustainable solutions and economic pressure causes innovation in the mining industry just like in any other branch. In this chapter, we present our approach to create a fleet of autonomous special purpose vehicles and to control these vehicles in mining operations. After an initial exploration of the site we deploy the fleet. Every vehicle is running an instance of our ROS 2-based architecture. The fleet is then controlled with a dedicated planning module. We also use continuous environment monitoring to implement a life-long mapping approach. In our experiments, we show that a combination of synthetic, augmented and real training data improves our classifier based on the deep learning network Yolo v5 to detect our vehicles, persons and navigation beacons. The classifier was successfully installed on the NVidia AGX-Drive platform, so that the abovementioned objects can be recognised during the dumper drive. The 3D poses of the detected beacons are assigned to lanelets and transferred to an existing map. Y1 - 2023 SN - 978-1-83768-290-4 U6 - https://doi.org/10.5772/intechopen.113044 PB - Intech Open CY - London ER - TY - CHAP A1 - Harlacher, Markus A1 - Altepost, Andrea A1 - Elsen, Ingo A1 - Ferrein, Alexander A1 - Hansen-Ampah, Adjan A1 - Merx, Wolfgang A1 - Niehues, Sina A1 - Schiffer, Stefan A1 - Shahinfar, Fatemeh Nasim ED - Lausberg, Isabel ED - Vogelsang, Michael T1 - Approach for the identification of requirements on the design of AI-supported work systems (in problem-based projects) T2 - AI in Business and Economics N2 - To successfully develop and introduce concrete artificial intelligence (AI) solutions in operational practice, a comprehensive process model is being tested in the WIRKsam joint project. It is based on a methodical approach that integrates human, technical and organisational aspects and involves employees in the process. The chapter focuses on the procedure for identifying requirements for a work system that is implementing AI in problem-driven projects and for selecting appropriate AI methods. This means that the use case has already been narrowed down at the beginning of the project and must be completely defined in the following. Initially, the existing preliminary work is presented. Based on this, an overview of all procedural steps and methods is given. All methods are presented in detail and good practice approaches are shown. Finally, a reflection of the developed procedure based on the application in nine companies is given. KW - Business understanding KW - Requirements KW - Process model KW - Participation KW - Im-plementation of AI-systems Y1 - 2024 SN - 9783110790320 U6 - https://doi.org/10.1515/9783110790320 SP - 87 EP - 99 PB - De Gruyter CY - Berlin ER - TY - CHAP A1 - Eichenbaum, Julian A1 - Nikolovski, Gjorgji A1 - Mülhens, Leon A1 - Reke, Michael A1 - Ferrein, Alexander A1 - Scholl, Ingrid T1 - Towards a lifelong mapping approach using Lanelet 2 for autonomous open-pit mine operations T2 - 2023 IEEE 19th International Conference on Automation Science and Engineering (CASE) N2 - Autonomous agents require rich environment models for fulfilling their missions. High-definition maps are a well-established map format which allows for representing semantic information besides the usual geometric information of the environment. These are, for instance, road shapes, road markings, traffic signs or barriers. The geometric resolution of HD maps can be as precise as of centimetre level. In this paper, we report on our approach of using HD maps as a map representation for autonomous load-haul-dump vehicles in open-pit mining operations. As the mine undergoes constant change, we also need to constantly update the map. Therefore, we follow a lifelong mapping approach for updating the HD maps based on camera-based object detection and GPS data. We show our mapping algorithm based on the Lanelet 2 map format and show our integration with the navigation stack of the Robot Operating System. We present experimental results on our lifelong mapping approach from a real open-pit mine. Y1 - 2023 SN - 979-8-3503-2069-5 (Online) SN - 979-8-3503-2070-1 (Print) U6 - https://doi.org/10.1109/CASE56687.2023.10260526 N1 - 19th International Conference on Automation Science and Engineering (CASE), 26-30 August 2023, Auckland, New Zealand. PB - IEEE ER - TY - CHAP A1 - Viehmann, Tarik A1 - Limpert, Nicolas A1 - Hofmann, Till A1 - Henning, Mike A1 - Ferrein, Alexander A1 - Lakemeyer, Gerhard ED - Eguchi, Amy ED - Lau, Nuno ED - Paetzel-Prüsmann, Maike ED - Wanichanon, Thanapat T1 - Winning the RoboCup logistics league with visual servoing and centralized goal reasoning T2 - RoboCup 2022: Robot World Cup XXV N2 - The RoboCup Logistics League (RCLL) is a robotics competition in a production logistics scenario in the context of a Smart Factory. In the competition, a team of three robots needs to assemble products to fulfill various orders that are requested online during the game. This year, the Carologistics team was able to win the competition with a new approach to multi-agent coordination as well as significant changes to the robot’s perception unit and a pragmatic network setup using the cellular network instead of WiFi. In this paper, we describe the major components of our approach with a focus on the changes compared to the last physical competition in 2019. Y1 - 2023 SN - 978-3-031-28468-7 (Print) SN - 978-3-031-28469-4 (Online) U6 - https://doi.org/https://doi.org/10.1007/978-3-031-28469-4_25 N1 - Robot World Cup, RoboCup 2022. 17. July 2023. Bangkok, Thailand. Part of the Lecture Notes in Computer Science book series (LNAI,volume 13561) SP - 300 EP - 312 PB - Springer CY - Cham ER - TY - JOUR A1 - Coll-Perales, Baldomero A1 - Schulte-Tigges, Joschua A1 - Rondinone, Michele A1 - Gozalvez, Javier A1 - Reke, Michael A1 - Matheis, Dominik A1 - Walter, Thomas T1 - Prototyping and evaluation of infrastructure-assisted transition of control for cooperative automated vehicles JF - IEEE Transactions on Intelligent Transportation Systems N2 - Automated driving is now possible in diverse road and traffic conditions. However, there are still situations that automated vehicles cannot handle safely and efficiently. In this case, a Transition of Control (ToC) is necessary so that the driver takes control of the driving. Executing a ToC requires the driver to get full situation awareness of the driving environment. If the driver fails to get back the control in a limited time, a Minimum Risk Maneuver (MRM) is executed to bring the vehicle into a safe state (e.g., decelerating to full stop). The execution of ToCs requires some time and can cause traffic disruption and safety risks that increase if several vehicles execute ToCs/MRMs at similar times and in the same area. This study proposes to use novel C-ITS traffic management measures where the infrastructure exploits V2X communications to assist Connected and Automated Vehicles (CAVs) in the execution of ToCs. The infrastructure can suggest a spatial distribution of ToCs, and inform vehicles of the locations where they could execute a safe stop in case of MRM. This paper reports the first field operational tests that validate the feasibility and quantify the benefits of the proposed infrastructure-assisted ToC and MRM management. The paper also presents the CAV and roadside infrastructure prototypes implemented and used in the trials. The conducted field trials demonstrate that infrastructure-assisted traffic management solutions can reduce safety risks and traffic disruptions. KW - Automated driving KW - automated vehicles KW - connected automated vehicles KW - CAV KW - experimental evaluation Y1 - 2021 U6 - https://doi.org/10.1109/TITS.2021.3061085 SN - 1524-9050 (Print) SN - 1558-0016 (Online) VL - 23 IS - 7 SP - 6720 EP - 6736 PB - IEEE ER - TY - CHAP A1 - Schulte-Tigges, Joschua A1 - Matheis, Dominik A1 - Reke, Michael A1 - Walter, Thomas A1 - Kaszner, Daniel ED - Krömker, Heidi T1 - Demonstrating a V2X enabled system for transition of control and minimum risk manoeuvre when leaving the operational design domain T2 - HCII 2023: HCI in Mobility, Transport, and Automotive Systems N2 - Modern implementations of driver assistance systems are evolving from a pure driver assistance to a independently acting automation system. Still these systems are not covering the full vehicle usage range, also called operational design domain, which require the human driver as fall-back mechanism. Transition of control and potential minimum risk manoeuvres are currently research topics and will bridge the gap until full autonomous vehicles are available. The authors showed in a demonstration that the transition of control mechanisms can be further improved by usage of communication technology. Receiving the incident type and position information by usage of standardised vehicle to everything (V2X) messages can improve the driver safety and comfort level. The connected and automated vehicle’s software framework can take this information to plan areas where the driver should take back control by initiating a transition of control which can be followed by a minimum risk manoeuvre in case of an unresponsive driver. This transition of control has been implemented in a test vehicle and was presented to the public during the IEEE IV2022 (IEEE Intelligent Vehicle Symposium) in Aachen, Germany. KW - V2X KW - Transiton of Control KW - Minimum Risk Manoeuvre KW - Operational Design Domain KW - Connected Automated Vehicle Y1 - 2023 SN - 978-3-031-35677-3 (Print) SN - 978-3-031-35678-0 (Online) U6 - https://doi.org/10.1007/978-3-031-35678-0_12 N1 - 5th International Conference, MobiTAS 2023, Held as Part of the 25th HCI International Conference, HCII 2023, Copenhagen, Denmark, July 23–28, 2023. SP - 200 EP - 210 PB - Springer CY - Cham ER - TY - CHAP A1 - Chavez Bermudez, Victor Francisco A1 - Cruz Castanon, Victor Fernando A1 - Ruchay, Marco A1 - Wollert, Jörg F. ED - Leipzig, Hochschule für Technik, Wirtschaft und Kultur T1 - Rapid prototyping framework for automation applications based on IO-Link T2 - Tagungsband AALE 2022: Wissenstransfer im Spannungsfeld von Autonomisierung und Fachkräftemangel N2 - The development of protype applications with sensors and actuators in the automation industry requires tools that are independent of manufacturer, and are flexible enough to be modified or extended for any specific requirements. Currently, developing prototypes with industrial sensors and actuators is not straightforward. First of all, the exchange of information depends on the industrial protocol that these devices have. Second, a specific configuration and installation is done based on the hardware that is used, such as automation controllers or industrial gateways. This means that the development for a specific industrial protocol, highly depends on the hardware and the software that vendors provide. In this work we propose a rapid-prototyping framework based on Arduino to solve this problem. For this project we have focused to work with the IO-Link protocol. The framework consists of an Arduino shield that acts as the physical layer, and a software that implements the IO-Link Master protocol. The main advantage of such framework is that an application with industrial devices can be rapid-prototyped with ease as its vendor independent, open-source and can be ported easily to other Arduino compatible boards. In comparison, a typical approach requires proprietary hardware, is not easy to port to another system and is closed-source. KW - Rapid-prototyping KW - Arduino KW - IO-Link KW - Industrial Communication Y1 - 2022 SN - 978-3-910103-00-9 U6 - https://doi.org/10.33968/2022.28 N1 - 18. AALE-Konferenz. Pforzheim, 09.03.-11.03.2022 CY - Leipzig ER - TY - JOUR A1 - Cheng, Chi-Tsun A1 - Wollert, Jörg F. A1 - Chen, Xi A1 - Fapojuwo, Abraham O. T1 - Guest Editorial : Circuits and Systems for Industry X.0 Applications JF - IEEE Journal on Emerging and Selected Topics in Circuits and Systems Y1 - 2023 U6 - https://doi.org/10.1109/JETCAS.2023.3278843 SN - 2156-3357 (Print) SN - 2156-3365 (Online) VL - 13 SP - 457 EP - 460 PB - IEEE CY - New York ET - 2 ER - TY - CHAP A1 - Nikolovski, Gjorgji A1 - Limpert, Nicolas A1 - Nessau, Hendrik A1 - Reke, Michael A1 - Ferrein, Alexander T1 - Model-predictive control with parallelised optimisation for the navigation of autonomous mining vehicles T2 - 2023 IEEE Intelligent Vehicles Symposium (IV) N2 - The work in modern open-pit and underground mines requires the transportation of large amounts of resources between fixed points. The navigation to these fixed points is a repetitive task that can be automated. The challenge in automating the navigation of vehicles commonly used in mines is the systemic properties of such vehicles. Many mining vehicles, such as the one we have used in the research for this paper, use steering systems with an articulated joint bending the vehicle’s drive axis to change its course and a hydraulic drive system to actuate axial drive components or the movements of tippers if available. To address the difficulties of controlling such a vehicle, we present a model-predictive approach for controlling the vehicle. While the control optimisation based on a parallel error minimisation of the predicted state has already been established in the past, we provide insight into the design and implementation of an MPC for an articulated mining vehicle and show the results of real-world experiments in an open-pit mine environment. KW - Mpc KW - Control KW - Path-following KW - Navigation KW - Automation Y1 - 2023 SN - 979-8-3503-4691-6 (Online) SN - 979-8-3503-4692-3 (Print) U6 - https://doi.org/10.1109/IV55152.2023.10186806 N1 - IEEE Symposium on Intelligent Vehicle, 4.-7. June 2023, Anchorage, AK, USA. PB - IEEE ER -