TY - CHAP A1 - Engemann, Heiko A1 - Du, Shengzhi A1 - Kallweit, Stephan A1 - Ning, Chuanfang A1 - Anwar, Saqib T1 - AutoSynPose: Automatic Generation of Synthetic Datasets for 6D Object Pose Estimation T2 - Machine Learning and Artificial Intelligence. Proceedings of MLIS 2020 N2 - We present an automated pipeline for the generation of synthetic datasets for six-dimension (6D) object pose estimation. Therefore, a completely automated generation process based on predefined settings is developed, which enables the user to create large datasets with a minimum of interaction and which is feasible for applications with a high object variance. The pipeline is based on the Unreal 4 (UE4) game engine and provides a high variation for domain randomization, such as object appearance, ambient lighting, camera-object transformation and distractor density. In addition to the object pose and bounding box, the metadata includes all randomization parameters, which enables further studies on randomization parameter tuning. The developed workflow is adaptable to other 3D objects and UE4 environments. An exemplary dataset is provided including five objects of the Yale-CMU-Berkeley (YCB) object set. The datasets consist of 6 million subsegments using 97 rendering locations in 12 different UE4 environments. Each dataset subsegment includes one RGB image, one depth image and one class segmentation image at pixel-level. Y1 - 2020 SN - 978-1-64368-137-5 U6 - https://doi.org/10.3233/FAIA200770 N1 - Frontiers in Artificial Intelligence and Applications. Vol 332 SP - 89 EP - 97 PB - IOS Press CY - Amsterdam ER - TY - JOUR A1 - Engemann, Heiko A1 - Du, Shengzhi A1 - Kallweit, Stephan A1 - Cönen, Patrick A1 - Dawar, Harshal T1 - OMNIVIL - an autonomous mobile manipulator for flexible production JF - Sensors Y1 - 2020 SN - 1424-8220 U6 - https://doi.org/10.3390/s20247249 N1 - Special issue: Sensor Networks Applications in Robotics and Mobile Systems VL - 20 IS - 24, art. no. 7249 SP - 1 EP - 30 PB - MDPI CY - Basel ER - TY - CHAP A1 - Ferrein, Alexander A1 - Meeßen, Marcus A1 - Limpert, Nicolas A1 - Schiffer, Stefan ED - Lepuschitz, Wilfried T1 - Compiling ROS schooling curricula via contentual taxonomies T2 - Robotics in Education N2 - The Robot Operating System (ROS) is the current de-facto standard in robot middlewares. The steadily increasing size of the user base results in a greater demand for training as well. User groups range from students in academia to industry professionals with a broad spectrum of developers in between. To deliver high quality training and education to any of these audiences, educators need to tailor individual curricula for any such training. In this paper, we present an approach to ease compiling curricula for ROS trainings based on a taxonomy of the teaching contents. The instructor can select a set of dedicated learning units and the system will automatically compile the teaching material based on the dependencies of the units selected and a set of parameters for a particular training. We walk through an example training to illustrate our work. Y1 - 2021 SN - 978-3-030-67411-3 U6 - https://doi.org/10.1007/978-3-030-67411-3_5 N1 - RiE: International Conference on Robotics in Education (RiE); Advances in Intelligent Systems and Computing book series (AISC, volume 1316) SP - 49 EP - 60 PB - Springer CY - Cham ER - TY - CHAP A1 - Ulmer, Jessica A1 - Braun, Sebastian A1 - Cheng, Chi-Tsun A1 - Dowey, Steve A1 - Wollert, Jörg T1 - Gamified Virtual Reality Training Environment for the Manufacturing Industry T2 - Proceedings of the 2020 19th International Conference on Mechatronics – Mechatronika (ME) N2 - Industry 4.0 imposes many challenges for manufacturing companies and their employees. Innovative and effective training strategies are required to cope with fast-changing production environments and new manufacturing technologies. Virtual Reality (VR) offers new ways of on-the-job, on-demand, and off-premise training. A novel concept and evaluation system combining Gamification and VR practice for flexible assembly tasks is proposed in this paper and compared to existing works. It is based on directed acyclic graphs and a leveling system. The concept enables a learning speed which is adjustable to the users’ pace and dynamics, while the evaluation system facilitates adaptive work sequences and allows employee-specific task fulfillment. The concept was implemented and analyzed in the Industry 4.0 model factory at FH Aachen for mechanical assembly jobs. Y1 - 2020 U6 - https://doi.org/10.1109/ME49197.2020.9286661 N1 - 2020 19th International Conference on Mechatronics – Mechatronika (ME), Prague, Czech Republic, December 2–4, 2020 SP - 1 EP - 6 PB - IEEE CY - New York, NY ER - TY - CHAP A1 - Chavez Bermudez, Victor Francisco A1 - Wollert, Jörg T1 - 10BASE-T1L industry 4.0 smart switch for field devices based on IO-Link T2 - 2022 IEEE 18th International Conference on Factory Communication Systems (WFCS) N2 - The recent amendment to the Ethernet physical layer known as the IEEE 802.3cg specification, allows to connect devices up to a distance of one kilometer and delivers a maximum of 60 watts of power over a twisted pair of wires. This new standard, also known as 10BASE-TIL, promises to overcome the limits of current physical layers used for field devices and bring them a step closer to Ethernet-based applications. The main advantage of 10BASE- TIL is that it can deliver power and data over the same line over a long distance, where traditional solutions (e.g., CAN, IO-Link, HART) fall short and cannot match its 10 Mbps bandwidth. Due to its recentness, IOBASE- TIL is still not integrated into field devices and it has been less than two years since silicon manufacturers released the first Ethernet-PHY chips. In this paper, we present a design proposal on how field devices could be integrated into a IOBASE-TIL smart switch that allows plug-and-play connectivity for sensors and actuators and is compliant with the Industry 4.0 vision. Instead of presenting a new field-level protocol for this work, we have decided to adopt the IO-Link specification which already includes a plug-and-play approach with features such as diagnosis and device configuration. The main objective of this work is to explore how field devices could be integrated into 10BASE-TIL Ethernet, its adaption with a well-known protocol, and its integration with Industry 4.0 technologies. KW - 10BASE-T1L KW - Ethernet KW - Field device KW - Sensors KW - IO-Link Y1 - 2022 SN - 978-1-6654-1086-1 SN - 978-1-6654-1087-8 U6 - https://doi.org/10.1109/WFCS53837.2022.9779176 N1 - 2022 IEEE 18th International Conference on Factory Communication Systems (WFCS), 27-29 April 2022, Pavia, Italy PB - IEEE CY - New York, NY ER - TY - CHAP A1 - Ulmer, Jessica A1 - Braun, Sebastian A1 - Cheng, Chi-Tsun A1 - Dowey, Steve A1 - Wollert, Jörg T1 - Usage of digital twins for gamification applications in manufacturing T2 - Procedia CIRP Leading manufacturing systems transformation – Proceedings of the 55th CIRP Conference on Manufacturing Systems 2022 N2 - Gamification applications are on the rise in the manufacturing sector to customize working scenarios, offer user-specific feedback, and provide personalized learning offerings. Commonly, different sensors are integrated into work environments to track workers’ actions. Game elements are selected according to the work task and users’ preferences. However, implementing gamified workplaces remains challenging as different data sources must be established, evaluated, and connected. Developers often require information from several areas of the companies to offer meaningful gamification strategies for their employees. Moreover, work environments and the associated support systems are usually not flexible enough to adapt to personal needs. Digital twins are one primary possibility to create a uniform data approach that can provide semantic information to gamification applications. Frequently, several digital twins have to interact with each other to provide information about the workplace, the manufacturing process, and the knowledge of the employees. This research aims to create an overview of existing digital twin approaches for digital support systems and presents a concept to use digital twins for gamified support and training systems. The concept is based upon the Reference Architecture Industry 4.0 (RAMI 4.0) and includes information about the whole life cycle of the assets. It is applied to an existing gamified training system and evaluated in the Industry 4.0 model factory by an example of a handle mounting. KW - Gamification KW - Digital Twin KW - Support System Y1 - 2022 U6 - https://doi.org/10.1016/j.procir.2022.05.044 SN - 2212-8271 N1 - 55th CIRP Conference on Manufacturing Systems, Jun 29, 2022 - Jul 01, 2022, Lugano, Switzerland VL - 107 SP - 675 EP - 680 PB - Elsevier CY - Amsterdam ER - TY - JOUR A1 - Schulte-Tigges, Joschua A1 - Förster, Marco A1 - Nikolovski, Gjorgji A1 - Reke, Michael A1 - Ferrein, Alexander A1 - Kaszner, Daniel A1 - Matheis, Dominik A1 - Walter, Thomas T1 - Benchmarking of various LiDAR sensors for use in self-driving vehicles in real-world environments JF - Sensors N2 - Abstract In this paper, we report on our benchmark results of the LiDAR sensors Livox Horizon, Robosense M1, Blickfeld Cube, Blickfeld Cube Range, Velodyne Velarray H800, and Innoviz Pro. The idea was to test the sensors in different typical scenarios that were defined with real-world use cases in mind, in order to find a sensor that meet the requirements of self-driving vehicles. For this, we defined static and dynamic benchmark scenarios. In the static scenarios, both LiDAR and the detection target do not move during the measurement. In dynamic scenarios, the LiDAR sensor was mounted on the vehicle which was driving toward the detection target. We tested all mentioned LiDAR sensors in both scenarios, show the results regarding the detection accuracy of the targets, and discuss their usefulness for deployment in self-driving cars. KW - Lidar KW - Benchmark KW - Self-driving Y1 - 2022 U6 - https://doi.org/10.3390/s22197146 SN - 1424-8220 N1 - This article belongs to the Special Issue "Sensor Fusion for Vehicles Navigation and Robotic Systems" VL - 22 IS - 19 PB - MDPI CY - Basel ER - TY - CHAP A1 - Dey, Thomas A1 - Elsen, Ingo A1 - Ferrein, Alexander A1 - Frauenrath, Tobias A1 - Reke, Michael A1 - Schiffer, Stefan ED - Makedon, Fillia T1 - CO2 Meter: a do-it-yourself carbon dioxide measuring device for the classroom T2 - PETRA '21: Proceedings of the 14th Pervasive Technologies Related to Assistive Environments Conference N2 - In this paper we report on CO2 Meter, a do-it-yourself carbon dioxide measuring device for the classroom. Part of the current measures for dealing with the SARS-CoV-2 pandemic is proper ventilation in indoor settings. This is especially important in schools with students coming back to the classroom even with high incidents rates. Static ventilation patterns do not consider the individual situation for a particular class. Influencing factors like the type of activity, the physical structure or the room occupancy are not incorporated. Also, existing devices are rather expensive and often provide only limited information and only locally without any networking. This leaves the potential of analysing the situation across different settings untapped. Carbon dioxide level can be used as an indicator of air quality, in general, and of aerosol load in particular. Since, according to the latest findings, SARS-CoV-2 can be transmitted primarily in the form of aerosols, carbon dioxide may be used as a proxy for the risk of a virus infection. Hence, schools could improve the indoor air quality and potentially reduce the infection risk if they actually had measuring devices available in the classroom. Our device supports schools in ventilation and it allows for collecting data over the Internet to enable a detailed data analysis and model generation. First deployments in schools at different levels were received very positively. A pilot installation with a larger data collection and analysis is underway. KW - embedded hardware KW - sensor networks KW - information systems KW - education KW - do-it-yourself Y1 - 2021 SN - 9781450387927 U6 - https://doi.org/10.1145/3453892.3462697 N1 - PETRA '21: The 14th PErvasive Technologies Related to Assistive Environments Conference Corfu Greece 29 June 2021- 2 July 2021 SP - 292 EP - 299 PB - Association for Computing Machinery CY - New York ER - TY - CHAP A1 - Viehmann, Tarik A1 - Limpert, Nicolas A1 - Hofmann, Till A1 - Henning, Mike A1 - Ferrein, Alexander A1 - Lakemeyer, Gerhard ED - Eguchi, Amy ED - Lau, Nuno ED - Paetzel-Prüsmann, Maike ED - Wanichanon, Thanapat T1 - Winning the RoboCup logistics league with visual servoing and centralized goal reasoning T2 - RoboCup 2022: Robot World Cup XXV N2 - The RoboCup Logistics League (RCLL) is a robotics competition in a production logistics scenario in the context of a Smart Factory. In the competition, a team of three robots needs to assemble products to fulfill various orders that are requested online during the game. This year, the Carologistics team was able to win the competition with a new approach to multi-agent coordination as well as significant changes to the robot’s perception unit and a pragmatic network setup using the cellular network instead of WiFi. In this paper, we describe the major components of our approach with a focus on the changes compared to the last physical competition in 2019. Y1 - 2023 SN - 978-3-031-28468-7 (Print) SN - 978-3-031-28469-4 (Online) U6 - https://doi.org/https://doi.org/10.1007/978-3-031-28469-4_25 N1 - Robot World Cup, RoboCup 2022. 17. July 2023. Bangkok, Thailand. Part of the Lecture Notes in Computer Science book series (LNAI,volume 13561) SP - 300 EP - 312 PB - Springer CY - Cham ER - TY - CHAP A1 - Eichenbaum, Julian A1 - Nikolovski, Gjorgji A1 - Mülhens, Leon A1 - Reke, Michael A1 - Ferrein, Alexander A1 - Scholl, Ingrid T1 - Towards a lifelong mapping approach using Lanelet 2 for autonomous open-pit mine operations T2 - 2023 IEEE 19th International Conference on Automation Science and Engineering (CASE) N2 - Autonomous agents require rich environment models for fulfilling their missions. High-definition maps are a well-established map format which allows for representing semantic information besides the usual geometric information of the environment. These are, for instance, road shapes, road markings, traffic signs or barriers. The geometric resolution of HD maps can be as precise as of centimetre level. In this paper, we report on our approach of using HD maps as a map representation for autonomous load-haul-dump vehicles in open-pit mining operations. As the mine undergoes constant change, we also need to constantly update the map. Therefore, we follow a lifelong mapping approach for updating the HD maps based on camera-based object detection and GPS data. We show our mapping algorithm based on the Lanelet 2 map format and show our integration with the navigation stack of the Robot Operating System. We present experimental results on our lifelong mapping approach from a real open-pit mine. Y1 - 2023 SN - 979-8-3503-2069-5 (Online) SN - 979-8-3503-2070-1 (Print) U6 - https://doi.org/10.1109/CASE56687.2023.10260526 N1 - 19th International Conference on Automation Science and Engineering (CASE), 26-30 August 2023, Auckland, New Zealand. PB - IEEE ER -