TY - CHAP A1 - Wittig, M. A1 - Rütters, René A1 - Bragard, Michael ED - Reiff-Stephan, Jörg ED - Jäkel, Jens ED - Schwarz, André T1 - Application of RL in control systems using the example of a rotatory inverted pendulum T2 - Tagungsband AALE 2024 : Fit für die Zukunft: praktische Lösungen für die industrielle Automation N2 - In this paper, the use of reinforcement learning (RL) in control systems is investigated using a rotatory inverted pendulum as an example. The control behavior of an RL controller is compared to that of traditional LQR and MPC controllers. This is done by evaluating their behavior under optimal conditions, their disturbance behavior, their robustness and their development process. All the investigated controllers are developed using MATLAB and the Simulink simulation environment and later deployed to a real pendulum model powered by a Raspberry Pi. The RL algorithm used is Proximal Policy Optimization (PPO). The LQR controller exhibits an easy development process, an average to good control behavior and average to good robustness. A linear MPC controller could show excellent results under optimal operating conditions. However, when subjected to disturbances or deviations from the equilibrium point, it showed poor performance and sometimes instable behavior. Employing a nonlinear MPC Controller in real time was not possible due to the high computational effort involved. The RL controller exhibits by far the most versatile and robust control behavior. When operated in the simulation environment, it achieved a high control accuracy. When employed in the real system, however, it only shows average accuracy and a significantly greater performance loss compared to the simulation than the traditional controllers. With MATLAB, it is not yet possible to directly post-train the RL controller on the Raspberry Pi, which is an obstacle to the practical application of RL in a prototyping or teaching setting. Nevertheless, RL in general proves to be a flexible and powerful control method, which is well suited for complex or nonlinear systems where traditional controllers struggle. KW - Rotatory Inverted Pendulum KW - MPC KW - LQR KW - PPO KW - Reinforcement Learning Y1 - 2024 SN - 978-3-910103-02-3 U6 - https://doi.org/10.33968/2024.53 N1 - 20. AALE-Konferenz. Bielefeld, 06.03.-08.03.2024. (Tagungsband unter https://doi.org/10.33968/2024.29) SP - 241 EP - 248 PB - le-tex publishing services GmbH CY - Leipzig ER - TY - PAT A1 - Hüning, Felix T1 - Positionssensorvorrichtung N2 - Die Erfindung betrifft eine Positionssensorvorrichtung zur Bestimmung einer Absolutposition eines beweglichen ersten Teils relativ zu einem ortsfesten zweiten Teil mit einem mit dem beweglichen ersten Teil gekoppelter Codekörper, der dazu eingerichtet ist, eine Codespur mit einer Mehrzahl von in Spurrichtung aufeinanderfolgenden Codeelementen zu enthalten zur Bildung eines Codewortes, mit einer magnetischen Detektionseinrichtung zur Detektion der Codespur, wobei die Detektionseinrichtung zum einen an dem Codekörper befestigte und entlang der Spurrichtung in einem solchen Abstand gegenpolig zueinander angeordnete Permanentmagneten aufweist, dass der Abstand mit einer vorgegebenen Länge der jeweiligen Codeelemente übereinstimmt, und zum anderen eine Anzahl von ortsfest und quer zu dem Codekörper versetzt angeordnete Wiegandsensoren aufweist, wobei der Abstand des Wiegandsensors zu einer Erstreckungsebene der Permanentmagneten derart gewählt ist, dass bei Überdeckung des Wiegandsensors durch den Permanentmagneten ein Wiegandpuls in dem Wiegandsensor induziert wird. Y1 - 2024 ER - TY - JOUR A1 - Schopp, Christoph A1 - Rohrbach, Felix A1 - Langer, Luc A1 - Heuermann, Holger T1 - Detection of welding wire length by active S11 measurement JF - IEEE Transactions on Plasma Science N2 - A novel method to determine the extruded length of a metallic wire for a directed energy deposition (DED) process using a microwave (MW) plasma jet with a straight-through wire feed is presented. The method is based on the relative comparison of the measured frequency response obtained by the large-signal scattering parameter (Hot-S) technique. In the practical working range, repeatability of less than 6% for a nonactive plasma and 9% for the active plasma state is found. Measurements are conducted with a focus on a simple solution to decrease the processing time and reduce the integration time of the process into the existing hardware. It is shown that monitoring a single frequency for magnitude and phase changes is sufficient to achieve good accuracy. A combination of different measurement values to determine the length is possible. The applicability to different diameter of the same material is shown as well as a contact detection of the wire and metallic substrate. KW - Circuit simulation KW - Hot S-parameter KW - Modeling KW - Plasma KW - Plasma diagnostics Y1 - 2024 U6 - https://doi.org/10.1109/TPS.2024.3356659 SN - 0093-3813 (Print) SN - 1939-9375 (Online) IS - Early Access SP - 1 EP - 6 PB - IEEE ER - TY - JOUR A1 - Turdumamatov, Samat A1 - Belda, Aljoscha A1 - Heuermann, Holger T1 - Shaping a decoupled atmospheric pressure microwave plasma with antenna structures, Maxwell’s equations, and boundary conditions JF - IEEE Transactions on Plasma Science N2 - This article addresses the need for an innovative technique in plasma shaping, utilizing antenna structures, Maxwell’s laws, and boundary conditions within a shielded environment. The motivation lies in exploring a novel approach to efficiently generate high-energy density plasma with potential applications across various fields. Implemented in an E01 circular cavity resonator, the proposed method involves the use of an impedance and field matching device with a coaxial connector and a specially optimized monopole antenna. This setup feeds a low-loss cavity resonator, resulting in a high-energy density air plasma with a surface temperature exceeding 3500 o C, achieved with a minimal power input of 80 W. The argon plasma, resembling the shape of a simple monopole antenna with modeled complex dielectric values, offers a more energy-efficient alternative compared to traditional, power-intensive plasma shaping methods. Simulations using a commercial electromagnetic (EM) solver validate the design’s effectiveness, while experimental validation underscores the method’s feasibility and practical implementation. Analyzing various parameters in an argon atmosphere, including hot S -parameters and plasma beam images, the results demonstrate the successful application of this technique, suggesting its potential in coating, furnace technology, fusion, and spectroscopy applications. KW - 3-D printing KW - Furnace KW - Fusion KW - Hot S-parameter KW - Mode converter Y1 - 2024 U6 - https://doi.org/10.1109/TPS.2024.3383589 SN - 0093-3813 (Print) SN - 1939-9375 (Online) IS - Early Access SP - 1 EP - 9 PB - IEEE ER - TY - CHAP A1 - Schneider, Dominik A1 - Wisselink, Frank A1 - Czarnecki, Christian A1 - Nölle, Nikolai T1 - Benefits and framework conditions for information-driven business models concerning the Internet of Things T2 - Digitalization in companies N2 - In the context of the increasing digitalization, the Internet of Things (IoT) is seen as a technological driver through which completely new business models can emerge in the interaction of different players. Identified key players include traditional industrial companies, municipalities and telecommunications companies. The latter, by providing connectivity, ensure that small devices with tiny batteries can be connected almost anywhere and directly to the Internet. There are already many IoT use cases on the market that provide simplification for end users, such as Philips Hue Tap. In addition to business models based on connectivity, there is great potential for information-driven business models that can support or enhance existing business models. One example is the IoT use case Park and Joy, which uses sensors to connect parking spaces and inform drivers about available parking spaces in real time. Information-driven business models can be based on data generated in IoT use cases. For example, a telecommunications company can add value by deriving more decision-relevant information – called insights – from data that is used to increase decision agility. In addition, insights can be monetized. The monetization of insights can only be sustainable, if careful attention is taken and frameworks are considered. In this chapter, the concept of information-driven business models is explained and illustrated with the concrete use case Park and Joy. In addition, the benefits, risks and framework conditions are discussed. Y1 - 2024 SN - 978-3-658-39093-8 (Print) SN - 978-3-658-39094-5 (eBook) U6 - https://doi.org/10.1007/978-3-658-39094-5_5 SP - 59 EP - 75 PB - Springer CY - Wiesbaden ER - TY - JOUR A1 - von Knobelsdorf-Brenkenhoff, Florian A1 - Frauenrath, Tobias A1 - Prothmann, Marcel A1 - Dieringer, Matthias A. A1 - Hezel, Fabian A1 - Renz, Wolfgang A1 - Kretschel, Kerstin A1 - Niendorf, Thoralf A1 - Schulz-Menger, Jeanette T1 - Cardiac chamber quantification using magnetic resonance imaging at 7 Tesla—a pilot study N2 - Objectives Interest in cardiovascular magnetic resonance (CMR) at 7 T is motivated by the expected increase in spatial and temporal resolution, but the method is technically challenging. We examined the feasibility of cardiac chamber quantification at 7 T. Methods A stack of short axes covering the left ventricle was obtained in nine healthy male volunteers. At 1.5 T, steady-state free precession (SSFP) and fast gradient echo (FGRE) cine imaging with 7 mm slice thickness (STH) were used. At 7 T, FGRE with 7 mm and 4 mm STH were applied. End-diastolic volume, end-systolic volume, ejection fraction and mass were calculated. Results All 7 T examinations provided excellent blood/myocardium contrast for all slice directions. No significant difference was found regarding ejection fraction and cardiac volumes between SSFP at 1.5 T and FGRE at 7 T, while volumes obtained from FGRE at 1.5 T were underestimated. Cardiac mass derived from FGRE at 1.5 and 7 T was larger than obtained from SSFP at 1.5 T. Agreement of volumes and mass between SSFP at 1.5 T and FGRE improved for FGRE at 7 T when combined with an STH reduction to 4 mm. Conclusions This pilot study demonstrates that cardiac chamber quantification at 7 T using FGRE is feasible and agrees closely with SSFP at 1.5 T. Y1 - 2010 U6 - https://doi.org/10.1007/s00330-010-1888-2 SN - 0938-7994 VL - 20 SP - 2844 EP - 2852 PB - Springer CY - Berlin, Heidelberg ER - TY - JOUR A1 - Alhwarin, Faraj A1 - Ferrein, Alexander A1 - Scholl, Ingrid T1 - IR stereo kinect: improving depth images by combining structured light with IR stereo Y1 - 2014 SP - 1 EP - 9 ER - TY - JOUR A1 - Hüning, Felix A1 - Heuermann, Holger A1 - Wache, Franz-Josef T1 - Wireless CAN without WLAN or Bluetooth JF - CAN Newsletter N2 - In two developed concepts, dual-mode radio enables CAN participants to be integrated wirelessly into a CAN network. Constructed from a few components, a protocol-free, real-time transmission and thus transparent integration into CAN is provided. Y1 - 2018 IS - December 2018 SP - 44 EP - 46 ER - TY - CHAP A1 - Niemüller, Tim A1 - Ewert, Daniel A1 - Reuter, Sebastian A1 - Karras, Ulrich A1 - Ferrein, Alexander T1 - Towards benchmarking cyber-physical systems in factory automation scenarios T2 - KI 2013: advances in artificial intelligence : 36th Annual German Conference on AI, Koblenz, Germany, September 16-20, 2013 ; proceedings / Ingo J. Timm ... (ed.). (Lecture notes in computer science ; 8077) Y1 - 2013 SN - 978-3-642-40941-7 SP - 296 EP - 299 PB - Springer CY - Berlin [u.a.] ER - TY - CHAP A1 - Schiffer, Stefan A1 - Ferrein, Alexander T1 - Decision-Theoretic Planning with Linguistic Terms in Golog T2 - FLinAl 2015 - Fuzzy Logic in Artificial Intelligence : Proceedings of the Workshop on Fuzzy Logic in AI (FLinAI-15) co-located with the 24th International Joint Conference on Artificial Intelligence (IJCAI 2015) Buenos Aires, Argentina, July 25, 2015. Y1 - 2015 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0074-1424-4 SN - 1613-0073 ER - TY - JOUR A1 - Schulte-Tigges, Joschua A1 - Förster, Marco A1 - Nikolovski, Gjorgji A1 - Reke, Michael A1 - Ferrein, Alexander A1 - Kaszner, Daniel A1 - Matheis, Dominik A1 - Walter, Thomas T1 - Benchmarking of various LiDAR sensors for use in self-driving vehicles in real-world environments JF - Sensors N2 - Abstract In this paper, we report on our benchmark results of the LiDAR sensors Livox Horizon, Robosense M1, Blickfeld Cube, Blickfeld Cube Range, Velodyne Velarray H800, and Innoviz Pro. The idea was to test the sensors in different typical scenarios that were defined with real-world use cases in mind, in order to find a sensor that meet the requirements of self-driving vehicles. For this, we defined static and dynamic benchmark scenarios. In the static scenarios, both LiDAR and the detection target do not move during the measurement. In dynamic scenarios, the LiDAR sensor was mounted on the vehicle which was driving toward the detection target. We tested all mentioned LiDAR sensors in both scenarios, show the results regarding the detection accuracy of the targets, and discuss their usefulness for deployment in self-driving cars. KW - Lidar KW - Benchmark KW - Self-driving Y1 - 2022 U6 - https://doi.org/10.3390/s22197146 SN - 1424-8220 N1 - This article belongs to the Special Issue "Sensor Fusion for Vehicles Navigation and Robotic Systems" VL - 22 IS - 19 PB - MDPI CY - Basel ER - TY - CHAP A1 - Ferrein, Alexander A1 - Kallweit, Stephan A1 - Scholl, Ingrid A1 - Reichert, Walter T1 - Learning to Program Mobile Robots in the ROS Summer School Series T2 - Proceedings 6th International Conference on Robotics in Education (RiE 15) N2 - The main objective of our ROS Summer School series is to introduce MA level students to program mobile robots with the Robot Operating System (ROS). ROS is a robot middleware that is used my many research institutions world-wide. Therefore, many state-of-the-art algorithms of mobile robotics are available in ROS and can be deployed very easily. As a basic robot platform we deploy a 1/10 RC cart that is wquipped with an Arduino micro-controller to control the servo motors, and an embedded PC that runs ROS. In two weeks, participants get to learn the basics of mobile robotics hands-on. We describe our teaching concepts and our curriculum and report on the learning success of our students. Y1 - 2015 ER - TY - JOUR A1 - Ferrein, Alexander A1 - Calmes, Laurent A1 - Lakemeyer, Gerhard A1 - Wagner, Hermann T1 - Von Schleiereulen und fussballspielenden Robotern / Calmes, Laurent ; Ferrein, Alexander ; Lakemeyer, Gerhard ; Wagner, Hermann JF - RWTH Themen (2006) Y1 - 2006 SN - 0179-079X SP - 30 EP - 33 ER - TY - JOUR A1 - Ferrein, Alexander A1 - Strack, Andreas A1 - Lakemeyer, Gerhard T1 - Laser-Based Localization with Sparse Landmarks / Strack, Andreas ; Ferrein, Alexander ; Lakemeyer, Gerhard JF - RoboCup 2005: Robot Soccer World Cup IX Y1 - 2006 SN - 978-3-540-35437-6 N1 - Lecture Notes in Computer Science ; 4020 SP - 569 EP - 576 PB - Springer CY - Berlin ER - TY - CHAP A1 - Dylla, Frank A1 - Ferrein, Alexander A1 - Lakemeyer, Gerhard T1 - AllemaniACs 2003 team description T2 - RoboCup 2003 : Robot Soccer World Cup VII Y1 - 2003 SP - 1 EP - 3 ER - TY - JOUR A1 - Vorst, Phillip A1 - Ferrein, Alexander A1 - Lakemeyer, Gerhard T1 - AllemaniACs3D team description Y1 - 2006 SP - 1 EP - 6 ER - TY - JOUR A1 - Ferrein, Alexander A1 - Schiffer, Stefan A1 - Lakemeyer, Gerhard T1 - Qualitative World Models for Soccer Robots / Schiffer, Stefan ; Ferrein, Alexander ; Lakemeyer, Gerhard JF - Qualitative constraint calculi : application and integration ; KI 2006, 14 - 19 June 2006, Bremen, Germany ; 29th Annual German Conference on Artificial Intelligence ; workshop / Stefan Wölfl ... (eds.) Y1 - 2006 SN - 3-88722-666-6 SP - 3 EP - 14 PB - Univ. CY - Bremen ER - TY - JOUR A1 - Heuermann, Holger A1 - Ibrahim, Irfan A1 - Hillebrand, J. T1 - Vector-Signal-Generator with Two ¿¿-PLL's / Ibrahim, I. ; Hillebrand, J. ; Heuermann, H. JF - European Conference on Wireless Technologies, 2007. ECWT 2007 ; 8 - 10 October 2007 Munich, Germany Y1 - 2007 SN - 978-2-87487-003-3 SP - 1 EP - 4 ER - TY - CHAP A1 - Alhwarin, Faraj A1 - Ferrein, Alexander A1 - Gebhardt, Andreas A1 - Kallweit, Stephan A1 - Scholl, Ingrid A1 - Tedjasukmana, Osmond Sanjaya T1 - Improving additive manufacturing by image processing and robotic milling T2 - 2015 IEEE International Conference on Automation Science and Engineering (CASE), Aug 24-28, 2015 Gothenburg, Sweden Y1 - 2015 U6 - https://doi.org/10.1109/CoASE.2015.7294217 SP - 924 EP - 929 ER - TY - CHAP A1 - Allal, D. A1 - Bannister, R. A1 - Buisman, K. A1 - Capriglione, D. A1 - Di Capua, G. A1 - García-Patrón, M. A1 - Gatzweiler, Thomas A1 - Gellersen, F. A1 - Harzheim, Thomas A1 - Heuermann, Holger A1 - Hoffmann, J. A1 - Izbrodin, A. A1 - Kuhlmann, K. A1 - Lahbacha, K. A1 - Maffucci, A. A1 - Miele, G. A1 - Mubarak, F. A1 - Salter, M. A1 - Pham, T.D. A1 - Sayegh, A. A1 - Singh, D. A1 - Stein, F. A1 - Zeier, M. T1 - RF measurements for future communication applications: an overview T2 - 2022 IEEE International Symposium on Measurements & Networking (M&N) N2 - In this paper research activities developed within the FutureCom project are presented. The project, funded by the European Metrology Programme for Innovation and Research (EMPIR), aims at evaluating and characterizing: (i) active devices, (ii) signal- and power integrity of field programmable gate array (FPGA) circuits, (iii) operational performance of electronic circuits in real-world and harsh environments (e.g. below and above ambient temperatures and at different levels of humidity), (iv) passive inter-modulation (PIM) in communication systems considering different values of temperature and humidity corresponding to the typical operating conditions that we can experience in real-world scenarios. An overview of the FutureCom project is provided here, then the research activities are described. KW - FPGA KW - signal integrity KW - power integrity KW - passive inter-modulation KW - metrological characterization Y1 - 2022 SN - 978-1-6654-8362-9 SN - 978-1-6654-8363-6 U6 - https://doi.org/10.1109/MN55117.2022.9887740 SN - 2639-5061 SN - 2639-507X N1 - 2022 IEEE International Symposium on Measurements & Networking (M&N), 18-20 July 2022, Padua, Italy. SP - 1 EP - 6 PB - IEEE ER -