TY - CHAP A1 - Wittig, M. A1 - Rütters, René A1 - Bragard, Michael ED - Reiff-Stephan, Jörg ED - Jäkel, Jens ED - Schwarz, André T1 - Application of RL in control systems using the example of a rotatory inverted pendulum T2 - Tagungsband AALE 2024 : Fit für die Zukunft: praktische Lösungen für die industrielle Automation N2 - In this paper, the use of reinforcement learning (RL) in control systems is investigated using a rotatory inverted pendulum as an example. The control behavior of an RL controller is compared to that of traditional LQR and MPC controllers. This is done by evaluating their behavior under optimal conditions, their disturbance behavior, their robustness and their development process. All the investigated controllers are developed using MATLAB and the Simulink simulation environment and later deployed to a real pendulum model powered by a Raspberry Pi. The RL algorithm used is Proximal Policy Optimization (PPO). The LQR controller exhibits an easy development process, an average to good control behavior and average to good robustness. A linear MPC controller could show excellent results under optimal operating conditions. However, when subjected to disturbances or deviations from the equilibrium point, it showed poor performance and sometimes instable behavior. Employing a nonlinear MPC Controller in real time was not possible due to the high computational effort involved. The RL controller exhibits by far the most versatile and robust control behavior. When operated in the simulation environment, it achieved a high control accuracy. When employed in the real system, however, it only shows average accuracy and a significantly greater performance loss compared to the simulation than the traditional controllers. With MATLAB, it is not yet possible to directly post-train the RL controller on the Raspberry Pi, which is an obstacle to the practical application of RL in a prototyping or teaching setting. Nevertheless, RL in general proves to be a flexible and powerful control method, which is well suited for complex or nonlinear systems where traditional controllers struggle. KW - Rotatory Inverted Pendulum KW - MPC KW - LQR KW - PPO KW - Reinforcement Learning Y1 - 2024 SN - 978-3-910103-02-3 U6 - http://dx.doi.org/10.33968/2024.53 N1 - 20. AALE-Konferenz. Bielefeld, 06.03.-08.03.2024. (Tagungsband unter https://doi.org/10.33968/2024.29) SP - 241 EP - 248 PB - le-tex publishing services GmbH CY - Leipzig ER - TY - CHAP A1 - Altherr, Lena A1 - Döring, Bernd A1 - Frauenrath, Tobias A1 - Groß, Rolf A1 - Mohan, Nijanthan A1 - Oyen, Marc A1 - Schnittcher, Lukas A1 - Voß, Norbert ED - Reiff-Stephan, Jörg ED - Jäkel, Jens ED - Schwarz, André T1 - DiggiTwin: ein interdisziplinäres Projekt zur Nutzung digitaler Zwillinge auf dem Weg zu einem klimaneutralen Gebäudebestand T2 - Tagungsband AALE 2024 : Fit für die Zukunft: praktische Lösungen für die industrielle Automation N2 - Im Hinblick auf die Klimaziele der Bundesrepublik Deutschland konzentriert sich das Projekt Diggi Twin auf die nachhaltige Gebäudeoptimierung. Grundlage für eine ganzheitliche Gebäudeüberwachung und -optimierung bildet dabei die Digitalisierung und Automation im Sinne eines Smart Buildings. Das interdisziplinäre Projekt der FH Aachen hat das Ziel, ein bestehendes Hochschulgebäude und einen Neubau an klimaneutrale Standards anzupassen. Im Rahmen des Projekts werden bekannte Verfahren, wie das Building Information Modeling (BIM), so erweitert, dass ein digitaler Gebäudezwilling entsteht. Dieser kann zur Optimierung des Gebäudebetriebs herangezogen werden, sowie als Basis für eine Erweiterung des Bewertungssystems Nachhaltiges Bauen (BNB) dienen. Mithilfe von Sensortechnologie und künstlicher Intelligenz kann so ein präzises Monitoring wichtiger Gebäudedaten erfolgen, um ungenutzte Energieeinsparpotenziale zu erkennen und zu nutzen. Das Projekt erforscht und setzt methodische Erkenntnisse zu BIM und digitalen Gebäudezwillingen praxisnah um, indem es spezifische Fragen zur Energie- und Ressourceneffizienz von Gebäuden untersucht und konkrete Lösungen für die Gebäudeoptimierung entwickelt. KW - Anomalieerkennung KW - IoT KW - Überwachung & Optimierung KW - DiggiTwin KW - BIM KW - Smart Building KW - Digitalisierung Y1 - 2024 SN - 978-3-910103-02-3 U6 - http://dx.doi.org/10.33968/2024.67 N1 - 20. AALE-Konferenz. Bielefeld, 06.03.-08.03.2024 (Tagungsband unter https://doi.org/10.33968/2024.29) SP - 341 EP - 346 PB - le-tex publishing services GmbH CY - Leipzig ER - TY - JOUR A1 - Schopp, Christoph A1 - Rohrbach, Felix A1 - Langer, Luc A1 - Heuermann, Holger T1 - Detection of welding wire length by active S11 measurement JF - IEEE Transactions on Plasma Science N2 - A novel method to determine the extruded length of a metallic wire for a directed energy deposition (DED) process using a microwave (MW) plasma jet with a straight-through wire feed is presented. The method is based on the relative comparison of the measured frequency response obtained by the large-signal scattering parameter (Hot-S) technique. In the practical working range, repeatability of less than 6% for a nonactive plasma and 9% for the active plasma state is found. Measurements are conducted with a focus on a simple solution to decrease the processing time and reduce the integration time of the process into the existing hardware. It is shown that monitoring a single frequency for magnitude and phase changes is sufficient to achieve good accuracy. A combination of different measurement values to determine the length is possible. The applicability to different diameter of the same material is shown as well as a contact detection of the wire and metallic substrate. KW - Circuit simulation KW - Hot S-parameter KW - Modeling KW - Plasma KW - Plasma diagnostics Y1 - 2024 U6 - http://dx.doi.org/10.1109/TPS.2024.3356659 SN - 0093-3813 (Print) SN - 1939-9375 (Online) IS - Early Access SP - 1 EP - 6 PB - IEEE ER - TY - PAT A1 - Hüning, Felix T1 - Positionssensorvorrichtung N2 - Die Erfindung betrifft eine Positionssensorvorrichtung zur Bestimmung einer Absolutposition eines beweglichen ersten Teils relativ zu einem ortsfesten zweiten Teil mit einem mit dem beweglichen ersten Teil gekoppelter Codekörper, der dazu eingerichtet ist, eine Codespur mit einer Mehrzahl von in Spurrichtung aufeinanderfolgenden Codeelementen zu enthalten zur Bildung eines Codewortes, mit einer magnetischen Detektionseinrichtung zur Detektion der Codespur, wobei die Detektionseinrichtung zum einen an dem Codekörper befestigte und entlang der Spurrichtung in einem solchen Abstand gegenpolig zueinander angeordnete Permanentmagneten aufweist, dass der Abstand mit einer vorgegebenen Länge der jeweiligen Codeelemente übereinstimmt, und zum anderen eine Anzahl von ortsfest und quer zu dem Codekörper versetzt angeordnete Wiegandsensoren aufweist, wobei der Abstand des Wiegandsensors zu einer Erstreckungsebene der Permanentmagneten derart gewählt ist, dass bei Überdeckung des Wiegandsensors durch den Permanentmagneten ein Wiegandpuls in dem Wiegandsensor induziert wird. Y1 - 2024 ER - TY - JOUR A1 - Turdumamatov, Samat A1 - Belda, Aljoscha A1 - Heuermann, Holger T1 - Shaping a decoupled atmospheric pressure microwave plasma with antenna structures, Maxwell’s equations, and boundary conditions JF - IEEE Transactions on Plasma Science N2 - This article addresses the need for an innovative technique in plasma shaping, utilizing antenna structures, Maxwell’s laws, and boundary conditions within a shielded environment. The motivation lies in exploring a novel approach to efficiently generate high-energy density plasma with potential applications across various fields. Implemented in an E01 circular cavity resonator, the proposed method involves the use of an impedance and field matching device with a coaxial connector and a specially optimized monopole antenna. This setup feeds a low-loss cavity resonator, resulting in a high-energy density air plasma with a surface temperature exceeding 3500 o C, achieved with a minimal power input of 80 W. The argon plasma, resembling the shape of a simple monopole antenna with modeled complex dielectric values, offers a more energy-efficient alternative compared to traditional, power-intensive plasma shaping methods. Simulations using a commercial electromagnetic (EM) solver validate the design’s effectiveness, while experimental validation underscores the method’s feasibility and practical implementation. Analyzing various parameters in an argon atmosphere, including hot S -parameters and plasma beam images, the results demonstrate the successful application of this technique, suggesting its potential in coating, furnace technology, fusion, and spectroscopy applications. KW - 3-D printing KW - Furnace KW - Fusion KW - Hot S-parameter KW - Mode converter Y1 - 2024 U6 - http://dx.doi.org/10.1109/TPS.2024.3383589 SN - 0093-3813 (Print) SN - 1939-9375 (Online) IS - Early Access SP - 1 EP - 9 PB - IEEE ER - TY - JOUR A1 - Wiegner, Jonas A1 - Volker, Hanno A1 - Mainz, Fabian A1 - Backes, Andreas A1 - Loeken, Michael A1 - Hüning, Felix T1 - Energy analysis of a wireless sensor node powered by a Wiegand sensor JF - Journal of Sensors and Sensor Systems (JSSS) N2 - This article describes an Internet of things (IoT) sensing device with a wireless interface which is powered by the energy-harvesting method of the Wiegand effect. The Wiegand effect, in contrast to continuous sources like photovoltaic or thermal harvesters, provides small amounts of energy discontinuously in pulsed mode. To enable an energy-self-sufficient operation of the sensing device with this pulsed energy source, the output energy of the Wiegand generator is maximized. This energy is used to power up the system and to acquire and process data like position, temperature or other resistively measurable quantities as well as transmit these data via an ultra-low-power ultra-wideband (UWB) data transmitter. A proof-of-concept system was built to prove the feasibility of the approach. The energy consumption of the system during start-up was analysed, traced back in detail to the individual components, compared to the generated energy and processed to identify further optimization options. Based on the proof of concept, an application prototype was developed. Y1 - 2023 U6 - http://dx.doi.org/10.5194/jsss-12-85-2023 SN - 2194-878X N1 - Corresponding author: Felix Hüning VL - 12 IS - 1 SP - 85 EP - 92 PB - Copernicus Publ. CY - Göttingen ER - TY - CHAP A1 - Grund, Raphael M. A1 - Altherr, Lena ED - Reiff-Stephan, Jörg ED - Jäkel, Jens ED - Schwarz, André T1 - Development of an open source energy disaggregation tool for the home automation platform Home Assistant T2 - Tagungsband AALE 2023 : mit Automatisierung gegen den Klimawandel N2 - In order to reduce energy consumption of homes, it is important to make transparent which devices consume how much energy. However, power consumption is often only monitored aggregated at the house energy meter. Disaggregating this power consumption into the contributions of individual devices can be achieved using Machine Learning. Our work aims at making state of the art disaggregation algorithms accessibe for users of the open source home automation platform Home Assistant. KW - Home Automation Platform KW - Home Assistant KW - Open Source KW - Machine Learning KW - Energy Disaggregation Y1 - 2023 SN - 978-3-910103-01-6 U6 - http://dx.doi.org/10.33968/2023.02 N1 - 19. AALE-Konferenz. Luxemburg, 08.03.-10.03.2023. BTS Connected Buildings & Cities Luxemburg (Tagungsband unter https://doi.org/10.33968/2023.01) SP - 11 EP - 20 PB - le-tex publishing services GmbH CY - Leipzig ER - TY - PAT A1 - Bragard, Michael A1 - Hüning, Felix A1 - Kowalewski, Paul T1 - Vorrichtung zur Relativlagenbestimmung [Offenlegungschrift] N2 - Die Erfindung betrifft eine Vorrichtung zur Bestimmung einer Relativlage zwischen einem feststehenden Teil und einem zu demselben in eine Bewegungsrichtung bewegbaren beweglichen Teil, wobei der feststehende Teil mit einem Wiegandsensor versehen ist, wobei der Wiegandsensor zwischen zwei gegenpolig zueinander ausgebildeten Permanentmagneten angeordnet ist und dass der bewegliche Teil eine Mehrzahl von beabstandet zueinander angeordneten Magnetisierungsstegen aus einem magnetisch leitenden Material aufweist, die in der Bewegungsrichtung zumindest eine gleich große Erstreckung aufweisen wie der Permanentmagnet, dass ein Abstand zwischen benachbarten Magnetisierungsstegen derart gewählt ist, dass in einer ersten Relativlage ein erster Permanentmagnet von einem der Magnetisierungsstege überdeckt ist und ein zweiter Permanentmagnet nicht von einem der Magnetisierungsstege überdeckt ist. Y1 - 2023 N1 - Offenlegungschrift zu DE102022115350A1 2023.12.21 ER - TY - CHAP A1 - Chircu, Alina A1 - Czarnecki, Christian A1 - Friedmann, Daniel A1 - Pomaskow, Johanna A1 - Sultanow, Eldar T1 - Towards a Digital Twin of Society T2 - Proceedings of the 56th Hawaii International Conference on System Sciences 2023 N2 - This paper describes the potential for developing a digital twin of society- a dynamic model that can be used to observe, analyze, and predict the evolution of various societal aspects. Such a digital twin can help governmental agencies and policy makers in interpreting trends, understanding challenges, and making decisions regarding investments or policies necessary to support societal development and ensure future prosperity. The paper reviews related work regarding the digital twin paradigm and its applications. The paper presents a motivating case study- an analysis of opportunities and challenges faced by the German federal employment agency, Bundesagentur f¨ur Arbeit (BA), proposes solutions using digital twins, and describes initial proofs of concept for such solutions. KW - Digital twin KW - Digital transformation KW - Prototype KW - Society KW - Stress testing Y1 - 2023 SN - 978-0-9981331-6-4 SP - 6748 EP - 6757 PB - University of Hawai'i CY - Honolulu ER - TY - CHAP A1 - Nikolovski, Gjorgji A1 - Limpert, Nicolas A1 - Nessau, Hendrik A1 - Reke, Michael A1 - Ferrein, Alexander T1 - Model-predictive control with parallelised optimisation for the navigation of autonomous mining vehicles T2 - 2023 IEEE Intelligent Vehicles Symposium (IV) N2 - The work in modern open-pit and underground mines requires the transportation of large amounts of resources between fixed points. The navigation to these fixed points is a repetitive task that can be automated. The challenge in automating the navigation of vehicles commonly used in mines is the systemic properties of such vehicles. Many mining vehicles, such as the one we have used in the research for this paper, use steering systems with an articulated joint bending the vehicle’s drive axis to change its course and a hydraulic drive system to actuate axial drive components or the movements of tippers if available. To address the difficulties of controlling such a vehicle, we present a model-predictive approach for controlling the vehicle. While the control optimisation based on a parallel error minimisation of the predicted state has already been established in the past, we provide insight into the design and implementation of an MPC for an articulated mining vehicle and show the results of real-world experiments in an open-pit mine environment. KW - Mpc KW - Control KW - Path-following KW - Navigation KW - Automation Y1 - 2023 SN - 979-8-3503-4691-6 (Online) SN - 979-8-3503-4692-3 (Print) U6 - http://dx.doi.org/10.1109/IV55152.2023.10186806 N1 - IEEE Symposium on Intelligent Vehicle, 4.-7. June 2023, Anchorage, AK, USA. PB - IEEE ER -