TY - CHAP A1 - Wittig, M. A1 - Rütters, René A1 - Bragard, Michael ED - Reiff-Stephan, Jörg ED - Jäkel, Jens ED - Schwarz, André T1 - Application of RL in control systems using the example of a rotatory inverted pendulum T2 - Tagungsband AALE 2024 : Fit für die Zukunft: praktische Lösungen für die industrielle Automation N2 - In this paper, the use of reinforcement learning (RL) in control systems is investigated using a rotatory inverted pendulum as an example. The control behavior of an RL controller is compared to that of traditional LQR and MPC controllers. This is done by evaluating their behavior under optimal conditions, their disturbance behavior, their robustness and their development process. All the investigated controllers are developed using MATLAB and the Simulink simulation environment and later deployed to a real pendulum model powered by a Raspberry Pi. The RL algorithm used is Proximal Policy Optimization (PPO). The LQR controller exhibits an easy development process, an average to good control behavior and average to good robustness. A linear MPC controller could show excellent results under optimal operating conditions. However, when subjected to disturbances or deviations from the equilibrium point, it showed poor performance and sometimes instable behavior. Employing a nonlinear MPC Controller in real time was not possible due to the high computational effort involved. The RL controller exhibits by far the most versatile and robust control behavior. When operated in the simulation environment, it achieved a high control accuracy. When employed in the real system, however, it only shows average accuracy and a significantly greater performance loss compared to the simulation than the traditional controllers. With MATLAB, it is not yet possible to directly post-train the RL controller on the Raspberry Pi, which is an obstacle to the practical application of RL in a prototyping or teaching setting. Nevertheless, RL in general proves to be a flexible and powerful control method, which is well suited for complex or nonlinear systems where traditional controllers struggle. KW - Rotatory Inverted Pendulum KW - MPC KW - LQR KW - PPO KW - Reinforcement Learning Y1 - 2024 SN - 978-3-910103-02-3 U6 - http://dx.doi.org/10.33968/2024.53 N1 - 20. AALE-Konferenz. Bielefeld, 06.03.-08.03.2024. (Tagungsband unter https://doi.org/10.33968/2024.29) SP - 241 EP - 248 PB - le-tex publishing services GmbH CY - Leipzig ER - TY - CHAP A1 - Altherr, Lena A1 - Döring, Bernd A1 - Frauenrath, Tobias A1 - Groß, Rolf A1 - Mohan, Nijanthan A1 - Oyen, Marc A1 - Schnittcher, Lukas A1 - Voß, Norbert ED - Reiff-Stephan, Jörg ED - Jäkel, Jens ED - Schwarz, André T1 - DiggiTwin: ein interdisziplinäres Projekt zur Nutzung digitaler Zwillinge auf dem Weg zu einem klimaneutralen Gebäudebestand T2 - Tagungsband AALE 2024 : Fit für die Zukunft: praktische Lösungen für die industrielle Automation N2 - Im Hinblick auf die Klimaziele der Bundesrepublik Deutschland konzentriert sich das Projekt Diggi Twin auf die nachhaltige Gebäudeoptimierung. Grundlage für eine ganzheitliche Gebäudeüberwachung und -optimierung bildet dabei die Digitalisierung und Automation im Sinne eines Smart Buildings. Das interdisziplinäre Projekt der FH Aachen hat das Ziel, ein bestehendes Hochschulgebäude und einen Neubau an klimaneutrale Standards anzupassen. Im Rahmen des Projekts werden bekannte Verfahren, wie das Building Information Modeling (BIM), so erweitert, dass ein digitaler Gebäudezwilling entsteht. Dieser kann zur Optimierung des Gebäudebetriebs herangezogen werden, sowie als Basis für eine Erweiterung des Bewertungssystems Nachhaltiges Bauen (BNB) dienen. Mithilfe von Sensortechnologie und künstlicher Intelligenz kann so ein präzises Monitoring wichtiger Gebäudedaten erfolgen, um ungenutzte Energieeinsparpotenziale zu erkennen und zu nutzen. Das Projekt erforscht und setzt methodische Erkenntnisse zu BIM und digitalen Gebäudezwillingen praxisnah um, indem es spezifische Fragen zur Energie- und Ressourceneffizienz von Gebäuden untersucht und konkrete Lösungen für die Gebäudeoptimierung entwickelt. KW - Anomalieerkennung KW - IoT KW - Überwachung & Optimierung KW - DiggiTwin KW - BIM KW - Smart Building KW - Digitalisierung Y1 - 2024 SN - 978-3-910103-02-3 U6 - http://dx.doi.org/10.33968/2024.67 N1 - 20. AALE-Konferenz. Bielefeld, 06.03.-08.03.2024 (Tagungsband unter https://doi.org/10.33968/2024.29) SP - 341 EP - 346 PB - le-tex publishing services GmbH CY - Leipzig ER - TY - CHAP A1 - Simsek, Beril A1 - Krause, Hans-Joachim A1 - Engelmann, Ulrich M. ED - Digel, Ilya ED - Staat, Manfred ED - Trzewik, Jürgen ED - Sielemann, Stefanie ED - Erni, Daniel ED - Zylka, Waldemar T1 - Magnetic biosensing with magnetic nanoparticles: Simulative approach to predict signal intensity in frequency mixing magnetic detection T2 - 4th YRA MedTech Symposium 2024 : February 1 / 2024 / FH Aachen N2 - Magnetic nanoparticles (MNP) are investigated with great interest for biomedical applications in diagnostics (e.g. imaging: magnetic particle imaging (MPI)), therapeutics (e.g. hyperthermia: magnetic fluid hyperthermia (MFH)) and multi-purpose biosensing (e.g. magnetic immunoassays (MIA)). What all of these applications have in common is that they are based on the unique magnetic relaxation mechanisms of MNP in an alternating magnetic field (AMF). While MFH and MPI are currently the most prominent examples of biomedical applications, here we present results on the relatively new biosensing application of frequency mixing magnetic detection (FMMD) from a simulation perspective. In general, we ask how the key parameters of MNP (core size and magnetic anisotropy) affect the FMMD signal: by varying the core size, we investigate the effect of the magnetic volume per MNP; and by changing the effective magnetic anisotropy, we study the MNPs’ flexibility to leave its preferred magnetization direction. From this, we predict the most effective combination of MNP core size and magnetic anisotropy for maximum signal generation. Y1 - 2024 SN - 978-3-940402-65-3 U6 - http://dx.doi.org/10.17185/duepublico/81475 SP - 27 EP - 28 PB - Universität Duisburg-Essen CY - Duisburg ER - TY - CHAP A1 - Schmitz, Annika A1 - Apandi, Shah Eiman Amzar Shah A1 - Spillner, Jan A1 - Hima, Flutura A1 - Behbahani, Mehdi ED - Digel, Ilya ED - Staat, Manfred ED - Trzewik, Jürgen ED - Sielemann, Stefanie ED - Erni, Daniel ED - Zylka, Waldemar T1 - Effect of different cannula positions in the pulmonary artery on blood flow and gas exchange using computational fluid dynamics analysis T2 - 4th YRA MedTech Symposium 2024 : February 1 / 2024 / FH Aachen N2 - Pulmonary arterial cannulation is a common and effective method for percutaneous mechanical circulatory support for concurrent right heart and respiratory failure [1]. However, limited data exists to what effect the positioning of the cannula has on the oxygen perfusion throughout the pulmonary artery (PA). This study aims to evaluate, using computational fluid dynamics (CFD), the effect of different cannula positions in the PA with respect to the oxygenation of the different branching vessels in order for an optimal cannula position to be determined. The four chosen different positions (see Fig. 1) of the cannulas are, in the lower part of the main pulmonary artery (MPA), in the MPA at the junction between the right pulmonary artery (RPA) and the left pulmonary artery (LPA), in the RPA at the first branch of the RPA and in the LPA at the first branch of the LPA. Y1 - 2024 SN - 978-3-940402-65-3 U6 - http://dx.doi.org/10.17185/duepublico/81475 SP - 29 EP - 30 PB - Universität Duisburg-Essen CY - Duisburg ER - TY - CHAP A1 - Sherelkhan, Dinara A1 - Alibekova, Alina ED - Digel, Ilya ED - Staat, Manfred ED - Trzewik, Jürgen ED - Sielemann, Stefanie ED - Erni, Daniel ED - Zylka, Waldemar T1 - EEM spectroscopy characterization of humic substances of biomedical importance T2 - 4th YRA MedTech Symposium 2024 : February 1 / 2024 / FH Aachen N2 - Humic substances possess distinctive chemical features enabling their use in many advanced applications, including biomedical fields. No chemicals in nature have the same combination of specific chemical and biological properties as humic substances. Traditional medicine and modern research have demonstrated that humic substances from different sources possess immunomodulatory and anti-inflammatory properties, which makes them suitable for the prevention and treatment of chronic dermatoses, allergic rhinitis, atopic dermatitis, and other conditions characterized by inflammatory and allergic responses [1-4]. The use of humic compounds as agentswith antifungal and antiviral properties shows great potential [5-7]. Y1 - 2024 SN - 978-3-940402-65-3 U6 - http://dx.doi.org/10.17185/duepublico/81475 SP - 31 EP - 32 PB - Universität Duisburg-Essen CY - Duisburg ER - TY - CHAP A1 - Tepecik, Atakan ED - Digel, Ilya ED - Staat, Manfred ED - Trzewik, Jürgen ED - Sielemann, Stefanie ED - Erni, Daniel ED - Zylka, Waldemar T1 - AstroBioLab: Review of technical and bioanalytical approaches T2 - 4th YRA MedTech Symposium 2024 : February 1 / 2024 / FH Aachen N2 - This study presents the concept of AstroBioLab, an autonomous astrobiological field laboratory tailored for the exploration of (sub)glacial habitats. AstroBioLab is an integral component of the TRIPLE (Technologies for Rapid Ice Penetration and subglacial Lake Exploration) DLR-funded project, aimed at advancing astrobiology research through the development and deployment of innovative technologies. AstroBioLab integrates diverse measurement techniques such as fluorescence microscopy, DNA sequencing and fluorescence spectrometry, while leveraging microfluidics for efficient sample delivery and preparation. Y1 - 2024 SN - 978-3-940402-65-3 U6 - http://dx.doi.org/10.17185/duepublico/81475 SP - 33 EP - 34 PB - Universität Duisburg-Essen CY - Duisburg ER - TY - CHAP A1 - Hille, Sebastian A1 - Stumpf, Eike A1 - Mayntz, Joscha A1 - Dahmann, Peter T1 - Prediction of sound exposure caused by a landing motor glider with recuperating propellers T2 - AIAA SCITECH 2023 Forum N2 - This paper presents an approach to predicting the sound exposure on the ground caused by a landing aircraft with recuperating propellers. The noise source along the trajectory of a flight specified for a steeper approach is simulated based on measurements of sound power levels and additional parameters of a single propeller placed in a wind tunnel. To validate the measured data/measurement results, these simulations are also supported by overflight measurements of a test aircraft. It is shown that the simple source models of propellers do not provide fully satisfactory results since the sound levels are estimated too low. Nevertheless, with a further reference comparison, margins for an acceptable increase in the sound power level of the aircraft on its now steeper approach path could be estimated. Thus, in this case, a +7 dB increase in SWL would not increase the SEL compared to the conventional approach within only 2 km ahead of the airfield. Y1 - 2023 U6 - http://dx.doi.org/10.2514/6.2023-0211 N1 - AIAA SCITECH 2023 Forum, 23-27 January 2023, National Harbor, MD & Online PB - AIAA ER - TY - CHAP A1 - Möhren, Felix A1 - Bergmann, Ole A1 - Janser, Frank A1 - Braun, Carsten T1 - On the determination of harmonic propeller loads T2 - AIAA SCITECH 2023 Forum N2 - Dynamic loads significantly impact the structural design of propeller blades due to fatigue and static strength. Since propellers are elastic structures, deformations and aerodynamic loads are coupled. In the past, propeller manufacturers established procedures to determine unsteady aerodynamic loads and the structural response with analytical steady-state calculations. According to the approach, aeroelastic coupling primarily consists of torsional deformations. They neglect bending deformations, deformation velocities, and inertia terms. This paper validates the assumptions above for a General Aviation propeller and a lift propeller for urban air mobility or large cargo drones. Fully coupled reduced-order simulations determine the dynamic loads in the time domain. A quasi-steady blade element momentum approach transfers loads to one-dimensional finite beam elements. The simulation results are in relatively good agreement with the analytical method for the General Aviation propeller but show increasing errors for the slender lift propeller. The analytical approach is modified to consider the induced velocities. Still, inertia and velocity proportional terms play a significant role for the lift propeller due to increased elasticity. The assumption that only torsional deformations significantly impact the dynamic loads of propellers is not valid. Adequate determination of dynamic loads of such designs requires coupled aeroelastic simulations or advanced analytical procedures. Y1 - 2023 U6 - http://dx.doi.org/10.2514/6.2023-2404 N1 - AIAA SCITECH 2023 Forum, 23-27 January 2023, National Harbor, MD & Online PB - AIAA ER - TY - CHAP A1 - Grund, Raphael M. A1 - Altherr, Lena ED - Reiff-Stephan, Jörg ED - Jäkel, Jens ED - Schwarz, André T1 - Development of an open source energy disaggregation tool for the home automation platform Home Assistant T2 - Tagungsband AALE 2023 : mit Automatisierung gegen den Klimawandel N2 - In order to reduce energy consumption of homes, it is important to make transparent which devices consume how much energy. However, power consumption is often only monitored aggregated at the house energy meter. Disaggregating this power consumption into the contributions of individual devices can be achieved using Machine Learning. Our work aims at making state of the art disaggregation algorithms accessibe for users of the open source home automation platform Home Assistant. KW - Home Automation Platform KW - Home Assistant KW - Open Source KW - Machine Learning KW - Energy Disaggregation Y1 - 2023 SN - 978-3-910103-01-6 U6 - http://dx.doi.org/10.33968/2023.02 N1 - 19. AALE-Konferenz. Luxemburg, 08.03.-10.03.2023. BTS Connected Buildings & Cities Luxemburg (Tagungsband unter https://doi.org/10.33968/2023.01) SP - 11 EP - 20 PB - le-tex publishing services GmbH CY - Leipzig ER - TY - CHAP A1 - Funke, Harald A1 - Beckmann, Nils A1 - Stefan, Lukas A1 - Keinz, Jan T1 - Hydrogen combustor integration study for a medium range aircraft engine using the dry-low NOx “Micromix” combustion principle T2 - Proceedings of the ASME Turbo Expo 2023: Turbomachinery Technical Conference and Exposition. Volume 1: Aircraft Engine. Boston, Massachusetts, USA. June 26–30, 2023 N2 - The feasibility study presents results of a hydrogen combustor integration for a Medium-Range aircraft engine using the Dry-Low-NOₓ Micromix combustion principle. Based on a simplified Airbus A320-type flight mission, a thermodynamic performance model of a kerosene and a hydrogen-powered V2530-A5 engine is used to derive the thermodynamic combustor boundary conditions. A new combustor design using the Dry-Low NOx Micromix principle is investigated by slice model CFD simulations of a single Micromix injector for design and off-design operation of the engine. Combustion characteristics show typical Micromix flame shapes and good combustion efficiencies for all flight mission operating points. Nitric oxide emissions are significant below ICAO CAEP/8 limits. For comparison of the Emission Index (EI) for NOₓ emissions between kerosene and hydrogen operation, an energy (kerosene) equivalent Emission Index is used. A full 15° sector model CFD simulation of the combustion chamber with multiple Micromix injectors including inflow homogenization and dilution and cooling air flows investigates the combustor integration effects, resulting NOₓ emission and radial temperature distributions at the combustor outlet. The results show that the integration of a Micromix hydrogen combustor in actual aircraft engines is feasible and offers, besides CO₂ free combustion, a significant reduction of NOₓ emissions compared to kerosene operation. KW - emission index KW - nitric oxides KW - aircraft engine KW - Micromix KW - combustion KW - hydrogen Y1 - 2023 SN - 978-0-7918-8693-9 U6 - http://dx.doi.org/10.1115/GT2023-102370 N1 - Paper No. GT2023-102370, V001T01A022 PB - ASME CY - New York ER -