TY - CHAP A1 - Wittig, M. A1 - Rütters, René A1 - Bragard, Michael ED - Reiff-Stephan, Jörg ED - Jäkel, Jens ED - Schwarz, André T1 - Application of RL in control systems using the example of a rotatory inverted pendulum T2 - Tagungsband AALE 2024 : Fit für die Zukunft: praktische Lösungen für die industrielle Automation N2 - In this paper, the use of reinforcement learning (RL) in control systems is investigated using a rotatory inverted pendulum as an example. The control behavior of an RL controller is compared to that of traditional LQR and MPC controllers. This is done by evaluating their behavior under optimal conditions, their disturbance behavior, their robustness and their development process. All the investigated controllers are developed using MATLAB and the Simulink simulation environment and later deployed to a real pendulum model powered by a Raspberry Pi. The RL algorithm used is Proximal Policy Optimization (PPO). The LQR controller exhibits an easy development process, an average to good control behavior and average to good robustness. A linear MPC controller could show excellent results under optimal operating conditions. However, when subjected to disturbances or deviations from the equilibrium point, it showed poor performance and sometimes instable behavior. Employing a nonlinear MPC Controller in real time was not possible due to the high computational effort involved. The RL controller exhibits by far the most versatile and robust control behavior. When operated in the simulation environment, it achieved a high control accuracy. When employed in the real system, however, it only shows average accuracy and a significantly greater performance loss compared to the simulation than the traditional controllers. With MATLAB, it is not yet possible to directly post-train the RL controller on the Raspberry Pi, which is an obstacle to the practical application of RL in a prototyping or teaching setting. Nevertheless, RL in general proves to be a flexible and powerful control method, which is well suited for complex or nonlinear systems where traditional controllers struggle. KW - Rotatory Inverted Pendulum KW - MPC KW - LQR KW - PPO KW - Reinforcement Learning Y1 - 2024 SN - 978-3-910103-02-3 U6 - https://doi.org/10.33968/2024.53 N1 - 20. AALE-Konferenz. Bielefeld, 06.03.-08.03.2024. (Tagungsband unter https://doi.org/10.33968/2024.29) SP - 241 EP - 248 PB - le-tex publishing services GmbH CY - Leipzig ER - TY - CHAP A1 - Altherr, Lena A1 - Döring, Bernd A1 - Frauenrath, Tobias A1 - Groß, Rolf A1 - Mohan, Nijanthan A1 - Oyen, Marc A1 - Schnittcher, Lukas A1 - Voß, Norbert ED - Reiff-Stephan, Jörg ED - Jäkel, Jens ED - Schwarz, André T1 - DiggiTwin: ein interdisziplinäres Projekt zur Nutzung digitaler Zwillinge auf dem Weg zu einem klimaneutralen Gebäudebestand T2 - Tagungsband AALE 2024 : Fit für die Zukunft: praktische Lösungen für die industrielle Automation N2 - Im Hinblick auf die Klimaziele der Bundesrepublik Deutschland konzentriert sich das Projekt Diggi Twin auf die nachhaltige Gebäudeoptimierung. Grundlage für eine ganzheitliche Gebäudeüberwachung und -optimierung bildet dabei die Digitalisierung und Automation im Sinne eines Smart Buildings. Das interdisziplinäre Projekt der FH Aachen hat das Ziel, ein bestehendes Hochschulgebäude und einen Neubau an klimaneutrale Standards anzupassen. Im Rahmen des Projekts werden bekannte Verfahren, wie das Building Information Modeling (BIM), so erweitert, dass ein digitaler Gebäudezwilling entsteht. Dieser kann zur Optimierung des Gebäudebetriebs herangezogen werden, sowie als Basis für eine Erweiterung des Bewertungssystems Nachhaltiges Bauen (BNB) dienen. Mithilfe von Sensortechnologie und künstlicher Intelligenz kann so ein präzises Monitoring wichtiger Gebäudedaten erfolgen, um ungenutzte Energieeinsparpotenziale zu erkennen und zu nutzen. Das Projekt erforscht und setzt methodische Erkenntnisse zu BIM und digitalen Gebäudezwillingen praxisnah um, indem es spezifische Fragen zur Energie- und Ressourceneffizienz von Gebäuden untersucht und konkrete Lösungen für die Gebäudeoptimierung entwickelt. KW - Anomalieerkennung KW - IoT KW - Überwachung & Optimierung KW - DiggiTwin KW - BIM KW - Smart Building KW - Digitalisierung Y1 - 2024 SN - 978-3-910103-02-3 U6 - https://doi.org/10.33968/2024.67 N1 - 20. AALE-Konferenz. Bielefeld, 06.03.-08.03.2024 (Tagungsband unter https://doi.org/10.33968/2024.29) SP - 341 EP - 346 PB - le-tex publishing services GmbH CY - Leipzig ER - TY - JOUR A1 - Engelmann, Ulrich M. A1 - Simsek, Beril A1 - Shalaby, Ahmed A1 - Krause, Hans-Joachim T1 - Key contributors to signal generation in frequency mixing magnetic detection (FMMD): an in silico study JF - Sensors N2 - Frequency mixing magnetic detection (FMMD) is a sensitive and selective technique to detect magnetic nanoparticles (MNPs) serving as probes for binding biological targets. Its principle relies on the nonlinear magnetic relaxation dynamics of a particle ensemble interacting with a dual frequency external magnetic field. In order to increase its sensitivity, lower its limit of detection and overall improve its applicability in biosensing, matching combinations of external field parameters and internal particle properties are being sought to advance FMMD. In this study, we systematically probe the aforementioned interaction with coupled Néel–Brownian dynamic relaxation simulations to examine how key MNP properties as well as applied field parameters affect the frequency mixing signal generation. It is found that the core size of MNPs dominates their nonlinear magnetic response, with the strongest contributions from the largest particles. The drive field amplitude dominates the shape of the field-dependent response, whereas effective anisotropy and hydrodynamic size of the particles only weakly influence the signal generation in FMMD. For tailoring the MNP properties and parameters of the setup towards optimal FMMD signal generation, our findings suggest choosing large particles of core sizes dc > 25 nm nm with narrow size distributions (σ < 0.1) to minimize the required drive field amplitude. This allows potential improvements of FMMD as a stand-alone application, as well as advances in magnetic particle imaging, hyperthermia and magnetic immunoassays. KW - key performance indicators KW - magnetic biosensing KW - coupled Néel–Brownian relaxation dynamics KW - frequency mixing magnetic detection KW - magnetic relaxation KW - micromagnetic simulation KW - magnetic nanoparticles Y1 - 2024 U6 - https://doi.org/10.3390/s24061945 SN - 1424-8220 N1 - This article belongs to the Special Issue "Advances in Magnetic Sensors and Their Applications" VL - 24 IS - 6 PB - MDPI CY - Basel ER - TY - JOUR A1 - Zhen, Manghao A1 - Liang, Yunpei A1 - Staat, Manfred A1 - Li, Quanqui A1 - Li, Jianbo T1 - Discontinuous fracture behaviors and constitutive model of sandstone specimens containing non-parallel prefabricated fissures under uniaxial compression JF - Theoretical and Applied Fracture Mechanics N2 - The deformation and damage laws of non-homogeneous irregular structural planes in rocks are the basis for studying the stability of rock engineering. To investigate the damage characteristics of rock containing non-parallel fissures, uniaxial compression tests and numerical simulations were conducted on sandstone specimens containing three non-parallel fissures inclined at 0°, 45° and 90° in this study. The characteristics of crack initiation and crack evolution of fissures with different inclinations were analyzed. A constitutive model for the discontinuous fractures of fissured sandstone was proposed. The results show that the fracture behaviors of fissured sandstone specimens are discontinuous. The stress–strain curves are non-smooth and can be divided into nonlinear crack closure stage, linear elastic stage, plastic stage and brittle failure stage, of which the plastic stage contains discontinuous stress drops. During the uniaxial compression test, the middle or ends of 0° fissures were the first to crack compared to 45° and 90° fissures. The end with small distance between 0° and 45° fissures cracked first, and the end with large distance cracked later. After the final failure, 0° fissures in all specimens were fractured, while 45° and 90° fissures were not necessarily fractured. Numerical simulation results show that the concentration of compressive stress at the tips of 0°, 45° and 90° fissures, as well as the concentration of tensile stress on both sides, decreased with the increase of the inclination angle. A constitutive model for the discontinuous fractures of fissured sandstone specimens was derived by combining the logistic model and damage mechanic theory. This model can well describe the discontinuous drops of stress and agrees well with the whole processes of the stress–strain curves of the fissured sandstone specimens. KW - Constitutive model KW - Damage mechanics theory KW - Discontinuous fractures KW - Uniaxial compression test KW - Non-parallel fissures Y1 - 2024 U6 - https://doi.org/10.1016/j.tafmec.2024.104373 SN - 0167-8442 VL - 131 PB - Elsevier CY - Amsterdam ER - TY - CHAP A1 - Zahra, Mahdi A1 - Phani Srujan, Merige A1 - Caminos, Ricardo Alexander Chico A1 - Schmitz, Pascal A1 - Herrmann, Ulf A1 - Teixeira Boura, Cristiano José A1 - Schmitz, Mark A1 - Gielen, Hans A1 - Gedle, Yibekal A1 - Dersch, Jürgen T1 - Modeling the thermal behavior of solar salt in electrical resistance heaters for the application in PV-CSP hybrid power plants T2 - SOLARPACES 2020 N2 - Concentrated Solar Power (CSP) systems are able to store energy cost-effectively in their integrated thermal energy storage (TES). By intelligently combining Photovoltaics (PV) systems with CSP, a further cost reduction of solar power plants is expected, as well as an increase in dispatchability and flexibility of power generation. PV-powered Resistance Heaters (RH) can be deployed to raise the temperature of the molten salt hot storage from 385 °C up to 565 °C in a Parabolic Trough Collector (PTC) plant. To avoid freezing and decomposition of molten salt, the temperature distribution in the electrical resistance heater is investigated in the present study. For this purpose, a RH has been modeled and CFD simulations have been performed. The simulation results show that the hottest regions occur on the electric rod surface behind the last baffle. A technical optimization was performed by adjusting three parameters: Shell-baffle clearance, electric rod-baffle clearance and number of baffles. After the technical optimization was carried out, the temperature difference between the maximum temperature and the average outlet temperature of the salt is within the acceptable limits, thus critical salt decomposition has been avoided. Additionally, the CFD simulations results were analyzed and compared with results obtained with a one-dimensional model in Modelica. KW - Solar thermal technologies KW - Hybrid energy system KW - Concentrated solar power KW - Energy storage KW - Photovoltaics Y1 - 2022 SN - 978-0-7354-4195-8 U6 - https://doi.org/10.1063/5.0086268 SN - 1551-7616 (online) SN - 0094-243X (print) N1 - SOLARPACES 2020: 26th International Conference on Concentrating Solar Power and Chemical Energy Systems, 28 September–2 October 2020, Freiburg, Germany IS - 2445 / 1 PB - AIP conference proceedings / American Institute of Physics CY - Melville, NY ER - TY - CHAP A1 - Caminos, Ricardo Alexander Chico A1 - Schmitz, Pascal A1 - Atti, Vikrama A1 - Mahdi, Zahra A1 - Teixeira Boura, Cristiano José A1 - Sattler, Johannes Christoph A1 - Herrmann, Ulf A1 - Hilger, Patrick A1 - Dieckmann, Simon T1 - Development of a micro heliostat and optical qualification assessment with a 3D laser scanning method T2 - SOLARPACES 2020 N2 - The Solar-Institut Jülich (SIJ) and the companies Hilger GmbH and Heliokon GmbH from Germany have developed a small-scale cost-effective heliostat, called “micro heliostat”. Micro heliostats can be deployed in small-scale concentrated solar power (CSP) plants to concentrate the sun's radiation for electricity generation, space or domestic water heating or industrial process heat. In contrast to conventional heliostats, the special feature of a micro heliostat is that it consists of dozens of parallel-moving, interconnected, rotatable mirror facets. The mirror facets array is fixed inside a box-shaped module and is protected from weathering and wind forces by a transparent glass cover. The choice of the building materials for the box, tracking mechanism and mirrors is largely dependent on the selected production process and the intended application of the micro heliostat. Special attention was paid to the material of the tracking mechanism as this has a direct influence on the accuracy of the micro heliostat. The choice of materials for the mirror support structure and the tracking mechanism is made in favor of plastic molded parts. A qualification assessment method has been developed by the SIJ in which a 3D laser scanner is used in combination with a coordinate measuring machine (CMM). For the validation of this assessment method, a single mirror facet was scanned and the slope deviation was computed. KW - Concentrated solar power KW - Electricity generation KW - Measuring instruments KW - Heliostats KW - Global change Y1 - 2022 SN - 978-0-7354-4195-8 U6 - https://doi.org/10.1063/5.0086262 SN - 1551-7616 (online) SN - 0094-243X (print) N1 - SOLARPACES 2020: 26th International Conference on Concentrating Solar Power and Chemical Energy Systems, 28 September–2 October 2020, Freiburg, Germany IS - 2445 / 1 PB - AIP conference proceedings / American Institute of Physics CY - Melville, NY ER - TY - CHAP A1 - Niederwestberg, Stefan A1 - Schneider, Falko A1 - Teixeira Boura, Cristiano José A1 - Herrmann, Ulf T1 - Introduction to a direct irradiated transparent tube particle receiver T2 - SOLARPACES 2020 N2 - New materials often lead to innovations and advantages in technical applications. This also applies to the particle receiver proposed in this work that deploys high-temperature and scratch resistant transparent ceramics. With this receiver design, particles are heated through direct-contact concentrated solar irradiance while flowing downwards through tubular transparent ceramics from top to bottom. In this paper, the developed particle receiver as well as advantages and disadvantages are described. Investigations on the particle heat-up characteristics from solar irradiance were carried out with DEM simulations which indicate that particle temperatures can reach up to 1200 K. Additionally, a simulation model was set up for investigating the dynamic behavior. A test receiver at laboratory scale has been designed and is currently being built. In upcoming tests, the receiver test rig will be used to validate the simulation results. The design and the measurement equipment is described in this work. KW - Solar irradiance KW - Ceramics Y1 - 2022 SN - 978-0-7354-4195-8 U6 - https://doi.org/10.1063/5.0086735 SN - 1551-7616 (online) SN - 0094-243X (print) N1 - SOLARPACES 2020: 26th International Conference on Concentrating Solar Power and Chemical Energy Systems, 28 September–2 October 2020, Freiburg, Germany IS - 2445 / 1 PB - AIP conference proceedings / American Institute of Physics CY - Melville, NY ER - TY - CHAP A1 - Neumann, Hannah A1 - Adam, Mario A1 - Backes, Klaus A1 - Börner, Martin A1 - Clees, Tanja A1 - Doetsch, Christian A1 - Glaeser, Susanne A1 - Herrmann, Ulf A1 - May, Johanna A1 - Rosenthal, Florian A1 - Sauer, Dirk Uwe A1 - Stadler, Ingo T1 - Development of open educational resources for renewable energy and the energy transition process T2 - ISES SWC 2021 N2 - The dissemination of knowledge about renewable energies is understood as a social task with the highest topicality. The transfer of teaching content on renewable energies into digital open educational resources offers the opportunity to significantly accelerate the implementation of the energy transition. Thus, in the here presented project six German universities create open educational resources for the energy transition. These materials are available to the public on the internet under a free license. So far there has been no publicly accessible, editable media that cover entire learning units about renewable energies extensively and in high technical quality. Thus, in this project, the content that remains up-to-date for a longer period is appropriately prepared in terms of media didactics. The materials enable lecturers to provide students with in-depth training about technologies for the energy transition. In a particular way, the created material is also suitable for making the general public knowledgeable about the energy transition with scientifically based material. KW - energy transition KW - renewable energies KW - open educational resources KW - dissemination KW - digitalization Y1 - 2021 U6 - https://doi.org/10.18086/swc.2021.47.03 N1 - ISES Solar World Congress, virtual conference 25-29 October 2021 PB - International Solar Energy Society CY - Freiburg ER - TY - PAT A1 - Hüning, Felix T1 - Positionssensorvorrichtung N2 - Die Erfindung betrifft eine Positionssensorvorrichtung zur Bestimmung einer Absolutposition eines beweglichen ersten Teils relativ zu einem ortsfesten zweiten Teil mit einem mit dem beweglichen ersten Teil gekoppelter Codekörper, der dazu eingerichtet ist, eine Codespur mit einer Mehrzahl von in Spurrichtung aufeinanderfolgenden Codeelementen zu enthalten zur Bildung eines Codewortes, mit einer magnetischen Detektionseinrichtung zur Detektion der Codespur, wobei die Detektionseinrichtung zum einen an dem Codekörper befestigte und entlang der Spurrichtung in einem solchen Abstand gegenpolig zueinander angeordnete Permanentmagneten aufweist, dass der Abstand mit einer vorgegebenen Länge der jeweiligen Codeelemente übereinstimmt, und zum anderen eine Anzahl von ortsfest und quer zu dem Codekörper versetzt angeordnete Wiegandsensoren aufweist, wobei der Abstand des Wiegandsensors zu einer Erstreckungsebene der Permanentmagneten derart gewählt ist, dass bei Überdeckung des Wiegandsensors durch den Permanentmagneten ein Wiegandpuls in dem Wiegandsensor induziert wird. Y1 - 2024 ER - TY - CHAP A1 - Sattler, Johannes Christoph A1 - Schneider, Iesse Peer A1 - Angele, Florian A1 - Atti, Vikrama A1 - Teixeira Boura, Cristiano José A1 - Herrmann, Ulf T1 - Development of heliostat field calibration methods: Theory and experimental test results T2 - SolarPACES 2022 conference proceedings N2 - In this work, three patent pending calibration methods for heliostat fields of central receiver systems (CRS) developed by the Solar-Institut Jülich (SIJ) of the FH Aachen University of Applied Sciences are presented. The calibration methods can either operate in a combined mode or in stand-alone mode. The first calibration method, method A, foresees that a camera matrix is placed into the receiver plane where it is subjected to concentrated solar irradiance during a measurement process. The second calibration method, method B, uses an unmanned aerial vehicle (UAV) such as a quadrocopter to automatically fly into the reflected solar irradiance cross-section of one or more heliostats (two variants of method B were tested). The third calibration method, method C, foresees a stereo central camera or multiple stereo cameras installed e.g. on the solar tower whereby the orientations of the heliostats are calculated from the location detection of spherical red markers attached to the heliostats. The most accurate method is method A which has a mean accuracy of 0.17 mrad. The mean accuracy of method B variant 1 is 1.36 mrad and of variant 2 is 1.73 mrad. Method C has a mean accuracy of 15.07 mrad. For method B there is great potential regarding improving the measurement accuracy. For method C the collected data was not sufficient for determining whether or not there is potential for improving the accuracy. KW - Heliostat Field Calibration KW - Unmanned aerial vehicle KW - UAV KW - Quadrocopter KW - Camera system Y1 - 2024 U6 - https://doi.org/10.52825/solarpaces.v1i.678 SN - 2751-9899 (online) N1 - SolarPACES 2022: 28th International Conference on Concentrating Solar Power and Chemical Energy Systems, 27-30 September, Albuquerque, NM, USA IS - 1 PB - TIB Open Publishing CY - Hannover ER -