TY - CHAP A1 - Wittig, M. A1 - Rütters, René A1 - Bragard, Michael ED - Reiff-Stephan, Jörg ED - Jäkel, Jens ED - Schwarz, André T1 - Application of RL in control systems using the example of a rotatory inverted pendulum T2 - Tagungsband AALE 2024 : Fit für die Zukunft: praktische Lösungen für die industrielle Automation N2 - In this paper, the use of reinforcement learning (RL) in control systems is investigated using a rotatory inverted pendulum as an example. The control behavior of an RL controller is compared to that of traditional LQR and MPC controllers. This is done by evaluating their behavior under optimal conditions, their disturbance behavior, their robustness and their development process. All the investigated controllers are developed using MATLAB and the Simulink simulation environment and later deployed to a real pendulum model powered by a Raspberry Pi. The RL algorithm used is Proximal Policy Optimization (PPO). The LQR controller exhibits an easy development process, an average to good control behavior and average to good robustness. A linear MPC controller could show excellent results under optimal operating conditions. However, when subjected to disturbances or deviations from the equilibrium point, it showed poor performance and sometimes instable behavior. Employing a nonlinear MPC Controller in real time was not possible due to the high computational effort involved. The RL controller exhibits by far the most versatile and robust control behavior. When operated in the simulation environment, it achieved a high control accuracy. When employed in the real system, however, it only shows average accuracy and a significantly greater performance loss compared to the simulation than the traditional controllers. With MATLAB, it is not yet possible to directly post-train the RL controller on the Raspberry Pi, which is an obstacle to the practical application of RL in a prototyping or teaching setting. Nevertheless, RL in general proves to be a flexible and powerful control method, which is well suited for complex or nonlinear systems where traditional controllers struggle. KW - Rotatory Inverted Pendulum KW - MPC KW - LQR KW - PPO KW - Reinforcement Learning Y1 - 2024 SN - 978-3-910103-02-3 U6 - http://dx.doi.org/10.33968/2024.53 N1 - 20. AALE-Konferenz. Bielefeld, 06.03.-08.03.2024. (Tagungsband unter https://doi.org/10.33968/2024.29) SP - 241 EP - 248 PB - le-tex publishing services GmbH CY - Leipzig ER - TY - JOUR A1 - Fagan, Andrew J. A1 - Bitz, Andreas A1 - Björkman-Burtscher, Isabella M. A1 - Collins, Christopher M. A1 - Kimbrell, Vera A1 - Raaijmakers, Alexander J. E. T1 - 7T MR Safety JF - Journal of Magnetic Resonance Imaging (JMRI) Y1 - 2021 U6 - http://dx.doi.org/10.1002/jmri.27319 SN - 1522-2586 VL - 53 IS - 2 SP - 333 EP - 346 PB - Wiley CY - Weinheim ER - TY - JOUR A1 - Fiedler, Thomas M. A1 - Ladd, Mark E. A1 - Clemens, Markus A1 - Bitz, Andreas T1 - Safety of subjects during radiofrequency exposure in ultra-high-field magnetic resonance imaging JF - IEEE Letters on Electromagnetic Compatibility Practice and Applications N2 - Magnetic resonance imaging (MRI) is one of the most important medical imaging techniques. Since the introduction of MRI in the mid-1980s, there has been a continuous trend toward higher static magnetic fields to obtain i.a. a higher signal-to-noise ratio. The step toward ultra-high-field (UHF) MRI at 7 Tesla and higher, however, creates several challenges regarding the homogeneity of the spin excitation RF transmit field and the RF exposure of the subject. In UHF MRI systems, the wavelength of the RF field is in the range of the diameter of the human body, which can result in inhomogeneous spin excitation and local SAR hotspots. To optimize the homogeneity in a region of interest, UHF MRI systems use parallel transmit systems with multiple transmit antennas and time-dependent modulation of the RF signal in the individual transmit channels. Furthermore, SAR increases with increasing field strength, while the SAR limits remain unchanged. Two different approaches to generate the RF transmit field in UHF systems using antenna arrays close and remote to the body are investigated in this letter. Achievable imaging performance is evaluated compared to typical clinical RF transmit systems at lower field strength. The evaluation has been performed under consideration of RF exposure based on local SAR and tissue temperature. Furthermore, results for thermal dose as an alternative RF exposure metric are presented. Y1 - 2020 SN - 2637-6423 U6 - http://dx.doi.org/10.1109/LEMCPA.2020.3029747 VL - 2 IS - 3 SP - 1 EP - 8 PB - IEEE CY - New York, NY ER - TY - CHAP A1 - Hofmann, Till A1 - Limpert, Nicolas A1 - Mataré, Viktor A1 - Ferrein, Alexander A1 - Lakemeyer, Gerhard T1 - Winning the RoboCup Logistics League with Fast Navigation, Precise Manipulation, and Robust Goal Reasoning T2 - RoboCup 2019: Robot World Cup XXIII. RoboCup Y1 - 2019 SN - 978-3-030-35699-6 U6 - http://dx.doi.org/10.1007/978-3-030-35699-6_41 N1 - Lecture Notes in Computer Science, vol 11531 SP - 504 EP - 516 PB - Springer CY - Cham ER - TY - CHAP A1 - Hoegen, Anne von A1 - Doncker, Rik W. De A1 - Rütters, René T1 - Teaching Digital Control of Operational Amplifier Processes with a LabVIEW Interface and Embedded Hardware T2 - The 23rd International Conference on Electrical Machines and Systems (ICEMS), Hamamatsu, Japan Y1 - 2020 U6 - http://dx.doi.org/10.23919/ICEMS50442.2020.9290928 SP - 1117 EP - 1122 ER - TY - CHAP A1 - Ibanez-Sanchez, Gema A1 - Wolf, Martin T1 - Interactive Process Mining-Induced Change Management Methodology for Healthcare T2 - Interactive Process Mining in Healthcare N2 - The adoption of the Digital Health Transformation is a tremendous paradigm change in health organizations, which is not a trivial process in reality. For that reason, in this chapter, it is proposed a methodology with the objective to generate a changing culture in healthcare organisations. Such a change culture is essential for the successful implementation of any supporting methods like Interactive Process Mining. It needs to incorporate (mostly) new ways of team-based and evidence-based approaches for solving structural problems in a digital healthcare environment. KW - Methodology KW - Change culture KW - Lean thinking KW - Interactive process mining KW - Objective data Y1 - 2020 SN - 978-3-030-53993-1 (Online) SN - 978-3-030-53992-4 (Print) U6 - http://dx.doi.org/10.1007/978-3-030-53993-1_16 SP - 267 EP - 293 PB - Springer CY - Cham ER - TY - JOUR A1 - Hüning, Felix A1 - Backes, Andreas T1 - Direct observation of large Barkhausen jump in thin Vicalloy wires JF - IEEE Magnetics Letters Y1 - 2020 SN - 1949-307X U6 - http://dx.doi.org/10.1109/LMAG.2020.3046411 VL - 11 IS - Art. 2506504 SP - 1 EP - 4 PB - IEEE CY - New York, NY ER - TY - CHAP A1 - Hoegen, Anne von A1 - Doncker, Rik W. De A1 - Bragard, Michael A1 - Hoegen, Svenja von T1 - Problem-Based Learning in Automation Engineering: Performing a Remote Laboratory Session Serving Various Educational Attainments T2 - 2021 IEEE Global Engineering Education Conference (EDUCON) Y1 - 2021 U6 - http://dx.doi.org/10.1109/EDUCON46332.2021.9453925 SP - 1605 EP - 1614 ER - TY - CHAP A1 - Hüning, Felix A1 - Stüttgen, Marcel T1 - Work in Progress: Interdisciplinary projects in times of COVID-19 crisis – challenges, risks and chances T2 - 2021 IEEE Global Engineering Education Conference (EDUCON) Y1 - 2021 U6 - http://dx.doi.org/10.1109/EDUCON46332.2021.9454006 SP - 1175 EP - 1179 ER - TY - JOUR A1 - Altherr, Lena A1 - Ederer, Thorsten A1 - Lorenz, Ulf A1 - Pelz, Peter F. A1 - Pöttgen, Philipp ED - Lübbecke, Marco ED - Koster, Arie ED - Letmathe, Peter ED - Madlener, Reihard ED - Peis, Britta ED - Walther, Grit T1 - Experimental validation of an enhanced system synthesis approach JF - Operations Research Proceedings 2014 N2 - Planning the layout and operation of a technical system is a common task for an engineer. Typically, the workflow is divided into consecutive stages: First, the engineer designs the layout of the system, with the help of his experience or of heuristic methods. Secondly, he finds a control strategy which is often optimized by simulation. This usually results in a good operating of an unquestioned sys- tem topology. In contrast, we apply Operations Research (OR) methods to find a cost-optimal solution for both stages simultaneously via mixed integer program- ming (MILP). Technical Operations Research (TOR) allows one to find a provable global optimal solution within the model formulation. However, the modeling error due to the abstraction of physical reality remains unknown. We address this ubiq- uitous problem of OR methods by comparing our computational results with mea- surements in a test rig. For a practical test case we compute a topology and control strategy via MILP and verify that the objectives are met up to a deviation of 8.7%. Y1 - 2014 SN - 978-3-319-28695-2 U6 - http://dx.doi.org/10.1007/978-3-319-28697-6_1 PB - Springer CY - Basel ER - TY - CHAP A1 - Altherr, Lena A1 - Ederer, Thorsten A1 - Schänzle, Christian A1 - Lorenz, Ulf A1 - Pelz, Peter F. T1 - Algorithmic system design using scaling and affinity laws T2 - Operations Research Proceedings 2015 N2 - Energy-efficient components do not automatically lead to energy-efficient systems. Technical Operations Research (TOR) shifts the focus from the single component to the system as a whole and finds its optimal topology and operating strategy simultaneously. In previous works, we provided a preselected construction kit of suitable components for the algorithm. This approach may give rise to a combinatorial explosion if the preselection cannot be cut down to a reasonable number by human intuition. To reduce the number of discrete decisions, we integrate laws derived from similarity theory into the optimization model. Since the physical characteristics of a production series are similar, it can be described by affinity and scaling laws. Making use of these laws, our construction kit can be modeled more efficiently: Instead of a preselection of components, it now encompasses whole model ranges. This allows us to significantly increase the number of possible set-ups in our model. In this paper, we present how to embed this new formulation into a mixed-integer program and assess the run time via benchmarks. We present our approach on the example of a ventilation system design problem. KW - Optimal Topology KW - Piecewise Linearization KW - Ventilation System KW - Similarity Theory Y1 - 2017 SN - 978-3-319-42901-4 SN - 978-3-319-42902-1 U6 - http://dx.doi.org/10.1007/978-3-319-42902-1 N1 - International Conference of the German, Austrian and Swiss Operations Research Societies (GOR, ÖGOR, SVOR/ASRO), University of Vienna, Austria, September 1-4, 2015 SP - 605 EP - 611 PB - Springer CY - Cham ER - TY - CHAP A1 - Nikolovski, Gjorgji A1 - Reke, Michael A1 - Elsen, Ingo A1 - Schiffer, Stefan T1 - Machine learning based 3D object detection for navigation in unstructured environments T2 - 2021 IEEE Intelligent Vehicles Symposium Workshops (IV Workshops) N2 - In this paper we investigate the use of deep neural networks for 3D object detection in uncommon, unstructured environments such as in an open-pit mine. While neural nets are frequently used for object detection in regular autonomous driving applications, more unusual driving scenarios aside street traffic pose additional challenges. For one, the collection of appropriate data sets to train the networks is an issue. For another, testing the performance of trained networks often requires tailored integration with the particular domain as well. While there exist different solutions for these problems in regular autonomous driving, there are only very few approaches that work for special domains just as well. We address both the challenges above in this work. First, we discuss two possible ways of acquiring data for training and evaluation. That is, we evaluate a semi-automated annotation of recorded LIDAR data and we examine synthetic data generation. Using these datasets we train and test different deep neural network for the task of object detection. Second, we propose a possible integration of a ROS2 detector module for an autonomous driving platform. Finally, we present the performance of three state-of-the-art deep neural networks in the domain of 3D object detection on a synthetic dataset and a smaller one containing a characteristic object from an open-pit mine. KW - 3D object detection KW - LiDAR KW - autonomous driving KW - Deep learning KW - Three-dimensional displays Y1 - 2021 SN - 978-1-6654-7921-9 U6 - http://dx.doi.org/10.1109/IVWorkshops54471.2021.9669218 N1 - 2021 IEEE Intelligent Vehicles Symposium Workshops (IV Workshops), 11-17 July 2021, Nagoya, Japan. SP - 236 EP - 242 PB - IEEE ER - TY - CHAP A1 - Schänzle, Christian A1 - Altherr, Lena A1 - Ederer, Thorsten A1 - Lorenz, Ulf A1 - Pelz, Peter F. T1 - As good as it can be: Ventilation system design by a combined scaling and discrete optimization method T2 - Proceedings of FAN 2015 N2 - The understanding that optimized components do not automatically lead to energy-efficient systems sets the attention from the single component on the entire technical system. At TU Darmstadt, a new field of research named Technical Operations Research (TOR) has its origin. It combines mathematical and technical know-how for the optimal design of technical systems. We illustrate our optimization approach in a case study for the design of a ventilation system with the ambition to minimize the energy consumption for a temporal distribution of diverse load demands. By combining scaling laws with our optimization methods we find the optimal combination of fans and show the advantage of the use of multiple fans. Y1 - 2015 N1 - Proceedings of FAN 2015, Lyon (France), 15 – 17 April 2015 SP - 1 EP - 11 ER - TY - JOUR A1 - Pöttgen, Philipp A1 - Ederer, Thorsten A1 - Altherr, Lena A1 - Lorenz, Ulf A1 - Pelz, Peter F. T1 - Examination and optimization of a heating circuit for energy-efficient buildings JF - Energy Technology N2 - The conference center darmstadtium in Darmstadt is a prominent example of energy efficient buildings. Its heating system consists of different source and consumer circuits connected by a Zortström reservoir. Our goal was to reduce the energy costs of the system as much as possible. Therefore, we analyzed its supply circuits. The first step towards optimization is a complete examination of the system: 1) Compilation of an object list for the system, 2) collection of the characteristic curves of the components, and 3) measurement of the load profiles of the heat and volume-flow demand. Instead of modifying the system manually and testing the solution by simulation, the second step was the creation of a global optimization program. The objective was to minimize the total energy costs for one year. We compare two different topologies and show opportunities for significant savings. KW - energy transfer KW - heating system KW - programming KW - system optimization KW - technical operations research Y1 - 2015 SN - 2194-4296 U6 - http://dx.doi.org/10.1002/ente.201500252 VL - 4 IS - 1 SP - 136 EP - 144 PB - WILEY-VCH Verlag CY - Weinheim ER - TY - CHAP A1 - Altherr, Lena A1 - Ederer, Thorsten A1 - Farnetane, Lucas S. A1 - Pöttgen, Philipp A1 - Vergé, Angela A1 - Pelz, Peter F. T1 - Multicriterial design of a hydrostatic transmission system via mixed-integer programming T2 - Operations Research Proceedings 2015 N2 - In times of planned obsolescence the demand for sustainability keeps growing. Ideally, a technical system is highly reliable, without failures and down times due to fast wear of single components. At the same time, maintenance should preferably be limited to pre-defined time intervals. Dispersion of load between multiple components can increase a system’s reliability and thus its availability inbetween maintenance points. However, this also results in higher investment costs and additional efforts due to higher complexity. Given a specific load profile and resulting wear of components, it is often unclear which system structure is the optimal one. Technical Operations Research (TOR) finds an optimal structure balancing availability and effort. We present our approach by designing a hydrostatic transmission system. Y1 - 2017 SN - 978-3-319-42901-4 SN - 978-3-319-42902-1 U6 - http://dx.doi.org/10.1007/978-3-319-42902-1_41 N1 - International Conference of the German, Austrian and Swiss Operations Research Societies (GOR, ÖGOR, SVOR/ASRO), University of Vienna, Austria, September 1-4, 2015 SP - 301 EP - 307 PB - Springer CY - Cham ER - TY - JOUR A1 - Altherr, Lena A1 - Ederer, Thorsten A1 - Pöttgen, Philipp A1 - Lorenz, Ulf A1 - Pelz, Peter F. ED - Pelz, Peter F. ED - Groche, Peter T1 - Multicriterial optimization of technical systems considering multiple load and availability scenarios JF - Applied Mechanics and Materials N2 - Cheap does not imply cost-effective -- this is rule number one of zeitgeisty system design. The initial investment accounts only for a small portion of the lifecycle costs of a technical system. In fluid systems, about ninety percent of the total costs are caused by other factors like power consumption and maintenance. With modern optimization methods, it is already possible to plan an optimal technical system considering multiple objectives. In this paper, we focus on an often neglected contribution to the lifecycle costs: downtime costs due to spontaneous failures. Consequently, availability becomes an issue. KW - sustainability KW - availability KW - energy efficiency KW - mixed-integer linear programming KW - system synthesis Y1 - 2015 SN - 1660-9336 U6 - http://dx.doi.org/10.4028/www.scientific.net/AMM.807.247 VL - 807 SP - 247 EP - 256 ER - TY - CHAP A1 - Altherr, Lena A1 - Leise, Philipp T1 - Resilience as a concept for mastering uncertainty T2 - Mastering Uncertainty in Mechanical Engineering Y1 - 2021 SN - 978-3-030-78353-2 U6 - http://dx.doi.org/10.1007/978-3-030-78354-9 N1 - Unterkapitel 6.3.1 des Kapitels "Strategies for Mastering Uncertainty" SP - 412 EP - 417 PB - Springer CY - Cham ER - TY - CHAP A1 - Altherr, Lena A1 - Leise, Philipp A1 - Pfetsch, Marc E. A1 - Schmitt, Andreas T1 - Optimal design of resilient technical systems on the example of water supply systems T2 - Mastering Uncertainty in Mechanical Engineering Y1 - 2021 SN - 978-3-030-78356-3 N1 - Unterkapitel des Kapitels "Strategies for Mastering Uncertainty" SP - 429 EP - 433 PB - Springer CY - Cham ER - TY - CHAP A1 - Leise, Philipp A1 - Altherr, Lena T1 - Experimental evaluation of resilience metrics in a fluid system T2 - Mastering Uncertainty in Mechanical Engineering Y1 - 2021 SN - 978-3-030-78356-3 N1 - Unterkapitel des Kapitels "Strategies for Mastering Uncertainty" SP - 442 EP - 447 PB - Springer CY - Cham ER - TY - CHAP A1 - Lorenz, Imke-Sophie A1 - Altherr, Lena A1 - Pelz, Peter F. T1 - Resilience enhancement of critical infrastructure – graph-theoretical resilience analysis of the water distribution system in the German city of Darmstadt T2 - 14th WCEAM Proceedings N2 - Water suppliers are faced with the great challenge of achieving high-quality and, at the same time, low-cost water supply. Since climatic and demographic influences will pose further challenges in the future, the resilience enhancement of water distribution systems (WDS), i.e. the enhancement of their capability to withstand and recover from disturbances, has been in particular focus recently. To assess the resilience of WDS, graph-theoretical metrics have been proposed. In this study, a promising approach is first physically derived analytically and then applied to assess the resilience of the WDS for a district in a major German City. The topology based resilience index computed for every consumer node takes into consideration the resistance of the best supply path as well as alternative supply paths. This resistance of a supply path is derived to be the dimensionless pressure loss in the pipes making up the path. The conducted analysis of a present WDS provides insight into the process of actively influencing the resilience of WDS locally and globally by adding pipes. The study shows that especially pipes added close to the reservoirs and main branching points in the WDS result in a high resilience enhancement of the overall WDS. KW - Resilient infrastructure KW - Resilience assessment KW - Resilience metric graph theory KW - Water distribution system KW - Case study Y1 - 2020 SN - 978-3-030-64228-0 SN - 978-3-030-64227-3 U6 - http://dx.doi.org/10.1007/978-3-030-64228-0_13 N1 - 14th WCEAM Proceedings. World Congress on Engineering Asset Management, 28-31 July 2019, Singapore Part of the Lecture Notes in Mechanical Engineering book series (LNME) SP - 137 EP - 149 PB - Springer CY - Cham ER -