TY - CHAP A1 - Wittig, M. A1 - Rütters, René A1 - Bragard, Michael ED - Reiff-Stephan, Jörg ED - Jäkel, Jens ED - Schwarz, André T1 - Application of RL in control systems using the example of a rotatory inverted pendulum T2 - Tagungsband AALE 2024 : Fit für die Zukunft: praktische Lösungen für die industrielle Automation N2 - In this paper, the use of reinforcement learning (RL) in control systems is investigated using a rotatory inverted pendulum as an example. The control behavior of an RL controller is compared to that of traditional LQR and MPC controllers. This is done by evaluating their behavior under optimal conditions, their disturbance behavior, their robustness and their development process. All the investigated controllers are developed using MATLAB and the Simulink simulation environment and later deployed to a real pendulum model powered by a Raspberry Pi. The RL algorithm used is Proximal Policy Optimization (PPO). The LQR controller exhibits an easy development process, an average to good control behavior and average to good robustness. A linear MPC controller could show excellent results under optimal operating conditions. However, when subjected to disturbances or deviations from the equilibrium point, it showed poor performance and sometimes instable behavior. Employing a nonlinear MPC Controller in real time was not possible due to the high computational effort involved. The RL controller exhibits by far the most versatile and robust control behavior. When operated in the simulation environment, it achieved a high control accuracy. When employed in the real system, however, it only shows average accuracy and a significantly greater performance loss compared to the simulation than the traditional controllers. With MATLAB, it is not yet possible to directly post-train the RL controller on the Raspberry Pi, which is an obstacle to the practical application of RL in a prototyping or teaching setting. Nevertheless, RL in general proves to be a flexible and powerful control method, which is well suited for complex or nonlinear systems where traditional controllers struggle. KW - Rotatory Inverted Pendulum KW - MPC KW - LQR KW - PPO KW - Reinforcement Learning Y1 - 2024 SN - 978-3-910103-02-3 U6 - https://doi.org/10.33968/2024.53 N1 - 20. AALE-Konferenz. Bielefeld, 06.03.-08.03.2024. (Tagungsband unter https://doi.org/10.33968/2024.29) SP - 241 EP - 248 PB - le-tex publishing services GmbH CY - Leipzig ER - TY - JOUR A1 - Pieper, Martin A1 - Klein, Peter T1 - Application of simple, periodic homogenization techniques to non-linear heat conduction problems in non-periodic, porous media JF - Heat mass transfer N2 - Often, detailed simulations of heat conduction in complicated, porous media have large runtimes. Then homogenization is a powerful tool to speed up the calculations by preserving accurate solutions at the same time. Unfortunately real structures are generally non-periodic, which requires unpractical, complicated homogenization techniques. We demonstrate in this paper, that the application of simple, periodic techniques to realistic media, that are just close to periodic, gives accurate, approximative solutions. In order to obtain effective parameters for the homogenized heat equation, we have to solve a so called “cell problem”. In contrast to periodic structures it is not trivial to determine a suitable unit cell, which represents a non-periodic media. To overcome this problem, we give a rule of thumb on how to choose a good cell. Finally we demonstrate the efficiency of our method for virtually generated foams as well as real foams and compare these results to periodic structures. Y1 - 2012 U6 - https://doi.org/10.1007/s00231-011-0879-4 SN - 0947-7411 VL - 48 IS - 2 SP - 291 EP - 300 PB - Springer CY - Berlin ER - TY - CHAP A1 - Bung, Daniel Bernhard A1 - Valero, Daniel ED - Crookston, B. ED - Tullis, B. T1 - Application of the optical flow method to velocity determination in hydraulic structure models BT - Session 11: Fish passage and shiplocks T2 - Hydraulic Structures and Water System Management. 6th IAHR International Symposium on Hydraulic Structures, Portland, OR, 27-30 June 2016 Y1 - 2016 SN - 978-1-884575-75-4 U6 - https://doi.org/10.15142/T3150628160853 SP - 223 EP - 232 ER - TY - JOUR A1 - Yoshinobu, Tatsuo A1 - Moritz, Werner A1 - Finger, Friedhelm A1 - Schöning, Michael Josef ED - Comini, Elisabetta T1 - Application of thin-film amorphous silicon to chemical imaging JF - Nanostructured materials and hybrid composites for gas sensors and biomedical applications : symposium held April 18-20, 2006, San Francisco , California, U.S.A. Y1 - 2006 SN - 9781558998711 N1 - Materials Research Society symposia proceedings; v. 915 IS - Paper 0910-A-20-01 SP - 1 EP - 10 ER - TY - JOUR A1 - Iding, Hans A1 - Siegert, Petra A1 - Mesch, K. A1 - Pohl, Martina T1 - Application of α-keto acid decarboxylases in biotransformations JF - Biochimica et biophysica acta (BBA) - Protein structure and molecular enzymology Y1 - 1998 SN - 1879-2588 (E-Journal); 0167-4838 (Print) VL - Vol. 1385 IS - Iss. 2 SP - 307 EP - 322 ER - TY - JOUR A1 - Schütz, S. A1 - Hummel, Hans E. A1 - Schöning, Michael Josef A1 - Schroth, P. A1 - Kordos, P. A1 - Lüth, H. A1 - Zimmermann, S. A1 - Schwarz, A. A1 - Kohl, C.-D. A1 - Koczan, D. T1 - Applications and perspectives of biosensors based on insect olfaction JF - Sensor 99 : proceedings / 9th International Fair and Conference for Sensors, Transducers & Systems, May 18 - 20, 1999, Exhibition Centre Nürnberg/Germany Y1 - 1999 N1 - Internationale Messe mit Kongreß für Sensoren, Meßaufnehmer & Systeme ; (9, 1999, Nürnberg) SP - 99 EP - 104 PB - AMA Service CY - Wunstorf ER - TY - JOUR A1 - Yoshinobu, T. A1 - Yasuhito, U. A1 - Iwasaki, H. A1 - Näther, Niko A1 - Schöning, Michael Josef A1 - Koudelka-Hep, M. T1 - Applications of the light-addressable potentiometric sensor to microfluidic devices JF - Digest of technical papers : September 12 - 15, 2004, Rome, Italy, Pontificia Universitas Sancto Thoma Aquinate in Urbe / [conference chairperson: C. Di Natale]. Y1 - 2004 SN - 88-7621-282-5 N1 - Eurosensors ; (18, 2004, Roma) SP - 434 EP - 437 CY - Roma ER - TY - CHAP A1 - Weber, Hans-Joachim T1 - Applied physics of compressible and incompressible fluids T2 - Critical care nephrology / [Hrsg.:] Claudio Ronco and Rinaldo Bellomo Y1 - 1998 SN - 978-94-010-6306-7 SP - 63 EP - 84 PB - Springer CY - Dordrecht ER - TY - JOUR A1 - Faßbender, Heinz A1 - Bühler, Gerhard T1 - Applying Ada, Java and CORBA for making a command and control information system platform independent JF - Proceedings : (SIGAda '99) ; October 17 - 21, 1999 ; Crowne Plaza, Redondo Beach & Marine Hotel, Redondo Beach, CA, USA / ACM SIGAda Annual International Conference Y1 - 1999 SN - 1-58113-127-5 N1 - (Ada letters ; 19,3) SP - 83 EP - 88 PB - ACM CY - New York, NY ER - TY - CHAP A1 - Eggert, Mathias A1 - Zähl, Philipp M. A1 - Wolf, Martin R. A1 - Haase, Martin ED - Cooper, Kendra M.L. ED - Bucchiarone, Antonio T1 - Applying leaderboards for quality improvement in software development projects T2 - Software Engineering for Games in Serious Contexts N2 - Software development projects often fail because of insufficient code quality. It is now well documented that the task of testing software, for example, is perceived as uninteresting and rather boring, leading to poor software quality and major challenges to software development companies. One promising approach to increase the motivation for considering software quality is the use of gamification. Initial research works already investigated the effects of gamification on software developers and come to promising. Nevertheless, a lack of results from field experiments exists, which motivates the chapter at hand. By conducting a gamification experiment with five student software projects and by interviewing the project members, the chapter provides insights into the changing programming behavior of information systems students when confronted with a leaderboard. The results reveal a motivational effect as well as a reduction of code smells. KW - Leaderboard KW - Gamification KW - Software testing KW - Software development Y1 - 2023 SN - 978-3-031-33337-8 (Print) SN - 978-3-031-33338-5 (Online) U6 - https://doi.org/10.1007/978-3-031-33338-5_11 SP - 243 EP - 263 PB - Springer CY - Cham ER -