TY - CHAP A1 - Wittig, M. A1 - Rütters, René A1 - Bragard, Michael ED - Reiff-Stephan, Jörg ED - Jäkel, Jens ED - Schwarz, André T1 - Application of RL in control systems using the example of a rotatory inverted pendulum T2 - Tagungsband AALE 2024 : Fit für die Zukunft: praktische Lösungen für die industrielle Automation N2 - In this paper, the use of reinforcement learning (RL) in control systems is investigated using a rotatory inverted pendulum as an example. The control behavior of an RL controller is compared to that of traditional LQR and MPC controllers. This is done by evaluating their behavior under optimal conditions, their disturbance behavior, their robustness and their development process. All the investigated controllers are developed using MATLAB and the Simulink simulation environment and later deployed to a real pendulum model powered by a Raspberry Pi. The RL algorithm used is Proximal Policy Optimization (PPO). The LQR controller exhibits an easy development process, an average to good control behavior and average to good robustness. A linear MPC controller could show excellent results under optimal operating conditions. However, when subjected to disturbances or deviations from the equilibrium point, it showed poor performance and sometimes instable behavior. Employing a nonlinear MPC Controller in real time was not possible due to the high computational effort involved. The RL controller exhibits by far the most versatile and robust control behavior. When operated in the simulation environment, it achieved a high control accuracy. When employed in the real system, however, it only shows average accuracy and a significantly greater performance loss compared to the simulation than the traditional controllers. With MATLAB, it is not yet possible to directly post-train the RL controller on the Raspberry Pi, which is an obstacle to the practical application of RL in a prototyping or teaching setting. Nevertheless, RL in general proves to be a flexible and powerful control method, which is well suited for complex or nonlinear systems where traditional controllers struggle. KW - Rotatory Inverted Pendulum KW - MPC KW - LQR KW - PPO KW - Reinforcement Learning Y1 - 2024 SN - 978-3-910103-02-3 U6 - https://doi.org/10.33968/2024.53 N1 - 20. AALE-Konferenz. Bielefeld, 06.03.-08.03.2024. (Tagungsband unter https://doi.org/10.33968/2024.29) SP - 241 EP - 248 PB - le-tex publishing services GmbH CY - Leipzig ER - TY - CHAP A1 - Buxbaum, Bernd A1 - Schwarte, Rudolf A1 - Ringbeck, Thorsten A1 - [u.a.], T1 - A new approach in optical broadband communication systems : a high integrated optical phase locked loop based on a mixing and correlating sensor, the Photonic Mixer Device (PMD) T2 - Proceedings / OPTO 98, Internationaler Kongress und Fachausstellung für Optische Sensorik, Messtechnik und Elektronik, 18. - 20. Mai 1998, Kongresszentrum Erfurt Y1 - 1998 N1 - Internationaler Kongress und Fachausstellung für Optische Sensorik, Messtechnik & Elektronik <3, 1998, Erfurt> ; International Congress and Exhibition on Optoelectronics, Optical Sensors and Measuring Techniques <3, 1998, Erfurt> ; OPTO <3, 1998, Erfurt> SP - 59 EP - 64 PB - ACS Organisations GmbH CY - Wunsdorf ER - TY - CHAP A1 - Kramer, Pia A1 - Bragard, Michael A1 - Ritz, Thomas A1 - Ferfer, Ute A1 - Schiffers, Tim T1 - Visualizing, Enhancing and Predicting Students’ Success through ECTS Monitoring T2 - 2024 IEEE Global Engineering Education Conference (EDUCON) N2 - This paper serves as an introduction to the ECTS monitoring system and its potential applications in higher education. It also emphasizes the potential for ECTS monitoring to become a proactive system, supporting students by predicting academic success and identifying groups of potential dropouts for tailored support services. The use of the nearest neighbor analysis is suggested for improving data analysis and prediction accuracy. KW - Monitoring KW - Engineering education KW - Data visualization KW - Accuracy KW - Data analysis Y1 - 2024 U6 - https://doi.org/10.1109/EDUCON60312.2024.10578652 SN - 2165-9559 SN - 2165-9567 (eISSN) N1 - 2024 IEEE Global Engineering Education Conference (EDUCON), 08-11 May 2024, Kos Island, Greece PB - IEEE CY - New York, NY ER - TY - CHAP A1 - Buxbaum, Bernd A1 - Hess, Holger A1 - Ringbeck, Thorsten ED - Voges, Edgar T1 - The photonic mixer device : new perspectives in optical wireless communication T2 - International Workshop on Optical MEMS and Integrated Optics : Universität Dortmund, Universitätskolleg Bommerholz, 11. & 12. June 2001 Y1 - 2001 N1 - International Workshop on Optical MEMS and Integrated Optics <2001, Dortmund> SP - (12)1 EP - (12)5 PB - Univ. CY - Dortmund ER - TY - CHAP A1 - Ringbeck, Thorsten A1 - Albrecht, M. A1 - Frey, J. ED - Lerch, Reinhard T1 - Time-of-Flight 3D-camera for autonomous navigation and industrial automation T2 - Proceedings : 11th international conference, 13 - 15 May 2003, Exhibition Centre Nuremberg, Germany ; an event of the Association for Sensor Technology, AMA Y1 - 2003 N1 - Internationale Messe mit Kongress Sensor PB - AMA Service CY - Wunstorf/Germany ET - CD-ROM-Ausg. ER - TY - CHAP A1 - Hagebeuker, Bianca A1 - Ringbeck, Thorsten A1 - Frydlewicz, Paul A1 - Jesorsky, Oliver A1 - Sünkel, Thomas ED - Grote, Caspar T1 - PMD-Sensoren als Schlüsselkomponenten für die mehrdimensionale Umfelderfassung des Fahrzeuginnenraums T2 - Begleittexte zum Entwicklerforum KFZ-Elektronik & FlexRay Solution Day : 15.Mai 2007, Ludwigsburg Y1 - 2007 N1 - Entwicklerforum Kfz-Elektronik <2007, Ludwigsburg> ; FlexRay Solution Day <2007, Ludwigsburg> SP - 287 EP - 296 PB - WEKA-Fachzeitschr.-Verl. CY - Poing ER - TY - CHAP A1 - Grothof, M. A1 - Schwarte, Rudolf A1 - Buxbaum, Bernd A1 - Ringbeck, Thorsten ED - Wagner, Elmar T1 - Product monitoring with MSM-PMD-Array T2 - Proceedings / OPTO 2002 : an event of the Association for Sensor Technology AMA ; 14 - 16 May 2002, Exhibition Centre Erfurt, Germany / International Conference Optoelectronics, Optical Sensors & Measuring Techniques Y1 - 2002 N1 - OPTO <5, 2002, Erfurt> ; International Conference Optoelectronics, Optical Sensors & Measuring Techniques SP - 41 EP - 47 PB - AMA Service GmbH CY - Wunsdorf ER - TY - CHAP A1 - Buxbaum, Bernd A1 - Schwarte, Rudolf A1 - Ringbeck, Thorsten A1 - Grothof, Markus A1 - Sluiter, A. A1 - Frey, Jochen A1 - Hildebrand, M. A1 - David, Klaus ED - Korevaar, Eric John T1 - Wireless LAN based on optical CDMA using a new high-speed correlation receiver (MSM-PMD) T2 - Optical wireless communications IV : 21-22 August, 2001, Denver, USA. - (SPIE proceedings series ; 4530) Y1 - 2001 SN - 0-8194-4254-2 U6 - https://doi.org/10.1117/12.449808 N1 - Optical Wireless Communications Conference <4, 2001, Denver, Colo.> SP - 168 EP - 178 PB - SPIE CY - Bellingham, Wash. ER - TY - CHAP A1 - Nötzold, K. A1 - Uphues, A. A1 - Wegener, R. A1 - Fink, K. A1 - Bragard, Michael A1 - Griessel, R. A1 - Soter, S. T1 - Inverter based test setup for LVRT verification of a full-scale 2 MW wind power converter T2 - 15th European Conference on Power Electronics and Applications (EPE), 2013 : 2 - 6 Sept. 2013, Lille, France / [EPE Association; PELS, IEEE Power Electronics Society] Y1 - 2013 SN - 978-1-4799-0115-9 (Online-Ausg.) U6 - https://doi.org/10.1109/EPE.2013.6634752 SP - 1037 EP - 1042 PB - IEEE CY - Piscataway, NJ ER - TY - CHAP A1 - Ellerweg, Roland A1 - Ritz, Thomas ED - Roth, Jörg T1 - Tool supported requirements analysis for the user centered development of mobile enterprise software T2 - Proceeding of Wireless Applications and Computing 2008 and Telecommunications, Networks and Systems 2008 : MCCSIS '08 ; IADIS Multi Conference on Computer Science and Information Systems ; 22 - 24 July 2008, Amsterdam, The Netherlands N2 - A user centered development method has proved satisfactory for the development of mobile enterprise software. To make use of this method, detailed information about the user and the place where the user interacts with his mobile device is required. This article describes how both can be modeled by a stereotypical and conceptual extended UML extension. Finally, a software tool is presented that supports the developed UML extension. Y1 - 2008 SN - 978-972-8924-62-1 SP - 160 EP - 162 PB - IADIS Press CY - [Lisboa] ER - TY - CHAP A1 - Lindner, Marvin A1 - Kolb, Andreas A1 - Ringbeck, Thorsten T1 - New insights into the calibration of ToF-sensors T2 - 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition workshops : Anchorage, AK, 23 - 28 June 2008 N2 - Time-of-flight (ToF) sensors have become an alternative to conventional distance sensing techniques like laser scanners or image based stereo. ToF sensors provide full range distance information at high frame-rates and thus have a significant impact onto current research in areas like online object recognition, collision prevention or scene reconstruction. However, ToF cameras like the photonic mixer device (PMD) still exhibit a number of challenges regarding static and dynamic effects, e.g. systematic distance errors and motion artefacts, respectively. Sensor calibration techniques reducing static system errors have been proposed and show promising results. However, current calibration techniques in general need a large set of reference data in order to determine the corresponding parameters for the calibration model. This paper introduces a new calibration approach which combines different demodulation techniques for the ToF- camera 's reference signal. Examples show, that the resulting combined demodulation technique yields improved distance values based on only two required reference data sets. Y1 - 2008 SN - 978-1-4244-2339-2 SN - 978-1-4244-2340-8 SP - 1 EP - 5 PB - IEEE Service Center CY - Piscataway, NJ ER - TY - CHAP A1 - Bragard, Michael A1 - Soltau, N. A1 - De Doncker, R. W. A1 - Schmiegel, A. T1 - Design and implementation of a 5 kW photovoltaic system with li-ion battery and additional DC-DC converter T2 - 2010 IEEE Energy Conversion Congress and Exposition (ECCE 2010) : Atlanta, Georgia, USA, 12 - 16 September 2010 / [sponsored by the IEEE Power Electronics and Industry Applications Societies] Y1 - 2010 SN - 978-1-4244-5286-6 (Print) SN - 978-1-4244-5287-3 (Online) U6 - https://doi.org/10.1109/ECCE.2010.5618220 SP - 2944 EP - 2949 PB - IEEE CY - Piscataway, NJ ER - TY - CHAP A1 - Bragard, Michael A1 - Conrad, M. A1 - De Doncker, R. W. T1 - The integrated emitter turn-off thyristor (IETO) : an innovative thyristor based high power semiconductor device using MOS assisted turn-off T2 - 2010 IEEE Energy Conversion Congress and Exposition (ECCE 2010) : Atlanta, Georgia, USA, 12 - 16 September 2010 / [sponsored by the IEEE Power Electronics and Industry Applications Societies] Y1 - 2010 SN - 978-1-4244-5286-6 (Print) SN - 978-1-4244-5287-3 (Online) U6 - https://doi.org/10.1109/ECCE.2010.5618410 SP - 4551 EP - 4557 PB - IEEE CY - Piscataway, NJ ER - TY - CHAP A1 - Ritz, Thomas T1 - Personalized information services : an electronic information commodity and its production T2 - Electronic publishing '01 : 2001 in the digital publishing odyssey ; proceedings of an ICCC/IFIP conference held at the University of Kent at Canterbury, Kent, United Kingdom, 5 - 7 July, 2001 ; [proceedings of the Fifth Conference on Electronic Publishing] Y1 - 2001 SN - 1-58603-191-0 SP - 48 EP - 58 PB - IOS Press [u.a.] CY - Amsterdam ER - TY - CHAP A1 - Hofmann, Till A1 - Mataré, Victor A1 - Neumann, Tobias A1 - Schönitz, Sebastian A1 - Henke, Christoph A1 - Limpert, Nicolas A1 - Niemueller, Tim A1 - Ferrein, Alexander A1 - Jeschke, Sabina A1 - Lakemeyer, Gerhard T1 - Enhancing Software and Hardware Reliability for a Successful Participation in the RoboCup Logistics League 2017 Y1 - 2018 SN - 978-3-030-00308-1 U6 - https://doi.org/10.1007/978-3-030-00308-1_40 N1 - Lecture Notes in Computer Science, vol 11175 SP - 486 EP - 497 PB - Springer CY - Cham ER - TY - CHAP A1 - Sadeghfam, Arash A1 - Sadeghi-Ahangar, A. A1 - Elgamal, Abdelrahman A1 - Heuermann, Holger T1 - Design and Development of a Novel Self-Igniting Microwave Plasma Jet for Industrial Applications T2 - IEEE MTT-S International Microwave Symposium Digest Y1 - 2019 SN - 978-172811309-8 SP - 63 EP - 66 ER - TY - CHAP A1 - Arndt, Tobias A1 - Conzen, Max A1 - Elsen, Ingo A1 - Ferrein, Alexander A1 - Galla, Oskar A1 - Köse, Hakan A1 - Schiffer, Stefan A1 - Tschesche, Matteo T1 - Anomaly detection in the metal-textile industry for the reduction of the cognitive load of quality control workers T2 - PETRA '23: Proceedings of the 16th International Conference on PErvasive Technologies Related to Assistive Environments N2 - This paper presents an approach for reducing the cognitive load for humans working in quality control (QC) for production processes that adhere to the 6σ -methodology. While 100% QC requires every part to be inspected, this task can be reduced when a human-in-the-loop QC process gets supported by an anomaly detection system that only presents those parts for manual inspection that have a significant likelihood of being defective. This approach shows good results when applied to image-based QC for metal textile products. KW - Datasets KW - Neural networks KW - Anomaly detection KW - Quality control KW - Process optimization Y1 - 2023 SN - 9798400700699 U6 - https://doi.org/10.1145/3594806.3596558 N1 - PETRA '23: Proceedings of the 16th International Conference on PErvasive Technologies Related to Assistive Environments, Corfu, Greece, July 5 - 7, 2023 SP - 535 EP - 542 PB - ACM ER - TY - CHAP A1 - Alhwarin, Faraj A1 - Ferrein, Alexander A1 - Scholl, Ingrid T1 - An Efficient Hashing Algorithm for NN Problem in HD Spaces T2 - Lecture Notes in Computer Science Y1 - 2019 SN - 978-303005498-4 U6 - https://doi.org/10.1007/978-3-030-05499-1_6 N1 - 7th International Conference on Pattern Recognition Applications and Methods, ICPRAM 2018; Funchal; Portugal; 16 January 2018 through 18 January 2018; Code 222779 SP - 101 EP - 115 ER - TY - CHAP A1 - Schopp, Christoph A1 - Nachtrodt, Frederik A1 - Heuermann, Holger A1 - Scherer, Ulrich W. A1 - Mostacci, Domiziano A1 - Finger, Torsten A1 - Tietsch, Wolfgang T1 - A novel 2.45 GHz/200 W Microwave Plasma Jet for High Temperature Applications above 3600 K T2 - Journal of Physics : Conference Series Y1 - 2012 SN - 1742-6596 VL - 406 IS - 012029 ER - TY - CHAP A1 - Niemüller, Tim A1 - Lakemeyer, Gerhard A1 - Ferrein, Alexander T1 - Aspects of integrating diverse software into robotic systems extended abstract T2 - ICRA 2013 - 8th Workshop on Software Development and Integration in Robotics (SDIR), Karlsruhe, Germany Y1 - 2013 SP - 1 EP - 2 ER -