Conference Proceeding
Refine
Year of publication
Institute
- Fachbereich Elektrotechnik und Informationstechnik (234)
- Fachbereich Medizintechnik und Technomathematik (210)
- Fachbereich Luft- und Raumfahrttechnik (183)
- Fachbereich Energietechnik (177)
- IfB - Institut für Bioengineering (148)
- Solar-Institut Jülich (110)
- Fachbereich Maschinenbau und Mechatronik (107)
- Fachbereich Bauingenieurwesen (75)
- ECSM European Center for Sustainable Mobility (52)
- Fachbereich Wirtschaftswissenschaften (51)
Language
- English (1162) (remove)
Document Type
- Conference Proceeding (1162) (remove)
Keywords
- Biosensor (25)
- CAD (7)
- Finite-Elemente-Methode (7)
- civil engineering (7)
- Bauingenieurwesen (6)
- Blitzschutz (6)
- Enterprise Architecture (5)
- Clusterion (4)
- Energy storage (4)
- Gamification (4)
An application of a scanning light-addressable potentiometric sensor for label-free DNA detection
(2013)
DNA-hybridization detection using light-addressable potentiometric sensor modified with gold layer
(2014)
Wireless systems for machinery safety : Requirements and solutions for wireless real time systems
(2015)
In this paper, the use of reinforcement learning (RL) in control systems is investigated using a rotatory inverted pendulum as an example. The control behavior of an RL controller is compared to that of traditional LQR and MPC controllers. This is done by evaluating their behavior under optimal conditions, their disturbance behavior, their robustness and their development process. All the investigated controllers are developed using MATLAB and the Simulink simulation environment and later deployed to a real pendulum model powered by a Raspberry Pi. The RL algorithm used is Proximal Policy Optimization (PPO). The LQR controller exhibits an easy development process, an average to good control behavior and average to good robustness. A linear MPC controller could show excellent results under optimal operating conditions. However, when subjected to disturbances or deviations from the equilibrium point, it showed poor performance and sometimes instable behavior. Employing a nonlinear MPC Controller in real time was not possible due to the high computational effort involved. The RL controller exhibits by far the most versatile and robust control behavior. When operated in the simulation environment, it achieved a high control accuracy. When employed in the real system, however, it only shows average accuracy and a significantly greater performance loss compared to the simulation than the traditional controllers. With MATLAB, it is not yet possible to directly post-train the RL controller on the Raspberry Pi, which is an obstacle to the practical application of RL in a prototyping or teaching setting. Nevertheless, RL in general proves to be a flexible and powerful control method, which is well suited for complex or nonlinear systems where traditional controllers struggle.
Infused Thermal Solutions (ITS) introduces a method for passive thermal control to stabilize structural components thermally without active heating and cooling systems, but with phase change material (PCM) for thermal energy storage (TES), in combination with lattice - both embedded in additive manufactured functional structures. In this ITS follow-on paper a thermal model approach and associated predictions are presented, related on the ITS functional breadboards developed at FH Aachen. Predictive TES by PCM is provided by a specially developed ITS PCM subroutine, which is applicable in ESATAN. The subroutine is based on the latent heat storage (LHS) method to numerically embed thermo-physical PCM behavior. Furthermore, a modeling approach is introduced to numerically consider the virtual PCM/lattice nodes within the macro-encapsulated PCM voids of the double wall ITS design. Related on these virtual nodes, in-plane and out-of-plane conductive links are defined. The recent additive manufactured ITS breadboard series are thermally cycled in the thermal vacuum chamber, both with and without embedded PCM. Related on breadboard hardware tests, measurement results are compared with predictions and are subsequently correlated. The results of specific simulations and measurements are presented. Recent predictive results of star tracker analyses are also presented in ICES-2021-106, based on this ITS PCM subroutine.