TY - JOUR A1 - Bornheim, Tobias A1 - Grieger, Niklas A1 - Blaneck, Patrick Gustav A1 - Bialonski, Stephan T1 - Speaker Attribution in German Parliamentary Debates with QLoRA-adapted Large Language Models JF - Journal for language technology and computational linguistics : JLCL N2 - The growing body of political texts opens up new opportunities for rich insights into political dynamics and ideologies but also increases the workload for manual analysis. Automated speaker attribution, which detects who said what to whom in a speech event and is closely related to semantic role labeling, is an important processing step for computational text analysis. We study the potential of the large language model family Llama 2 to automate speaker attribution in German parliamentary debates from 2017-2021. We fine-tune Llama 2 with QLoRA, an efficient training strategy, and observe our approach to achieve competitive performance in the GermEval 2023 Shared Task On Speaker Attribution in German News Articles and Parliamentary Debates. Our results shed light on the capabilities of large language models in automating speaker attribution, revealing a promising avenue for computational analysis of political discourse and the development of semantic role labeling systems. KW - large language models KW - German KW - speaker attribution KW - semantic role labeling Y1 - 2024 U6 - http://dx.doi.org/10.21248/jlcl.37.2024.244 SN - 2190-6858 VL - 37 IS - 1 PB - Gesellschaft für Sprachtechnologie und Computerlinguistik CY - Regensburg ER - TY - INPR A1 - Grieger, Niklas A1 - Mehrkanoon, Siamak A1 - Bialonski, Stephan T1 - Preprint: Data-efficient sleep staging with synthetic time series pretraining T2 - arXiv N2 - Analyzing electroencephalographic (EEG) time series can be challenging, especially with deep neural networks, due to the large variability among human subjects and often small datasets. To address these challenges, various strategies, such as self-supervised learning, have been suggested, but they typically rely on extensive empirical datasets. Inspired by recent advances in computer vision, we propose a pretraining task termed "frequency pretraining" to pretrain a neural network for sleep staging by predicting the frequency content of randomly generated synthetic time series. Our experiments demonstrate that our method surpasses fully supervised learning in scenarios with limited data and few subjects, and matches its performance in regimes with many subjects. Furthermore, our results underline the relevance of frequency information for sleep stage scoring, while also demonstrating that deep neural networks utilize information beyond frequencies to enhance sleep staging performance, which is consistent with previous research. We anticipate that our approach will be advantageous across a broad spectrum of applications where EEG data is limited or derived from a small number of subjects, including the domain of brain-computer interfaces. Y1 - 2024 ER - TY - JOUR A1 - Ringers, Christa A1 - Bialonski, Stephan A1 - Ege, Mert A1 - Solovev, Anton A1 - Hansen, Jan Niklas A1 - Jeong, Inyoung A1 - Friedrich, Benjamin M. A1 - Jurisch-Yaksi, Nathalie T1 - Novel analytical tools reveal that local synchronization of cilia coincides with tissue-scale metachronal waves in zebrafish multiciliated epithelia JF - eLife N2 - Motile cilia are hair-like cell extensions that beat periodically to generate fluid flow along various epithelial tissues within the body. In dense multiciliated carpets, cilia were shown to exhibit a remarkable coordination of their beat in the form of traveling metachronal waves, a phenomenon which supposedly enhances fluid transport. Yet, how cilia coordinate their regular beat in multiciliated epithelia to move fluids remains insufficiently understood, particularly due to lack of rigorous quantification. We combine experiments, novel analysis tools, and theory to address this knowledge gap. To investigate collective dynamics of cilia, we studied zebrafish multiciliated epithelia in the nose and the brain. We focused mainly on the zebrafish nose, due to its conserved properties with other ciliated tissues and its superior accessibility for non-invasive imaging. We revealed that cilia are synchronized only locally and that the size of local synchronization domains increases with the viscosity of the surrounding medium. Even though synchronization is local only, we observed global patterns of traveling metachronal waves across the zebrafish multiciliated epithelium. Intriguingly, these global wave direction patterns are conserved across individual fish, but different for left and right noses, unveiling a chiral asymmetry of metachronal coordination. To understand the implications of synchronization for fluid pumping, we used a computational model of a regular array of cilia. We found that local metachronal synchronization prevents steric collisions, i.e., cilia colliding with each other, and improves fluid pumping in dense cilia carpets, but hardly affects the direction of fluid flow. In conclusion, we show that local synchronization together with tissue-scale cilia alignment coincide and generate metachronal wave patterns in multiciliated epithelia, which enhance their physiological function of fluid pumping. Y1 - 2023 U6 - http://dx.doi.org/10.7554/eLife.77701 SN - 2050-084X VL - 12 PB - eLife Sciences Publications ER - TY - JOUR A1 - Bialonski, Stephan A1 - Grieger, Niklas T1 - Der KI-Chatbot ChatGPT: Eine Herausforderung für die Hochschulen JF - Die neue Hochschule N2 - Essays, Gedichte, Programmcode: ChatGPT generiert automatisch Texte auf bisher unerreicht hohem Niveau. Dieses und nachfolgende Systeme werden nicht nur die akademische Welt nachhaltig verändern. Y1 - 2023 U6 - http://dx.doi.org/10.5281/zenodo.7533758 SN - 0340-448X VL - 2023 IS - 1 SP - 24 EP - 27 PB - HLB CY - Bonn ER - TY - INPR A1 - Bornheim, Tobias A1 - Niklas, Grieger A1 - Blaneck, Patrick Gustav A1 - Bialonski, Stephan T1 - Preprint: Speaker attribution in German parliamentary debates with QLoRA-adapted large language models T2 - Journal for Language Technology and Computational Linguistics N2 - The growing body of political texts opens up new opportunities for rich insights into political dynamics and ideologies but also increases the workload for manual analysis. Automated speaker attribution, which detects who said what to whom in a speech event and is closely related to semantic role labeling, is an important processing step for computational text analysis. We study the potential of the large language model family Llama 2 to automate speaker attribution in German parliamentary debates from 2017-2021. We fine-tune Llama 2 with QLoRA, an efficient training strategy, and observe our approach to achieve competitive performance in the GermEval 2023 Shared Task On Speaker Attribution in German News Articles and Parliamentary Debates. Our results shed light on the capabilities of large language models in automating speaker attribution, revealing a promising avenue for computational analysis of political discourse and the development of semantic role labeling systems. Y1 - 2023 U6 - http://dx.doi.org/10.48550/arXiv.2309.09902 N1 - Veröffentlichte Version verfügbar unter: https://doi.org/10.21248/jlcl.37.2024.244 ER - TY - JOUR A1 - Schneider, Jules A1 - Schwabedal, Justus T. C. A1 - Bialonski, Stephan T1 - Schlafspindeln – Funktion, Detektion und Nutzung als Biomarker für die psychiatrische Diagnostik JF - Der Nervenarzt N2 - Hintergrund: Die Schlafspindel ist ein Graphoelement des Elektroenzephalogramms (EEG), das im Leicht- und Tiefschlaf beobachtet werden kann. Veränderungen der Spindelaktivität wurden für verschiedene psychiatrische Erkrankungen beschrieben. Schlafspindeln zeigen aufgrund ihrer relativ konstanten Eigenschaften Potenzial als Biomarker in der psychiatrischen Diagnostik. Methode: Dieser Beitrag liefert einen Überblick über den Stand der Wissenschaft zu Eigenschaften und Funktionen der Schlafspindeln sowie über beschriebene Veränderungen der Spindelaktivität bei psychiatrischen Erkrankungen. Verschiedene methodische Ansätze und Ausblicke zur Spindeldetektion werden hinsichtlich deren Anwendungspotenzial in der psychiatrischen Diagnostik erläutert. Ergebnisse und Schlussfolgerung: Während Veränderungen der Spindelaktivität bei psychiatrischen Erkrankungen beschrieben wurden, ist deren exaktes Potenzial für die psychiatrische Diagnostik noch nicht ausreichend erforscht. Diesbezüglicher Erkenntnisgewinn wird in der Forschung gegenwärtig durch ressourcenintensive und fehleranfällige Methoden zur manuellen oder automatisierten Spindeldetektion ausgebremst. Neuere Detektionsansätze, die auf Deep-Learning-Verfahren basieren, könnten die Schwierigkeiten bisheriger Detektionsmethoden überwinden und damit neue Möglichkeiten für die praktisch KW - Schlafspindeldetektion KW - Psychiatrische Biomarker KW - · Psychiatrische Erkrankungen/Diagnostik KW - Elektroenzephalographie KW - Deep Learning Y1 - 2022 U6 - http://dx.doi.org/10.1007/s00115-022-01340-z SN - 1433-0407 SP - 1 EP - 8 PB - Springer CY - Berlin, Heidelberg ER - TY - CHAP A1 - Blaneck, Patrick Gustav A1 - Bornheim, Tobias A1 - Grieger, Niklas A1 - Bialonski, Stephan T1 - Automatic readability assessment of german sentences with transformer ensembles T2 - Proceedings of the GermEval 2022 Workshop on Text Complexity Assessment of German Text N2 - Reliable methods for automatic readability assessment have the potential to impact a variety of fields, ranging from machine translation to self-informed learning. Recently, large language models for the German language (such as GBERT and GPT-2-Wechsel) have become available, allowing to develop Deep Learning based approaches that promise to further improve automatic readability assessment. In this contribution, we studied the ability of ensembles of fine-tuned GBERT and GPT-2-Wechsel models to reliably predict the readability of German sentences. We combined these models with linguistic features and investigated the dependence of prediction performance on ensemble size and composition. Mixed ensembles of GBERT and GPT-2-Wechsel performed better than ensembles of the same size consisting of only GBERT or GPT-2-Wechsel models. Our models were evaluated in the GermEval 2022 Shared Task on Text Complexity Assessment on data of German sentences. On out-of-sample data, our best ensemble achieved a root mean squared error of 0:435. Y1 - 2022 U6 - http://dx.doi.org/10.48550/arXiv.2209.04299 N1 - Proceedings of the 18th Conference on Natural Language Processing/Konferenz zur Verarbeitung natürlicher Sprache (KONVENS 2022) 12-15 September, 2022 University of Potsdam Potsdam, Germany SP - 57 EP - 62 PB - Association for Computational Linguistics CY - Potsdam ER - TY - JOUR A1 - Kaulen, Lars A1 - Schwabedal, Justus T. C. A1 - Schneider, Jules A1 - Ritter, Philipp A1 - Bialonski, Stephan T1 - Advanced sleep spindle identification with neural networks JF - Scientific Reports N2 - Sleep spindles are neurophysiological phenomena that appear to be linked to memory formation and other functions of the central nervous system, and that can be observed in electroencephalographic recordings (EEG) during sleep. Manually identified spindle annotations in EEG recordings suffer from substantial intra- and inter-rater variability, even if raters have been highly trained, which reduces the reliability of spindle measures as a research and diagnostic tool. The Massive Online Data Annotation (MODA) project has recently addressed this problem by forming a consensus from multiple such rating experts, thus providing a corpus of spindle annotations of enhanced quality. Based on this dataset, we present a U-Net-type deep neural network model to automatically detect sleep spindles. Our model’s performance exceeds that of the state-of-the-art detector and of most experts in the MODA dataset. We observed improved detection accuracy in subjects of all ages, including older individuals whose spindles are particularly challenging to detect reliably. Our results underline the potential of automated methods to do repetitive cumbersome tasks with super-human performance. Y1 - 2022 U6 - http://dx.doi.org/10.1038/s41598-022-11210-y SN - 2045-2322 N1 - Corresponding author: Stephan Bialonski VL - 12 IS - Article number: 7686 SP - 1 EP - 10 PB - Springer Nature CY - London ER - TY - JOUR A1 - Röthenbacher, Annika A1 - Cesari, Matteo A1 - Doppler, Christopher E.J. A1 - Okkels, Niels A1 - Willemsen, Nele A1 - Sembowski, Nora A1 - Seger, Aline A1 - Lindner, Marie A1 - Brune, Corinna A1 - Stefani, Ambra A1 - Högl, Birgit A1 - Bialonski, Stephan A1 - Borghammer, Per A1 - Fink, Gereon R. A1 - Schober, Martin A1 - Sommerauer, Michael T1 - RBDtector: an open-source software to detect REM sleep without atonia according to visual scoring criteria JF - Scientific Reports N2 - REM sleep without atonia (RSWA) is a key feature for the diagnosis of rapid eye movement (REM) sleep behaviour disorder (RBD). We introduce RBDtector, a novel open-source software to score RSWA according to established SINBAR visual scoring criteria. We assessed muscle activity of the mentalis, flexor digitorum superficialis (FDS), and anterior tibialis (AT) muscles. RSWA was scored manually as tonic, phasic, and any activity by human scorers as well as using RBDtector in 20 subjects. Subsequently, 174 subjects (72 without RBD and 102 with RBD) were analysed with RBDtector to show the algorithm’s applicability. We additionally compared RBDtector estimates to a previously published dataset. RBDtector showed robust conformity with human scorings. The highest congruency was achieved for phasic and any activity of the FDS. Combining mentalis any and FDS any, RBDtector identified RBD subjects with 100% specificity and 96% sensitivity applying a cut-off of 20.6%. Comparable performance was obtained without manual artefact removal. RBD subjects also showed muscle bouts of higher amplitude and longer duration. RBDtector provides estimates of tonic, phasic, and any activity comparable to human scorings. RBDtector, which is freely available, can help identify RBD subjects and provides reliable RSWA metrics. Y1 - 2022 U6 - http://dx.doi.org/10.1038/s41598-022-25163-9 SN - 2045-2322 VL - 12 IS - Article number: 20886 SP - 1 EP - 14 PB - Springer Nature CY - London ER - TY - JOUR A1 - Grieger, Niklas A1 - Schwabedal, Justus T. C. A1 - Wendel, Stefanie A1 - Ritze, Yvonne A1 - Bialonski, Stephan T1 - Automated scoring of pre-REM sleep in mice with deep learning JF - Scientific Reports N2 - Reliable automation of the labor-intensive manual task of scoring animal sleep can facilitate the analysis of long-term sleep studies. In recent years, deep-learning-based systems, which learn optimal features from the data, increased scoring accuracies for the classical sleep stages of Wake, REM, and Non-REM. Meanwhile, it has been recognized that the statistics of transitional stages such as pre-REM, found between Non-REM and REM, may hold additional insight into the physiology of sleep and are now under vivid investigation. We propose a classification system based on a simple neural network architecture that scores the classical stages as well as pre-REM sleep in mice. When restricted to the classical stages, the optimized network showed state-of-the-art classification performance with an out-of-sample F1 score of 0.95 in male C57BL/6J mice. When unrestricted, the network showed lower F1 scores on pre-REM (0.5) compared to the classical stages. The result is comparable to previous attempts to score transitional stages in other species such as transition sleep in rats or N1 sleep in humans. Nevertheless, we observed that the sequence of predictions including pre-REM typically transitioned from Non-REM to REM reflecting sleep dynamics observed by human scorers. Our findings provide further evidence for the difficulty of scoring transitional sleep stages, likely because such stages of sleep are under-represented in typical data sets or show large inter-scorer variability. We further provide our source code and an online platform to run predictions with our trained network. Y1 - 2021 U6 - http://dx.doi.org/10.1038/s41598-021-91286-0 SN - 2045-2322 N1 - Corresponding author: Stephan Bialonski VL - 11 IS - Art. 12245 PB - Springer Nature CY - London ER - TY - CHAP A1 - Bornheim, Tobias A1 - Grieger, Niklas A1 - Bialonski, Stephan T1 - FHAC at GermEval 2021: Identifying German toxic, engaging, and fact-claiming comments with ensemble learning T2 - Proceedings of the GermEval 2021 Workshop on the Identification of Toxic, Engaging, and Fact-Claiming Comments : 17th Conference on Natural Language Processing KONVENS 2021 Y1 - 2021 U6 - http://dx.doi.org/10.48415/2021/fhw5-x128 N1 - SP - 105 EP - 111 PB - Heinrich Heine University CY - Düsseldorf ER - TY - INPR A1 - Ringers, Christa A1 - Bialonski, Stephan A1 - Solovev, Anton A1 - Hansen, Jan N. A1 - Ege, Mert A1 - Friedrich, Benjamin M. A1 - Jurisch-Yaksi, Nathalie T1 - Preprint: Local synchronization of cilia and tissue-scale cilia alignment are sufficient for global metachronal waves T2 - bioRxiv N2 - Motile cilia are hair-like cell extensions present in multiple organs of the body. How cilia coordinate their regular beat in multiciliated epithelia to move fluids remains insufficiently understood, particularly due to lack of rigorous quantification. We combine here experiments, novel analysis tools, and theory to address this knowledge gap. We investigate collective dynamics of cilia in the zebrafish nose, due to its conserved properties with other ciliated tissues and its superior accessibility for non-invasive imaging. We revealed that cilia are synchronized only locally and that the size of local synchronization domains increases with the viscosity of the surrounding medium. Despite the fact that synchronization is local only, we observed global patterns of traveling metachronal waves across the multiciliated epithelium. Intriguingly, these global wave direction patterns are conserved across individual fish, but different for left and right nose, unveiling a chiral asymmetry of metachronal coordination. To understand the implications of synchronization for fluid pumping, we used a computational model of a regular array of cilia. We found that local metachronal synchronization prevents steric collisions and improves fluid pumping in dense cilia carpets, but hardly affects the direction of fluid flow. In conclusion, we show that local synchronization together with tissue-scale cilia alignment are sufficient to generate metachronal wave patterns in multiciliated epithelia, which enhance their physiological function of fluid pumping. Y1 - 2021 U6 - http://dx.doi.org/10.1101/2021.11.23.469646 N1 - Veröffentlicht in eLife 12:e77701 (https://doi.org/10.7554/eLife.77701). ER - TY - JOUR A1 - Schwabedal, Justus T. C. A1 - Sippel, Daniel A1 - Brandt, Moritz D. A1 - Bialonski, Stephan T1 - Automated Classification of Sleep Stages and EEG Artifacts in Mice with Deep Learning N2 - Sleep scoring is a necessary and time-consuming task in sleep studies. In animal models (such as mice) or in humans, automating this tedious process promises to facilitate long-term studies and to promote sleep biology as a data-driven f ield. We introduce a deep neural network model that is able to predict different states of consciousness (Wake, Non-REM, REM) in mice from EEG and EMG recordings with excellent scoring results for out-of-sample data. Predictions are made on epochs of 4 seconds length, and epochs are classified as artifactfree or not. The model architecture draws on recent advances in deep learning and in convolutional neural networks research. In contrast to previous approaches towards automated sleep scoring, our model does not rely on manually defined features of the data but learns predictive features automatically. We expect deep learning models like ours to become widely applied in different fields, automating many repetitive cognitive tasks that were previously difficult to tackle. Y1 - 2018 U6 - http://dx.doi.org/10.48550/arXiv.1809.08443 ER - TY - JOUR A1 - Karnatak, Rajat A1 - Kantz, Holger A1 - Bialonski, Stephan T1 - Early warning signal for interior crises in excitable systems JF - Physical Review E Y1 - 2017 U6 - http://dx.doi.org/10.1103/PhysRevE.96.042211 SN - 2470-0053 VL - 96 IS - 4 SP - 042211 ER - TY - JOUR A1 - Ngamga, Eulalie Joelle A1 - Bialonski, Stephan A1 - Marwan, Norbert A1 - Kurths, Jürgen A1 - Geier, Christian A1 - Lehnertz, Klaus T1 - Evaluation of selected recurrence measures in discriminating pre-ictal and inter-ictal periods from epileptic EEG data JF - Physics Letters A N2 - We investigate the suitability of selected measures of complexity based on recurrence quantification analysis and recurrence networks for an identification of pre-seizure states in multi-day, multi-channel, invasive electroencephalographic recordings from five epilepsy patients. We employ several statistical techniques to avoid spurious findings due to various influencing factors and due to multiple comparisons and observe precursory structures in three patients. Our findings indicate a high congruence among measures in identifying seizure precursors and emphasize the current notion of seizure generation in large-scale epileptic networks. A final judgment of the suitability for field studies, however, requires evaluation on a larger database. Y1 - 2016 U6 - http://dx.doi.org/10.1016/j.physleta.2016.02.024 SN - 0375-9601 VL - 380 IS - 16 SP - 1419 EP - 1425 PB - Elsevier CY - Amsterdam ER - TY - JOUR A1 - Bialonski, Stephan A1 - Caron, David A. A1 - Schloen, Julia A1 - Feudel, Ulrike A1 - Kantz, Holger A1 - Moorthi, Stefanie D. T1 - Phytoplankton dynamics in the Southern California Bight indicate a complex mixture of transport and biology JF - Journal of Plankton Research N2 - The stimulation and dominance of potentially harmful phytoplankton taxa at a given locale and time are determined by local environmental conditions as well as by transport to or from neighboring regions. The present study investigated the occurrence of common harmful algal bloom (HAB) taxa within the Southern California Bight, using cross-correlation functions to determine potential dependencies between HAB taxa and environmental factors, and potential links to algal transport via local hydrography and currents. A simulation study, in which Lagrangian particles were released, was used to assess travel times due to advection by prevailing ocean currents in the bight. Our results indicate that transport of some taxa may be an important mechanism for the expansion of their distributions into other regions, which was supported by mean travel times derived from our simulation study and other literature on ocean currents in the Southern California Bight. In other cases, however, phytoplankton dynamics were rather linked to local environmental conditions, including coastal upwelling events. Overall, our study shows that complex current patterns in the Southern California Bight may contribute significantly to the formation and expansion of HABs in addition to local environmental factors determining the spatiotemporal dynamics of phytoplankton blooms. Y1 - 2016 U6 - http://dx.doi.org/10.1093/plankt/fbv122 SN - 1464-3774 VL - 38 IS - 4 SP - 1077 EP - 1091 PB - Oxford University Press CY - Oxford ER - TY - CHAP A1 - Bialonski, Stephan T1 - Are interaction clusters in epileptic networks predictive of seizures? T2 - Epilepsy: The Intersection of Neurosciences, Biology, Mathematics, Engineering, and Physics Y1 - 2016 SN - 978-143983886-0 SP - 349 EP - 355 PB - CRC Press ER - TY - JOUR A1 - Bialonski, Stephan A1 - Ansmann, Gerrit A1 - Kantz, Holger T1 - Data-driven prediction and prevention of extreme events in a spatially extended excitable system JF - Physical Review E Y1 - 2015 U6 - http://dx.doi.org/10.1103/PhysRevE.92.042910 SN - 2470-0053 VL - 92 IS - 4 SP - 042910 ER - TY - JOUR A1 - Mulhern, Colm A1 - Bialonski, Stephan A1 - Kantz, Holger T1 - Extreme events due to localization of energy JF - Physical Review E Y1 - 2015 U6 - http://dx.doi.org/10.1103/PhysRevE.91.012918 SN - 2470-0053 VL - 91 IS - 1 SP - 012918 ER - TY - JOUR A1 - Geier, Christian A1 - Lehnertz, Klaus A1 - Bialonski, Stephan T1 - Time-dependent degree-degree correlations in epileptic brain networks: from assortative to dissortative mixing JF - Frontiers in Human Neuroscience Y1 - 2015 U6 - http://dx.doi.org/10.3389/fnhum.2015.00462 SN - 1662-5161 PB - Frontiers Research Foundation CY - Lausanne ER -