Refine
Year of publication
Document Type
- Article (23)
- Part of a Book (4)
- Preprint (3)
- Conference Proceeding (2)
- Book (1)
Language
- English (33) (remove)
Has Fulltext
- no (33) (remove)
Institute
- Fachbereich Medizintechnik und Technomathematik (33) (remove)
Analyzing electroencephalographic (EEG) time series can be challenging, especially with deep neural networks, due to the large variability among human subjects and often small datasets. To address these challenges, various strategies, such as self-supervised learning, have been suggested, but they typically rely on extensive empirical datasets. Inspired by recent advances in computer vision, we propose a pretraining task termed "frequency pretraining" to pretrain a neural network for sleep staging by predicting the frequency content of randomly generated synthetic time series. Our experiments demonstrate that our method surpasses fully supervised learning in scenarios with limited data and few subjects, and matches its performance in regimes with many subjects. Furthermore, our results underline the relevance of frequency information for sleep stage scoring, while also demonstrating that deep neural networks utilize information beyond frequencies to enhance sleep staging performance, which is consistent with previous research. We anticipate that our approach will be advantageous across a broad spectrum of applications where EEG data is limited or derived from a small number of subjects, including the domain of brain-computer interfaces.
Motile cilia are hair-like cell extensions present in multiple organs of the body. How cilia coordinate their regular beat in multiciliated epithelia to move fluids remains insufficiently understood, particularly due to lack of rigorous quantification. We combine here experiments, novel analysis tools, and theory to address this knowledge gap. We investigate collective dynamics of cilia in the zebrafish nose, due to its conserved properties with other ciliated tissues and its superior accessibility for non-invasive imaging. We revealed that cilia are synchronized only locally and that the size of local synchronization domains increases with the viscosity of the surrounding medium. Despite the fact that synchronization is local only, we observed global patterns of traveling metachronal waves across the multiciliated epithelium. Intriguingly, these global wave direction patterns are conserved across individual fish, but different for left and right nose, unveiling a chiral asymmetry of metachronal coordination. To understand the implications of synchronization for fluid pumping, we used a computational model of a regular array of cilia. We found that local metachronal synchronization prevents steric collisions and improves fluid pumping in dense cilia carpets, but hardly affects the direction of fluid flow. In conclusion, we show that local synchronization together with tissue-scale cilia alignment are sufficient to generate metachronal wave patterns in multiciliated epithelia, which enhance their physiological function of fluid pumping.
The growing body of political texts opens up new opportunities for rich insights into political dynamics and ideologies but also increases the workload for manual analysis. Automated speaker attribution, which detects who said what to whom in a speech event and is closely related to semantic role labeling, is an important processing step for computational text analysis. We study the potential of the large language model family Llama 2 to automate speaker attribution in German parliamentary debates from 2017-2021. We fine-tune Llama 2 with QLoRA, an efficient training strategy, and observe our approach to achieve competitive performance in the GermEval 2023 Shared Task On Speaker Attribution in German News Articles and Parliamentary Debates. Our results shed light on the capabilities of large language models in automating speaker attribution, revealing a promising avenue for computational analysis of political discourse and the development of semantic role labeling systems.
Motile cilia are hair-like cell extensions that beat periodically to generate fluid flow along various epithelial tissues within the body. In dense multiciliated carpets, cilia were shown to exhibit a remarkable coordination of their beat in the form of traveling metachronal waves, a phenomenon which supposedly enhances fluid transport. Yet, how cilia coordinate their regular beat in multiciliated epithelia to move fluids remains insufficiently understood, particularly due to lack of rigorous quantification. We combine experiments, novel analysis tools, and theory to address this knowledge gap. To investigate collective dynamics of cilia, we studied zebrafish multiciliated epithelia in the nose and the brain. We focused mainly on the zebrafish nose, due to its conserved properties with other ciliated tissues and its superior accessibility for non-invasive imaging. We revealed that cilia are synchronized only locally and that the size of local synchronization domains increases with the viscosity of the surrounding medium. Even though synchronization is local only, we observed global patterns of traveling metachronal waves across the zebrafish multiciliated epithelium. Intriguingly, these global wave direction patterns are conserved across individual fish, but different for left and right noses, unveiling a chiral asymmetry of metachronal coordination. To understand the implications of synchronization for fluid pumping, we used a computational model of a regular array of cilia. We found that local metachronal synchronization prevents steric collisions, i.e., cilia colliding with each other, and improves fluid pumping in dense cilia carpets, but hardly affects the direction of fluid flow. In conclusion, we show that local synchronization together with tissue-scale cilia alignment coincide and generate metachronal wave patterns in multiciliated epithelia, which enhance their physiological function of fluid pumping.
Reliable methods for automatic readability assessment have the potential to impact a variety of fields, ranging from machine translation to self-informed learning. Recently, large language models for the German language (such as GBERT and GPT-2-Wechsel) have become available, allowing to develop Deep Learning based approaches that promise to further improve automatic readability assessment. In this contribution, we studied the ability of ensembles of fine-tuned GBERT and GPT-2-Wechsel models to reliably predict the readability of German sentences. We combined these models with linguistic features and investigated the dependence of prediction performance on ensemble size and composition. Mixed ensembles of GBERT and GPT-2-Wechsel performed better than ensembles of the same size consisting of only GBERT or GPT-2-Wechsel models. Our models were evaluated in the GermEval 2022 Shared Task on Text Complexity Assessment on data of German sentences. On out-of-sample data, our best ensemble achieved a root mean squared error of 0:435.
Detecting synchronization clusters in multivariate time series via coarse-graining of Markov chains
(2007)
Rationale: Previous studies [Topolnik et al., Cereb Cortex 2003; 13: 883; Schindler et al., Brain 2007; 130: 65] indicate that the termination of focal onset seizures may be causally related to an increase of global neuronal correlation during the second half of the seizures. This increase was observed to occur earlier in complex partial seizures than in secondarily generalized seizures. We here address the question whether such an increase of neuronal correlation prior to seizure end is indeed a global phenomenon, involving both hemispheres or whether there are side-specific differences. Methods: We analyzed 20 focal onset seizures (10 complex partial, 10 secondarily generalized seizures) recorded in 13 patients who underwent presurgical evaluation of focal epilepsies of different origin. EEG was recorded intracranially from bilaterally implanted subdural strip and intrahippocampal depth electrodes. Utilizing a moving window approach, we investigated the evolution of the maximum cross correlation for all channel combinations during seizures. For each moving window the mean value of the maximum cross correlation (MCC) between all electrode contacts was computed separately for each hemisphere. After normalization of seizure durations, MCC values of the ipsi- and contralateral hemisphere for all seizures were determined. Results: We observed that the MCC of the contralateral hemisphere in complex partial seizures increased during the first half of the seizure, whereas, for the same time interval, the MCC of the ipsilateral hemisphere even declined below the level of the pre-seizure period. In contrast, no significant differences between both hemispheres could be observed for secondarily generalized seizures where both hemispheres showed a simultaneous increase of MCC during the second half of the seizures. The level of MCC for the contralateral hemisphere was higher for complex partial seizures than for secondarily generalized seizures during the first half of the seizure. Conclusions: Our findings indicate that there are indeed lateralized differences in the evolution of global neuronal correlation during complex partial and secondarily generalized seizures. The observed contralateral increase of neuronal correlation during complex partial seizures might indicate an emerging self-organizing mechanism for preventing the spread of seizure activity.
Epilepsy
(2010)
Objective
To investigate whether functional brain networks of epilepsy patients treated with antiepileptic medication differ from networks of healthy controls even during the seizure-free interval.
Methods
We applied different rules to construct binary and weighted networks from EEG and MEG data recorded under a resting-state eyes-open and eyes-closed condition from 21 epilepsy patients and 23 healthy controls. The average shortest path length and the clustering coefficient served as global statistical network characteristics.
Results
Independent on the behavioral condition, epileptic brains exhibited a more regular functional network structure. Similarly, the eyes-closed condition was characterized by a more regular functional network structure in both groups. The amount of network reorganization due to behavioral state changes was similar in both groups. Consistent findings could be achieved for networks derived from EEG but hardly from MEG recordings, and network construction rules had a rather strong impact on our findings.
Conclusions
Despite the locality of the investigated processes epileptic brain networks differ in their global characteristics from non-epileptic brain networks. Further methodological developments are necessary to improve the characterization of disturbed and normal functional networks.
Significance
An increased regularity and a diminished modulation capability appear characteristic of epileptic brain networks.
We consider recent reports on small-world topologies of interaction networks derived from the dynamics of spatially extended systems that are investigated in diverse scientific fields such as neurosciences, geophysics, or meteorology. With numerical simulations that mimic typical experimental situations, we have identified an important constraint when characterizing such networks: indications of a small-world topology can be expected solely due to the spatial sampling of the system along with the commonly used time series analysis based approaches to network characterization.
We investigate interaction networks that we derive from multivariate time series with methods frequently employed in diverse scientific fields such as biology, quantitative finance, physics, earth and climate sciences, and the neurosciences. Mimicking experimental situations, we generate time series with finite length and varying frequency content but from independent stochastic processes. Using the correlation coefficient and the maximum cross-correlation, we estimate interdependencies between these time series. With clustering coefficient and average shortest path length, we observe unweighted interaction networks, derived via thresholding the values of interdependence, to possess non-trivial topologies as compared to Erdös-Rényi networks, which would indicate small-world characteristics. These topologies reflect the mostly unavoidable finiteness of the data, which limits the reliability of typically used estimators of signal interdependence. We propose random networks that are tailored to the way interaction networks are derived from empirical data. Through an exemplary investigation of multichannel electroencephalographic recordings of epileptic seizures – known for their complex spatial and temporal dynamics – we show that such random networks help to distinguish network properties of interdependence structures related to seizure dynamics from those spuriously induced by the applied methods of analysis.