TY - CHAP A1 - Kohl, Philipp A1 - Schmidts, Oliver A1 - Klöser, Lars A1 - Werth, Henri A1 - Kraft, Bodo A1 - Zündorf, Albert T1 - STAMP 4 NLP – an agile framework for rapid quality-driven NLP applications development T2 - Quality of Information and Communications Technology. QUATIC 2021 N2 - The progress in natural language processing (NLP) research over the last years, offers novel business opportunities for companies, as automated user interaction or improved data analysis. Building sophisticated NLP applications requires dealing with modern machine learning (ML) technologies, which impedes enterprises from establishing successful NLP projects. Our experience in applied NLP research projects shows that the continuous integration of research prototypes in production-like environments with quality assurance builds trust in the software and shows convenience and usefulness regarding the business goal. We introduce STAMP 4 NLP as an iterative and incremental process model for developing NLP applications. With STAMP 4 NLP, we merge software engineering principles with best practices from data science. Instantiating our process model allows efficiently creating prototypes by utilizing templates, conventions, and implementations, enabling developers and data scientists to focus on the business goals. Due to our iterative-incremental approach, businesses can deploy an enhanced version of the prototype to their software environment after every iteration, maximizing potential business value and trust early and avoiding the cost of successful yet never deployed experiments. KW - Machine learning KW - Process model KW - Natural language processing Y1 - 2021 SN - 978-3-030-85346-4 SN - 978-3-030-85347-1 U6 - http://dx.doi.org/10.1007/978-3-030-85347-1_12 N1 - International Conference on the Quality of Information and Communications Technology, QUATIC 2021, 8-11 September, Algarve, Portugal SP - 156 EP - 166 PB - Springer CY - Cham ER - TY - CHAP A1 - Kohl, Philipp A1 - Freyer, Nils A1 - Krämer, Yoka A1 - Werth, Henri A1 - Wolf, Steffen A1 - Kraft, Bodo A1 - Meinecke, Matthias A1 - Zündorf, Albert ED - Conte, Donatello ED - Fred, Ana ED - Gusikhin, Oleg ED - Sansone, Carlo T1 - ALE: a simulation-based active learning evaluation framework for the parameter-driven comparison of query strategies for NLP T2 - Deep Learning Theory and Applications. DeLTA 2023. Communications in Computer and Information Science N2 - Supervised machine learning and deep learning require a large amount of labeled data, which data scientists obtain in a manual, and time-consuming annotation process. To mitigate this challenge, Active Learning (AL) proposes promising data points to annotators they annotate next instead of a subsequent or random sample. This method is supposed to save annotation effort while maintaining model performance. However, practitioners face many AL strategies for different tasks and need an empirical basis to choose between them. Surveys categorize AL strategies into taxonomies without performance indications. Presentations of novel AL strategies compare the performance to a small subset of strategies. Our contribution addresses the empirical basis by introducing a reproducible active learning evaluation (ALE) framework for the comparative evaluation of AL strategies in NLP. The framework allows the implementation of AL strategies with low effort and a fair data-driven comparison through defining and tracking experiment parameters (e.g., initial dataset size, number of data points per query step, and the budget). ALE helps practitioners to make more informed decisions, and researchers can focus on developing new, effective AL strategies and deriving best practices for specific use cases. With best practices, practitioners can lower their annotation costs. We present a case study to illustrate how to use the framework. KW - Active learning KW - Query learning KW - Natural language processing KW - Deep learning KW - Reproducible research Y1 - 2023 SN - 978-3-031-39058-6 (Print) SN - 978-3-031-39059-3 (Online) U6 - http://dx.doi.org/978-3-031-39059-3 N1 - 4th International Conference, DeLTA 2023, Rome, Italy, July 13–14, 2023. SP - 235 EP - 253 PB - Springer CY - Cham ER - TY - CHAP A1 - Kob, Malte A1 - Gömmel, Andreas A1 - Butenweg, Christoph A1 - Niendorf, Thoralf T1 - Training of a combined model of larynx and vocal folds with data from MRI measurements T2 - The 5th International Conference on Voice Physiology and Biomechanics: Variations across Cultures and Species, July 12-14, 2006, Tokyo, Japan. Proceedings Y1 - 2006 SP - 45 EP - 46 ER - TY - CHAP A1 - Kob, Malte A1 - Butenweg, Christoph T1 - A finite element model of the interaction between intra-and extralaryngeal muscles T2 - International Conference on Voice Physiology and Biomechanics, August 18-20, 2004, Marseille, France Y1 - 2004 SP - 1 EP - 2 ER - TY - CHAP A1 - Knackstedt, Ralf A1 - Eggert, Mathias A1 - Heddier, Marcel A1 - Chasin, Friedrich A1 - Becker, Jörg T1 - The Relationship Of Is And Law - The Perspective Of And Implications For IS Research T2 - ECIS 2013 Completed Research. 18 Y1 - 2013 N1 - Proceedings of the 21st European Conference on Information Systems ER - TY - CHAP A1 - Knackstedt, Ralf A1 - Eggert, Mathias A1 - Heddier, Marcel A1 - Chasin, Friedrich A1 - Becker, Jörg T1 - The Relationship of IS and Law - Insights into the German Online Car Registration Case T2 - ECIS 2013 Completed Research. 18. Proceedings of the 21st European Conference on Information Systems Y1 - 2013 ER - TY - CHAP A1 - Knackstedt, Ralf A1 - Eggert, Mathias A1 - Fleischer, Stefan T1 - The Legal Perspective on Business to Government Reporting - A Conceptual Modeling Approach and Its Application in the Financial Sector T2 - 45th Hawaii International Conference on System Sciences 2012 Y1 - 2012 SN - 978-0-7695-4525-7 U6 - http://dx.doi.org/10.1109/HICSS.2012.576 SP - 2309 EP - 2318 ER - TY - CHAP A1 - Klöser, Lars A1 - Kohl, Philipp A1 - Kraft, Bodo A1 - Zündorf, Albert T1 - Multi-attribute relation extraction (MARE): simplifying the application of relation extraction T2 - Proceedings of the 2nd International Conference on Deep Learning Theory and Applications - DeLTA N2 - Natural language understanding’s relation extraction makes innovative and encouraging novel business concepts possible and facilitates new digitilized decision-making processes. Current approaches allow the extraction of relations with a fixed number of entities as attributes. Extracting relations with an arbitrary amount of attributes requires complex systems and costly relation-trigger annotations to assist these systems. We introduce multi-attribute relation extraction (MARE) as an assumption-less problem formulation with two approaches, facilitating an explicit mapping from business use cases to the data annotations. Avoiding elaborated annotation constraints simplifies the application of relation extraction approaches. The evaluation compares our models to current state-of-the-art event extraction and binary relation extraction methods. Our approaches show improvement compared to these on the extraction of general multi-attribute relations. Y1 - 2021 SN - 978-989-758-526-5 U6 - http://dx.doi.org/10.5220/0010559201480156 N1 - Proceedings of the 2nd International Conference on Deep Learning Theory and Applications, DeLTA2021, July 7-9, 2021 SP - 148 EP - 156 ER - TY - CHAP A1 - Klöser, Lars A1 - Büsgen, André A1 - Kohl, Philipp A1 - Kraft, Bodo A1 - Zündorf, Albert ED - Conte, Donatello ED - Fred, Ana ED - Gusikhin, Oleg ED - Sansone, Carlo T1 - Explaining relation classification models with semantic extents T2 - DeLTA 2023: Deep Learning Theory and Applications N2 - In recent years, the development of large pretrained language models, such as BERT and GPT, significantly improved information extraction systems on various tasks, including relation classification. State-of-the-art systems are highly accurate on scientific benchmarks. A lack of explainability is currently a complicating factor in many real-world applications. Comprehensible systems are necessary to prevent biased, counterintuitive, or harmful decisions. We introduce semantic extents, a concept to analyze decision patterns for the relation classification task. Semantic extents are the most influential parts of texts concerning classification decisions. Our definition allows similar procedures to determine semantic extents for humans and models. We provide an annotation tool and a software framework to determine semantic extents for humans and models conveniently and reproducibly. Comparing both reveals that models tend to learn shortcut patterns from data. These patterns are hard to detect with current interpretability methods, such as input reductions. Our approach can help detect and eliminate spurious decision patterns during model development. Semantic extents can increase the reliability and security of natural language processing systems. Semantic extents are an essential step in enabling applications in critical areas like healthcare or finance. Moreover, our work opens new research directions for developing methods to explain deep learning models. KW - Relation classification KW - Natural language processing KW - Natural language understanding KW - Information extraction KW - Trustworthy artificial intelligence Y1 - 2023 SN - 978-3-031-39058-6 (Print) SN - 978-3-031-39059-3 (Online) U6 - http://dx.doi.org/10.1007/978-3-031-39059-3_13 N1 - 4th International Conference, DeLTA 2023, Rome, Italy, July 13–14, 2023. SP - 189 EP - 208 PB - Springer CY - Cham ER - TY - CHAP A1 - Kloock, Joachim P. A1 - Schöning, Michael Josef T1 - Heavy metal detection with semiconductor devices based on PLD-prepared chalcogenide glass thin films T2 - Armenian Journal of Physics Y1 - 2007 SN - 1829-1171 SP - 95 EP - 98 ER -