TY - CHAP A1 - Sildatke, Michael A1 - Karwanni, Hendrik A1 - Kraft, Bodo A1 - Schmidts, Oliver A1 - Zündorf, Albert T1 - Automated Software Quality Monitoring in Research Collaboration Projects T2 - ICSEW'20: Proceedings of the IEEE/ACM 42nd International Conference on Software Engineering Workshops Y1 - 2020 U6 - http://dx.doi.org/10.1145/3387940.3391478 SP - 603 EP - 610 ER - TY - CHAP A1 - Siebigteroth, Ines A1 - Kraft, Bodo A1 - Schmidts, Oliver A1 - Zündorf, Albert T1 - A Study on Improving Corpus Creation by Pair Annotation T2 - Proceedings of the Poster Session of the 2nd Conference on Language, Data and Knowledge (LDK-PS 2019) Y1 - 2019 SN - 1613-0073 SP - 40 EP - 44 ER - TY - CHAP A1 - Schreiber, Marc A1 - Kraft, Bodo A1 - Zündorf, Albert T1 - Cost-efficient quality assurance of natural language processing tools through continuous monitoring with continuous integration T2 - 3rd International Workshop on Software Engineering Research and Industrial Practice Y1 - 2016 U6 - http://dx.doi.org/10.1145/2897022.2897029 N1 - SER&IP’16, May 17 2016, Austin, TX, USA SP - 46 EP - 52 ER - TY - CHAP A1 - Schreiber, Marc A1 - Kraft, Bodo A1 - Zündorf, Albert ED - Bilof, Randall T1 - Metrics driven research collaboration: focusing on common project goals continuously T2 - Proceedings : 2017 IEEE/ACM 4th International Workshop on Software Engineering Research and Industrial Practice : SER&IP 2017 : 21 May 2017 Buenos Aires, Argentina Y1 - 2017 SN - 978-1-5386-2797-6 U6 - http://dx.doi.org/10.1109/SER-IP.2017..6 SP - 41 EP - 47 PB - IEEE Press CY - Piscataway, NJ ER - TY - CHAP A1 - Schreiber, Marc A1 - Kraft, Bodo A1 - Zündorf, Albert T1 - NLP Lean Programming Framework: Developing NLP Applications More Effectively T2 - Proceedings of NAACL-HLT 2018: Demonstrations, New Orleans, Louisiana, June 2 - 4, 2018 N2 - This paper presents NLP Lean Programming framework (NLPf), a new framework for creating custom natural language processing (NLP) models and pipelines by utilizing common software development build systems. This approach allows developers to train and integrate domain-specific NLP pipelines into their applications seamlessly. Additionally, NLPf provides an annotation tool which improves the annotation process significantly by providing a well-designed GUI and sophisticated way of using input devices. Due to NLPf’s properties developers and domain experts are able to build domain-specific NLP applications more efficiently. NLPf is Opensource software and available at https:// gitlab.com/schrieveslaach/NLPf. Y1 - 2018 U6 - http://dx.doi.org/10.18653/v1/N18-5001  ER - TY - CHAP A1 - Schmidts, Oliver A1 - Kraft, Bodo A1 - Winkens, Marvin A1 - Zündorf, Albert T1 - Catalog integration of low-quality product data by attribute label ranking T2 - Proceedings of the 9th International Conference on Data Science, Technology and Applications - Volume 1: DATA Y1 - 2020 SN - 978-989-758-440-4 U6 - http://dx.doi.org/10.5220/0009831000900101 SP - 90 EP - 101 ER - TY - CHAP A1 - Schmidts, Oliver A1 - Kraft, Bodo A1 - Winkens, Marvin A1 - Zündorf, Albert T1 - Catalog integration of heterogeneous and volatile product data T2 - DATA 2020: Data Management Technologies and Applications N2 - The integration of frequently changing, volatile product data from different manufacturers into a single catalog is a significant challenge for small and medium-sized e-commerce companies. They rely on timely integrating product data to present them aggregated in an online shop without knowing format specifications, concept understanding of manufacturers, and data quality. Furthermore, format, concepts, and data quality may change at any time. Consequently, integrating product catalogs into a single standardized catalog is often a laborious manual task. Current strategies to streamline or automate catalog integration use techniques based on machine learning, word vectorization, or semantic similarity. However, most approaches struggle with low-quality or real-world data. We propose Attribute Label Ranking (ALR) as a recommendation engine to simplify the integration process of previously unknown, proprietary tabular format into a standardized catalog for practitioners. We evaluate ALR by focusing on the impact of different neural network architectures, language features, and semantic similarity. Additionally, we consider metrics for industrial application and present the impact of ALR in production and its limitations. Y1 - 2021 SN - 978-3-030-83013-7 U6 - http://dx.doi.org/10.1007/978-3-030-83014-4_7 N1 - International Conference on Data Management Technologies and Applications, DATA 2020, 7-9 July SP - 134 EP - 153 PB - Springer CY - Cham ER - TY - CHAP A1 - Schmidts, Oliver A1 - Kraft, Bodo A1 - Siebigteroth, Ines A1 - Zündorf, Albert T1 - Schema Matching with Frequent Changes on Semi-Structured Input Files: A Machine Learning Approach on Biological Product Data T2 - Proceedings of the 21st International Conference on Enterprise Information Systems - Volume 1: ICEIS Y1 - 2019 SN - 978-989-758-372-8 U6 - http://dx.doi.org/10.5220/0007723602080215 SP - 208 EP - 215 ER - TY - CHAP A1 - Kohl, Philipp A1 - Schmidts, Oliver A1 - Klöser, Lars A1 - Werth, Henri A1 - Kraft, Bodo A1 - Zündorf, Albert T1 - STAMP 4 NLP – an agile framework for rapid quality-driven NLP applications development T2 - Quality of Information and Communications Technology. QUATIC 2021 N2 - The progress in natural language processing (NLP) research over the last years, offers novel business opportunities for companies, as automated user interaction or improved data analysis. Building sophisticated NLP applications requires dealing with modern machine learning (ML) technologies, which impedes enterprises from establishing successful NLP projects. Our experience in applied NLP research projects shows that the continuous integration of research prototypes in production-like environments with quality assurance builds trust in the software and shows convenience and usefulness regarding the business goal. We introduce STAMP 4 NLP as an iterative and incremental process model for developing NLP applications. With STAMP 4 NLP, we merge software engineering principles with best practices from data science. Instantiating our process model allows efficiently creating prototypes by utilizing templates, conventions, and implementations, enabling developers and data scientists to focus on the business goals. Due to our iterative-incremental approach, businesses can deploy an enhanced version of the prototype to their software environment after every iteration, maximizing potential business value and trust early and avoiding the cost of successful yet never deployed experiments. KW - Machine learning KW - Process model KW - Natural language processing Y1 - 2021 SN - 978-3-030-85346-4 SN - 978-3-030-85347-1 U6 - http://dx.doi.org/10.1007/978-3-030-85347-1_12 N1 - International Conference on the Quality of Information and Communications Technology, QUATIC 2021, 8-11 September, Algarve, Portugal SP - 156 EP - 166 PB - Springer CY - Cham ER - TY - CHAP A1 - Kohl, Philipp A1 - Freyer, Nils A1 - Krämer, Yoka A1 - Werth, Henri A1 - Wolf, Steffen A1 - Kraft, Bodo A1 - Meinecke, Matthias A1 - Zündorf, Albert ED - Conte, Donatello ED - Fred, Ana ED - Gusikhin, Oleg ED - Sansone, Carlo T1 - ALE: a simulation-based active learning evaluation framework for the parameter-driven comparison of query strategies for NLP T2 - Deep Learning Theory and Applications. DeLTA 2023. Communications in Computer and Information Science N2 - Supervised machine learning and deep learning require a large amount of labeled data, which data scientists obtain in a manual, and time-consuming annotation process. To mitigate this challenge, Active Learning (AL) proposes promising data points to annotators they annotate next instead of a subsequent or random sample. This method is supposed to save annotation effort while maintaining model performance. However, practitioners face many AL strategies for different tasks and need an empirical basis to choose between them. Surveys categorize AL strategies into taxonomies without performance indications. Presentations of novel AL strategies compare the performance to a small subset of strategies. Our contribution addresses the empirical basis by introducing a reproducible active learning evaluation (ALE) framework for the comparative evaluation of AL strategies in NLP. The framework allows the implementation of AL strategies with low effort and a fair data-driven comparison through defining and tracking experiment parameters (e.g., initial dataset size, number of data points per query step, and the budget). ALE helps practitioners to make more informed decisions, and researchers can focus on developing new, effective AL strategies and deriving best practices for specific use cases. With best practices, practitioners can lower their annotation costs. We present a case study to illustrate how to use the framework. KW - Active learning KW - Query learning KW - Natural language processing KW - Deep learning KW - Reproducible research Y1 - 2023 SN - 978-3-031-39058-6 (Print) SN - 978-3-031-39059-3 (Online) U6 - http://dx.doi.org/978-3-031-39059-3 N1 - 4th International Conference, DeLTA 2023, Rome, Italy, July 13–14, 2023. SP - 235 EP - 253 PB - Springer CY - Cham ER -