TY - CHAP A1 - Sildatke, Michael A1 - Karwanni, Hendrik A1 - Kraft, Bodo A1 - Schmidts, Oliver A1 - Zündorf, Albert T1 - Automated Software Quality Monitoring in Research Collaboration Projects T2 - ICSEW'20: Proceedings of the IEEE/ACM 42nd International Conference on Software Engineering Workshops N2 - In collaborative research projects, both researchers and practitioners work together solving business-critical challenges. These projects often deal with ETL processes, in which humans extract information from non-machine-readable documents by hand. AI-based machine learning models can help to solve this problem. Since machine learning approaches are not deterministic, their quality of output may decrease over time. This fact leads to an overall quality loss of the application which embeds machine learning models. Hence, the software qualities in development and production may differ. Machine learning models are black boxes. That makes practitioners skeptical and increases the inhibition threshold for early productive use of research prototypes. Continuous monitoring of software quality in production offers an early response capability on quality loss and encourages the use of machine learning approaches. Furthermore, experts have to ensure that they integrate possible new inputs into the model training as quickly as possible. In this paper, we introduce an architecture pattern with a reference implementation that extends the concept of Metrics Driven Research Collaboration with an automated software quality monitoring in productive use and a possibility to auto-generate new test data coming from processed documents in production. Through automated monitoring of the software quality and auto-generated test data, this approach ensures that the software quality meets and keeps requested thresholds in productive use, even during further continuous deployment and changing input data. Y1 - 2020 U6 - https://doi.org/10.1145/3387940.3391478 N1 - ICSE '20: 42nd International Conference on Software Engineering, Seoul, Republic of Korea, 27 June 2020 - 19 July 2020 SP - 603 EP - 610 PB - IEEE CY - New York, NY ER - TY - JOUR A1 - Sildatke, Michael A1 - Karwanni, Hendrik A1 - Kraft, Bodo A1 - Zündorf, Albert T1 - A distributed microservice architecture pattern for the automated generation of information extraction pipelines JF - SN Computer Science N2 - Companies often build their businesses based on product information and therefore try to automate the process of information extraction (IE). Since the information source is usually heterogeneous and non-standardized, classic extract, transform, load techniques reach their limits. Hence, companies must implement the newest findings from research to tackle the challenges of process automation. They require a flexible and robust system that is extendable and ensures the optimal processing of the different document types. This paper provides a distributed microservice architecture pattern that enables the automated generation of IE pipelines. Since their optimal design is individual for each input document, the system ensures the ad-hoc generation of pipelines depending on specific document characteristics at runtime. Furthermore, it introduces the automated quality determination of each available pipeline and controls the integration of new microservices based on their impact on the business value. The introduced system enables fast prototyping of the newest approaches from research and supports companies in automating their IE processes. Based on the automated quality determination, it ensures that the generated pipelines always meet defined business requirements when they come into productive use. KW - Architectural design KW - Model-driven software engineering KW - Software and systems modeling KW - Enterprise information systems KW - Information extraction Y1 - 2023 U6 - https://doi.org/10.1007/s42979-023-02256-4 SN - 2661-8907 N1 - Corresponding authors: Michael Sildatke, Hendrik Karwanni IS - 4, Article number: 833 PB - Springer Singapore CY - Singapore ER -