Performance Drift Detection in Machine Learningas a Service (MLaaS) for IoT Environments Show others and affiliations
2026 (English) In: IEEE Transactions on Network and Service Management, E-ISSN 1932-4537, Vol. 23, p. 7496-7510Article in journal (Refereed) Published
Abstract [en]
Machine Learning as a Service (MLaaS) is a powerful cloud paradigm enabling data-driven intelligent applications in Internet of Things (IoT) environments, widely adopted across healthcare, smart homes, and industry due to its costeff-ectiveness. However, the dynamic nature of IoT frequently alters data distributions, affecting MLaaS stability, while periodic MLaaS updates further introduce performance drift. Unlike traditional ML systems, MLaaS clients operate as black-box users without access to internal data or parameters, making drift detection particularly challenging. To address this, we propose a novel MLaaS Performance Drift Detection framework for IoT environments. The framework first employs an MLaaS extraction model that learns service behavior from input–output pairs and identifies prediction-influenced features. Building on this, the proposed MLaaS Performance Drift Detection (MPDD) model jointly captures variations in input data and MLaaS behavior.We further design an Adaptive-Temporal Performance Drift Detection Mechanism (APDDM) that dynamically adjusts monitoring frequency based on behavioral and data variations, enabling timely drift detection for effective service management. Extensive experiments on real-world datasets demonstrate that MPDD achieves up to 22–25% accuracy improvement over baseline drift detection methods. APDDM provides an average accuracy gain of approximately 4% and reduces the miss detection rate by around 9% compared to fixed-interval monitoring.
Place, publisher, year, edition, pages Institute of Electrical and Electronics Engineers (IEEE), 2026. Vol. 23, p. 7496-7510
Keywords [en]
Drift Detection, IoT, Machine Learning as a Service, Model Monitoring, Performance Drift
National Category
Communication Systems
Identifiers URN: urn:nbn:se:umu:diva-259025 DOI: 10.1109/TNSM.2026.3732372 Scopus ID: 2-s2.0-105050423752 OAI: oai:DiVA.org:umu-259025 DiVA, id: diva2:2105775
2026-09-282026-09-282026-09-28 Bibliographically approved