[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-120968-en":3,"doc-seo-120968-105":29,"detail-sidebar-cat-0-en-105":95},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":11,"language":21,"language_code":22,"site_id":23,"html_lang":22,"table_of_contents":24,"faqs":25,"seo_title":26,"seo_description":14,"update_tm":27,"read_time":28},120968,137441390410,"Hazel","https://ap-avatar.wpscdn.com/avatar/2000252f4ab5702993?_k=1776741390130283984",8,"Research & Report","Is My Model Up-to-date - Detecting CoViD-19 Variants by Machine Learning - Online drift detection and model update","Machine learning systems can become outdated when the real-world data distribution shifts after deployment. Continuous adaptation is needed to preserve prediction quality. This work evaluates the behavior of the currently deployed model in an online fashion using a drift detector to capture performance slumps and trigger replacement with an up-to-date model. Experiments use 8642 hematochemical examinations from hospitalized patients and predict RT-PCR CoViD-19 outcomes, achieving an AUC of 0.794 with gains over offline and standard online binary approaches.","Is My Model Up-to-date? Detecting CoViD-19 Variants by Machine Learning⋆  \nOguzhan Avci1,†, Giuseppe Pozzi1, **,†  \n1 DEIB, Politecnico di Milano, P. za L. da Vinci 32, I-20133, Milano, Italy  \nAbstract  \nMachine learning extracts models from huge quantities of data. Models trained and validated over past data can be deployed in making forecasts as well as in classifying new incoming data. The real world which generates data may change over time, making the deployed model an obsolete one. To preserve the quality of the currently deployed model, continuous machine learning is required. Our approach retrospectively evaluates in an online fashion the behaviour of the currently deployed model. A drift detector detects any performance slump, and, in case, can replace the previous model with an up-to-date one. The approach experiments on a dataset of 8642 hematochemical examinations from hospitalized patients gathered over  \n6 months: the outcome of the model predicts the RT-PCR test result about CoViD-19 . The method reached an area under the curve (AUC) of 0.794 , 6% better than offline and 5% better than standard online-binary classification techniques.  \nKeywords  \nMachine learning, adaptive modelling, concept drift, model update, CoViD-19  \n1. Introduction  \nArtificial Intelligence (AI) initially aimed at simulating and replicating the human way of thinking.AI evolved very rapidly, and nowadays aims to “reason about huge quantities of data” [1], rising the concept of Machine Learning (ML) . Reasoning refers to the capacity of extracting knowledge; learning refers to the capacity of acquiring new knowledge from facts, automatically deriving a thesaurus of knowledge which makes the system capable of autonomous behavior in the real world.  \nML processes huge quantities of stored data to derive a model: the model enables us to make forecasts about values for future data. Forecasts are the more precise and the more accurate ones the more the model adheres to the real world. However, the real world may experience changes, thus drifting away from the original behavior, i.e., the one over which the model was initially defined. As a consequence, the performance of the model slumps. Two urgent needs arise: a) detect the performance slump of the model; b) decide when new training on more recent data is needed, to re-couple the model with the real world. The current paper aims at identifying a criterium to detect the need for re-coupling the model with the real world. As an application scenario, the paper considers data from blood examinations from [2]: data are then  \nPublished in the Workshop Proceedings of the EDBT/ICDT 2023 Joint Conference (March 28-March 31, 2023), Ioannina, Greece  \n* Corresponding author.  \n†  \nThese authors contributed equally.  \n$ [oguzhan.avci@mail.polimi.it](oguzhan.avci@mail.polimi.it) (O. Avci); [giuseppe.pozzi@polimi.it](giuseppe.pozzi@polimi.it)[ ](giuseppe.pozzi@polimi.it)(G. Pozzi)  \n􀂀 https://www.deib.polimi.it/pozzi (G. Pozzi)  \n􀀚 —(O. Avci); 0000-0002-2828-862X (G. Pozzi)  \n© 2023 Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4 .0 International (CC BY 4 .0) .  \nCEUR Workshop Proceedings ([CEUR-WS.org](CEUR-WS.org))  \n[http://ceur-ws.org](http://ceur-ws.org)  \n[ISSN 1613-0073](ISSN 1613-0073)  \nprocessed to build a predictive model, which classifies if the patient is affected by CoViD-19 or not.  \nThe paper is structured as follows: Section 2 describes the state of the art in ML; Section 3 focuses on the approach we propose here; Section 4 describes some details about the prototype implementation; Section 5 reports about the on-the-field deployment of the model; finally, Section 6 draws some concluding remarks.  \n2. Related Work  \nThis section describes some background issues and the state ofthe art on modelling and machine learning.  \n2.1. Background  \nGiven a huge quantity of data (the ground truth), ML enable us to build up a model which best fits t","cbCairtpV64708Pk","https://ap.wps.com/l/cbCairtpV64708Pk","pdf",1476849,1,"English","en",105,"# Abstract\n# Introduction\n## Problem of model obsolescence and drift\n## Need for detection and timely retraining\n# Related Work\n## Background on ML training/validation and performance degradation\n## Online learning, MLOps, and adaptive frameworks\n# Proposed Approach\n## Online evaluation with drift detection\n# Implementation and Deployment\n## Prototype details\n## On-the-field deployment\n# Conclusions","[{\"question\":\"Why can a deployed machine learning model become obsolete?\",\"answer\":\"Because the real world that generates the data can change over time, causing concept drift and degrading model performance.\"},{\"question\":\"How does the proposed approach decide when to update the model?\",\"answer\":\"It uses a drift detector that monitors the deployed model’s performance in an online manner, detects a performance slump, and replaces the previous model with an up-to-date one.\"},{\"question\":\"What data and task are used to evaluate the method?\",\"answer\":\"The experiments use 8642 hematochemical examinations from hospitalized patients, and the model predicts the RT-PCR test result for CoViD-19 (affected vs not affected).\"},{\"question\":\"What performance improvement does the method achieve?\",\"answer\":\"It reaches an AUC of 0.794, about 6% better than offline and about 5% better than standard online binary classification techniques.\"}]","Is My Model Up-to-date - Detecting CoViD-19 Variants by Machine Learning - Online drift detection and model update | PDF",1785733114,20,{"code":4,"msg":30,"data":31},"ok",{"site_id":23,"language":22,"slug":32,"title":13,"keywords":33,"description":14,"schema_data":34,"social_meta":90,"head_meta":92,"extra_data":94,"updated_unix":27},"is-my-model-up-to-date-detecting-covid-19-variants-by-machine-learning-online-drift-detection-and-model-update","",{"@graph":35,"@context":89},[36,53,68],{"@type":37,"itemListElement":38},"BreadcrumbList",[39,43,47,50],{"item":40,"name":41,"@type":42,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":44,"name":45,"@type":42,"position":46},"https://docshare.wps.com/document/","Document",2,{"item":48,"name":12,"@type":42,"position":49},"https://docshare.wps.com/document/research-report/",3,{"item":51,"name":13,"@type":42,"position":52},"https://docshare.wps.com/document/is-my-model-up-to-date-detecting-covid-19-variants-by-machine-learning-online-drift-detection-and-model-update/120968/",4,{"url":51,"name":13,"@type":54,"author":55,"headline":13,"publisher":57,"fileFormat":60,"inLanguage":22,"description":14,"dateModified":61,"datePublished":62,"encodingFormat":60,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":56},"Person",{"url":40,"name":58,"@type":59},"DocShare","Organization","application/pdf","2026-08-04","2026-08-03",true,{"@type":65,"interactionType":66,"userInteractionCount":20},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81,85],{"name":72,"@type":73,"acceptedAnswer":74},"Why can a deployed machine learning model become obsolete?","Question",{"text":75,"@type":76},"Because the real world that generates the data can change over time, causing concept drift and degrading model performance.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"How does the proposed approach decide when to update the model?",{"text":80,"@type":76},"It uses a drift detector that monitors the deployed model’s performance in an online manner, detects a performance slump, and replaces the previous model with an up-to-date one.",{"name":82,"@type":73,"acceptedAnswer":83},"What data and task are used to evaluate the method?",{"text":84,"@type":76},"The experiments use 8642 hematochemical examinations from hospitalized patients, and the model predicts the RT-PCR test result for CoViD-19 (affected vs not affected).",{"name":86,"@type":73,"acceptedAnswer":87},"What performance improvement does the method achieve?",{"text":88,"@type":76},"It reaches an AUC of 0.794, about 6% better than offline and about 5% better than standard online binary classification techniques.","https://schema.org",{"og:url":51,"og:type":91,"og:title":13,"og:site_name":58,"og:description":14},"article",{"robots":93,"canonical":51},"index,follow",{"doc_id":7,"site_id":23},{"code":4,"msg":5,"data":96},[97,101,105,109,114,119,124,127,131,134,138],{"id":20,"doc_module":4,"doc_module_name":45,"category_name":98,"show_sort_weight":99,"slug":100},"Story & Novel",90,"story-novel",{"id":46,"doc_module":4,"doc_module_name":45,"category_name":102,"show_sort_weight":103,"slug":104},"Literature",80,"literature",{"id":52,"doc_module":4,"doc_module_name":45,"category_name":106,"show_sort_weight":107,"slug":108},"Exam",70,"exam",{"id":110,"doc_module":4,"doc_module_name":45,"category_name":111,"show_sort_weight":112,"slug":113},5,"Comic",60,"comic",{"id":115,"doc_module":4,"doc_module_name":45,"category_name":116,"show_sort_weight":117,"slug":118},6,"Technology",50,"technology",{"id":120,"doc_module":4,"doc_module_name":45,"category_name":121,"show_sort_weight":122,"slug":123},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":45,"category_name":12,"show_sort_weight":125,"slug":126},30,"research-report",{"id":128,"doc_module":4,"doc_module_name":45,"category_name":129,"show_sort_weight":28,"slug":130},9,"Religion & Spirituality","religion-spirituality",{"id":28,"doc_module":4,"doc_module_name":45,"category_name":132,"show_sort_weight":28,"slug":133},"World Cup","world-cup",{"id":135,"doc_module":4,"doc_module_name":45,"category_name":136,"show_sort_weight":135,"slug":137},10,"Lifestyle","lifestyle",{"id":139,"doc_module":4,"doc_module_name":45,"category_name":140,"show_sort_weight":110,"slug":141},19,"General","general"]