[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-117414-en":3,"doc-seo-117414-105":30,"detail-sidebar-cat-0-en-105":92},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},117414,7971461740909,"Levi","https://ap-avatar.wpscdn.com/davatar_155a257f0dc6eb9ab79c44ca47cae57d",8,"Research & Report","A Cloud-Agnostic Serverless Architecture for Distributed Machine Learning - research paper","Serverless computing shows strong promise for big data analytics, particularly with machine learning. Prior research rarely addresses cloud-agnostic serverless architectures that reuse existing parallel ML implementations. This work proposes a multicloud serverless architecture enabling ML engineers, regardless of cloud expertise, to port parallel stateful ML algorithms while avoiding vendor lock-in. Two algorithms—k-means clustering and logistic regression—are ported to serverless and evaluated.","This is a repository copy of A Cloud-Agnostic Serverless Architecture for Distributed Machine Learning.  \nWhite Rose Research Online URL for this paper:  \n[https://eprints.whiterose.ac.uk/id/eprint/226782/](https://eprints.whiterose.ac.uk/id/eprint/226782/)  \n[Version: Accepted Version](Version: Accepted Version)  \nProceedings Paper:  \nPredoaia, [Ionut orcid.org/0000-0002-2009-4054 and Garc](Ionut orcid.org/0000-0002-2009-4054 and Garc) ía-López, Pedro (2025) A CloudAgnostic Serverless Architecture for Distributed Machine Learning. In: Proceedings-2024 IEEE/ACM International Conference on Big Data Computing, Applications and Technologies, BDCAT 2024. 11th IEEE/ACM International Conference on Big Data Computing, Applications and Technologies, BDCAT 2024, 16-19 Dec 2024 IEEE , ARE , pp. 131-140.  \n[https://doi.org/10.1109/BDCAT63179.2024.00032](https://doi.org/10.1109/BDCAT63179.2024.00032)  \nReuse  \nThis article is distributed under the terms of the Creative Commons Attribution (CC BY) licence. This licence allows you to distribute, remix, tweak, and build upon the work, even commercially, as long as you credit the authors for the original work. More information and the full terms of the licence here: [https://creativecommons.org/licenses/](https://creativecommons.org/licenses/)  \nTakedown  \nIf you consider content in White Rose Research Online to be in breach of UK law, please notify us by  \nemailing [eprints@whiterose.ac.uk](eprints@whiterose.ac.uk) including the URL of the record and the reason for the withdrawal request.  \n[eprints@whiterose.ac.uk](eprints@whiterose.ac.uk)[ ](eprints@whiterose.ac.uk)[https://eprints.whiterose.ac.uk/](https://eprints.whiterose.ac.uk/)  \nA Cloud-Agnostic Serverless Architecture for Distributed Machine Learning  \nIonut Predoaia  \nUniversity of York United Kingdom [ionut.predoaia@york.ac.uk](ionut.predoaia@york.ac.uk)  \nPedro GarcÂıa-LÂopez  \nUniversitat Rovira i Virgili Spain [pedro.garcia@urv.cat](pedro.garcia@urv.cat)  \nAbstractÐServerless computing has shown vast potential for big data analytics applications, especially involving machine learning algorithms. Nevertheless, little consideration has been given in the literature to cloud-agnostic serverless architectures that leverage existing parallel implementations of machine learning algorithms. This work bridges this gap by proposing a multicloud serverless architecture for distributed machine learning, that enables machine learning engineers without cloud computing expertise to effortlessly port already implemented parallel machine learning algorithms to serverless, whilst overcoming vendor lock-in. In this work, two stateful machine learning algorithms have been ported to serverless, k-means clustering and logistic regression. The serverless implementation ofk-means provided superior performance and scalability compared to aserverful implementation when using a number of workers that is equal to or slightly lower than the total number of vCPUs available on the VM running the serverful implementation. Additionally, it achieved an 87-fold speedup compared to a sequential implementation. Moreover, two storage designs of the shared state will be proposed for the serverless implementations, one that requires locks for updating the shared state, and another that is lock-free. Our experimental evaluation demonstrates that the performance of the lock-free serverless implementation ofk-means declines with the increase in the number of clusters.  \nIndex TermsÐDistributed Machine Learning, Big Data, Serverless Architectures, Cloud Agnostic, Multicloud, Lithops  \nI. INTRODUCTION  \nThe rise of serverless computing has widely propagated the democratization of massive-scale data parallelism. By leveraging serverless computing, cloud users can today launch thousands of concurrent stateless functions to run big data analytics workloads, without the need of complex cluster management and the burden of managing and provisioning cloud resources. One can sea","cbCaiswtxsrLGK9w","https://ap.wps.com/l/cbCaiswtxsrLGK9w","pdf",554697,1,11,"English","en",105,"# Abstract\n# Introduction\n## Background and problem statement\n## Proposed cloud-agnostic serverless architecture\n# Experimental evaluation\n## Performance and scalability results\n## Shared state storage designs (locked vs lock-free)","[{\"question\":\"What problem does the proposed architecture address?\",\"answer\":\"It targets the lack of cloud-agnostic serverless architectures that can reuse existing parallel machine learning implementations without vendor lock-in.\"},{\"question\":\"Which machine learning algorithms are ported and evaluated?\",\"answer\":\"The paper ports and evaluates k-means clustering and logistic regression in a serverless setting.\"},{\"question\":\"How does the serverless k-means performance compare to a serverful implementation?\",\"answer\":\"The serverless k-means implementation shows superior performance and scalability for worker counts around or slightly below the serverful VM’s available vCPUs, achieving an 87-fold speedup over a sequential baseline.\"}]","A Cloud-Agnostic Serverless Architecture for Distributed Machine Learning - research paper | PDF",1785675750,28,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":87,"head_meta":89,"extra_data":91,"updated_unix":28},"a-cloud-agnostic-serverless-architecture-for-distributed-machine-learning-research-paper","",{"@graph":36,"@context":86},[37,54,69],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/a-cloud-agnostic-serverless-architecture-for-distributed-machine-learning-research-paper/117414/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":63,"encodingFormat":61,"isAccessibleForFree":64,"interactionStatistic":65},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-05","2026-08-02",true,{"@type":66,"interactionType":67,"userInteractionCount":20},"InteractionCounter",{"@type":68},"ViewAction",{"@type":70,"mainEntity":71},"FAQPage",[72,78,82],{"name":73,"@type":74,"acceptedAnswer":75},"What problem does the proposed architecture address?","Question",{"text":76,"@type":77},"It targets the lack of cloud-agnostic serverless architectures that can reuse existing parallel machine learning implementations without vendor lock-in.","Answer",{"name":79,"@type":74,"acceptedAnswer":80},"Which machine learning algorithms are ported and evaluated?",{"text":81,"@type":77},"The paper ports and evaluates k-means clustering and logistic regression in a serverless setting.",{"name":83,"@type":74,"acceptedAnswer":84},"How does the serverless k-means performance compare to a serverful implementation?",{"text":85,"@type":77},"The serverless k-means implementation shows superior performance and scalability for worker counts around or slightly below the serverful VM’s available vCPUs, achieving an 87-fold speedup over a sequential baseline.","https://schema.org",{"og:url":52,"og:type":88,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":90,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":93},[94,98,102,106,111,116,121,124,129,132,136],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":95,"show_sort_weight":96,"slug":97},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":99,"show_sort_weight":100,"slug":101},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":103,"show_sort_weight":104,"slug":105},"Exam",70,"exam",{"id":107,"doc_module":4,"doc_module_name":46,"category_name":108,"show_sort_weight":109,"slug":110},5,"Comic",60,"comic",{"id":112,"doc_module":4,"doc_module_name":46,"category_name":113,"show_sort_weight":114,"slug":115},6,"Technology",50,"technology",{"id":117,"doc_module":4,"doc_module_name":46,"category_name":118,"show_sort_weight":119,"slug":120},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":122,"slug":123},30,"research-report",{"id":125,"doc_module":4,"doc_module_name":46,"category_name":126,"show_sort_weight":127,"slug":128},9,"Religion & Spirituality",20,"religion-spirituality",{"id":127,"doc_module":4,"doc_module_name":46,"category_name":130,"show_sort_weight":127,"slug":131},"World Cup","world-cup",{"id":133,"doc_module":4,"doc_module_name":46,"category_name":134,"show_sort_weight":133,"slug":135},10,"Lifestyle","lifestyle",{"id":137,"doc_module":4,"doc_module_name":46,"category_name":138,"show_sort_weight":107,"slug":139},19,"General","general"]