[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-119298-en":3,"doc-seo-119298-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":4,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},119298,13056703019404,"Miles","https://ap-avatar.wpscdn.com/davatar_29158cc5080c5b710cf443261637dec0",8,"Research & Report","Automation and Orchestration for Machine Learning Pipelines - A Study of Machine Learning Scaling - Exploring Micro-service architecture with Kubernetes","Machine Learning (ML) has rapidly expanded beyond algorithms and coding, creating strong needs for building and managing complete ML projects. This thesis investigates how a minimal engineering team can create and maintain an MLOps pipeline. The work explores containerization and micro-service orchestration, producing a minimal on-premises Kubernetes cluster on physical servers and Ubuntu VMs. The cluster scales by adding nodes, uses a locally shared network folder as external storage, and supports local or cloud container registries. After setup, the system trains YOLOv5 on a custom dataset and later performs distributed DDP training with PyTorch, TorchX, PyTorch Lightning, and Volcano.","Automation and Orchestration for Machine Learning Pipelines  \nA Study of Machine Learning Scaling:  \nExploring Micro-service architecture with Kubernetes Master’s thesis in Complex Adaptive Systems  \nFILIP MELBERG VASILIKI KOSTARA  \nDEPARTMENT OF PHYSICS  \nCHALMERS UNIVERSITY OF TECHNOLOGY Gothenburg, Sweden 2024  \n[www.chalmers.se](www.chalmers.se)  \nMaster’s thesis 2024  \nAutomation and Orchestration for Machine Learning Pipelines  \nA Study of Machine Learning Scaling: Exploring Micro-service architecture with Kubernetes  \nFILIP MELBERG VASILIKI KOSTARA  \nDepartment of Physics  \nChalmers University of Technology Gothenburg, Sweden 2024  \nAutomation and Orchestration for Machine Learning Pipelines A Study of Machine Learning Scaling:  \nExploring Micro-service architecture with Kubernetes FILIP MELBERG, VASILIKI KOSTARA  \n© FILIP MELBERG, VASILIKI KOSTARA, 2024 .  \nSupervisors: Hamid Ebadi, Infotiv Technology Development &  \nGiovanni Volpe, Department of Physics Examiner: Giovanni Volpe, Department of Physics  \nMaster’s thesis 2024 Department of Physics  \nChalmers University of Technology SE-412 96 G¨oteborg  \nSweden  \nTelephone + 46 (0)31-772 1000  \nChalmers digital printing Gothenburg, Sweden 2024  \nAutomation and Orchestration for Machine Learning Pipelines A Study of Machine Learning Scaling:  \nExploring Micro-service architecture with Kubernetes FILIP MELBERG, VASILIKI KOSTARA Department of Physics  \nChalmers University of Technology  \nAbstract  \nAlthough Machine Learning (ML) has been around for many decades, its popularity has grown tremendously in recent years. Today’s requirements show a great need for the development and management of ML projects beyond algorithms and coding. The aim of this thesis is to investigate how a minimal team of engineers can create and maintain a ML pipeline. To this end, we will explore how a Machine Learning Operations (MLOps) pipeline could be created using containerization and container orchestration of micro-services. After relevant research, the result is a minimal, on-premises Kubernetes cluster set up on physical servers and Virtual Machines (VMs) running the Ubuntu Operating System (OS) . The cluster consists of a master and two worker nodes, which are used for two main ML frameworks. Populating the cluster with more nodes is straightforward, which makes scaling a simple task. Additionally, a locally shared folder on the network is mounted in the cluster as an external storage and the cluster is configured to access either a local or a cloud-provided container registry. Once the cluster is set up and running, an application is launched to train the YOLOv5 model on a custom dataset. Later, Distributed Data Parallel (DDP) training is performed on the cluster using PyTorch, TorchX, PyTorch Lightning and Volcano.  \nKeywords: DevOps, Docker, Kubernetes, Micro-service, ML, MLOps, PyTorch, YOLO  \nvi  \nAcknowledgements  \nThe research for this master thesis was carried out within the SMILE IV project, financed by Vinnova, FFI, Fordonsstrategisk forskning och innovation under the grant number 2023-00789 [75] . We would like to express our deepest gratitude to our project supervisor Dr. Hamid Ebadi, Senior Researcher and Competence Leader at Infotiv Technology Development, for his invaluable guidance and his constant engagement in our thesis project. We would also wish to extend our gratefulness to Maria Kindmark Alemyr, Consultant Manager at Infotiv Technology Development, as well as the company personnel, for providing beneficial advise and access to crucial resources, such as software tools and technical infrastructure. Finally we want to thank our supervisor and examiner at Chalmers University of Technology Giovanni Volpe, Senior Lecturer at Institution of Physics at Gothenburg University, for his direction concerning administrative processes.  \nFilip Melberg and Vasiliki Kostara, Gothenburg, June 2024  \nviii  \nContents  \nList of Figures x  \nList of Tables xii  \nList of Abbreviations xiii","cbCaievMoQsG9kST","https://ap.wps.com/l/cbCaievMoQsG9kST","pdf",2034064,1,78,"English","en",105,"# Contents\n## Introduction\n## Background\n## Methods\n## Results\n## List of Abbreviations","[{\"question\":\"What is the main goal of this thesis?\",\"answer\":\"To investigate how a minimal team of engineers can create and maintain a Machine Learning Operations (MLOps) pipeline beyond just writing ML algorithms.\"},{\"question\":\"How is the MLOps pipeline implemented?\",\"answer\":\"It uses containerization and container orchestration of micro-services, resulting in a minimal on-premises Kubernetes cluster with a master and two worker nodes.\"},{\"question\":\"How does the system support scaling and training workflows?\",\"answer\":\"Scaling is enabled by adding more Kubernetes nodes, and the cluster mounts shared external storage and can use a local or cloud container registry. Training includes YOLOv5 and later distributed DDP training using PyTorch-related tooling.\"}]","Automation and Orchestration for Machine Learning Pipelines - A Study of Machine Learning Scaling - Exploring Micro-service architecture with Kubernetes | PDF",1785723584,197,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"automation-and-orchestration-for-machine-learning-pipelines-a-study-of-machine-learning-scaling-exploring-micro-service-architecture-with-kubernetes","",{"@graph":36,"@context":85},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/automation-and-orchestration-for-machine-learning-pipelines-a-study-of-machine-learning-scaling-exploring-micro-service-architecture-with-kubernetes/119298/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-03",true,{"@type":65,"interactionType":66,"userInteractionCount":4},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"What is the main goal of this thesis?","Question",{"text":75,"@type":76},"To investigate how a minimal team of engineers can create and maintain a Machine Learning Operations (MLOps) pipeline beyond just writing ML algorithms.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"How is the MLOps pipeline implemented?",{"text":80,"@type":76},"It uses containerization and container orchestration of micro-services, resulting in a minimal on-premises Kubernetes cluster with a master and two worker nodes.",{"name":82,"@type":73,"acceptedAnswer":83},"How does the system support scaling and training workflows?",{"text":84,"@type":76},"Scaling is enabled by adding more Kubernetes nodes, and the cluster mounts shared external storage and can use a local or cloud container registry. Training includes YOLOv5 and later distributed DDP training using PyTorch-related tooling.","https://schema.org",{"og:url":52,"og:type":87,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":89,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,120,123,128,131,135],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":46,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":46,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":121,"slug":122},30,"research-report",{"id":124,"doc_module":4,"doc_module_name":46,"category_name":125,"show_sort_weight":126,"slug":127},9,"Religion & Spirituality",20,"religion-spirituality",{"id":126,"doc_module":4,"doc_module_name":46,"category_name":129,"show_sort_weight":126,"slug":130},"World Cup","world-cup",{"id":132,"doc_module":4,"doc_module_name":46,"category_name":133,"show_sort_weight":132,"slug":134},10,"Lifestyle","lifestyle",{"id":136,"doc_module":4,"doc_module_name":46,"category_name":137,"show_sort_weight":106,"slug":138},19,"General","general"]