[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-124792-en":3,"doc-seo-124792-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":4,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},124792,3848291630094,"Emma Wilson","https://eur-avatar.wpscdn.com/davatar_085a072bc5b1113ac321206ff7593b45",8,"Research & Report","An Empirical Study of Self-Admitted Technical Debt in Machine Learning Software - research findings","Machine learning software development often produces technical debt through sub-optimal design and implementation choices that developers explicitly acknowledge in code comments, known as self-admitted technical debt (SATD). This study analyzes 318 open-source ML projects across five domains and compares them with 318 non-ML projects. It detects SATD in comment snapshots, performs manual characterization of sampled SATD, and applies survival analysis to model evolution dynamics. Results show ML has higher SATD rates, greater susceptibility in preprocessing and pipeline stages, earlier appearance, and long-lasting SATD linked to large, low-complexity multi-file code changes.","arXiv :2311 . 12019v3 [ cs . SE] 27 Nov 2025  \nAn Empirical Study of Self-Admitted Technical Debt in Machine Learning Software  \nAADITYA BHATIA, SAIL, Queen’s University, Canada FOUTSE KHOMH, Polytechnique Montréal, Canada BRAM ADAMS, MCIS, Queen’s University, Canada AHMED E HASSAN, SAIL, Queen’s University, Canada  \nThe emergence of open-source ML libraries such as TensorFlow and Google Auto ML has enabled developers to harness state-of-the-art ML algorithms with minimal overhead. However, during this accelerated ML development process, said developers may often make sub-optimal design and implementation decisions, leading to the introduction of technical debt that, if not addressed promptly, can significantly impact on the quality of ML-based software. Developers frequently acknowledge these sub-optimal design and development choices through code comments written during development. These comments, which often highlight areas requiring additional work or refinement in the future are known as self-admitted technical debt (SATD). While prior research has demonstrated that SATD can serve as a reliable indicator of technical debt and has extensively studied SATD in traditional (non-ML) software, little attention has been given to this issue in the context of ML. This paper aims to investigate the occurrence of SATD in ML code by analyzing 318 open-source ML projects across five domains, along with 318 non-ML projects. We detected SATD in source code comments in various snapshots of the studied projects, conducted a manual analysis of a sample of the identified SATD to comprehend the nature of technical debt in the ML code, and performed a survival analysis of the SATD to understand the evolution dynamics of such debts. Our analyses yielded the following observations: (i) Machine learning projects have a median percentage of SATD that is twice that of non-machine learning projects. (ii) ML pipeline stages for data preprocessing and model generation logic are more susceptible to debt than model validation and deployment stages. (iii) SATDs appear in ML projects earlier in the development process compared to non-ML projects. (iv) Long-lasting SATDs are typically introduced during extensive code changes that span multiple files, which exhibit low complexity.  \nOur research contributes to the understanding of technical debt in an ML context and underscores the need for targeted debt management strategies. This contribution is particularly relevant for developers and stakeholders in ML projects by aiding them in identifying and addressing technical debt proactively and paving the way for future research in developing automated tools and methodologies for managing SATD inan ML environment.  \nAdditional Key Words and Phrases: Self Admitted Technical Debt, Machine Learning, Temporal Analysis  \nACM Reference Format:  \nAaditya Bhatia, Foutse Khomh, Bram Adams, and Ahmed E Hassan. 2025. An Empirical Study of Self-Admitted Technical Debt in Machine Learning Software. ACM Trans. Softw. Eng. Methodol. 1, 1 (December 2025), 41 pages.  \n[https://doi.org/10.1145/nnnnnnn.nnnnnnn](https://doi.org/10.1145/nnnnnnn.nnnnnnn)  \nAuthors’ Contact Information: Aaditya Bhatia, [aaditya.bhatia@queensu.ca](aaditya.bhatia@queensu.ca), SAIL, Queen’s University, Kingston, Canada;  \nFoutse Khomh, [foutse.khomh@polymtl.ca](foutse.khomh@polymtl.ca), Polytechnique Montréal, Canada; Bram Adams, [bram.adams@queensu.ca](bram.adams@queensu.ca), MCIS,  \nQueen’s University, Kingston, Canada; Ahmed E Hassan, [ahmed@cs.queensu.ca](ahmed@cs.queensu.ca), SAIL, Queen’s University, Kingston, Canada.  \nPermission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with cred","cbCaid3HR9UfcTES","https://ap.wps.com/l/cbCaid3HR9UfcTES","pdf",1626058,1,41,"English","en",105,"# Introduction\n## Motivation and context for SATD in ML\n# Study Design\n## Research goals and dataset\n## SATD detection and manual analysis\n## Survival analysis approach\n# Observations and Findings\n## SATD rate comparison: ML vs non-ML\n## Pipeline-stage susceptibility patterns\n## Timing of SATD introduction\n## Characteristics of long-lasting SATD\n# Contributions and Implications","[{\"question\":\"What is self-admitted technical debt (SATD) in this study?\",\"answer\":\"SATD refers to technical debt that developers acknowledge in code comments during development, typically highlighting areas needing future work or refinement.\"},{\"question\":\"How was SATD investigated across machine learning and non-machine learning projects?\",\"answer\":\"The study analyzes 318 open-source ML projects and 318 non-ML projects by detecting SATD in source-code comments, manually analyzing a sample for nature of debt, and running survival analysis to study evolution over time.\"},{\"question\":\"What stages in ML pipelines are most prone to SATD?\",\"answer\":\"SATD is more susceptible in ML pipeline stages related to data preprocessing and model generation logic than in model validation and deployment stages.\"}]","An Empirical Study of Self-Admitted Technical Debt in Machine Learning Software - research findings | PDF",1785894679,103,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"an-empirical-study-of-self-admitted-technical-debt-in-machine-learning-software-research-findings","",{"@graph":36,"@context":85},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/an-empirical-study-of-self-admitted-technical-debt-in-machine-learning-software-research-findings/124792/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-05",true,{"@type":65,"interactionType":66,"userInteractionCount":4},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"What is self-admitted technical debt (SATD) in this study?","Question",{"text":75,"@type":76},"SATD refers to technical debt that developers acknowledge in code comments during development, typically highlighting areas needing future work or refinement.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"How was SATD investigated across machine learning and non-machine learning projects?",{"text":80,"@type":76},"The study analyzes 318 open-source ML projects and 318 non-ML projects by detecting SATD in source-code comments, manually analyzing a sample for nature of debt, and running survival analysis to study evolution over time.",{"name":82,"@type":73,"acceptedAnswer":83},"What stages in ML pipelines are most prone to SATD?",{"text":84,"@type":76},"SATD is more susceptible in ML pipeline stages related to data preprocessing and model generation logic than in model validation and deployment stages.","https://schema.org",{"og:url":52,"og:type":87,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":89,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,120,123,128,131,135],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":46,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":46,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":121,"slug":122},30,"research-report",{"id":124,"doc_module":4,"doc_module_name":46,"category_name":125,"show_sort_weight":126,"slug":127},9,"Religion & Spirituality",20,"religion-spirituality",{"id":126,"doc_module":4,"doc_module_name":46,"category_name":129,"show_sort_weight":126,"slug":130},"World Cup","world-cup",{"id":132,"doc_module":4,"doc_module_name":46,"category_name":133,"show_sort_weight":132,"slug":134},10,"Lifestyle","lifestyle",{"id":136,"doc_module":4,"doc_module_name":46,"category_name":137,"show_sort_weight":106,"slug":138},19,"General","general"]