[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-121892-en":3,"doc-seo-121892-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},121892,4398048949847,"Eliana","https://ap-avatar.wpscdn.com/avatar/400002536579ef2da7f?_k=1778318612642679267",8,"Research & Report","Systematic review finds “spin” practices and poor reporting standards in studies on machine learning-based prediction models","Objectives evaluate the presence and frequency of spin practices and poor reporting standards in studies developing and/or validating clinical prediction models using supervised machine learning techniques. A systematic search of PubMed from 01/2018 to 12/2019 identified diagnostic and prognostic prediction model studies without restrictions on data sources, outcomes, or clinical specialty. Results included 152 studies, with frequent incomplete performance reporting and limited external validation before clinical recommendation. Conclusions indicate spin and inadequate reporting also occur in machine learning prediction model research, supporting a tailored framework for detection.","Journal of Clinical Epidemiology 158 (2023) 99e110  \nREVIEW  \nSystematic review finds ‘‘spin’’ practices and poor reporting standards in studies on machine learning-based prediction models  \nConstanza L. Andaur Navarroa,b, *, Johanna A.A. Damena,b, Toshihiko Takadaa, Steven W.J. Nijmana, Paula Dhimanc,d, Jie Mac, Gary S. Collinsc,d, Ram Bajpaie, Richard D. Rileye, Karel G.M. Moonsa,b, Lotty Hoofta,b  \naJulius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands bCochrane Netherlands, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands  \ncCenter for Statistics in Medicine, NDORMS, University of Oxford, Oxford, UK  \ndNIHR Oxford Biomedical Research Centre, Oxford University Hospitals NHS Foundation Trust, Oxford, UK eCentre for Prognosis Research, School of Medicine, Keele University, Keele, UK  \nAccepted 28 March 2023; Published online 5 April 2023  \nAbstract  \nObjectives: We evaluated the presence and frequency of spin practices and poor reporting standards in studies that developed and/or validated clinical prediction models using supervised machine learning techniques.  \nStudy Design and Setting: We systematically searched PubMed from 01/2018 to 12/2019 to identify diagnostic and prognostic prediction model studies using supervised machine learning. No restrictions were placed on data source, outcome, or clinical specialty.  \nResults: We included 152 studies: 38% reported diagnostic models and 62% prognostic models. When reported, discrimination was described without precision estimates in 53/71 abstracts (74.6% [95% CI 63.4e83.3]) and 53/81 main texts (65.4% [95% CI 54.6e74.9]) . Of the 21 abstracts that recommended the model to be used in daily practice, 20 (95.2%[95% CI 77.3e99.8]) lacked any external validation of the developed models. Likewise, 74/133 (55.6%[95% CI 47.2e63.8]) studies made recommendations for clinical use in their main text without any external validation. Reporting guidelines were cited in 13/152 (8.6%[95% CI 5.1e14.1]) studies.  \nConclusion: Spin practices and poor reporting standards are also present in studies on prediction models using machine learning techniques. A tailored framework for the identification of spin will enhance the sound reporting of prediction model studies. 􀀁 2023 The Author(s). Published by Elsevier Inc. This is an open access article under the CC BY license ([http://creativecommons.org/licenses/by/4.0/](http://creativecommons.org/licenses/by/4.0/)).  \nKeywords: Diagnosis; Prognosis; Development; Validation; Misinterpretation; Overinterpretation; Overextrapolation; Spin  \nSystematic review registration: PROSPERO, CRD42019161764 .  \nFunding: There is no specific funding to disclosure for this study. GSC is funded by the National Institute for Health Research (NIHR) Oxford Biomedical Research Centre (BRC) and by Cancer Research UK program grant (C49297/A27294) . PD is funded by the NIHR Oxford BRC. RB is affiliated to the National Institute for Health and Care Research (NIHR) Applied Research Collaboration (ARC) West Midlands. None of the funding sources had a role in the design, conduct, analyses, or reporting of the study or in the decision to submit the manuscript for publication. The views expressed are those of the author(s) and not necessarily those of the NIHR or the Department of Health and Social Care.  \nCompeting interests: Authors declare no competing interests.  \nAvailability of data, code, and other materials: Data and analytical code is available upon reasonable request to corresponding author.  \nDeclaration of interests: The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.  \nRegistration and protocol: This review was registered in PROSPERO (CRD42019161764). The study protocol can be accessed in [https://doi](https://doi). org/10.1136/bmjopen-2020-038832 .  \n","cbCaie8AJ7Zw5P2C","https://ap.wps.com/l/cbCaie8AJ7Zw5P2C","pdf",356288,1,12,"English","en",105,"# Introduction\n## Study objectives\n## Search strategy and inclusion\n## Results: reporting and external validation\n## Conclusions and implications","[{\"question\":\"What does the review evaluate about machine learning prediction model studies?\",\"answer\":\"It evaluates the presence and frequency of spin practices and poor reporting standards in studies that develop and/or validate supervised machine learning-based clinical prediction models.\"},{\"question\":\"How were studies selected for this systematic review?\",\"answer\":\"The review systematically searched PubMed from 01/2018 to 12/2019 to identify diagnostic and prognostic prediction model studies using supervised machine learning, with no restrictions on data source, outcome, or clinical specialty.\"},{\"question\":\"What were the main findings regarding reporting and external validation?\",\"answer\":\"Among 152 included studies, performance was often described without precision estimates, and most recommendations for daily clinical use lacked any external validation of the developed models.\"}]","Systematic review finds “spin” practices and poor reporting standards in studies on machine learning-based prediction models | PDF",1785807579,30,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"systematic-review-finds-spin-practices-and-poor-reporting-standards-in-studies-on-machine-learning-based-prediction-models","",{"@graph":36,"@context":85},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/systematic-review-finds-spin-practices-and-poor-reporting-standards-in-studies-on-machine-learning-based-prediction-models/121892/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-04",true,{"@type":65,"interactionType":66,"userInteractionCount":20},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"What does the review evaluate about machine learning prediction model studies?","Question",{"text":75,"@type":76},"It evaluates the presence and frequency of spin practices and poor reporting standards in studies that develop and/or validate supervised machine learning-based clinical prediction models.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"How were studies selected for this systematic review?",{"text":80,"@type":76},"The review systematically searched PubMed from 01/2018 to 12/2019 to identify diagnostic and prognostic prediction model studies using supervised machine learning, with no restrictions on data source, outcome, or clinical specialty.",{"name":82,"@type":73,"acceptedAnswer":83},"What were the main findings regarding reporting and external validation?",{"text":84,"@type":76},"Among 152 included studies, performance was often described without precision estimates, and most recommendations for daily clinical use lacked any external validation of the developed models.","https://schema.org",{"og:url":52,"og:type":87,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":89,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,120,122,127,130,134],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":46,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":46,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":29,"slug":121},"research-report",{"id":123,"doc_module":4,"doc_module_name":46,"category_name":124,"show_sort_weight":125,"slug":126},9,"Religion & Spirituality",20,"religion-spirituality",{"id":125,"doc_module":4,"doc_module_name":46,"category_name":128,"show_sort_weight":125,"slug":129},"World Cup","world-cup",{"id":131,"doc_module":4,"doc_module_name":46,"category_name":132,"show_sort_weight":131,"slug":133},10,"Lifestyle","lifestyle",{"id":135,"doc_module":4,"doc_module_name":46,"category_name":136,"show_sort_weight":106,"slug":137},19,"General","general"]