[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-125548-en":3,"doc-seo-125548-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":4,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},125548,1099513958607,"Jiven","https://ap-avatar.wpscdn.com/avatar/100002390cf8733938c?x-image-process=image/resize,m_fixed,w_180,h_180&k=1778829742770036399",8,"Research & Report","Screening for in vitro systematic reviews - a comparison of screening methods and training of a machine learning classifier","Objective: Strategies for identifying relevant studies for systematic review can vary in performance across research domains. This work compares four approaches that use either human or automated screening of title and abstract or full text, and describes training of a machine learning classifier to detect in vitro studies from bibliographic records. Methods: A systematic review of oxygen–glucose deprivation in PC-12 cells compared human screening and text mining using enriched PubMed Central training decisions. Results: Full-text methods performed best, while title/abstract screening with text mining outperformed human screening; the target sensitivity yielded moderate specificity. Conclusion: Title/abstract exclusions can be substantial; the algorithm can support first-phase selection to reduce full-text workload.","Edinburgh Research Explorer  \nScreening for in vitro systematic reviews  \nCitation for published version:  \nWilson, E, Cruz, F, Maclean, D, Ghanawi, J, McCann, SK, Brennan, PM, Liao, J, Sena, ES & Macleod, M 2023, 'Screening for in vitro systematic reviews: a comparison of screening methods and training of a machine learning classifier', Clinical science, vol. 137, no. 2, pp. 181-193.  \n[https://doi.org/10.1042/CS20220594](https://doi.org/10.1042/CS20220594)  \nDigital Object Identifier (DOI):  \n10.1042/CS20220594  \nLink:  \nLink to publication record in Edinburgh Research Explorer  \nDocument Version:  \nPublisher's PDF, also known as Version of record  \nPublished In:  \nClinical science  \nGeneral rights  \nCopyright for the publications made accessible via the Edinburgh Research Explorer is retained by the author(s) and / or other copyright owners and it is a condition of accessing these publications that users recognise and abide by the legal requirements associated with these rights.  \nTake down policy  \nThe University of Edinburgh has made every reasonable effort to ensure that Edinburgh Research Explorer content complies with UK legislation. If you believe that the public display of this file breaches copyright please [contact openaccess@ed.ac.uk](contact openaccess@ed.ac.uk) providing details, and we will remove access to the work immediately and investigate your claim.  \nDownload date: 11. May. 2024  \nClinical Science (2023) 137 181–193 [https://doi.org/10.1042/CS20220594](https://doi.org/10.1042/CS20220594)  \nResearch Article  \nScreening for in vitro systematic reviews: a comparison of screening methods and training of a machine learning classifier  \n Emma Wilson1 , Florenz Cruz2 , Duncan Maclean3 , Joly Ghanawi4 , Sarah K. McCann2 , Paul M. Brennan1 , Jing Liao1 , Emily S. Sena1 and  Malcolm Macleod1  \n1 Centre for Clinical Brain Sciences, The University of Edinburgh, Edinburgh, U. K. ; 2 Berlin Institute of Health at Charit-Universittsmedizin Berlin, QUEST Center, Berlin, Germany; 3 University of Edinburgh Medical School, University of Edinburgh, Edinburgh, U. K. ; 4 Independent Researcher, U. K.  \nCorrespondence: Emma Wilson ([emma.wilson@ed.ac.uk](emma.wilson@ed.ac.uk))  \nReceived: 31 August 2022  \nRevised: 15 December 2022  \nAccepted: 11 January 2023  \nAccepted Manuscript online:  \n11 January 2023  \nVersion of Record published:  \n27 January 2023  \nObjective: Existing strategies to identify relevant studies for systematic review may not perform equally well across research domains. We compare four approaches based on either human or automated screening of either title and abstract or full text, and report the training of a machine learning algorithm to identify in vitro studies from bibliographic records. Methods: We used a systematic review of oxygen–glucose deprivation (OGD) in PC-12 cells to compare approaches. For human screening, two reviewers independently screened studies based on title and abstract or full text, with disagreements reconciled by a third. For automated screening, we applied text mining to either title and abstract or full text. We trained a machine learning algorithm with decisions from 2000 randomly selected PubMed Central records enriched with a dataset of known in vitro studies. Results: Full-text approaches performed best, with human (sensitivity: 0.990, specificity: 1 .000 and precision: 0.994) outperforming text mining (sensitivity: 0.972, specificity: 0.980 and precision: 0.764) . For title and abstract, text mining (sensitivity: 0.890, specificity: 0.995 and precision: 0.922) outperformed human screening (sensitivity: 0.862, specificity: 0.998 and precision: 0.975) . At our target sensitivity of 95% the algorithm performed with specificity of 0.850 and precision of 0.700. Conclusion: In this in vitro systematic review, human screening based on title and abstract erroneously excluded 14% of relevant studies, perhaps because title and abstract provide an incomplete description of methods used","cbCaioFcLqkNCG9S","https://ap.wps.com/l/cbCaioFcLqkNCG9S","pdf",1452014,1,14,"English","en",105,"# Objective\n# Methods\n## Human screening\n## Automated screening and model training\n# Results\n# Conclusion\n# Introduction","[{\"question\":\"What is the primary objective of this study?\",\"answer\":\"To compare multiple strategies for screening studies for in vitro systematic reviews, including human versus automated approaches and title/abstract versus full-text screening, and to report training of a machine learning classifier.\"},{\"question\":\"How were human and automated screening approaches implemented?\",\"answer\":\"Human screening used two independent reviewers screening title/abstract or full text, with disagreements reconciled by a third reviewer. Automated screening applied text mining to title/abstract or full text.\"},{\"question\":\"Which screening approach performed best and what key trade-off was observed?\",\"answer\":\"Full-text approaches performed best overall, with human screening achieving very high sensitivity and specificity. When targeting sensitivity at 95%, specificity and precision were lower, showing a trade-off between recall and exclusion accuracy.\"}]","Screening for in vitro systematic reviews - a comparison of screening methods and training of a machine learning classifier | PDF",1785899797,35,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"screening-for-in-vitro-systematic-reviews-a-comparison-of-screening-methods-and-training-of-a-machine-learning-classifier","",{"@graph":36,"@context":85},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/screening-for-in-vitro-systematic-reviews-a-comparison-of-screening-methods-and-training-of-a-machine-learning-classifier/125548/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-05",true,{"@type":65,"interactionType":66,"userInteractionCount":4},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"What is the primary objective of this study?","Question",{"text":75,"@type":76},"To compare multiple strategies for screening studies for in vitro systematic reviews, including human versus automated approaches and title/abstract versus full-text screening, and to report training of a machine learning classifier.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"How were human and automated screening approaches implemented?",{"text":80,"@type":76},"Human screening used two independent reviewers screening title/abstract or full text, with disagreements reconciled by a third reviewer. Automated screening applied text mining to title/abstract or full text.",{"name":82,"@type":73,"acceptedAnswer":83},"Which screening approach performed best and what key trade-off was observed?",{"text":84,"@type":76},"Full-text approaches performed best overall, with human screening achieving very high sensitivity and specificity. When targeting sensitivity at 95%, specificity and precision were lower, showing a trade-off between recall and exclusion accuracy.","https://schema.org",{"og:url":52,"og:type":87,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":89,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,120,123,128,131,135],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":46,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":46,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":121,"slug":122},30,"research-report",{"id":124,"doc_module":4,"doc_module_name":46,"category_name":125,"show_sort_weight":126,"slug":127},9,"Religion & Spirituality",20,"religion-spirituality",{"id":126,"doc_module":4,"doc_module_name":46,"category_name":129,"show_sort_weight":126,"slug":130},"World Cup","world-cup",{"id":132,"doc_module":4,"doc_module_name":46,"category_name":133,"show_sort_weight":132,"slug":134},10,"Lifestyle","lifestyle",{"id":136,"doc_module":4,"doc_module_name":46,"category_name":137,"show_sort_weight":106,"slug":138},19,"General","general"]