[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-125167-en":3,"doc-seo-125167-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":4,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},125167,13056703019404,"Miles","https://ap-avatar.wpscdn.com/davatar_29158cc5080c5b710cf443261637dec0",8,"Research & Report","SyROCCo - Enhancing Systematic Reviews using Machine Learning","The growing volume of research outputs makes systematic reviewing increasingly time- and resource-intensive. This paper investigates how machine learning can support multiple stages beyond article screening, including profiling and analysis of 1,952 publications on outcomes-based contracting. The work develops tools to classify policy areas, extract key entities and metadata for evidence mapping, link results to an existing dataset, and detect thematic subgroups. An interactive tool and a released public dataset support evidence accessibility and analysis, while also emphasizing current limitations and the need for careful use due to potential errors and biases.","SyROCCo: Enhancing Systematic Reviews using Machine Learning  \nZheng Fang1, Miguel Arana-Catania2, Felix-Anselm van Lier3, Juliana Outes Velarde3, Harry Bregazzi3, Mara Airoldi3, Eleanor Carter3, Rob Procter1*  \nAfiliations:  \n1 Department ofComputer Science, University of Warwick and Alan Turing Institutefor Data Science and AI, Coventry, United Kingdom  \n2 School ofAerospace, Transport and Manufacturing, Cranfield University, United Kingdom  \n3 Government Outcomes Lab, Blavatnik School of Government, University of Oxford, Oxford, United Kingdom  \n* [Corresponding author:](Corresponding author: rob.procter@warwick.ac.uk)[ ](Corresponding author: rob.procter@warwick.ac.uk)[rob.procter@warwick.ac.uk](Corresponding author: rob.procter@warwick.ac.uk)  \nEmail address:  \n[Zheng Fang:](Zheng Fang: Z.Fang.4@warwick.ac.uk)[ ](Zheng Fang: Z.Fang.4@warwick.ac.uk)[Z.Fang.4@warwick.ac.uk](Zheng Fang: Z.Fang.4@warwick.ac.uk)  \n[Miguel Arana-Catania:](Miguel Arana-Catania: miguel.aranacatania@cranfield.ac.uk)[ miguel.aranacatania@cranfield.ac.uk](Miguel Arana-Catania: miguel.aranacatania@cranfield.ac.uk)[ ](Miguel Arana-Catania: miguel.aranacatania@cranfield.ac.uk)[Felix-Anselm van Lier:](Felix-Anselm van Lier:felix-anselm.vanlier@bsg.ox.ac.uk)[felix-anselm.vanlier@bsg.ox.ac.uk](Felix-Anselm van Lier:felix-anselm.vanlier@bsg.ox.ac.uk)  \n[Juliana Outes Velarde: juliana.outesvelarde@bsg.ox.ac.uk](Juliana Outes Velarde: juliana.outesvelarde@bsg.ox.ac.uk)  \nHarry Bregazzi: [harry.bregazzi@bsg.ox.ac.uk](harry.bregazzi@bsg.ox.ac.uk)  \n[Mara Airoldi: mara.airoldi@bsg.ox.ac.uk](Mara Airoldi: mara.airoldi@bsg.ox.ac.uk)  \nEleanor Carter: [eleanor.carter@bsg.ox.ac.uk](eleanor.carter@bsg.ox.ac.uk)  \n[Rob Procter: rob.procter@warwick.ac.uk](Rob Procter: rob.procter@warwick.ac.uk)  \nKeywords: Systematic Review; Outcomes-based Contracts; Machine learning; Data Mining  \nABSTRACT  \nThe sheer number of research outputs published every year makes systematic reviewing increasingly time- and resource-intensive. This paper explores the use of machine learning techniques to help navigate the systematic review process. Machine learning has previously been used to reliably ‘screen’ articles for review – that is, identify relevant articles based on reviewers’ inclusion criteria. The application of machine learning techniques to subsequent stages of a review, however, such as data extraction and evidence mapping, is in its infancy. We therefore set out to develop a series of tools that would assist in the profiling and analysis of 1,952 publications on the theme of ‘outcomes-based contracting’. Tools were developed for the following tasks: assign publications into ‘policy area’ categories; identify and extract key information for evidence mapping, such as organisations, laws, and geographical information; connect the evidence base to an existing dataset on the same topic; and identify subgroups of articles that may share thematic content. An interactive tool using these techniques and a public dataset with their outputs have been released. Our results demonstrate the utility of machine learning techniques to enhance evidence accessibility and analysis within the systematic review processes. These efforts show promise in potentially yielding substantial efficiencies for future systematic reviewing and for broadening their analytical scope. Beyond this, our work suggests  \nthat there may be implications for the ease with which policymakers and practitioners can access evidence. While machine learning techniques seem poised to play a significant role in bridging the gap between research and policy by offering innovative ways of gathering, accessing, and analysing data from systematic reviews, we also highlight their current limitations and the need to exercise caution in their application, particularly given the potential for errors and biases.  \nPolicy Significance Statement  \nSystematic reviews, despite aiming to bolster evidence-based policy, often face challenges in","cbCaipMRk4UF2FSU","https://ap.wps.com/l/cbCaipMRk4UF2FSU","pdf",1346376,1,28,"English","en",105,"# Abstract\n# Policy Significance Statement\n# Introduction","[{\"question\":\"Why are systematic reviews becoming more difficult to conduct at scale?\",\"answer\":\"The number of research outputs has increased rapidly, making it time- and resource-intensive to collect relevant papers and extract information for a defined research question.\"},{\"question\":\"Which stages of the systematic review does this work target beyond screening articles?\",\"answer\":\"It focuses on subsequent stages such as data extraction and evidence mapping, including profiling and analysis of publications.\"},{\"question\":\"What tools were developed for the outcomes-based contracting literature?\",\"answer\":\"The tools classify publications into policy areas, extract key information for evidence mapping (e.g., organisations, laws, geography), connect the evidence base to an existing dataset, and identify thematic subgroups.\"}]","SyROCCo - Enhancing Systematic Reviews using Machine Learning | PDF",1785897108,71,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"syrocco-enhancing-systematic-reviews-using-machine-learning","",{"@graph":36,"@context":85},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/syrocco-enhancing-systematic-reviews-using-machine-learning/125167/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-05",true,{"@type":65,"interactionType":66,"userInteractionCount":4},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"Why are systematic reviews becoming more difficult to conduct at scale?","Question",{"text":75,"@type":76},"The number of research outputs has increased rapidly, making it time- and resource-intensive to collect relevant papers and extract information for a defined research question.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"Which stages of the systematic review does this work target beyond screening articles?",{"text":80,"@type":76},"It focuses on subsequent stages such as data extraction and evidence mapping, including profiling and analysis of publications.",{"name":82,"@type":73,"acceptedAnswer":83},"What tools were developed for the outcomes-based contracting literature?",{"text":84,"@type":76},"The tools classify publications into policy areas, extract key information for evidence mapping (e.g., organisations, laws, geography), connect the evidence base to an existing dataset, and identify thematic subgroups.","https://schema.org",{"og:url":52,"og:type":87,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":89,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,120,123,128,131,135],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":46,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":46,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":121,"slug":122},30,"research-report",{"id":124,"doc_module":4,"doc_module_name":46,"category_name":125,"show_sort_weight":126,"slug":127},9,"Religion & Spirituality",20,"religion-spirituality",{"id":126,"doc_module":4,"doc_module_name":46,"category_name":129,"show_sort_weight":126,"slug":130},"World Cup","world-cup",{"id":132,"doc_module":4,"doc_module_name":46,"category_name":133,"show_sort_weight":132,"slug":134},10,"Lifestyle","lifestyle",{"id":136,"doc_module":4,"doc_module_name":46,"category_name":137,"show_sort_weight":106,"slug":138},19,"General","general"]