[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-124227-en":3,"doc-seo-124227-105":30,"detail-sidebar-cat-0-en-105":95},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},124227,1099514067438,"River Wang","https://ap-avatar.wpscdn.com/avatar/100002539ee87300030?x-image-process=image/resize,m_fixed,w_180,h_180&k=1780474512215547542",8,"Research & Report","What predicts citation counts and translational impact in headache research? - A machine learning analysis","A study develops the first machine learning models to predict citation counts and the translational impact of headache research, where translational impact is defined as inclusion in guidelines or policy documents. Bibliometric data and the titles, abstracts, and keywords from 8,600 publications across three headache-focused journals (from inception to 31 Dec 2017) train models for citation-count intervals and translational impact. Gradient boosting best predicts citation-count classes (out-of-sample AUC 0.81), while translation models perform best when combining bibliometrics with publication text, reaching an AUC of 0.71. Results highlight which measurable features most influence impact.","Original Article  \nWhat predicts citation counts and translational impact in headache research? A machine learning analysis  \nAntonios Danelakis 1,2, Helge Langseth 1,2, Parashkev Nachev3, Amy Nelson3, Marte-Helene Bjørk 1,4,5 ,  \nManjit S. Matharu 1,6 , Erling Tronvik 1,7, Arne May 1,8,*  and Anker Stubberud 1,7,*   \nCephalalgia  \n2024, Vol. 44(5) 1–11  \n! International Headache Society 2024 Article reuse guidelines: [sagepub.com/journals-permissions](sagepub.com/journals-permissions)[ ](sagepub.com/journals-permissions)[DOI: 10.1177/03331024241251488](DOI: 10.1177/03331024241251488)[ ](DOI: 10.1177/03331024241251488)[journals.sagepub.com/home/cep](journals.sagepub.com/home/cep)  \nAbstract  \nBackground: We aimed to develop the first machine learning models to predict citation counts and the translational impact, defined as inclusion in guidelines or policy documents, of headache research, and assess which factors are most predictive.  \nMethods: Bibliometric data and the titles, abstracts, and keywords from 8600 publications in three headache-oriented journals from their inception to 31 December 2017 were used. A series of machine learning models were implemented to predict three classes of 5-year citation count intervals (0–5, 6–14 and, > 14 citations); and the translational impact of a publication. Models were evaluated out-of-sample with area under the receiver operating characteristics curve (AUC). Results: The top performing gradient boosting model predicted correct citation count class with an out-of-sample AUC of 0.81 . Bibliometric data such as page count, number of references, first and last author citation counts and h-index were among the most important predictors. Prediction of translational impact worked optimally when including both bibliometric data and information from the title, abstract and keywords, reaching an out-of-sample AUC of 0.71 for the top performing random forest model.  \nConclusion: Citation counts are best predicted by bibliometric data, while models incorporating both bibliometric data and publication content identifies the translational impact of headache research.  \nKeywords  \nArtificial intelligence, prediction, translational, deep learning, neural networks  \nDate received: 16 November 2023; revised: 7 April 2024; accepted: 8 April 2024  \nBackground  \nThe headache research literature is rapidly expanding (1), yet the importance and influence of individual scientific works can be difficult to measure. Citation counts, impact factor and h-index are common metrics of research performance (2) . Such metrics traditionally drive research funding, recruitment and indicate the  \n1 NorHead Norwegian Centre for Headache Research, Trondheim, Norway  \n2Department of Computer Science, NTNU Norwegian University of Science and Technology, Trondheim, Norway  \n3High Dimensional Neurology Group, UCL Queen Square Institute of Neurology, University College London, London, UK  \n4Department of Clinical Medicine, University of Bergen, Bergen, Norway 5Department of Neurology, Haukeland University Hospital, Bergen, Norway  \n6Headache and Facial Pain Group, UCL Queen Square Institute of Neurology and National Hospital for Neurology and Neurosurgery, London, UK  \n7Department of Neuromedicine and Movement Sciences, NTNU Norwegian University of Science and Technology, Trondheim, Norway 8Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, Hamburg, Germany  \n*Contributed equally as last authors  \nCorresponding author:  \nAntonios Danelakis, NorHead and Department of Computer Science, NTNU Norwegian University of Science and Technology, Sem Sælands vei 9, 7034, Trondheim, Norway.  \nEmail: [antonios.danelakis@ntnu.no](antonios.danelakis@ntnu.no)  \nCreative Commons CC BY: This article is distributed under the terms of the Creative Commons Attribution 4.0 License ([https://](https://)  \n[creativecommons.org/licenses/by/4.0/](creativecommons.org/licenses/by/4.0/)) which permits any use, reproduction ","cbCaie4apsAaSKTv","https://ap.wps.com/l/cbCaie4apsAaSKTv","pdf",1346302,1,11,"English","en",105,"# Abstract\n# Background\n# Methods\n## Data and outcome definitions\n## Machine learning models and evaluation\n# Results\n# Conclusion","[{\"question\":\"What are the study’s goals regarding headache research impact?\",\"answer\":\"To predict both citation counts and translational impact of headache research papers, and to identify which factors are most predictive.\"},{\"question\":\"What data sources were used to build the machine learning models?\",\"answer\":\"Bibliometric data plus the titles, abstracts, and keywords from 8,600 publications from three headache-oriented journals through 31 December 2017.\"},{\"question\":\"Which model performed best for predicting citation count intervals, and how was it evaluated?\",\"answer\":\"A gradient boosting model achieved the best out-of-sample performance for citation-count classes with an AUC of 0.81, evaluated using out-of-sample AUC based on receiver operating characteristics.\"},{\"question\":\"What inputs most improved prediction of translational impact?\",\"answer\":\"Combining bibliometric data with information from the title, abstract, and keywords produced the best translational-impact prediction, with an out-of-sample AUC of 0.71.\"}]","What predicts citation counts and translational impact in headache research? - A machine learning analysis | PDF",1785821116,28,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":90,"head_meta":92,"extra_data":94,"updated_unix":28},"what-predicts-citation-counts-and-translational-impact-in-headache-research-a-machine-learning-analysis","",{"@graph":36,"@context":89},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/what-predicts-citation-counts-and-translational-impact-in-headache-research-a-machine-learning-analysis/124227/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-04",true,{"@type":65,"interactionType":66,"userInteractionCount":20},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81,85],{"name":72,"@type":73,"acceptedAnswer":74},"What are the study’s goals regarding headache research impact?","Question",{"text":75,"@type":76},"To predict both citation counts and translational impact of headache research papers, and to identify which factors are most predictive.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"What data sources were used to build the machine learning models?",{"text":80,"@type":76},"Bibliometric data plus the titles, abstracts, and keywords from 8,600 publications from three headache-oriented journals through 31 December 2017.",{"name":82,"@type":73,"acceptedAnswer":83},"Which model performed best for predicting citation count intervals, and how was it evaluated?",{"text":84,"@type":76},"A gradient boosting model achieved the best out-of-sample performance for citation-count classes with an AUC of 0.81, evaluated using out-of-sample AUC based on receiver operating characteristics.",{"name":86,"@type":73,"acceptedAnswer":87},"What inputs most improved prediction of translational impact?",{"text":88,"@type":76},"Combining bibliometric data with information from the title, abstract, and keywords produced the best translational-impact prediction, with an out-of-sample AUC of 0.71.","https://schema.org",{"og:url":52,"og:type":91,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":93,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":96},[97,101,105,109,114,119,124,127,132,135,139],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":106,"show_sort_weight":107,"slug":108},"Exam",70,"exam",{"id":110,"doc_module":4,"doc_module_name":46,"category_name":111,"show_sort_weight":112,"slug":113},5,"Comic",60,"comic",{"id":115,"doc_module":4,"doc_module_name":46,"category_name":116,"show_sort_weight":117,"slug":118},6,"Technology",50,"technology",{"id":120,"doc_module":4,"doc_module_name":46,"category_name":121,"show_sort_weight":122,"slug":123},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":125,"slug":126},30,"research-report",{"id":128,"doc_module":4,"doc_module_name":46,"category_name":129,"show_sort_weight":130,"slug":131},9,"Religion & Spirituality",20,"religion-spirituality",{"id":130,"doc_module":4,"doc_module_name":46,"category_name":133,"show_sort_weight":130,"slug":134},"World Cup","world-cup",{"id":136,"doc_module":4,"doc_module_name":46,"category_name":137,"show_sort_weight":136,"slug":138},10,"Lifestyle","lifestyle",{"id":140,"doc_module":4,"doc_module_name":46,"category_name":141,"show_sort_weight":110,"slug":142},19,"General","general"]