[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-124284-en":3,"doc-seo-124284-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":4,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},124284,2336464648746,"Skyler","https://ap-avatar.wpscdn.com/davatar_276721f389ce27ea32af1340a28f341c",8,"Research & Report","Categorizing Political Campaign Messages on Social Media using Supervised Machine Learning - Research approach and algorithm accuracy","Political communication scholars analyze messages through systematic content analysis, a process that demands large-scale reading and consistent categorization to describe message dimensions, types, and styles and to study their effects. Digital trace data from platforms such as Facebook and Twitter expands research opportunities while creating scale challenges when corpora contain thousands to millions of messages. This article presents a human-supervised machine learning approach to classify political campaign messages, designed to deliver theoretically informed, more accurate and reliable results than unsupervised or off-the-shelf methods.","RUNNING HEAD: Categorizing Campaign Messages using Supervised Machine Learning  \nCategorizing Political Campaign Messages on Social Media using Supervised Machine Learning  \nJennifer Stromer-Galleya* and Patricia Rossinib  \na School of Information Studies, Syracuse University, Syracuse, USA; bSchool of Social & Political Sciences, University of Glasgow, Glasgow, UK  \n*School of Information Studies, 343 Hinds Hall, Syracuse University, Syracuse, NY 13244, [j](jstromer@syr.edu)[stromer@syr.edu](jstromer@syr.edu)  \nWord Count: 7976  \nFunding Details: This work was supported by a John S. and James L. Knight grant, and a Fellowship from the Tow Center for Digital Journalism at Columbia University.  \nDisclosure Statement: The authors report there are no competing interests to declare.  \nBiographical Note:  \nJennifer Stromer-Galley (Ph.D., 2002, University of Pennsylvania) is Professor in the School of Information Studies, Senior Associate Dean for Academic and Faculty Affairs, and Director of Diversity, Equity, Inclusion, and Accessibility Initiatives. She is former president of the Association of Internet Researchers. Her book Presidential Campaigning in the Internet Age received the 2015 Roderick P. Hart Top Book Award in the Political Communication Division of the National Communication Association. Jenny has been studying “social media” since before it was called social media, studying online interaction and strategic communication in a variety of contexts, including political forums and online games. She has published over 70 journal articles, proceedings, and book chapters, and received over $15 million in federal and corporate grants to support her research endeavors.  \nRUNNING HEAD: Categorizing Campaign Messages using Supervised Machine Learning  \nPatrícia Rossini (Ph.D., 2017, Federal University of Minas Gerais) is a Senior Lecturer in Communication, Media & Democracy at the University of Glasgow. Prior to joining UofG, she was an inaugural Derby Fellow in the Department of Communication and Media at the University of Liverpool (2019-22), and a post-doctoral researcher at the School of Information Studies (iSchool) at Syracuse University (2017-19). Patrícia studies the interplay between political communication and technologies, with a focus on digital threats to democracy—specifically, uncivil and intolerant online discourse, misand disinformation, as well as (dark) participation, democratic backsliding, and online campaigns. Her research has been funded by social media companies such as Facebook, Google, Twitter, and WhatsApp; the British Academy, and the Knight Foundation (USA) .  \nData availability statement: Data is available from the authors upon request.  \nRUNNING HEAD: Categorizing Campaign Messages using Supervised Machine Learning  \nCategorizing Political Campaign Messages on Social Media using Supervised Machine Learning  \nScholars have access to a rich source of political discourse via social media. Although computational approaches to understand this communication is being used, they tend to be unsupervised and off-the-shelf algorithms to describe a corpus of messages. This article details our approach at using human-supervised machine learning to study political campaign messages. Although some declare this technique too labor-intensive, it provides theoretically-informed classification, making it more accurate and reliable. This article describes the design decisions and accuracy of our algorithms, and the applicability of the approach to classifying messages from Facebook and Twitter across two cultures and to advertisements.  \nKeywords: supervised machine learning, political campaigns, content analysis, computational  \nsocial science  \nRUNNING HEAD: Categorizing Campaign Messages using Supervised Machine Learning  \nThe study of political communication messages is a labor-intensive process. Systematic content analysis and other qualitative approaches to characterize and thematize discourse requires reading l","cbCaikeU84BTUM8m","https://ap.wps.com/l/cbCaikeU84BTUM8m","pdf",491438,1,39,"English","en",105,"# Introduction\n## Challenges in scaling political message analysis\n## Limits of metadata and network-focused methods\n## Toward automated content characterization\n# Method overview (human-supervised machine learning)\n## Theoretical basis for classification\n## Algorithm design decisions and accuracy","[{\"question\":\"Why is political communication message analysis labor-intensive?\",\"answer\":\"Systematic content analysis requires reading large volumes of text and applying categorization to examine message nature, dimensions, and effects across types and styles.\"},{\"question\":\"What challenges arise when using digital trace data for political discourse?\",\"answer\":\"The sheer volume of messages makes random sampling difficult and creates scaling problems when datasets reach thousands or millions of units.\"},{\"question\":\"How does the article improve classification of campaign messages on social media?\",\"answer\":\"It uses human-supervised machine learning to produce theoretically informed categories, aiming for greater accuracy and reliability than unsupervised or off-the-shelf approaches.\"}]","Categorizing Political Campaign Messages on Social Media using Supervised Machine Learning - Research approach and algorithm accuracy | PDF",1785821370,98,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"categorizing-political-campaign-messages-on-social-media-using-supervised-machine-learning-research-approach-and-algorithm-accuracy","",{"@graph":36,"@context":85},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/categorizing-political-campaign-messages-on-social-media-using-supervised-machine-learning-research-approach-and-algorithm-accuracy/124284/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-04",true,{"@type":65,"interactionType":66,"userInteractionCount":4},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"Why is political communication message analysis labor-intensive?","Question",{"text":75,"@type":76},"Systematic content analysis requires reading large volumes of text and applying categorization to examine message nature, dimensions, and effects across types and styles.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"What challenges arise when using digital trace data for political discourse?",{"text":80,"@type":76},"The sheer volume of messages makes random sampling difficult and creates scaling problems when datasets reach thousands or millions of units.",{"name":82,"@type":73,"acceptedAnswer":83},"How does the article improve classification of campaign messages on social media?",{"text":84,"@type":76},"It uses human-supervised machine learning to produce theoretically informed categories, aiming for greater accuracy and reliability than unsupervised or off-the-shelf approaches.","https://schema.org",{"og:url":52,"og:type":87,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":89,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,120,123,128,131,135],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":46,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":46,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":121,"slug":122},30,"research-report",{"id":124,"doc_module":4,"doc_module_name":46,"category_name":125,"show_sort_weight":126,"slug":127},9,"Religion & Spirituality",20,"religion-spirituality",{"id":126,"doc_module":4,"doc_module_name":46,"category_name":129,"show_sort_weight":126,"slug":130},"World Cup","world-cup",{"id":132,"doc_module":4,"doc_module_name":46,"category_name":133,"show_sort_weight":132,"slug":134},10,"Lifestyle","lifestyle",{"id":136,"doc_module":4,"doc_module_name":46,"category_name":137,"show_sort_weight":106,"slug":138},19,"General","general"]