[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-127633-en":3,"doc-seo-127633-105":31,"detail-sidebar-cat-0-en-105":84},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":21,"is_downloadable":21,"audit_status":21,"page_count":22,"language":23,"language_code":24,"site_id":25,"html_lang":24,"table_of_contents":26,"faqs":27,"seo_title":28,"seo_description":14,"update_tm":29,"read_time":30},127633,962084925502,"Lucas Martin","https://ap-avatar.wpscdn.com/davatar_6f874abed73319feea01a86fa6f0fab8",6,"Technology","Best Practices in Supervised Machine Learning: A Tutorial for Psychologists","Supervised machine learning (ML) is increasingly used in psychology and other social sciences, yet core ML concepts and predictive-modeling techniques are still not widely taught in psychology curricula. This tutorial provides an intuitive, thorough four-module primer for psychologists: resampling and model evaluation, random-forest modeling for prediction, benchmark comparisons across datasets, and interpretation with variable importance, effect plots, and fairness. Minimal formulas are used, with R code examples and practical guidance on the PhoneStudy dataset plus a reporting checklist and online materials.","~~ ~~ ASSOCIATION FOR  \nTutorial PSYCHOLOGICAL SCIENCE  \nBest Practices in Supervised Machine Learning: A Tutorial for Psychologists  \nFlorian Pargent1, Ramona Schoedel1, and Clemens Stachl1,2  \n1Department Psychology, Ludwig-Maximilians-Universität München, Munich, Germany, and 2Institute of Behavioral Science and Technology, University of St. Gallen, St. Gallen, Switzerland  \nAdvances in Methods and Practices in Psychological Science July-September 2023, Vol. 6, No. 3, pp. 1–35  \n© The Author(s) 2023  \nArticle reuse guidelines: [sagepub.com/journals-permissions](sagepub.com/journals-permissions)[ ](sagepub.com/journals-permissions)[DOI: 10.1177/25152459231162559](DOI: 10.1177/25152459231162559)[ ](DOI: 10.1177/25152459231162559)[www.psychologicalscience.org/AMPPS](www.psychologicalscience.org/AMPPS)  \nAbstract  \nSupervised machine learning (ML) is becoming an influential analytical method in psychology and other social sciences. However, theoretical ML concepts and predictive-modeling techniques are not yet widely taught in psychology programs. This tutorial is intended to provide an intuitive but thorough primer and introduction to supervised ML for psychologists in four consecutive modules. After introducing the basic terminology and mindset of supervised ML, in Module 1, we cover how to use resampling methods to evaluate the performance of ML models (bias-variance trade-off, performance measures, k-fold cross-validation) . In Module 2, we introduce the nonlinear random forest, a type of ML model that is particularly user-friendly and well suited to predicting psychological outcomes. Module 3 is about performing empirical benchmark experiments (comparing the performance of several ML models on multiple data sets) . Finally, in Module 4, we discuss the interpretation of ML models, including permutation variable importance measures, effect plots (partialdependence plots, individual conditional-expectation profiles), and the concept of model fairness. Throughout the tutorial, intuitive descriptions of theoretical concepts are provided, with as few mathematical formulas as possible, and followed by code examples using the mlr3 and companion packages in R. Key practical-analysis steps are demonstrated on the publicly available PhoneStudy data set (N = 624), which includes more than 1,800 variables from smartphone sensing to predict Big Five personality trait scores. The article contains a checklist to be used as a reminder of important elements when performing, reporting, or reviewing ML analyses in psychology. Additional examples and more advanced concepts are demonstrated in online materials ([https://osf.io/9273g/](https://osf.io/9273g/)).  \nKeywords  \ntutorial, supervised machine learning, cross-validation, interpretable machine learning, random forest, open data, open materials  \nReceived 7/13/22; Revision accepted 2/17/23  \nOver the past decade, supervised machine learning (ML) has appeared with increasing frequency in psychology and other social sciences. In psychology, ML has been used to tackle such diverse topics as predicting psychological traits from digital traces of online and offline behavior (Kosinski et al. , 2013; Stachl, Au, et al. , 2020; Youyou et al. , 2015), modeling consistency in human behavior (Shaw et al. , 2022), or investigating the empirical structure of self-regulation (Eisenberg et al. , 2019) . This popularity can be traced to a number of features: a focus on prediction, which complements traditional methods that emphasize description and explanation (Shmueli, 2010); the flexibility to account for nonlinear  \npatterns in large quantities of data (Kosinski et al. , 2016); and an increase in the generalizability of research findings by evaluating predictive performance on new data (Yarkoni, 2022) . Together, these features hold the promise of elevating the understanding of the processes that connect human behavior, cognition, and experience while being able to account for real-world complexity (Ro","cbCaisoLjGMC4X2o","https://ap.wps.com/l/cbCaisoLjGMC4X2o","pdf",6763890,2,1,35,"English","en",105,"# Tutorial modules\n## Module 1: resampling and evaluation\n## Module 2: random forest prediction\n## Module 3: benchmark experiments\n## Module 4: model interpretation and fairness","[{\"question\":\"How does the tutorial help readers interpret supervised ML models?\",\"answer\":\"Module 4 covers interpretation methods such as permutation variable importance, effect plots (partial dependence and individual conditional expectation profiles), and the concept of model fairness.\"}]","Best Practices in Supervised Machine Learning: A Tutorial for Psychologists | PDF",1785940417,88,{"code":4,"msg":32,"data":33},"ok",{"site_id":25,"language":24,"slug":34,"title":13,"keywords":35,"description":14,"schema_data":36,"social_meta":79,"head_meta":81,"extra_data":83,"updated_unix":29},"best-practices-in-supervised-machine-learning-a-tutorial-for-psychologists","",{"@graph":37,"@context":78},[38,54,69],{"@type":39,"itemListElement":40},"BreadcrumbList",[41,45,48,51],{"item":42,"name":43,"@type":44,"position":21},"https://docshare.wps.com","Home","ListItem",{"item":46,"name":47,"@type":44,"position":20},"https://docshare.wps.com/document/","Document",{"item":49,"name":12,"@type":44,"position":50},"https://docshare.wps.com/document/technology/",3,{"item":52,"name":13,"@type":44,"position":53},"https://docshare.wps.com/document/best-practices-in-supervised-machine-learning-a-tutorial-for-psychologists/127633/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":24,"description":14,"dateModified":62,"datePublished":63,"encodingFormat":61,"isAccessibleForFree":64,"interactionStatistic":65},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":42,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-27","2026-08-05",true,{"@type":66,"interactionType":67,"userInteractionCount":20},"InteractionCounter",{"@type":68},"ViewAction",{"@type":70,"mainEntity":71},"FAQPage",[72],{"name":73,"@type":74,"acceptedAnswer":75},"How does the tutorial help readers interpret supervised ML models?","Question",{"text":76,"@type":77},"Module 4 covers interpretation methods such as permutation variable importance, effect plots (partial dependence and individual conditional expectation profiles), and the concept of model fairness.","Answer","https://schema.org",{"og:url":52,"og:type":80,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":82,"canonical":52},"index,follow",{"doc_id":7,"site_id":25},{"code":4,"msg":5,"data":85},[86,90,94,98,103,106,111,116,121,124,128],{"id":21,"doc_module":4,"doc_module_name":47,"category_name":87,"show_sort_weight":88,"slug":89},"Story & Novel",90,"story-novel",{"id":20,"doc_module":4,"doc_module_name":47,"category_name":91,"show_sort_weight":92,"slug":93},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":47,"category_name":95,"show_sort_weight":96,"slug":97},"Exam",70,"exam",{"id":99,"doc_module":4,"doc_module_name":47,"category_name":100,"show_sort_weight":101,"slug":102},5,"Comic",60,"comic",{"id":11,"doc_module":4,"doc_module_name":47,"category_name":12,"show_sort_weight":104,"slug":105},50,"technology",{"id":107,"doc_module":4,"doc_module_name":47,"category_name":108,"show_sort_weight":109,"slug":110},7,"Healthcare",40,"healthcare",{"id":112,"doc_module":4,"doc_module_name":47,"category_name":113,"show_sort_weight":114,"slug":115},8,"Research & Report",30,"research-report",{"id":117,"doc_module":4,"doc_module_name":47,"category_name":118,"show_sort_weight":119,"slug":120},9,"Religion & Spirituality",20,"religion-spirituality",{"id":119,"doc_module":4,"doc_module_name":47,"category_name":122,"show_sort_weight":119,"slug":123},"World Cup","world-cup",{"id":125,"doc_module":4,"doc_module_name":47,"category_name":126,"show_sort_weight":125,"slug":127},10,"Lifestyle","lifestyle",{"id":129,"doc_module":4,"doc_module_name":47,"category_name":130,"show_sort_weight":99,"slug":131},19,"General","general"]