[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-117052-en":3,"doc-seo-117052-105":30,"detail-sidebar-cat-0-en-105":92},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},117052,3848291630094,"Emma Wilson","https://eur-avatar.wpscdn.com/davatar_085a072bc5b1113ac321206ff7593b45",8,"Research & Report","Machine Learning Facial Emotion Classifiers in Psychotherapy Research - A Proof-of-Concept Study","New advances in machine learning enable high-resolution tracking of facial emotional expressions, including micro-expressions, offering a faster alternative to manual coding approaches such as the Facial Action Coding System. The study tested whether machine learning can reliably identify in-session emotional expression in a naturalistic psychotherapy setting and examined how these measures relate to psychotherapy outcomes. A machine learning emotion classifier was applied to video material from 389 sessions involving 23 patients with borderline personality pathology, with validation using human ratings on the Clients Emotional Arousal Scale and analyses of treatment outcomes.","Psychopathology  \nResearch Article  \nPsychopathology  \nDOI: 10.1159/000534811  \nReceived: September 6, 2022  \nAccepted: October 16, 2023  \nPublished online: November 27, 2023  \nMachine Learning Facial Emotion Classifiers in Psychotherapy Research:  \nA Proof-of-Concept Study  \nMartin Steppana, b Ronan Zimmermann a, b Lukas Fürer b Matthew Southward c Julian Koenig d, e Michael Kaessd,f Johann Roland Kleinbubg Volker Roth h Klaus Schmeck b  \naFaculty of Psychology, University of Basel, Basel, Switzerland; bPsychiatric University Hospital, Basel, Switzerland; cDepartment of Psychology, University of Kentucky, Lexington, KY, USA; dUniversity Hospital of Child and Adolescent Psychiatry and Psychotherapy, University of Bern, Bern, Switzerland; eSection for Experimental Child and Adolescent Psychiatry, Department of Child and Adolescent Psychiatry, Centre for Psychosocial Medicine, University of Heidelberg, Heidelberg, Germany; fSection for Translational Psychobiology in Child and Adolescent Psychiatry, Department of Child and Adolescent Psychiatry, Centre for Psychosocial Medicine, University of Heidelberg, Heidelberg, Germany; gDepartment of Philosophy, Sociology, Education and Applied Psychology, University of Padova, Padova, Italy; hDepartment of Mathematics and Informatics, University of Basel, Basel, Switzerland  \nKeywords  \nAdolescents · Borderline personality disorder · Emotions · Facial expressions classifiers · Psychotherapy  \nAbstract  \nBackground: New advances in the field of machine learning make it possible to track facial emotional expression with high resolution, including micro-expressions. These advances have promising applications for psychotherapy research, since manual coding (e.g., the Facial Action Coding System), is timeconsuming. Purpose: We tested whether this technology can reliably identify in-session emotional expression in a naturalistic treatment setting, and how these measures relate to the outcome of psychotherapy. Method: We applied a machine learning emotion classifier to video material from 389 psychotherapy sessions of 23 patients with borderline personality pathology. We validated the findings with human ratings  \naccording to the Clients Emotional Arousal Scale (CEAS) and explored associations with treatment outcomes. Results: Overall, machine learning ratings showed significant agreement with human ratings. Machine learning emotion classifiers, particularly the display of positive emotions (smiling and happiness), showed medium effect size on median-split treatment outcome (d = 0.3) as well as continuous improvement (r = 0.49, p \u003C 0.05). Patients who dropped out form psychotherapy, showed significantly more neutral expressions, and generally less social smiling, particularly at the beginning of psychotherapeutic sessions. Conclusions: Machine learning classifiers are a highly promising resource for research in psychotherapy. The results highlight differential associations of displayed positive and negative feelings with treatment outcomes. Machine learning emotion recognition may be used for the early identification of drop-out risks and clinically relevant interactions in psychotherapy. © 2023 The Author(s) .  \nPublished by S. Karger AG, Basel  \n[karger@karger.com](karger@karger.com)[ ](karger@karger.com)[www.karger.com/psp](www.karger.com/psp)  \n© 2023 The Author(s) .  \nPublished by S. Karger AG, Basel  \nCorrespondence to:  \nMartin Steppan, [mhsteppan](mhsteppan@ gmail.com)[@](mhsteppan@ gmail.com)[ gmail.com](mhsteppan@ gmail.com)  \nThis article is licensed under the Creative Commons AttributionNonCommercial4.0International License(CC BY-NC)([http://www](http://www). [karger.com/Services/OpenAccessLicense](karger.com/Services/OpenAccessLicense)). Usage and distribution for commercial purposes requires written permission.  \nDownloaded from [http://karger.com/psp/article-pdf/doi/10.1159/000534811/4051895/000534811.pdf by Universit](http://karger.com/psp/article-pdf/doi/10.1159/000534811/4051895/00053481","cbCaic5ObK3DvxZV","https://ap.wps.com/l/cbCaic5ObK3DvxZV","pdf",661287,1,10,"English","en",105,"# Abstract\n## Background\n## Purpose\n## Method\n## Results\n## Conclusions\n# Introduction\n## Limits of manual facial coding in psychotherapy\n## Facial Action Coding System and its role\n## Indirect markers of emotional arousal\n## Facial emotion recognition with real-time algorithms","[{\"question\":\"What problem does this proof-of-concept study address in psychotherapy research?\",\"answer\":\"Manual coding of facial expressions is time-consuming and makes it difficult to assess emotions across many video frames and sessions. Machine learning classifiers aim to automate reliable in-session emotion identification.\"},{\"question\":\"How was the machine learning emotion classifier evaluated?\",\"answer\":\"The classifier was applied to video data from 389 psychotherapy sessions of 23 patients with borderline personality pathology, and results were validated with human ratings using the Clients Emotional Arousal Scale.\"},{\"question\":\"What relationships did the study find between facial emotions and psychotherapy outcomes?\",\"answer\":\"Machine learning ratings agreed significantly with human ratings, with medium effects for positive emotions on treatment outcomes and evidence of continuous improvement. Patients who dropped out showed more neutral expressions and less social smiling, especially early in sessions.\"}]","Machine Learning Facial Emotion Classifiers in Psychotherapy Research - A Proof-of-Concept Study | PDF",1785673443,25,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":87,"head_meta":89,"extra_data":91,"updated_unix":28},"machine-learning-facial-emotion-classifiers-in-psychotherapy-research-a-proof-of-concept-study","",{"@graph":36,"@context":86},[37,54,69],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/machine-learning-facial-emotion-classifiers-in-psychotherapy-research-a-proof-of-concept-study/117052/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":63,"encodingFormat":61,"isAccessibleForFree":64,"interactionStatistic":65},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-05","2026-08-02",true,{"@type":66,"interactionType":67,"userInteractionCount":20},"InteractionCounter",{"@type":68},"ViewAction",{"@type":70,"mainEntity":71},"FAQPage",[72,78,82],{"name":73,"@type":74,"acceptedAnswer":75},"What problem does this proof-of-concept study address in psychotherapy research?","Question",{"text":76,"@type":77},"Manual coding of facial expressions is time-consuming and makes it difficult to assess emotions across many video frames and sessions. Machine learning classifiers aim to automate reliable in-session emotion identification.","Answer",{"name":79,"@type":74,"acceptedAnswer":80},"How was the machine learning emotion classifier evaluated?",{"text":81,"@type":77},"The classifier was applied to video data from 389 psychotherapy sessions of 23 patients with borderline personality pathology, and results were validated with human ratings using the Clients Emotional Arousal Scale.",{"name":83,"@type":74,"acceptedAnswer":84},"What relationships did the study find between facial emotions and psychotherapy outcomes?",{"text":85,"@type":77},"Machine learning ratings agreed significantly with human ratings, with medium effects for positive emotions on treatment outcomes and evidence of continuous improvement. Patients who dropped out showed more neutral expressions and less social smiling, especially early in sessions.","https://schema.org",{"og:url":52,"og:type":88,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":90,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":93},[94,98,102,106,111,116,121,124,129,132,135],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":95,"show_sort_weight":96,"slug":97},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":99,"show_sort_weight":100,"slug":101},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":103,"show_sort_weight":104,"slug":105},"Exam",70,"exam",{"id":107,"doc_module":4,"doc_module_name":46,"category_name":108,"show_sort_weight":109,"slug":110},5,"Comic",60,"comic",{"id":112,"doc_module":4,"doc_module_name":46,"category_name":113,"show_sort_weight":114,"slug":115},6,"Technology",50,"technology",{"id":117,"doc_module":4,"doc_module_name":46,"category_name":118,"show_sort_weight":119,"slug":120},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":122,"slug":123},30,"research-report",{"id":125,"doc_module":4,"doc_module_name":46,"category_name":126,"show_sort_weight":127,"slug":128},9,"Religion & Spirituality",20,"religion-spirituality",{"id":127,"doc_module":4,"doc_module_name":46,"category_name":130,"show_sort_weight":127,"slug":131},"World Cup","world-cup",{"id":21,"doc_module":4,"doc_module_name":46,"category_name":133,"show_sort_weight":21,"slug":134},"Lifestyle","lifestyle",{"id":136,"doc_module":4,"doc_module_name":46,"category_name":137,"show_sort_weight":107,"slug":138},19,"General","general"]