[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-118829-en":3,"doc-seo-118829-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":4,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},118829,962075006959,"Anda","https://ap-avatar.wpscdn.com/avatar/e0002397efbe92a78e?_k=1776741047341049297",8,"Research & Report","MACHINE LEARNING SYSTEMS FOR HUMAN EMOTIONAL STATES - DISSERTATION","Human emotions play a vital role in everyday communication, perception, and experience, yet detecting, modeling, and predicting emotional states is difficult because emotions are subjective, ambiguous, and volatile. Existing sensing modalities often lack robustness in realistic settings and can be intrusive, creating constraints for emotion-aware system design. The dissertation proposes multimodal, contextual input and machine learning frameworks for more explanatory, generalizable, privacy-preserving, multi-sensory emotion prediction. It introduces minimally intrusive mobile sensing apps, indirect context-emotion pattern recognition, deep architectures for representation learning, and a transformer model that provides explanations alongside predictions. It also presents emotional navigation for dynamic driving environments.","MACHINE LEARNING SYSTEMS FOR HUMAN  \nEMOTIONAL STATES  \nDISSERTATION  \nan der Fakultät für Mathematik, Informatik und Statistik der Ludwig-Maximilians-Universität München  \nvorgelegt von  \nDAVID BETHGE  \nM.Sc. Wirtschaftsingenieurwesen  \nMünchen, den 1 . August 2023  \nErstgutachter: Prof. Dr. Albrecht Schmidt Zweitgutachter: Prof. Dr. Christian Holz Drittgutachter: Prof. Dr. Bastian Pfleging  \nTag der mündlichen Prüfung: 26 .5.2023  \nABSTRACT  \nHuman emotions play a vital role in our everyday lives and influence our communication, perception and experience in the real world. However, detecting, modeling, and predicting human emotional states remains challenging. Emotions are subjective, ambiguous, volatile, and current sensing modalities lack robustness in realistic environments and are potentially intrusive. The central question of this thesis is: How can we design emotion-aware systems under these constraints that utilize recent advances in machine learning?  \nWe present novel input for human emotions based on multimodal and contextual data. We furthermore propose machine learning frameworks that provide more explanatory, generalizable, privacypreserving, and multi-sensory emotion state predictions.  \nWe introduce two ubiquitous mobile sensing applications for human emotional states [P1, P5] . The applications are designed to be minimally intrusive and do not require body contact by acquiring contextual data only to infer emotions. We show that the re-formalization of the classification problem to an indirect estimation context-emotion pattern recognition works better than existing (facial expressions) baseline approaches. Our findings have major implications for future emotional state recognition systems because ubiquitous devices can easily acquire contextual data and transform them into smart emotion-estimation sensors. In the second pillar of this thesis, we focus on machine learning architectures for human emotional states. We present three different deep learning architectures for learning emotion representations from multivariate time-series data [P4, P3, P2] . We show how the representations can be designed to be emotion predictive but also participant-invariant [P2] . We furthermore propose an architecture that can learn a shared emotional representation from multiple noisy datasets with different inherent sensing characteristics [P3, P4] . In summary, the proposed approaches are tailored to capture detailed semantics in noisy input data and also propose measures for making the prediction more interpretable, domain-invariant and scalable. Furthermore, we present a novel transformer-based deep learning architecture for emotion prediction that is able to derive explanations alongside its predictions [P6] . Thereby, a better understanding of the link between emotion sensor input and the model decision can be derived that ultimately helps designing appropriate user interfaces powered by emotion prediction methods. Ultimately, we show a machine learning application of contextual emotion prediction that enables an emotion-aware experience in a dynamic driving environment [P7] . We present the first navigation application that is able to route after emotions. We thereby leverage the concept of context-emotion linking to predict emotional-states on future road-segments and optimize after travel-time and predicted emotional states. We show in a blind-user study, that emotional navigation has a positive effect on valence after riding the predicted happy route.  \nAlthough our work is concentrated on human emotional states, we argue that this enables other human-states (e.g., fatigue, cognitive load) prediction systems to be designed to be more robust, scalable, privacy-aware. These systems also allow the user to understand and investigate the decision process and offer explanations. Furthermore, our work provides a foundation for emotion-aware systems in unconstrained, dynamic environments.  \nZUSAMMENFASSUNG  \nMenschliche Emot","cbCaiapoueI5b6hK","https://ap.wps.com/l/cbCaiapoueI5b6hK","pdf",50579928,1,153,"English","en",105,"# Abstract\n## Problem: emotion detection under realistic constraints\n## Proposed inputs and learning frameworks\n## Mobile sensing applications and indirect estimation\n## Deep learning architectures for emotion representations\n## Interpretability with transformer-based explanations\n## Contextual emotion prediction for emotional navigation\n## Implications and broader human-state modeling","[{\"question\":\"Why is human emotional-state prediction challenging in realistic environments?\",\"answer\":\"Emotions are subjective, ambiguous, and volatile, and current sensing modalities are often not robust in real-world conditions. Many also risk being intrusive.\"},{\"question\":\"What approach does the thesis use to infer emotions without intrusive sensing?\",\"answer\":\"It proposes minimally intrusive mobile sensing that relies on contextual data only, inferring emotions through context-emotion pattern recognition rather than direct facial-expression baselines.\"},{\"question\":\"How does the thesis improve usefulness beyond prediction accuracy?\",\"answer\":\"It develops frameworks that aim for explanatory, generalizable, privacy-preserving, and participant-invariant predictions. It also includes interpretability via a transformer-based architecture that generates explanations with its emotion predictions.\"}]","MACHINE LEARNING SYSTEMS FOR HUMAN EMOTIONAL STATES - DISSERTATION | PDF",1785720495,386,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"machine-learning-systems-for-human-emotional-states-dissertation","",{"@graph":36,"@context":85},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/machine-learning-systems-for-human-emotional-states-dissertation/118829/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-03",true,{"@type":65,"interactionType":66,"userInteractionCount":4},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"Why is human emotional-state prediction challenging in realistic environments?","Question",{"text":75,"@type":76},"Emotions are subjective, ambiguous, and volatile, and current sensing modalities are often not robust in real-world conditions. Many also risk being intrusive.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"What approach does the thesis use to infer emotions without intrusive sensing?",{"text":80,"@type":76},"It proposes minimally intrusive mobile sensing that relies on contextual data only, inferring emotions through context-emotion pattern recognition rather than direct facial-expression baselines.",{"name":82,"@type":73,"acceptedAnswer":83},"How does the thesis improve usefulness beyond prediction accuracy?",{"text":84,"@type":76},"It develops frameworks that aim for explanatory, generalizable, privacy-preserving, and participant-invariant predictions. It also includes interpretability via a transformer-based architecture that generates explanations with its emotion predictions.","https://schema.org",{"og:url":52,"og:type":87,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":89,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,120,123,128,131,135],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":46,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":46,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":121,"slug":122},30,"research-report",{"id":124,"doc_module":4,"doc_module_name":46,"category_name":125,"show_sort_weight":126,"slug":127},9,"Religion & Spirituality",20,"religion-spirituality",{"id":126,"doc_module":4,"doc_module_name":46,"category_name":129,"show_sort_weight":126,"slug":130},"World Cup","world-cup",{"id":132,"doc_module":4,"doc_module_name":46,"category_name":133,"show_sort_weight":132,"slug":134},10,"Lifestyle","lifestyle",{"id":136,"doc_module":4,"doc_module_name":46,"category_name":137,"show_sort_weight":106,"slug":138},19,"General","general"]