[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-125545-en":3,"doc-seo-125545-105":30,"detail-sidebar-cat-0-en-105":91},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":4,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},125545,1099513958607,"Jiven","https://ap-avatar.wpscdn.com/avatar/100002390cf8733938c?x-image-process=image/resize,m_fixed,w_180,h_180&k=1778829742770036399",8,"Research & Report","Machine Learning Framework for Causal Modeling for Process Fault Diagnosis and Mechanistic Explanation Generation - Doctor of Philosophy Thesis","Machine learning models often trade explainability for performance, but mechanistically grounded explanations require first-principles, at least mechanistic, rooting. This dissertation develops a causal-modeling machine learning framework spanning different levels of process knowledge for process fault diagnosis and mechanistic explanation generation. It presents data-centric causal model construction, then shows deep learning-based classification and regression limitations in aligning hidden representations with system mechanisms. It further integrates process knowledge to produce explainable models via automated variable transformations, extracting system mechanisms from provided model knowledge.","Machine Learning Framework for Causal Modeling for Process Fault Diagnosis and  \nMechanistic Explanation Generation  \nAbhishek Sivaram  \nSubmitted in partial fulfillment of the  \nrequirements for the degree of  \nDoctor of Philosophy  \nunder the Executive Committee  \nof the Graduate School of Arts and Sciences  \nCOLUMBIA UNIVERSITY  \n© 2022 Abhishek Sivaram  \nAll Rights Reserved  \nAbstract  \nMachine Learning Framework for Causal Modeling for Process Fault Diagnosis and  \nMechanistic Explanation Generation  \nAbhishek Sivaram  \nMachine learning models, typically deep learning models, often come at the cost of explainability. To generate explanations of such systems, models need to be rooted in first-principles, at least mechanistically. In this work we look at a gamete of machine learning models based on different levels of process knowledge for process fault diagnosis and generating mechanistic explanations of processes. In chapter 1, we introduce the thesis using a range of problems from causality, explainability, aiming towards the goal of generating mechanistic explanations of process systems. Chapter 2 looks at an approach for generating causal models purely through data-centric approach, with minimal process knowledge with respect to equipment connectivity and identifying causality in the domains. These causal models generated can be utilized for process fault diagnosis.  \nChapter 3 and chapter 4 show how deep learning models can be used for both classification for process fault diagnosis and regression. We see that depending on the hyperparameters, i.e., purely the breadth and depth of a neural network, the learned hidden representations vary from a simple set of features, to more complex sets of features. While these hidden representations may be exploited to aid in classification and regression problems, the true explanations of these representations do not correlate with mechanisms in the system of interest. There is thus a requirement to add more mechanistic information  \nabout the features generated to aid in explainability.  \nChapter 5 shows how incorporating process knowledge can aid in generating such mechanistic explanations based on automated variable transformations. In this chapter we show how process knowledge can be used to generate features, or model forms to generate explainable models. These models have the ability of extracting the true models of the system from the model knowledge provided.  \nTable of Contents  \nAcknowledgments .................................... ix  \nChapter 1: Introduction and Background ........................ 1  \nChapter 2: From data to causal models ......................... 5  \n2.1 Transfer Entropy as a Measure of Causality .................. 8  \n2.1.1 Generating digraph based on transfer entropy ............. 11  \n2.2 Tennessee Eastman Benchmark Process ..................... 14  \n2.3 Hierarchical framework for developing causal maps .............. 17  \n2.3.1 Tier 1: Plant-level DAG ......................... 19  \n2.3.2 Tier 2: Subsystem-level graph with possible cycles ........... 30  \n2.4 Major Results ................................... 33  \nChapter 3: Neural Networks for Classification ..................... 35  \n3.1 Mathematical Background ............................ 38  \n3.1.1 Problem Formulation ........................... 38  \n3.1.2 Classification with Neural Networks ................... 40  \n3.2 Peeking Under the Hood of a Deep Neural Network .............. 42  \n3.2.1 Feature Extraction: Node-specific Selective Activation of the Input Space ................................... 43  \n3.2.2 Wider vs Deeper Networks: Complexity of Features .......... 45  \n3.2.3 From Features to Feature Spaces .................... 49  \n3.2.4 The Final Layer: Separating Hyperplanes for Classification ...... 50  \n3.2.5 Degeneracy of parameters using softmax activation .......... 52  \n3.3 How does a Neural Network Learn the Mapping?: From Parts to Whole ... 56  \n3.4 Major Results ..........................","cbCaineFmmpWiDCF","https://ap.wps.com/l/cbCaineFmmpWiDCF","pdf",30950968,1,155,"English","en",105,"# Acknowledgments\n# Chapter 1: Introduction and Background\n# Chapter 2: From data to causal models\n## Transfer Entropy as a Measure of Causality\n## Tennessee Eastman Benchmark Process\n## Hierarchical framework for developing causal maps\n# Chapter 3: Neural Networks for Classification\n## Peeking Under the Hood of a Deep Neural Network\n# Chapter 4: Neural Networks for Regression\n## Peeking Under the Hood of a Neural Network\n# Chapter 5: Mechanistic Explanation Generation (MEG)\n## AI for Mechanistic Explanation Generation – XAI-MEG\n## Results and Discussion","[{\"question\":\"Why does the thesis focus on mechanistic explanations for machine learning models?\",\"answer\":\"Deep learning models often lack explainability, so the work emphasizes generating explanations rooted in first-principles and mechanistic understanding of process systems.\"},{\"question\":\"How are causal models generated with minimal process knowledge?\",\"answer\":\"Chapter 2 proposes a data-centric approach to generate causal models using measurements and causality identification, including a transfer-entropy-based method to build causal structure.\"},{\"question\":\"What role does process knowledge play in improving explainability?\",\"answer\":\"Later chapters show that hidden representations from standard deep models may not reflect real mechanisms, so process knowledge is incorporated to generate explainable mechanistic models through automated variable transformations.\"}]","Machine Learning Framework for Causal Modeling for Process Fault Diagnosis and Mechanistic Explanation Generation - Doctor of Philosophy Thesis | PDF",1785899789,391,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":86,"head_meta":88,"extra_data":90,"updated_unix":28},"machine-learning-framework-for-causal-modeling-for-process-fault-diagnosis-and-mechanistic-explanation-generation-doctor-of-philosophy-thesis","",{"@graph":36,"@context":85},[37,54,68],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/machine-learning-framework-for-causal-modeling-for-process-fault-diagnosis-and-mechanistic-explanation-generation-doctor-of-philosophy-thesis/125545/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":62,"encodingFormat":61,"isAccessibleForFree":63,"interactionStatistic":64},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-05",true,{"@type":65,"interactionType":66,"userInteractionCount":4},"InteractionCounter",{"@type":67},"ViewAction",{"@type":69,"mainEntity":70},"FAQPage",[71,77,81],{"name":72,"@type":73,"acceptedAnswer":74},"Why does the thesis focus on mechanistic explanations for machine learning models?","Question",{"text":75,"@type":76},"Deep learning models often lack explainability, so the work emphasizes generating explanations rooted in first-principles and mechanistic understanding of process systems.","Answer",{"name":78,"@type":73,"acceptedAnswer":79},"How are causal models generated with minimal process knowledge?",{"text":80,"@type":76},"Chapter 2 proposes a data-centric approach to generate causal models using measurements and causality identification, including a transfer-entropy-based method to build causal structure.",{"name":82,"@type":73,"acceptedAnswer":83},"What role does process knowledge play in improving explainability?",{"text":84,"@type":76},"Later chapters show that hidden representations from standard deep models may not reflect real mechanisms, so process knowledge is incorporated to generate explainable mechanistic models through automated variable transformations.","https://schema.org",{"og:url":52,"og:type":87,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":89,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":92},[93,97,101,105,110,115,120,123,128,131,135],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":94,"show_sort_weight":95,"slug":96},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":98,"show_sort_weight":99,"slug":100},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":102,"show_sort_weight":103,"slug":104},"Exam",70,"exam",{"id":106,"doc_module":4,"doc_module_name":46,"category_name":107,"show_sort_weight":108,"slug":109},5,"Comic",60,"comic",{"id":111,"doc_module":4,"doc_module_name":46,"category_name":112,"show_sort_weight":113,"slug":114},6,"Technology",50,"technology",{"id":116,"doc_module":4,"doc_module_name":46,"category_name":117,"show_sort_weight":118,"slug":119},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":121,"slug":122},30,"research-report",{"id":124,"doc_module":4,"doc_module_name":46,"category_name":125,"show_sort_weight":126,"slug":127},9,"Religion & Spirituality",20,"religion-spirituality",{"id":126,"doc_module":4,"doc_module_name":46,"category_name":129,"show_sort_weight":126,"slug":130},"World Cup","world-cup",{"id":132,"doc_module":4,"doc_module_name":46,"category_name":133,"show_sort_weight":132,"slug":134},10,"Lifestyle","lifestyle",{"id":136,"doc_module":4,"doc_module_name":46,"category_name":137,"show_sort_weight":106,"slug":138},19,"General","general"]