[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"doc-detail-127800-en":3,"doc-seo-127800-105":30,"detail-sidebar-cat-0-en-105":92},{"code":4,"msg":5,"data":6},0,"success",{"doc_id":7,"user_id":8,"nickname":9,"user_avatar":10,"doc_module":4,"category_id":11,"category_name":12,"doc_title":13,"doc_description":14,"doc_content":15,"file_id":16,"file_url":17,"file_type":18,"file_size":19,"view_count":20,"is_deleted":4,"is_public":20,"is_downloadable":20,"audit_status":20,"page_count":21,"language":22,"language_code":23,"site_id":24,"html_lang":23,"table_of_contents":25,"faqs":26,"seo_title":27,"seo_description":14,"update_tm":28,"read_time":29},127800,1099523885074,"Ivy","https://ap-avatar.wpscdn.com/davatar_9964176cb1d06d4a9deccf72a44ae3dc",8,"Research & Report","Informed Machine Learning - Integrating Prior Knowledge into Data-Driven Learning Systems - Dissertation","Machine Learning is a core method in Artificial Intelligence for prediction and recognition by learning from large data sets, yet it can fail when training data is insufficient. Informed Machine Learning extends this paradigm by integrating prior knowledge such as physical laws, logic rules, or knowledge graphs into data-driven pipelines. This PhD thesis unifies Informed ML via systematic frameworks, proposing a hybrid information-source concept and a taxonomy, developing universal knowledge-integration methods, and quantifying benefits with tailored metrics.","Informed Machine Learning: Integrating Prior Knowledge into Data-Driven Learning Systems  \nDissertation  \nzur  \nErlangung des Doktorgrades (Dr. rer. nat.)  \nder  \nMathematisch-Naturwissenschaftlichen Fakultät  \nder  \nRheinischen Friedrich-Wilhelms-Universität Bonn  \nvon  \nLaura von Rüden  \naus  \nMarsberg  \nBonn, 12.06.2023  \nAngefertigt mit Genehmigung der Mathematisch-Naturwissenschaftlichen Fakultät der Rheinischen Friedrich-Wilhelms-Universität Bonn  \n1. Gutachter: Prof. Dr. Christian Bauckhage  \n2. Gutachter: Prof. Dr. Jochen Garcke  \nTag der Promotion: 12.10.2023  \nErscheinungsjahr: 2023  \nAbstract  \nMachine Learning is an important method in Artificial Intelligence (AI) . It has shown great success in building models for tasks like prediction or image recognition by learning from patterns in large amounts of data. However, it can have its limits when dealing with insufficient training data. A potential solution is the additional integration of prior knowledge, such as physical laws, logic rules, or knowledge graphs. This leads to the notion of Informed Machine Learning (Informed ML) . However, the field is so application-driven that general analyses are rare.  \nThe goal of this PhD thesis is the unification of Informed ML through general, systematic frameworks. In particular, the following research questions are answered: 1) What is the fundamental concept of Informed ML, and how can existing approaches be structurally classified, 2) is it possible to integrate prior knowledge in a universal way, and 3) how can the benefits of Informed ML be quantified, and what are the requirements for the injected knowledge?  \nFirst, a concept for Informed ML is proposed, which defines it as learning from a hybrid information source that consists of data and prior knowledge. A taxonomy that serves as a structured classification framework for existing or potential approaches is presented. It considers the knowledge source, its representation type, and the integration stage into the ML pipeline. The concept of Informed ML is further extended to the combination of ML and simulation towards Hybrid AI.  \nThen, two new methods for a universal knowledge integration are developed. The first method, Informed Pre-Training, allows to initialize neural networks with prototypes from prior knowledge. Experiments show that it improves generalization, especially for small data, and increases robustness. An analysis of the individual neural network layers shows that the improvements come from transferring the deeper layers, which confirms the transfer of semantic knowledge (Informed Transfer Learning) . The second method, Geo-Informed Validation, checks models for their conformity with knowledge from street maps. It is developed in the application context of autonomous driving, where it can help to prevent potential predictions errors, e.g., in semantic segmentations of traffic scenes.  \nFinally, a catalogue of relevant metrics for quantifying the benefits of knowledge injection is defined. Among others, it includes in-distribution accuracy, out-of-distribution robustness, as well as knowledge conformity, and a new metric that combines performance improvement and data reduction is introduced. Furthermore, a theoretical framework that represents prior knowledge in a function space and relates it to data representations is presented. It reveals that the distances between knowledge and data influence potential model improvements, which is confirmed in a systematic experimental study.  \nAll in all, these frameworks support the unification of Informed ML, which makes it more accessible and usable – and helps to achieve trustworthy AI.  \nContents  \n1 Introduction 1  \n1. 1 Motivation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1  \n1.2 Technical Background ................................. 3  \n1.2.1 Artificial Intelligence .............................. 3  \n1.2.2 Machine Learning and Neural Networks .................... 4  \n1.3 Thesis Contribut","cbCaig2TYv29hiNE","https://ap.wps.com/l/cbCaig2TYv29hiNE","pdf",18602009,1,119,"English","en",105,"# Introduction\n## Motivation\n## Technical Background\n## Thesis Contributions\n# P1) Informed ML: Integrating Prior Knowledge into Data-Driven Learning Systems – Concept, Taxonomy, and Survey\n## Research Question\n## Results Summary\n## Author’s Contribution\n# P2) Combining ML and Simulation to Hybrid AI\n## Research Question\n## Results Summary\n## Author’s Contribution\n# P3) Informed Pre-Training of Neural Networks Using Knowledge Prototypes\n## Research Question\n## Results Summary\n## Author’s Contribution\n# P4) Geo-Informed Validation of ML Models for Autonomous Driving\n## Research Question\n## Results Summary\n## Author’s Contribution\n# P5) Quantifying the Benefits: How Knowledge Injection Helps in Informed ML – Metrics, Theory and Systematic Analysis\n## Research Question","[{\"question\":\"What problem does Informed Machine Learning address compared with standard machine learning?\",\"answer\":\"Standard machine learning can reach limits when training data is insufficient. Informed Machine Learning addresses this by integrating prior knowledge into the learning process.\"},{\"question\":\"How does the thesis unify and classify approaches in Informed Machine Learning?\",\"answer\":\"It proposes a concept defining Informed ML as learning from a hybrid information source of data and prior knowledge. It also presents a taxonomy covering the knowledge source, its representation type, and the integration stage in the ML pipeline.\"},{\"question\":\"Which methods are introduced for universal prior-knowledge integration and what benefits are measured?\",\"answer\":\"The thesis develops Informed Pre-Training and Geo-Informed Validation. It defines a catalog of metrics, including in-distribution accuracy, out-of-distribution robustness, knowledge conformity, and a metric combining performance improvement with data reduction.\"}]","Informed Machine Learning - Integrating Prior Knowledge into Data-Driven Learning Systems - Dissertation | PDF",1785941865,300,{"code":4,"msg":31,"data":32},"ok",{"site_id":24,"language":23,"slug":33,"title":13,"keywords":34,"description":14,"schema_data":35,"social_meta":87,"head_meta":89,"extra_data":91,"updated_unix":28},"informed-machine-learning-integrating-prior-knowledge-into-data-driven-learning-systems-dissertation","",{"@graph":36,"@context":86},[37,54,69],{"@type":38,"itemListElement":39},"BreadcrumbList",[40,44,48,51],{"item":41,"name":42,"@type":43,"position":20},"https://docshare.wps.com","Home","ListItem",{"item":45,"name":46,"@type":43,"position":47},"https://docshare.wps.com/document/","Document",2,{"item":49,"name":12,"@type":43,"position":50},"https://docshare.wps.com/document/research-report/",3,{"item":52,"name":13,"@type":43,"position":53},"https://docshare.wps.com/document/informed-machine-learning-integrating-prior-knowledge-into-data-driven-learning-systems-dissertation/127800/",4,{"url":52,"name":13,"@type":55,"author":56,"headline":13,"publisher":58,"fileFormat":61,"inLanguage":23,"description":14,"dateModified":62,"datePublished":63,"encodingFormat":61,"isAccessibleForFree":64,"interactionStatistic":65},"DigitalDocument",{"name":9,"@type":57},"Person",{"url":41,"name":59,"@type":60},"DocShare","Organization","application/pdf","2026-08-22","2026-08-05",true,{"@type":66,"interactionType":67,"userInteractionCount":20},"InteractionCounter",{"@type":68},"ViewAction",{"@type":70,"mainEntity":71},"FAQPage",[72,78,82],{"name":73,"@type":74,"acceptedAnswer":75},"What problem does Informed Machine Learning address compared with standard machine learning?","Question",{"text":76,"@type":77},"Standard machine learning can reach limits when training data is insufficient. Informed Machine Learning addresses this by integrating prior knowledge into the learning process.","Answer",{"name":79,"@type":74,"acceptedAnswer":80},"How does the thesis unify and classify approaches in Informed Machine Learning?",{"text":81,"@type":77},"It proposes a concept defining Informed ML as learning from a hybrid information source of data and prior knowledge. It also presents a taxonomy covering the knowledge source, its representation type, and the integration stage in the ML pipeline.",{"name":83,"@type":74,"acceptedAnswer":84},"Which methods are introduced for universal prior-knowledge integration and what benefits are measured?",{"text":85,"@type":77},"The thesis develops Informed Pre-Training and Geo-Informed Validation. It defines a catalog of metrics, including in-distribution accuracy, out-of-distribution robustness, knowledge conformity, and a metric combining performance improvement with data reduction.","https://schema.org",{"og:url":52,"og:type":88,"og:title":13,"og:site_name":59,"og:description":14},"article",{"robots":90,"canonical":52},"index,follow",{"doc_id":7,"site_id":24},{"code":4,"msg":5,"data":93},[94,98,102,106,111,116,121,124,129,132,136],{"id":20,"doc_module":4,"doc_module_name":46,"category_name":95,"show_sort_weight":96,"slug":97},"Story & Novel",90,"story-novel",{"id":47,"doc_module":4,"doc_module_name":46,"category_name":99,"show_sort_weight":100,"slug":101},"Literature",80,"literature",{"id":53,"doc_module":4,"doc_module_name":46,"category_name":103,"show_sort_weight":104,"slug":105},"Exam",70,"exam",{"id":107,"doc_module":4,"doc_module_name":46,"category_name":108,"show_sort_weight":109,"slug":110},5,"Comic",60,"comic",{"id":112,"doc_module":4,"doc_module_name":46,"category_name":113,"show_sort_weight":114,"slug":115},6,"Technology",50,"technology",{"id":117,"doc_module":4,"doc_module_name":46,"category_name":118,"show_sort_weight":119,"slug":120},7,"Healthcare",40,"healthcare",{"id":11,"doc_module":4,"doc_module_name":46,"category_name":12,"show_sort_weight":122,"slug":123},30,"research-report",{"id":125,"doc_module":4,"doc_module_name":46,"category_name":126,"show_sort_weight":127,"slug":128},9,"Religion & Spirituality",20,"religion-spirituality",{"id":127,"doc_module":4,"doc_module_name":46,"category_name":130,"show_sort_weight":127,"slug":131},"World Cup","world-cup",{"id":133,"doc_module":4,"doc_module_name":46,"category_name":134,"show_sort_weight":133,"slug":135},10,"Lifestyle","lifestyle",{"id":137,"doc_module":4,"doc_module_name":46,"category_name":138,"show_sort_weight":107,"slug":139},19,"General","general"]